Brandon Hancock (bhancock_ai) b8d07fee83 Brandon/eng 290 make tool inputs actual objects and not strings (#1868) ...

* Improving tool calling to pass dictionaries instead of strings

* Fix issues with parsing none/null

* remove prints and unnecessary comments

* Fix crew_test issues with function calling

* improve prompting

* add back in support for add_image

* add tests for tool validation

* revert back to figure out why tests are timing out

* Update cassette

* trying to find what is timing out

* add back in guardrails

* add back in manager delegation tests

* Trying to fix tests

* Force test to pass

* Trying to fix tests

* add in more role tests

* add back old tool validation

* updating tests

* vcr

* Fix tests

* improve function llm logic

* vcr 2

* drop llm

* Failing test

* add more tests back in

* Revert tool validation

2025-01-10 17:16:46 -05:00

..

test_after_crew_modification.yaml

adding before and after crew

2024-11-18 00:21:36 -03:00

test_after_kickoff_modification.yaml

Cassettes

2024-11-20 10:26:00 -03:00

test_agent_custom_max_iterations.yaml

Fixed core invoke loop logic and relevant tests (#1865)

2025-01-09 12:13:02 -05:00

test_agent_error_on_parsing_tool.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_execute_task_basic.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_execute_task_with_context.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_execute_task_with_custom_llm.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_execute_task_with_ollama.yaml

Trying out timeouts (#1840)

2025-01-02 16:06:48 -05:00

test_agent_execute_task_with_tool.yaml

Brandon/eng 266 conversation crew v1 (#1843)

2025-01-06 16:12:43 -05:00

test_agent_execute_task.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_execution_with_specific_tools.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_execution_with_tools.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_execution.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_function_calling_llm.yaml

Fixed core invoke loop logic and relevant tests (#1865)

2025-01-09 12:13:02 -05:00

test_agent_human_input.yaml

Brandon/cre 509 hitl multiple rounds of followup (#1702)

2024-12-05 10:14:04 -05:00

test_agent_moved_on_after_max_iterations.yaml

Fixed core invoke loop logic and relevant tests (#1865)

2025-01-09 12:13:02 -05:00

test_agent_powered_by_new_o_model_family_that_allows_skipping_tool.yaml

Correcting a small grammatical issue that was bugging me: from _satisfy the expect criteria_ to _satisfies the expected criteria_ (#1783)

2024-12-20 10:17:34 -05:00

test_agent_powered_by_new_o_model_family_that_uses_tool.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_remembers_output_format_after_using_tools_too_many_times.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_repeated_tool_usage_check_even_with_disabled_cache.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_repeated_tool_usage.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_respect_the_max_rpm_set_over_crew_rpm.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_respect_the_max_rpm_set.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_step_callback.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_tool_role_matching[ "Futel Official Infopoint" -True].yaml

Brandon/eng 290 make tool inputs actual objects and not strings (#1868)

2025-01-10 17:16:46 -05:00

test_agent_tool_role_matching[ FUTEL\nOFFICIAL INFOPOINT -True].yaml

Brandon/eng 290 make tool inputs actual objects and not strings (#1868)

2025-01-10 17:16:46 -05:00

test_agent_tool_role_matching["Futel Official Infopoint"-True].yaml

Brandon/eng 290 make tool inputs actual objects and not strings (#1868)

2025-01-10 17:16:46 -05:00

test_agent_tool_role_matching[Futel Official Infopoint-True].yaml

Brandon/eng 290 make tool inputs actual objects and not strings (#1868)

2025-01-10 17:16:46 -05:00

test_agent_tool_role_matching[Futel Official Infopoint\n-True].yaml

Brandon/eng 290 make tool inputs actual objects and not strings (#1868)

2025-01-10 17:16:46 -05:00

test_agent_usage_metrics_are_captured_for_hierarchical_process.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_use_specific_tasks_output_as_context.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agent_with_knowledge_sources.yaml

apply agent ops changes and resolve merge conflicts (#1748)

2024-12-12 15:04:32 -05:00

test_agent_with_ollama_llama3.yaml

Trying out timeouts (#1840)

2025-01-02 16:06:48 -05:00

test_agent_without_max_rpm_respects_crew_rpm.yaml

Fixed core invoke loop logic and relevant tests (#1865)

2025-01-09 12:13:02 -05:00

test_agent_without_max_rpm_respet_crew_rpm.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_agents_do_not_get_delegation_tools_with_there_is_only_one_agent.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_api_calls_throttling.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_before_crew_modification.yaml

adding before and after crew

2024-11-18 00:21:36 -03:00

test_before_crew_with_none_input.yaml

adding before and after crew

2024-11-18 00:21:36 -03:00

test_before_kickoff_modification.yaml

Cassettes

2024-11-20 10:26:00 -03:00

test_before_kickoff_with_none_input.yaml

Cassettes

2024-11-20 10:26:00 -03:00

test_cache_hitting_between_agents.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_cache_hitting.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_conditional_task_last_task_when_conditional_is_false.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_conditional_task_last_task_when_conditional_is_true.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_crew_creation.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_crew_does_not_interpolate_without_inputs.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_crew_function_calling_llm.yaml

Brandon/eng 290 make tool inputs actual objects and not strings (#1868)

2025-01-10 17:16:46 -05:00

test_crew_kickoff_usage_metrics.yaml

restrict python version compatibility (#1731)

2024-12-09 14:00:18 -05:00

test_crew_log_file_output.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_crew_output_file_end_to_end.yaml

Fix interpolation for output_file in Task (#1803) (#1814)

2024-12-29 01:57:59 -03:00

test_crew_verbose_output.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_crew_with_delegating_agents_should_not_override_agent_tools.yaml

Adding Multimodal Abilities to Crew (#1805)

2024-12-27 17:03:35 -03:00

test_crew_with_delegating_agents_should_not_override_task_tools.yaml

Adding Multimodal Abilities to Crew (#1805)

2024-12-27 17:03:35 -03:00

test_crew_with_delegating_agents.yaml

Adding Multimodal Abilities to Crew (#1805)

2024-12-27 17:03:35 -03:00

test_crew_with_failing_task_guardrails.yaml

improving guardrails

2025-01-04 16:30:20 -03:00

test_custom_converter_cls.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_delegation_is_not_enabled_if_there_are_only_one_agent.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_disabled_memory_using_contextual_memory.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_disabling_cache_for_agent.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_handle_context_length_exceeds_limit_cli_no.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_handle_context_length_exceeds_limit.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_hierarchical_crew_creation_tasks_with_agents.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_hierarchical_crew_creation_tasks_with_async_execution.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_hierarchical_crew_creation_tasks_with_sync_last.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_hierarchical_process.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_hierarchical_verbose_false_manager_agent.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_hierarchical_verbose_manager_agent.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_increment_delegations_for_hierarchical_process.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_increment_delegations_for_sequential_process.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_increment_tool_errors.yaml

apply agent ops changes and resolve merge conflicts (#1748)

2024-12-12 15:04:32 -05:00

test_json_property_without_output_json.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_kickoff_for_each_error_handling.yaml

Knowledge (#1567)

2024-11-20 15:40:08 -08:00

test_kickoff_for_each_multiple_inputs.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_kickoff_for_each_single_input.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_llm_call_with_all_attributes.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_llm_call_with_ollama_llama3.yaml

Trying out timeouts (#1840)

2025-01-02 16:06:48 -05:00

test_llm_call.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_llm_callback_replacement.yaml

restrict python version compatibility (#1731)

2024-12-09 14:00:18 -05:00

test_logging_tool_usage.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_manager_agent_delegating_to_all_agents.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_manager_agent_delegating_to_assigned_task_agent.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_multimodal_agent_live_image_analysis.yaml

Adding Multimodal Abilities to Crew (#1805)

2024-12-27 17:03:35 -03:00

test_multiple_before_after_crew.yaml

adding before and after crew

2024-11-18 00:21:36 -03:00

test_multiple_before_after_kickoff.yaml

Cassettes

2024-11-20 10:26:00 -03:00

test_output_json_dict_hierarchical.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_output_json_dict_sequential.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_output_json_hierarchical.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_output_json_sequential.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_output_json_to_another_task.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_output_pydantic_hierarchical.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_output_pydantic_sequential.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_output_pydantic_to_another_task.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_replay_interpolates_inputs_properly.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_replay_setup_context.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_replay_with_context.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_save_task_json_output.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_save_task_output.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_save_task_pydantic_output.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_sequential_async_task_execution_completion.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_single_task_with_async_execution.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_task_execution_times.yaml

[ENG-227] Record task execution timestamps (#1844)

2025-01-03 13:12:13 -05:00

test_task_tools_override_agent_tools.yaml

Brandon/eng 266 conversation crew v1 (#1843)

2025-01-06 16:12:43 -05:00

test_task_with_no_arguments.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_tool_result_as_answer_is_the_final_answer_for_the_agent.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_tool_usage_information_is_appended_to_agent.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_tools_with_custom_caching.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00

test_using_contextual_memory.yaml

Bringing support to o1 family back + any models that don't support stop words

2024-09-24 22:18:20 -03:00