andre/crewAI
1
0
Fork 0
mirror of https://github.com/crewAIInc/crewAI.git synced 2026-01-09 16:18:30 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Fix tests

Browse Source
This commit is contained in:
Brandon Hancock
2025-01-09 16:25:20 -05:00
parent 389d5a9982
commit fb763885eb
6 changed files with 171 additions and 134 deletions
Download Patch File Download Diff File Expand all files Collapse all files

68
tests/cassettes/test_agent_tool_role_matching[ "Futel Official Infopoint" -True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}], tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}' "model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers: headers:
accept: accept:
- application/json - application/json
@@ -20,12 +20,12 @@ interactions:
connection: connection:
- keep-alive - keep-alive
content-length: content-length:
- '939' - '944'
content-type: content-type:
- application/json - application/json
cookie: cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ; - __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
_cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000 _cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000
host: host:
- api.openai.com - api.openai.com
user-agent: user-agent:
@@ -51,29 +51,41 @@ interactions:
method: POST method: POST
uri: https://api.openai.com/v1/chat/completions uri: https://api.openai.com/v1/chat/completions
response: response:
content: "{\n \"id\": \"chatcmpl-AnuAJX0JApdkr5cr5HRQLNSoWs6Dj\",\n \"object\": content: "{\n \"id\": \"chatcmpl-AnuIpSDtrmEL7zuRDN3MJq6xUMrMx\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457335,\n \"model\": \"gpt-4o-2024-08-06\",\n \"chat.completion\",\n \"created\": 1736457863,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\": \ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer \\nFinal \"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: When your coworker asks about the current status or details involving Answer: Futel Football Club (FFC) is a professional football club based in Futel,
the Futel Football Club, it's crucial to provide a comprehensive answer. It known for its committed fanbase and rich history in the local football scene.
is essential to them about the particular aspect of the club they are inquiring Established in [Year of Establishment], the team has made significant strides
about, such as recent matches, player information, upcoming events, or club in recent years, participating in various leagues and competitions. The club's
history, and then deliver detailed information relevant to that query. Always home matches are held at [Stadium Name], which boasts a capacity of [Capacity
strive to be as precise and informative as possible, while maintaining an engaging Number] and provides a vibrant atmosphere for supporters. \\n\\nFFC's colors
and helpful demeanor to support their understanding and knowledge of the Futel are [Team Colors], and the club's mascot, [Mascot Name], embodies the spirit
Football Club.\",\n \"refusal\": null\n },\n \"logprobs\": of the team. The coaching staff, led by [Head Coach Name], focuses on developing
null,\n \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\": both individual skill and team cohesion to enhance performance on the pitch.\\n\\nFutel
177,\n \"completion_tokens\": 111,\n \"total_tokens\": 288,\n \"prompt_tokens_details\": FC also places a strong emphasis on youth development, with a dedicated academy
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": that nurtures young talent and prepares them for professional football. Community
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\": engagement is a priority, as the club regularly participates in charitable events
and promotes inclusivity in sports.\\n\\nIn terms of recent achievements, the
team has achieved [List of Major Achievements], and currently aims to qualify
for [Upcoming Tournament/League]. The club's fan engagement efforts, including
social media promotions and matchday events, help maintain a robust follower
connection both locally and internationally. \\n\\nFor further information or
inquiries about the team, fans can visit the official website at [Website Link],
where they can find schedules, news updates, and ticket purchasing options.\",\n
\ \"refusal\": null\n },\n \"logprobs\": null,\n \"finish_reason\":
\"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\": 177,\n \"completion_tokens\":
292,\n \"total_tokens\": 469,\n \"prompt_tokens_details\": {\n \"cached_tokens\":
0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": {\n
\ \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\": 0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n" \"fp_f2cd28694a\"\n}\n"
headers: headers:
CF-Cache-Status: CF-Cache-Status:
- DYNAMIC - DYNAMIC
CF-RAY: CF-RAY:
- 8ff7718889367bcc-ATL - 8ff77e6f7edbbfb6-ATL
Connection: Connection:
- keep-alive - keep-alive
Content-Encoding: Content-Encoding:
@@ -81,7 +93,7 @@ interactions:
Content-Type: Content-Type:
- application/json - application/json
Date: Date:
- Thu, 09 Jan 2025 21:15:38 GMT - Thu, 09 Jan 2025 21:24:28 GMT
Server: Server:
- cloudflare - cloudflare
Transfer-Encoding: Transfer-Encoding:
@@ -95,25 +107,25 @@ interactions:
openai-organization: openai-organization:
- crewai-iuxna1 - crewai-iuxna1
openai-processing-ms: openai-processing-ms:
- '3003' - '5185'
openai-version: openai-version:
- '2020-10-01' - '2020-10-01'
strict-transport-security: strict-transport-security:
- max-age=31536000; includeSubDomains; preload - max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests: x-ratelimit-limit-requests:
- '10000' - '30000'
x-ratelimit-limit-tokens: x-ratelimit-limit-tokens:
- '30000000' - '150000000'
x-ratelimit-remaining-requests: x-ratelimit-remaining-requests:
- '9999' - '29999'
x-ratelimit-remaining-tokens: x-ratelimit-remaining-tokens:
- '29999786' - '149999786'
x-ratelimit-reset-requests: x-ratelimit-reset-requests:
- 6ms - 2ms
x-ratelimit-reset-tokens: x-ratelimit-reset-tokens:
- 0s - 0s
x-request-id: x-request-id:
- req_3503475199cb974c296141f7d37bbf46 - req_a5d2111d19d2239dc81e3395abb7955c
http_version: HTTP/1.1 http_version: HTTP/1.1
status_code: 200 status_code: 200
version: 1 version: 1

54
tests/cassettes/test_agent_tool_role_matching[ FUTEL\nOFFICIAL INFOPOINT -True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}], tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}' "model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers: headers:
accept: accept:
- application/json - application/json
@@ -20,12 +20,12 @@ interactions:
connection: connection:
- keep-alive - keep-alive
content-length: content-length:
- '939' - '944'
content-type: content-type:
- application/json - application/json
cookie: cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ; - __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
_cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000 _cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000
host: host:
- api.openai.com - api.openai.com
user-agent: user-agent:
@@ -51,25 +51,29 @@ interactions:
method: POST method: POST
uri: https://api.openai.com/v1/chat/completions uri: https://api.openai.com/v1/chat/completions
response: response:
content: "{\n \"id\": \"chatcmpl-AnuAPADYARn6GIgkkQyuyciAju6N6\",\n \"object\": content: "{\n \"id\": \"chatcmpl-AnuJ164hlSKBxhJLbcBXn8KKeZVM7\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457341,\n \"model\": \"gpt-4o-2024-08-06\",\n \"chat.completion\",\n \"created\": 1736457875,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\": \ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer\\nFinal \"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: Thank you for evaluating my task performance. I'm committed to providing Answer: As a Futel Official Infopoint representative, I'm here to provide you
detailed and complete responses in accordance with your direct instructions with comprehensive information about Futel Football Club. If you have inquiries
and expectations. If there's any other way I can further assist, please let regarding our team\u2019s performance, player statistics, match schedules, or
me know.\",\n \"refusal\": null\n },\n \"logprobs\": null,\n club history, please feel free to ask. I can also help with details such as
\ \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\": our training facilities, ticketing processes for upcoming matches, and any community
177,\n \"completion_tokens\": 51,\n \"total_tokens\": 228,\n \"prompt_tokens_details\": outreach programs we may be involved in. Your questions are important, and I'm
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": committed to delivering the most accurate and thorough information possible.\",\n
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\": \ \"refusal\": null\n },\n \"logprobs\": null,\n \"finish_reason\":
\"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\": 177,\n \"completion_tokens\":
109,\n \"total_tokens\": 286,\n \"prompt_tokens_details\": {\n \"cached_tokens\":
0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": {\n
\ \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\": 0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n" \"fp_f2cd28694a\"\n}\n"
headers: headers:
CF-Cache-Status: CF-Cache-Status:
- DYNAMIC - DYNAMIC
CF-RAY: CF-RAY:
- 8ff771ae9dd57bcc-ATL - 8ff77eb6b8ffbfb6-ATL
Connection: Connection:
- keep-alive - keep-alive
Content-Encoding: Content-Encoding:
@@ -77,7 +81,7 @@ interactions:
Content-Type: Content-Type:
- application/json - application/json
Date: Date:
- Thu, 09 Jan 2025 21:15:43 GMT - Thu, 09 Jan 2025 21:24:36 GMT
Server: Server:
- cloudflare - cloudflare
Transfer-Encoding: Transfer-Encoding:
@@ -91,25 +95,25 @@ interactions:
openai-organization: openai-organization:
- crewai-iuxna1 - crewai-iuxna1
openai-processing-ms: openai-processing-ms:
- '1754' - '1718'
openai-version: openai-version:
- '2020-10-01' - '2020-10-01'
strict-transport-security: strict-transport-security:
- max-age=31536000; includeSubDomains; preload - max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests: x-ratelimit-limit-requests:
- '10000' - '30000'
x-ratelimit-limit-tokens: x-ratelimit-limit-tokens:
- '30000000' - '150000000'
x-ratelimit-remaining-requests: x-ratelimit-remaining-requests:
- '9999' - '29999'
x-ratelimit-remaining-tokens: x-ratelimit-remaining-tokens:
- '29999786' - '149999786'
x-ratelimit-reset-requests: x-ratelimit-reset-requests:
- 6ms - 2ms
x-ratelimit-reset-tokens: x-ratelimit-reset-tokens:
- 0s - 0s
x-request-id: x-request-id:
- req_4c2c3dd4a9fd3a15a5b0a5eed2f45ef1 - req_8cbe3c35a86d61c2148d9fbecfc519a4
http_version: HTTP/1.1 http_version: HTTP/1.1
status_code: 200 status_code: 200
version: 1 version: 1

52
tests/cassettes/test_agent_tool_role_matching["Futel Official Infopoint"-True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}], tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}' "model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers: headers:
accept: accept:
- application/json - application/json
@@ -20,12 +20,12 @@ interactions:
connection: connection:
- keep-alive - keep-alive
content-length: content-length:
- '939' - '944'
content-type: content-type:
- application/json - application/json
cookie: cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ; - __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
_cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000 _cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000
host: host:
- api.openai.com - api.openai.com
user-agent: user-agent:
@@ -51,26 +51,26 @@ interactions:
method: POST method: POST
uri: https://api.openai.com/v1/chat/completions uri: https://api.openai.com/v1/chat/completions
response: response:
content: "{\n \"id\": \"chatcmpl-AnuANJKaIk2mlENKbOQ37R8NM34cK\",\n \"object\": content: "{\n \"id\": \"chatcmpl-AnuIz94aaKJ9WaDwUCnRHhjhXI7tb\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457339,\n \"model\": \"gpt-4o-2024-08-06\",\n \"chat.completion\",\n \"created\": 1736457873,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\": \ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer\\nFinal \"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: As this is a test task, please clarify what specific information or Answer: Thank you for your message. How may I assist you regarding Futel Football
context is needed for a coworker to understand the criteria based on the established Club today? Whether you need information about player stats, match schedules,
guidelines for Futel Official Infopoint. If there are any particular questions team history, or upcoming events, I'm here to help. Please specify your inquiry
about Futel or its football club, please provide those so I can offer a detailed so I can provide the most accurate and thorough response.\",\n \"refusal\":
and well-informed response.\",\n \"refusal\": null\n },\n \"logprobs\": null\n },\n \"logprobs\": null,\n \"finish_reason\": \"stop\"\n
null,\n \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\": \ }\n ],\n \"usage\": {\n \"prompt_tokens\": 177,\n \"completion_tokens\":
177,\n \"completion_tokens\": 76,\n \"total_tokens\": 253,\n \"prompt_tokens_details\": 67,\n \"total_tokens\": 244,\n \"prompt_tokens_details\": {\n \"cached_tokens\":
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": {\n
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\": \ \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\": 0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n" \"fp_f2cd28694a\"\n}\n"
headers: headers:
CF-Cache-Status: CF-Cache-Status:
- DYNAMIC - DYNAMIC
CF-RAY: CF-RAY:
- 8ff771a50de57bcc-ATL - 8ff77eae19b5bfb6-ATL
Connection: Connection:
- keep-alive - keep-alive
Content-Encoding: Content-Encoding:
@@ -78,7 +78,7 @@ interactions:
Content-Type: Content-Type:
- application/json - application/json
Date: Date:
- Thu, 09 Jan 2025 21:15:41 GMT - Thu, 09 Jan 2025 21:24:34 GMT
Server: Server:
- cloudflare - cloudflare
Transfer-Encoding: Transfer-Encoding:
@@ -92,25 +92,25 @@ interactions:
openai-organization: openai-organization:
- crewai-iuxna1 - crewai-iuxna1
openai-processing-ms: openai-processing-ms:
- '1427' - '1144'
openai-version: openai-version:
- '2020-10-01' - '2020-10-01'
strict-transport-security: strict-transport-security:
- max-age=31536000; includeSubDomains; preload - max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests: x-ratelimit-limit-requests:
- '10000' - '30000'
x-ratelimit-limit-tokens: x-ratelimit-limit-tokens:
- '30000000' - '150000000'
x-ratelimit-remaining-requests: x-ratelimit-remaining-requests:
- '9999' - '29999'
x-ratelimit-remaining-tokens: x-ratelimit-remaining-tokens:
- '29999786' - '149999786'
x-ratelimit-reset-requests: x-ratelimit-reset-requests:
- 6ms - 2ms
x-ratelimit-reset-tokens: x-ratelimit-reset-tokens:
- 0s - 0s
x-request-id: x-request-id:
- req_f4375b737642033563eec3b2b8d03def - req_281529b8942406847721dc78731db6a4
http_version: HTTP/1.1 http_version: HTTP/1.1
status_code: 200 status_code: 200
version: 1 version: 1

70
tests/cassettes/test_agent_tool_role_matching[Futel Official Infopoint-True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}], tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}' "model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers: headers:
accept: accept:
- application/json - application/json
@@ -20,7 +20,7 @@ interactions:
connection: connection:
- keep-alive - keep-alive
content-length: content-length:
- '939' - '944'
content-type: content-type:
- application/json - application/json
host: host:
@@ -48,31 +48,37 @@ interactions:
method: POST method: POST
uri: https://api.openai.com/v1/chat/completions uri: https://api.openai.com/v1/chat/completions
response: response:
content: "{\n \"id\": \"chatcmpl-AnuAGjEj2bGDImZFDYAcDsf9VvboK\",\n \"object\": content: "{\n \"id\": \"chatcmpl-AnuImOrKAxPy2UnH2hquf7ruYtDcE\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457332,\n \"model\": \"gpt-4o-2024-08-06\",\n \"chat.completion\",\n \"created\": 1736457860,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\": \ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer\\nFinal \"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: Futel Football Club is a community-driven soccer initiative that promotes Answer: Futel Football Club, often referred to simply as Futel, is a professional
engagement and participation in the sport. The club aims to foster teamwork, football club based in [Insert City/Country], established in [Insert Year].
discipline, and sportsmanship among its members. Futel FC organizes regular The club competes in [Insert League Name] and has a rich history that includes
training sessions, friendly matches, and community events to encourage physical [Insert Notable Achievements, such as championships, cup wins, etc.]. The team's
activity and social interaction. As part of its mission, Futel FC is dedicated colors are [Insert Team Colors], and they play their home matches at [Insert
to providing opportunities for players of all ages and skill levels to develop Stadium Name], which has a capacity of [Insert Capacity]. \\n\\nFutel is well-known
their abilities and enjoy the game of football. With a focus on inclusivity for its strong youth academy, which has produced several notable players who
and community spirit, Futel FC is committed to nurturing talent and building have gone on to excel in both domestic and international competitions. In addition
lasting relationships through the love of the sport.\",\n \"refusal\": to the men's team, Futel also supports a women's team and various youth programs,
null\n },\n \"logprobs\": null,\n \"finish_reason\": \"stop\"\n promoting football at all levels within the community. \\n\\nFans of Futel
\ }\n ],\n \"usage\": {\n \"prompt_tokens\": 177,\n \"completion_tokens\": are known for their dedicated support, creating a vibrant atmosphere during
130,\n \"total_tokens\": 307,\n \"prompt_tokens_details\": {\n \"cached_tokens\": matches, especially in key rivalries, such as against [Insert Rival Team]. The
0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": {\n club is committed to community engagement, often participating in local initiatives
\ \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\": and charity events. With a goal to continue developing high-caliber talent and
competing at the highest levels, Futel Football Club looks towards a promising
future.\",\n \"refusal\": null\n },\n \"logprobs\": null,\n
\ \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\":
177,\n \"completion_tokens\": 243,\n \"total_tokens\": 420,\n \"prompt_tokens_details\":
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\":
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\": 0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n" \"fp_f2cd28694a\"\n}\n"
headers: headers:
CF-Cache-Status: CF-Cache-Status:
- DYNAMIC - DYNAMIC
CF-RAY: CF-RAY:
- 8ff77178df2a7bcc-ATL - 8ff77e597819bfb6-ATL
Connection: Connection:
- keep-alive - keep-alive
Content-Encoding: Content-Encoding:
@@ -80,14 +86,14 @@ interactions:
Content-Type: Content-Type:
- application/json - application/json
Date: Date:
- Thu, 09 Jan 2025 21:15:35 GMT - Thu, 09 Jan 2025 21:24:23 GMT
Server: Server:
- cloudflare - cloudflare
Set-Cookie: Set-Cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ; - __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
path=/; expires=Thu, 09-Jan-25 21:45:35 GMT; domain=.api.openai.com; HttpOnly; path=/; expires=Thu, 09-Jan-25 21:54:23 GMT; domain=.api.openai.com; HttpOnly;
Secure; SameSite=None Secure; SameSite=None
- _cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000; - _cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000;
path=/; domain=.api.openai.com; HttpOnly; Secure; SameSite=None path=/; domain=.api.openai.com; HttpOnly; Secure; SameSite=None
Transfer-Encoding: Transfer-Encoding:
- chunked - chunked
@@ -100,25 +106,25 @@ interactions:
openai-organization: openai-organization:
- crewai-iuxna1 - crewai-iuxna1
openai-processing-ms: openai-processing-ms:
- '2324' - '3398'
openai-version: openai-version:
- '2020-10-01' - '2020-10-01'
strict-transport-security: strict-transport-security:
- max-age=31536000; includeSubDomains; preload - max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests: x-ratelimit-limit-requests:
- '10000' - '30000'
x-ratelimit-limit-tokens: x-ratelimit-limit-tokens:
- '30000000' - '150000000'
x-ratelimit-remaining-requests: x-ratelimit-remaining-requests:
- '9999' - '29999'
x-ratelimit-remaining-tokens: x-ratelimit-remaining-tokens:
- '29999786' - '149999786'
x-ratelimit-reset-requests: x-ratelimit-reset-requests:
- 6ms - 2ms
x-ratelimit-reset-tokens: x-ratelimit-reset-tokens:
- 0s - 0s
x-request-id: x-request-id:
- req_e014b10824e8214be57d23808c0a6157 - req_e2438df0a2e3a39eb64f28f805e49bf0
http_version: HTTP/1.1 http_version: HTTP/1.1
status_code: 200 status_code: 200
version: 1 version: 1

60
tests/cassettes/test_agent_tool_role_matching[Futel Official Infopoint\n-True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}], tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}' "model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers: headers:
accept: accept:
- application/json - application/json
@@ -20,12 +20,12 @@ interactions:
connection: connection:
- keep-alive - keep-alive
content-length: content-length:
- '939' - '944'
content-type: content-type:
- application/json - application/json
cookie: cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ; - __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
_cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000 _cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000
host: host:
- api.openai.com - api.openai.com
user-agent: user-agent:
@@ -51,26 +51,40 @@ interactions:
method: POST method: POST
uri: https://api.openai.com/v1/chat/completions uri: https://api.openai.com/v1/chat/completions
response: response:
content: "{\n \"id\": \"chatcmpl-AnuAMhHvodVuC2y7NF7y7kNvJhvOK\",\n \"object\": content: "{\n \"id\": \"chatcmpl-AnuIvuNJQ3ntNli788vO7ebeQEe9r\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457338,\n \"model\": \"gpt-4o-2024-08-06\",\n \"chat.completion\",\n \"created\": 1736457869,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\": \ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer\\nFinal \"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: Thank you for providing the necessary details. However, there seems Answer: Futel Football Club, known for its strong commitment to developing youth
to be a misunderstanding as this is a test task prompt without a specific question talent and promoting community engagement, enjoys a growing reputation in regional
related to Futel Football Club. Please provide the necessary context or question, leagues. Established in [insert year], the club operates with a clear mission
and I'll be glad to assist you with a complete and accurate response related to foster sporting excellence whilst maintaining a family-friendly environment.
to Futel Football Club.\",\n \"refusal\": null\n },\n \"logprobs\": The club\u2019s facilities include a modern training ground, well-maintained
pitches, and a fan-friendly stadium that regularly hosts matches drawing enthusiastic
crowds. \\n\\nFutel FC fields various teams across different age groups, promoting
not just competitive play but also teamwork and personal growth among young
athletes. The club\u2019s coaching staff is comprised of qualified professionals
who focus on not only the technical and tactical development of players but
also their psychological and social skills.\\n\\nBeyond the pitch, Futel Football
Club actively participates in community outreach programs, partnering with local
schools and organizations to encourage healthy lifestyles and the joy of playing
football. The club hosts events such as open training sessions, school visits,
and charity matches aimed at giving back to the community that supports them.\\n\\nWith
a vision for sustainable growth and continuous improvement, Futel FC is striving
to leave a lasting impact in the world of football, aiming for success on and
off the pitch. Their mission is to not only win games but to also inspire the
next generation of footballers.\",\n \"refusal\": null\n },\n \"logprobs\":
null,\n \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\": null,\n \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\":
177,\n \"completion_tokens\": 73,\n \"total_tokens\": 250,\n \"prompt_tokens_details\": 177,\n \"completion_tokens\": 260,\n \"total_tokens\": 437,\n \"prompt_tokens_details\":
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": {\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\":
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\": {\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\": 0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n" \"fp_f2cd28694a\"\n}\n"
headers: headers:
CF-Cache-Status: CF-Cache-Status:
- DYNAMIC - DYNAMIC
CF-RAY: CF-RAY:
- 8ff7719bee997bcc-ATL - 8ff77e909a34bfb6-ATL
Connection: Connection:
- keep-alive - keep-alive
Content-Encoding: Content-Encoding:
@@ -78,7 +92,7 @@ interactions:
Content-Type: Content-Type:
- application/json - application/json
Date: Date:
- Thu, 09 Jan 2025 21:15:39 GMT - Thu, 09 Jan 2025 21:24:33 GMT
Server: Server:
- cloudflare - cloudflare
Transfer-Encoding: Transfer-Encoding:
@@ -92,25 +106,25 @@ interactions:
openai-organization: openai-organization:
- crewai-iuxna1 - crewai-iuxna1
openai-processing-ms: openai-processing-ms:
- '1364' - '4585'
openai-version: openai-version:
- '2020-10-01' - '2020-10-01'
strict-transport-security: strict-transport-security:
- max-age=31536000; includeSubDomains; preload - max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests: x-ratelimit-limit-requests:
- '10000' - '30000'
x-ratelimit-limit-tokens: x-ratelimit-limit-tokens:
- '30000000' - '150000000'
x-ratelimit-remaining-requests: x-ratelimit-remaining-requests:
- '9999' - '29999'
x-ratelimit-remaining-tokens: x-ratelimit-remaining-tokens:
- '29999786' - '149999786'
x-ratelimit-reset-requests: x-ratelimit-reset-requests:
- 6ms - 2ms
x-ratelimit-reset-tokens: x-ratelimit-reset-tokens:
- 0s - 0s
x-request-id: x-request-id:
- req_40d89cdfe6aa3018720fba78fdfed960 - req_e4c8f59f855a707f13781c49e5342a39
http_version: HTTP/1.1 http_version: HTTP/1.1
status_code: 200 status_code: 200
version: 1 version: 1

1
tests/test_manager_llm_delegation.py
View File

@@ -36,6 +36,7 @@ def test_agent_tool_role_matching(role_name, should_match):
goal="Answer questions about Futel", goal="Answer questions about Futel",
backstory="Futel Football Club info", backstory="Futel Football Club info",
allow_delegation=False, allow_delegation=False,
llm="gpt-4o-mini",
) )
# Create test agent tool # Create test agent tool