andre/crewAI
1
0
Fork 0
mirror of https://github.com/crewAIInc/crewAI.git synced 2026-01-09 16:18:30 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Fix tests

Browse Source
This commit is contained in:
Brandon Hancock
2025-01-09 16:25:20 -05:00
parent 389d5a9982
commit fb763885eb
6 changed files with 171 additions and 134 deletions
Download Patch File Download Diff File Expand all files Collapse all files

68
tests/cassettes/test_agent_tool_role_matching[ "Futel Official Infopoint" -True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}'
"model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers:
accept:
- application/json
@@ -20,12 +20,12 @@ interactions:
connection:
- keep-alive
content-length:
- '939'
- '944'
content-type:
- application/json
cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ;
_cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000
- __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
_cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000
host:
- api.openai.com
user-agent:
@@ -51,29 +51,41 @@ interactions:
method: POST
uri: https://api.openai.com/v1/chat/completions
response:
content: "{\n \"id\": \"chatcmpl-AnuAJX0JApdkr5cr5HRQLNSoWs6Dj\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457335,\n \"model\": \"gpt-4o-2024-08-06\",\n
content: "{\n \"id\": \"chatcmpl-AnuIpSDtrmEL7zuRDN3MJq6xUMrMx\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457863,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: When your coworker asks about the current status or details involving
the Futel Football Club, it's crucial to provide a comprehensive answer. It
is essential to them about the particular aspect of the club they are inquiring
about, such as recent matches, player information, upcoming events, or club
history, and then deliver detailed information relevant to that query. Always
strive to be as precise and informative as possible, while maintaining an engaging
and helpful demeanor to support their understanding and knowledge of the Futel
Football Club.\",\n \"refusal\": null\n },\n \"logprobs\":
null,\n \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\":
177,\n \"completion_tokens\": 111,\n \"total_tokens\": 288,\n \"prompt_tokens_details\":
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\":
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
Answer: Futel Football Club (FFC) is a professional football club based in Futel,
known for its committed fanbase and rich history in the local football scene.
Established in [Year of Establishment], the team has made significant strides
in recent years, participating in various leagues and competitions. The club's
home matches are held at [Stadium Name], which boasts a capacity of [Capacity
Number] and provides a vibrant atmosphere for supporters. \\n\\nFFC's colors
are [Team Colors], and the club's mascot, [Mascot Name], embodies the spirit
of the team. The coaching staff, led by [Head Coach Name], focuses on developing
both individual skill and team cohesion to enhance performance on the pitch.\\n\\nFutel
FC also places a strong emphasis on youth development, with a dedicated academy
that nurtures young talent and prepares them for professional football. Community
engagement is a priority, as the club regularly participates in charitable events
and promotes inclusivity in sports.\\n\\nIn terms of recent achievements, the
team has achieved [List of Major Achievements], and currently aims to qualify
for [Upcoming Tournament/League]. The club's fan engagement efforts, including
social media promotions and matchday events, help maintain a robust follower
connection both locally and internationally. \\n\\nFor further information or
inquiries about the team, fans can visit the official website at [Website Link],
where they can find schedules, news updates, and ticket purchasing options.\",\n
\ \"refusal\": null\n },\n \"logprobs\": null,\n \"finish_reason\":
\"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\": 177,\n \"completion_tokens\":
292,\n \"total_tokens\": 469,\n \"prompt_tokens_details\": {\n \"cached_tokens\":
0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": {\n
\ \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n"
\"fp_f2cd28694a\"\n}\n"
headers:
CF-Cache-Status:
- DYNAMIC
CF-RAY:
- 8ff7718889367bcc-ATL
- 8ff77e6f7edbbfb6-ATL
Connection:
- keep-alive
Content-Encoding:
@@ -81,7 +93,7 @@ interactions:
Content-Type:
- application/json
Date:
- Thu, 09 Jan 2025 21:15:38 GMT
- Thu, 09 Jan 2025 21:24:28 GMT
Server:
- cloudflare
Transfer-Encoding:
@@ -95,25 +107,25 @@ interactions:
openai-organization:
- crewai-iuxna1
openai-processing-ms:
- '3003'
- '5185'
openai-version:
- '2020-10-01'
strict-transport-security:
- max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests:
- '10000'
- '30000'
x-ratelimit-limit-tokens:
- '30000000'
- '150000000'
x-ratelimit-remaining-requests:
- '9999'
- '29999'
x-ratelimit-remaining-tokens:
- '29999786'
- '149999786'
x-ratelimit-reset-requests:
- 6ms
- 2ms
x-ratelimit-reset-tokens:
- 0s
x-request-id:
- req_3503475199cb974c296141f7d37bbf46
- req_a5d2111d19d2239dc81e3395abb7955c
http_version: HTTP/1.1
status_code: 200
version: 1

52
tests/cassettes/test_agent_tool_role_matching[ FUTEL\nOFFICIAL INFOPOINT -True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}'
"model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers:
accept:
- application/json
@@ -20,12 +20,12 @@ interactions:
connection:
- keep-alive
content-length:
- '939'
- '944'
content-type:
- application/json
cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ;
_cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000
- __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
_cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000
host:
- api.openai.com
user-agent:
@@ -51,25 +51,29 @@ interactions:
method: POST
uri: https://api.openai.com/v1/chat/completions
response:
content: "{\n \"id\": \"chatcmpl-AnuAPADYARn6GIgkkQyuyciAju6N6\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457341,\n \"model\": \"gpt-4o-2024-08-06\",\n
content: "{\n \"id\": \"chatcmpl-AnuJ164hlSKBxhJLbcBXn8KKeZVM7\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457875,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: Thank you for evaluating my task performance. I'm committed to providing
detailed and complete responses in accordance with your direct instructions
and expectations. If there's any other way I can further assist, please let
me know.\",\n \"refusal\": null\n },\n \"logprobs\": null,\n
\ \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\":
177,\n \"completion_tokens\": 51,\n \"total_tokens\": 228,\n \"prompt_tokens_details\":
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\":
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
Answer: As a Futel Official Infopoint representative, I'm here to provide you
with comprehensive information about Futel Football Club. If you have inquiries
regarding our team\u2019s performance, player statistics, match schedules, or
club history, please feel free to ask. I can also help with details such as
our training facilities, ticketing processes for upcoming matches, and any community
outreach programs we may be involved in. Your questions are important, and I'm
committed to delivering the most accurate and thorough information possible.\",\n
\ \"refusal\": null\n },\n \"logprobs\": null,\n \"finish_reason\":
\"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\": 177,\n \"completion_tokens\":
109,\n \"total_tokens\": 286,\n \"prompt_tokens_details\": {\n \"cached_tokens\":
0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": {\n
\ \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n"
\"fp_f2cd28694a\"\n}\n"
headers:
CF-Cache-Status:
- DYNAMIC
CF-RAY:
- 8ff771ae9dd57bcc-ATL
- 8ff77eb6b8ffbfb6-ATL
Connection:
- keep-alive
Content-Encoding:
@@ -77,7 +81,7 @@ interactions:
Content-Type:
- application/json
Date:
- Thu, 09 Jan 2025 21:15:43 GMT
- Thu, 09 Jan 2025 21:24:36 GMT
Server:
- cloudflare
Transfer-Encoding:
@@ -91,25 +95,25 @@ interactions:
openai-organization:
- crewai-iuxna1
openai-processing-ms:
- '1754'
- '1718'
openai-version:
- '2020-10-01'
strict-transport-security:
- max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests:
- '10000'
- '30000'
x-ratelimit-limit-tokens:
- '30000000'
- '150000000'
x-ratelimit-remaining-requests:
- '9999'
- '29999'
x-ratelimit-remaining-tokens:
- '29999786'
- '149999786'
x-ratelimit-reset-requests:
- 6ms
- 2ms
x-ratelimit-reset-tokens:
- 0s
x-request-id:
- req_4c2c3dd4a9fd3a15a5b0a5eed2f45ef1
- req_8cbe3c35a86d61c2148d9fbecfc519a4
http_version: HTTP/1.1
status_code: 200
version: 1

50
tests/cassettes/test_agent_tool_role_matching["Futel Official Infopoint"-True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}'
"model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers:
accept:
- application/json
@@ -20,12 +20,12 @@ interactions:
connection:
- keep-alive
content-length:
- '939'
- '944'
content-type:
- application/json
cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ;
_cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000
- __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
_cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000
host:
- api.openai.com
user-agent:
@@ -51,26 +51,26 @@ interactions:
method: POST
uri: https://api.openai.com/v1/chat/completions
response:
content: "{\n \"id\": \"chatcmpl-AnuANJKaIk2mlENKbOQ37R8NM34cK\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457339,\n \"model\": \"gpt-4o-2024-08-06\",\n
content: "{\n \"id\": \"chatcmpl-AnuIz94aaKJ9WaDwUCnRHhjhXI7tb\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457873,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: As this is a test task, please clarify what specific information or
context is needed for a coworker to understand the criteria based on the established
guidelines for Futel Official Infopoint. If there are any particular questions
about Futel or its football club, please provide those so I can offer a detailed
and well-informed response.\",\n \"refusal\": null\n },\n \"logprobs\":
null,\n \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\":
177,\n \"completion_tokens\": 76,\n \"total_tokens\": 253,\n \"prompt_tokens_details\":
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\":
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
Answer: Thank you for your message. How may I assist you regarding Futel Football
Club today? Whether you need information about player stats, match schedules,
team history, or upcoming events, I'm here to help. Please specify your inquiry
so I can provide the most accurate and thorough response.\",\n \"refusal\":
null\n },\n \"logprobs\": null,\n \"finish_reason\": \"stop\"\n
\ }\n ],\n \"usage\": {\n \"prompt_tokens\": 177,\n \"completion_tokens\":
67,\n \"total_tokens\": 244,\n \"prompt_tokens_details\": {\n \"cached_tokens\":
0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": {\n
\ \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n"
\"fp_f2cd28694a\"\n}\n"
headers:
CF-Cache-Status:
- DYNAMIC
CF-RAY:
- 8ff771a50de57bcc-ATL
- 8ff77eae19b5bfb6-ATL
Connection:
- keep-alive
Content-Encoding:
@@ -78,7 +78,7 @@ interactions:
Content-Type:
- application/json
Date:
- Thu, 09 Jan 2025 21:15:41 GMT
- Thu, 09 Jan 2025 21:24:34 GMT
Server:
- cloudflare
Transfer-Encoding:
@@ -92,25 +92,25 @@ interactions:
openai-organization:
- crewai-iuxna1
openai-processing-ms:
- '1427'
- '1144'
openai-version:
- '2020-10-01'
strict-transport-security:
- max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests:
- '10000'
- '30000'
x-ratelimit-limit-tokens:
- '30000000'
- '150000000'
x-ratelimit-remaining-requests:
- '9999'
- '29999'
x-ratelimit-remaining-tokens:
- '29999786'
- '149999786'
x-ratelimit-reset-requests:
- 6ms
- 2ms
x-ratelimit-reset-tokens:
- 0s
x-request-id:
- req_f4375b737642033563eec3b2b8d03def
- req_281529b8942406847721dc78731db6a4
http_version: HTTP/1.1
status_code: 200
version: 1

68
tests/cassettes/test_agent_tool_role_matching[Futel Official Infopoint-True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}'
"model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers:
accept:
- application/json
@@ -20,7 +20,7 @@ interactions:
connection:
- keep-alive
content-length:
- '939'
- '944'
content-type:
- application/json
host:
@@ -48,31 +48,37 @@ interactions:
method: POST
uri: https://api.openai.com/v1/chat/completions
response:
content: "{\n \"id\": \"chatcmpl-AnuAGjEj2bGDImZFDYAcDsf9VvboK\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457332,\n \"model\": \"gpt-4o-2024-08-06\",\n
content: "{\n \"id\": \"chatcmpl-AnuImOrKAxPy2UnH2hquf7ruYtDcE\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457860,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: Futel Football Club is a community-driven soccer initiative that promotes
engagement and participation in the sport. The club aims to foster teamwork,
discipline, and sportsmanship among its members. Futel FC organizes regular
training sessions, friendly matches, and community events to encourage physical
activity and social interaction. As part of its mission, Futel FC is dedicated
to providing opportunities for players of all ages and skill levels to develop
their abilities and enjoy the game of football. With a focus on inclusivity
and community spirit, Futel FC is committed to nurturing talent and building
lasting relationships through the love of the sport.\",\n \"refusal\":
null\n },\n \"logprobs\": null,\n \"finish_reason\": \"stop\"\n
\ }\n ],\n \"usage\": {\n \"prompt_tokens\": 177,\n \"completion_tokens\":
130,\n \"total_tokens\": 307,\n \"prompt_tokens_details\": {\n \"cached_tokens\":
0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\": {\n
\ \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
Answer: Futel Football Club, often referred to simply as Futel, is a professional
football club based in [Insert City/Country], established in [Insert Year].
The club competes in [Insert League Name] and has a rich history that includes
[Insert Notable Achievements, such as championships, cup wins, etc.]. The team's
colors are [Insert Team Colors], and they play their home matches at [Insert
Stadium Name], which has a capacity of [Insert Capacity]. \\n\\nFutel is well-known
for its strong youth academy, which has produced several notable players who
have gone on to excel in both domestic and international competitions. In addition
to the men's team, Futel also supports a women's team and various youth programs,
promoting football at all levels within the community. \\n\\nFans of Futel
are known for their dedicated support, creating a vibrant atmosphere during
matches, especially in key rivalries, such as against [Insert Rival Team]. The
club is committed to community engagement, often participating in local initiatives
and charity events. With a goal to continue developing high-caliber talent and
competing at the highest levels, Futel Football Club looks towards a promising
future.\",\n \"refusal\": null\n },\n \"logprobs\": null,\n
\ \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\":
177,\n \"completion_tokens\": 243,\n \"total_tokens\": 420,\n \"prompt_tokens_details\":
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\":
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n"
\"fp_f2cd28694a\"\n}\n"
headers:
CF-Cache-Status:
- DYNAMIC
CF-RAY:
- 8ff77178df2a7bcc-ATL
- 8ff77e597819bfb6-ATL
Connection:
- keep-alive
Content-Encoding:
@@ -80,14 +86,14 @@ interactions:
Content-Type:
- application/json
Date:
- Thu, 09 Jan 2025 21:15:35 GMT
- Thu, 09 Jan 2025 21:24:23 GMT
Server:
- cloudflare
Set-Cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ;
path=/; expires=Thu, 09-Jan-25 21:45:35 GMT; domain=.api.openai.com; HttpOnly;
- __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
path=/; expires=Thu, 09-Jan-25 21:54:23 GMT; domain=.api.openai.com; HttpOnly;
Secure; SameSite=None
- _cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000;
- _cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000;
path=/; domain=.api.openai.com; HttpOnly; Secure; SameSite=None
Transfer-Encoding:
- chunked
@@ -100,25 +106,25 @@ interactions:
openai-organization:
- crewai-iuxna1
openai-processing-ms:
- '2324'
- '3398'
openai-version:
- '2020-10-01'
strict-transport-security:
- max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests:
- '10000'
- '30000'
x-ratelimit-limit-tokens:
- '30000000'
- '150000000'
x-ratelimit-remaining-requests:
- '9999'
- '29999'
x-ratelimit-remaining-tokens:
- '29999786'
- '149999786'
x-ratelimit-reset-requests:
- 6ms
- 2ms
x-ratelimit-reset-tokens:
- 0s
x-request-id:
- req_e014b10824e8214be57d23808c0a6157
- req_e2438df0a2e3a39eb64f28f805e49bf0
http_version: HTTP/1.1
status_code: 200
version: 1

58
tests/cassettes/test_agent_tool_role_matching[Futel Official Infopoint\n-True].yaml
View File

@@ -11,7 +11,7 @@ interactions:
for the context shared.\nyou MUST return the actual complete content as the
final answer, not a summary.\n\nBegin! This is VERY important to you, use the
tools available and give your best Final Answer, your job depends on it!\n\nThought:"}],
"model": "gpt-4o", "stop": ["\nObservation:"], "stream": false}'
"model": "gpt-4o-mini", "stop": ["\nObservation:"], "stream": false}'
headers:
accept:
- application/json
@@ -20,12 +20,12 @@ interactions:
connection:
- keep-alive
content-length:
- '939'
- '944'
content-type:
- application/json
cookie:
- __cf_bm=PayAEPcVMbXBjhxhnXnOiohFbX24Zmpq3CYdIymCQK4-1736457335-1.0.1.1-FZG4EX90pRlyTvEavWmg2mz_rgrfv92rWJSspC1e9DdGZmSt3LHpavV7oMwK_HWozerDkzns46Czafjkk1qAqQ;
_cfuvid=FnUqyyJsek9lGXDNKiSxP8UqVYwVhxUqfiw5tO38VNI-1736457335028-0.0.1.1-604800000
- __cf_bm=Jg0G7BoRPBX4M8hcoS68IF61914mtIKq.6mPgNOyCOc-1736457863-1.0.1.1-DcdeXCNEQAhe07yALccPhte0Lq4lgwiYki9DLtjftCaRatWdS1vVRBW.8sdUK58qxA0xViYhMKEAxkKAsggewA;
_cfuvid=Mzb0AcDjRhz_fanW9l7lmZY9o0ikr25.Gb1MupvtUuU-1736457863531-0.0.1.1-604800000
host:
- api.openai.com
user-agent:
@@ -51,26 +51,40 @@ interactions:
method: POST
uri: https://api.openai.com/v1/chat/completions
response:
content: "{\n \"id\": \"chatcmpl-AnuAMhHvodVuC2y7NF7y7kNvJhvOK\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457338,\n \"model\": \"gpt-4o-2024-08-06\",\n
content: "{\n \"id\": \"chatcmpl-AnuIvuNJQ3ntNli788vO7ebeQEe9r\",\n \"object\":
\"chat.completion\",\n \"created\": 1736457869,\n \"model\": \"gpt-4o-mini-2024-07-18\",\n
\ \"choices\": [\n {\n \"index\": 0,\n \"message\": {\n \"role\":
\"assistant\",\n \"content\": \"I now can give a great answer \\nFinal
Answer: Thank you for providing the necessary details. However, there seems
to be a misunderstanding as this is a test task prompt without a specific question
related to Futel Football Club. Please provide the necessary context or question,
and I'll be glad to assist you with a complete and accurate response related
to Futel Football Club.\",\n \"refusal\": null\n },\n \"logprobs\":
Answer: Futel Football Club, known for its strong commitment to developing youth
talent and promoting community engagement, enjoys a growing reputation in regional
leagues. Established in [insert year], the club operates with a clear mission
to foster sporting excellence whilst maintaining a family-friendly environment.
The club\u2019s facilities include a modern training ground, well-maintained
pitches, and a fan-friendly stadium that regularly hosts matches drawing enthusiastic
crowds. \\n\\nFutel FC fields various teams across different age groups, promoting
not just competitive play but also teamwork and personal growth among young
athletes. The club\u2019s coaching staff is comprised of qualified professionals
who focus on not only the technical and tactical development of players but
also their psychological and social skills.\\n\\nBeyond the pitch, Futel Football
Club actively participates in community outreach programs, partnering with local
schools and organizations to encourage healthy lifestyles and the joy of playing
football. The club hosts events such as open training sessions, school visits,
and charity matches aimed at giving back to the community that supports them.\\n\\nWith
a vision for sustainable growth and continuous improvement, Futel FC is striving
to leave a lasting impact in the world of football, aiming for success on and
off the pitch. Their mission is to not only win games but to also inspire the
next generation of footballers.\",\n \"refusal\": null\n },\n \"logprobs\":
null,\n \"finish_reason\": \"stop\"\n }\n ],\n \"usage\": {\n \"prompt_tokens\":
177,\n \"completion_tokens\": 73,\n \"total_tokens\": 250,\n \"prompt_tokens_details\":
177,\n \"completion_tokens\": 260,\n \"total_tokens\": 437,\n \"prompt_tokens_details\":
{\n \"cached_tokens\": 0,\n \"audio_tokens\": 0\n },\n \"completion_tokens_details\":
{\n \"reasoning_tokens\": 0,\n \"audio_tokens\": 0,\n \"accepted_prediction_tokens\":
0,\n \"rejected_prediction_tokens\": 0\n }\n },\n \"system_fingerprint\":
\"fp_703d4ff298\"\n}\n"
\"fp_f2cd28694a\"\n}\n"
headers:
CF-Cache-Status:
- DYNAMIC
CF-RAY:
- 8ff7719bee997bcc-ATL
- 8ff77e909a34bfb6-ATL
Connection:
- keep-alive
Content-Encoding:
@@ -78,7 +92,7 @@ interactions:
Content-Type:
- application/json
Date:
- Thu, 09 Jan 2025 21:15:39 GMT
- Thu, 09 Jan 2025 21:24:33 GMT
Server:
- cloudflare
Transfer-Encoding:
@@ -92,25 +106,25 @@ interactions:
openai-organization:
- crewai-iuxna1
openai-processing-ms:
- '1364'
- '4585'
openai-version:
- '2020-10-01'
strict-transport-security:
- max-age=31536000; includeSubDomains; preload
x-ratelimit-limit-requests:
- '10000'
- '30000'
x-ratelimit-limit-tokens:
- '30000000'
- '150000000'
x-ratelimit-remaining-requests:
- '9999'
- '29999'
x-ratelimit-remaining-tokens:
- '29999786'
- '149999786'
x-ratelimit-reset-requests:
- 6ms
- 2ms
x-ratelimit-reset-tokens:
- 0s
x-request-id:
- req_40d89cdfe6aa3018720fba78fdfed960
- req_e4c8f59f855a707f13781c49e5342a39
http_version: HTTP/1.1
status_code: 200
version: 1

1
tests/test_manager_llm_delegation.py
View File

@@ -36,6 +36,7 @@ def test_agent_tool_role_matching(role_name, should_match):
goal="Answer questions about Futel",
backstory="Futel Football Club info",
allow_delegation=False,
llm="gpt-4o-mini",
)
# Create test agent tool