Files
crewAI/lib/cli/tests
João MouraandClaude Opus 5.5 ddfa8517b8
CodeQL Advanced / Analyze (actions) (push) Has been cancelled
CodeQL Advanced / Analyze (python) (push) Has been cancelled
Vulnerability Scan / Detect changes (push) Has been cancelled
Vulnerability Scan / pip-audit (push) Has been cancelled
feat(cli): crewai eval --models says at once where a stopped model broke (#8105)
* feat(cli): crewai eval --models says at once where a stopped model broke

The service's poll answer now lists the setups that stopped, with where in
the project each broke (step → crew → task → agent), the whole reason and
its plain words. The CLI says each one the moment that is known, while the
others keep running: a coding agent gets a block it can start fixing from,
the run's own words quoted as data; a person gets one red line. An older
service sends nothing and nothing changes. The AGENTS.md templates say to
run a comparison in the background and read its output as it goes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* fix(cli): a stopped setup's location is a list of names, and the run's words come only from `reported`

Review (#8105): `where` from the service was used whenever it was truthy, so a
string skipped the wait and printed one character per place, and anything not
iterable raised. Each stopped setup is now parsed once into a checked record
(_Stop): only a list of non-empty strings is a location; the run's own words
are read only from `reported`, where the service (crew-optimize #25) puts them
beside its data-not-instructions note — top-level text is not the run's
channel. The AGENTS.md templates say a location prints when the service knows
it, and an unplaced stop after about 20 seconds or when the comparison ends.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* test(cli): pin when an unplaced stop is said, not just the order

Review (#8105): the ordering assertion passed even if an invalid `where` were
announced on the first poll, since the progress line prints first anyway. The
test now records the fake clock when the stop is said and asserts 30 s — after
the wait ran out, never at the first poll.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-13 14:58:03 -03:00
..