Files
crewAI/lib/cli/tests/experimental
João MouraandClaude Opus 5.5 00e2ff98e9 feat(cli): crewai eval prints a markdown brief when run by an agent (#7907)
* feat(cli): crewai eval prints a markdown brief when run by an agent

When stdout is not a terminal (or CREWAI_DMN is on), `crewai eval` and
`crewai eval --models` print the poll response's `brief_markdown` after the
verdict and the report link — written straight to stdout, never through
Rich markup — or "Brief (markdown): <brief_url>" when only the link came.
An older AMP sends neither and nothing extra is printed. In a terminal
nothing changes. Exit codes unchanged.

`crewai eval --help` and the `--models` help say so, and the AGENTS.md the
crew, flow and declarative-flow templates scaffold gains an "Evaluating"
section telling a coding agent to run `crewai eval` after a change and act
on the brief.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

* docs(cli): an agent re-runs before it re-evaluates; each command's exit rule; the brief may be a link

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

* fix(cli): keep the eval guidance out of tool projects; the brief is conditional in --help

`crewai create tool` copies the shared AGENTS.md too, but a tool project has
no `crewai run` and no traced run for `crewai eval`. The evaluation blocks
are marked in the template and dropped for a tool (`evaluation=False`);
crew, flow and JSON-crew projects keep them, markers stripped.

--help now says the brief prints when AMP provides it, else its link, else
nothing more.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-07 10:28:34 -07:00
..