chore(cli): move crewai eval under experimental (#7707)
Some checks failed
CodeQL Advanced / Analyze (python) (push) Has been cancelled
CodeQL Advanced / Analyze (actions) (push) Has been cancelled
Vulnerability Scan / Detect changes (push) Has been cancelled
Vulnerability Scan / pip-audit (push) Has been cancelled

Nothing about the command changes. It is still `crewai eval`, still listed in
`--help`, still takes `--run`, still prints the same lines. Only the module
moved, from `crewai_cli/eval_crew.py` to `crewai_cli/experimental/eval_crew.py`,
with its tests alongside.

The package says what the command's location could not: its output and its
options may change between releases without the deprecation cycle a settled
command gets. That is honest about where it stands — most of what it depends
on lives outside this repository, in an AMP endpoint and the evaluator behind
it, and both are new enough that the report's shape is still moving. The
command is already built to absorb some of that, printing whatever the
evaluation graded rather than a list of its own, but the promise it makes to a
user should match.

`crewai/experimental/` has the same role on the library side, so this is the
convention the repository already has rather than a new one. The CLI had no
experimental package before; it does now, and `crewai eval` is its first
tenant.

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
This commit is contained in:
João Moura
2026-09-22 03:41:50 -03:00
committed by GitHub
parent 9de80df7f3
commit bdd1bc6200
5 changed files with 15 additions and 2 deletions

View File

@@ -49,7 +49,7 @@ def run_crew(*args: Any, **kwargs: Any) -> Any:
def eval_crew(*args: Any, **kwargs: Any) -> Any:
from crewai_cli.eval_crew import eval_crew as _eval_crew
from crewai_cli.experimental.eval_crew import eval_crew as _eval_crew
return _eval_crew(*args, **kwargs)

View File

@@ -0,0 +1,13 @@
"""Commands whose shape is not settled yet.
What lives here still works exactly like the rest of the CLI — it is listed in
`crewai --help` and invoked the same way. The package says something narrower:
its behaviour, its output and its options may change between releases without
the deprecation cycle the settled commands get.
`crewai eval` is here because most of what it depends on lives outside this
repository — an AMP endpoint and the evaluator behind it — and both are new
enough that the report's shape is still moving. The command itself is
deliberately tolerant of that: it prints whatever the evaluation graded rather
than a list of its own.
"""

View File

View File

@@ -12,7 +12,7 @@ import httpx
import pytest
from rich.console import Console
from crewai_cli import eval_crew as eval_module
from crewai_cli.experimental import eval_crew as eval_module
from crewai_cli.cli import eval_command