mirror of
https://github.com/crewAIInc/crewAI.git
synced 2026-09-23 03:11:05 +00:00
chore(cli): move crewai eval under experimental (#7707)
Nothing about the command changes. It is still `crewai eval`, still listed in `--help`, still takes `--run`, still prints the same lines. Only the module moved, from `crewai_cli/eval_crew.py` to `crewai_cli/experimental/eval_crew.py`, with its tests alongside. The package says what the command's location could not: its output and its options may change between releases without the deprecation cycle a settled command gets. That is honest about where it stands — most of what it depends on lives outside this repository, in an AMP endpoint and the evaluator behind it, and both are new enough that the report's shape is still moving. The command is already built to absorb some of that, printing whatever the evaluation graded rather than a list of its own, but the promise it makes to a user should match. `crewai/experimental/` has the same role on the library side, so this is the convention the repository already has rather than a new one. The CLI had no experimental package before; it does now, and `crewai eval` is its first tenant. Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -49,7 +49,7 @@ def run_crew(*args: Any, **kwargs: Any) -> Any:
|
||||
|
||||
|
||||
def eval_crew(*args: Any, **kwargs: Any) -> Any:
|
||||
from crewai_cli.eval_crew import eval_crew as _eval_crew
|
||||
from crewai_cli.experimental.eval_crew import eval_crew as _eval_crew
|
||||
|
||||
return _eval_crew(*args, **kwargs)
|
||||
|
||||
|
||||
13
lib/cli/src/crewai_cli/experimental/__init__.py
Normal file
13
lib/cli/src/crewai_cli/experimental/__init__.py
Normal file
@@ -0,0 +1,13 @@
|
||||
"""Commands whose shape is not settled yet.
|
||||
|
||||
What lives here still works exactly like the rest of the CLI — it is listed in
|
||||
`crewai --help` and invoked the same way. The package says something narrower:
|
||||
its behaviour, its output and its options may change between releases without
|
||||
the deprecation cycle the settled commands get.
|
||||
|
||||
`crewai eval` is here because most of what it depends on lives outside this
|
||||
repository — an AMP endpoint and the evaluator behind it — and both are new
|
||||
enough that the report's shape is still moving. The command itself is
|
||||
deliberately tolerant of that: it prints whatever the evaluation graded rather
|
||||
than a list of its own.
|
||||
"""
|
||||
0
lib/cli/tests/experimental/__init__.py
Normal file
0
lib/cli/tests/experimental/__init__.py
Normal file
@@ -12,7 +12,7 @@ import httpx
|
||||
import pytest
|
||||
from rich.console import Console
|
||||
|
||||
from crewai_cli import eval_crew as eval_module
|
||||
from crewai_cli.experimental import eval_crew as eval_module
|
||||
from crewai_cli.cli import eval_command
|
||||
|
||||
|
||||
Reference in New Issue
Block a user