Commit Graph

2 Commits

Author SHA1 Message Date
Devin AI
d00f7a7960 fix: strip cache_breakpoint from LiteLLM path for non-Anthropic providers
The LiteLLM-based LLM.call() (used by Groq, OpenAI-compatible, etc.)
does not go through BaseLLM._format_messages() which strips the
cache_breakpoint flag. This causes providers like Groq to reject
messages with 'cache_breakpoint' as an unsupported property.

Strip the flag in _prepare_completion_params() so it is removed from
the wire payload for all providers using the LiteLLM code path.

Fixes #5886

Co-Authored-By: João <joao@crewai.com>
2026-05-21 10:10:46 +00:00
Lorenze Jay
264da8245a Lorenze/imp/prompt layering (#5774)
Some checks failed
CodeQL Advanced / Analyze (actions) (push) Has been cancelled
CodeQL Advanced / Analyze (python) (push) Has been cancelled
Check Documentation Broken Links / Check broken links (push) Has been cancelled
Vulnerability Scan / pip-audit (push) Has been cancelled
Nightly Canary Release / Check for new commits (push) Has been cancelled
Nightly Canary Release / Build nightly packages (push) Has been cancelled
Nightly Canary Release / Publish nightly to PyPI (push) Has been cancelled
Mark stale issues and pull requests / stale (push) Has been cancelled
* improving prompt structure especially for prompt caching

* addressing comments
2026-05-12 12:39:12 -07:00