Files
crewAI/lib
Vidit Ostwal 6388421510 [OSS-128] Handle oversized single messages during chunking (#7014)
* fix(OSS-128): split oversized messages before context chunking

Normalize single messages that exceed the token budget before boundary
chunking so summarization LLM calls do not replay the same context error.
Reserve summarization prompt overhead from the chunk budget for large
context windows.

* refactor(OSS-128): inline message content text extraction as lambda

* refactor(OSS-128): restore _message_content_text as a function

Revert the lambda assignment to satisfy ruff E731 and keep the helper
readable alongside the LLMMessage content shape.

* refactor(OSS-128): drop summarization prompt overhead from chunk budget

Use the full context window size for message chunking instead of
subtracting a fixed prompt overhead.

* fix(OSS-128): preserve LLMMessage fields when splitting oversized content

Copy the original message attributes into each sub-message and only
replace content when expanding oversized entries for chunking.

* test(OSS-128): assert rendered summarization requests fit raw context

Verify each chunked summarization payload, including system and
instruction overhead, stays within the model limit implied by the
85% context window usage ratio.
2026-08-17 09:41:54 -07:00
..