Devin AI 207079e562 Fix CSVKnowledgeSource token limit issue with batching ...

- Add batch_size parameter to BaseFileKnowledgeSource (default: 50)
- Modify _save_documents to process chunks in batches
- Add comprehensive tests for large file handling and batching
- Ensure backward compatibility with existing code

Fixes #3574

Co-Authored-By: João <joao@crewai.com>

2025-09-22 10:06:40 +00:00

30 KiB

Raw Blame History

View Raw