Fixed core invoke loop logic and relevant tests (#1865)

* Fixed core invoke loop logic and relevant tests

* Fix failing tests

* Clean up final print statements

* Additional clean up for PR review
This commit is contained in:
Brandon Hancock (bhancock_ai)
2025-01-09 12:13:02 -05:00
committed by GitHub
parent b3504e768c
commit 2131b94ddb
11 changed files with 1854 additions and 32101 deletions

View File

@@ -76,7 +76,7 @@ LLM_CONTEXT_WINDOW_SIZES = {
"mixtral-8x7b-32768": 32768,
"llama-3.3-70b-versatile": 128000,
"llama-3.3-70b-instruct": 128000,
#sambanova
# sambanova
"Meta-Llama-3.3-70B-Instruct": 131072,
"QwQ-32B-Preview": 8192,
"Qwen2.5-72B-Instruct": 8192,