From 4eb40736615ffa2d49439cf8a9550ef1cd0dda3d Mon Sep 17 00:00:00 2001 From: "OP (oppenheimer)" <21008429+Ompragash@users.noreply.github.com> Date: Mon, 15 Jul 2024 00:41:54 +0530 Subject: [PATCH] Add Groq - OpenAI Compatible API - details (#934) --- docs/how-to/LLM-Connections.md | 11 +++++++++-- 1 file changed, 9 insertions(+), 2 deletions(-) diff --git a/docs/how-to/LLM-Connections.md b/docs/how-to/LLM-Connections.md index f1ac52e39..21361d0d3 100644 --- a/docs/how-to/LLM-Connections.md +++ b/docs/how-to/LLM-Connections.md @@ -127,7 +127,7 @@ llm = HuggingFaceHub( ``` ## OpenAI Compatible API Endpoints -Switch between APIs and models seamlessly using environment variables, supporting platforms like FastChat, LM Studio, and Mistral AI. +Switch between APIs and models seamlessly using environment variables, supporting platforms like FastChat, LM Studio, Groq, and Mistral AI. ### Configuration Examples #### FastChat @@ -144,6 +144,13 @@ OPENAI_API_BASE="http://localhost:1234/v1" OPENAI_API_KEY="lm-studio" ``` +#### Groq API +```sh +OPENAI_API_KEY=your-groq-api-key +OPENAI_MODEL_NAME='llama3-8b-8192' +OPENAI_API_BASE=https://api.groq.com/openai/v1 +``` + #### Mistral API ```sh OPENAI_API_KEY=your-mistral-api-key @@ -211,4 +218,4 @@ azure_agent = Agent( ``` ## Conclusion -Integrating CrewAI with different LLMs expands the framework's versatility, allowing for customized, efficient AI solutions across various domains and platforms. \ No newline at end of file +Integrating CrewAI with different LLMs expands the framework's versatility, allowing for customized, efficient AI solutions across various domains and platforms.