mirror of
https://github.com/crewAIInc/crewAI.git
synced 2026-01-08 15:48:29 +00:00
Add SageMaker as a LLM provider (#1947)
* Add SageMaker as a LLM provider * Removed unnecessary constants; updated docs to align with bootstrap naming convention --------- Co-authored-by: Brandon Hancock (bhancock_ai) <109994880+bhancockio@users.noreply.github.com>
This commit is contained in:
@@ -243,6 +243,9 @@ There are three ways to configure LLMs in CrewAI. Choose the method that best fi
|
|||||||
# llm: bedrock/amazon.titan-text-express-v1
|
# llm: bedrock/amazon.titan-text-express-v1
|
||||||
# llm: bedrock/meta.llama2-70b-chat-v1
|
# llm: bedrock/meta.llama2-70b-chat-v1
|
||||||
|
|
||||||
|
# Amazon SageMaker Models - Enterprise-grade
|
||||||
|
# llm: sagemaker/<my-endpoint>
|
||||||
|
|
||||||
# Mistral Models - Open source alternative
|
# Mistral Models - Open source alternative
|
||||||
# llm: mistral/mistral-large-latest
|
# llm: mistral/mistral-large-latest
|
||||||
# llm: mistral/mistral-medium-latest
|
# llm: mistral/mistral-medium-latest
|
||||||
@@ -506,6 +509,21 @@ Learn how to get the most out of your LLM configuration:
|
|||||||
)
|
)
|
||||||
```
|
```
|
||||||
</Accordion>
|
</Accordion>
|
||||||
|
|
||||||
|
<Accordion title="Amazon SageMaker">
|
||||||
|
```python Code
|
||||||
|
AWS_ACCESS_KEY_ID=<your-access-key>
|
||||||
|
AWS_SECRET_ACCESS_KEY=<your-secret-key>
|
||||||
|
AWS_DEFAULT_REGION=<your-region>
|
||||||
|
```
|
||||||
|
|
||||||
|
Example usage:
|
||||||
|
```python Code
|
||||||
|
llm = LLM(
|
||||||
|
model="sagemaker/<my-endpoint>"
|
||||||
|
)
|
||||||
|
```
|
||||||
|
</Accordion>
|
||||||
|
|
||||||
<Accordion title="Mistral">
|
<Accordion title="Mistral">
|
||||||
```python Code
|
```python Code
|
||||||
|
|||||||
Reference in New Issue
Block a user