mirror of
https://github.com/crewAIInc/crewAI.git
synced 2026-04-11 13:32:34 +00:00
* fix: add path and URL validation to RAG tools Add validation utilities to prevent unauthorized file reads and SSRF when RAG tools accept LLM-controlled paths/URLs at runtime. Changes: - New crewai_tools.utilities.safe_path module with validate_file_path(), validate_directory_path(), and validate_url() - File paths validated against base directory (defaults to cwd). Resolves symlinks and ../ traversal. Rejects escape attempts. - URLs validated: file:// blocked entirely. HTTP/HTTPS resolves DNS and blocks private/reserved IPs (10.x, 172.16-31.x, 192.168.x, 127.x, 169.254.x, 0.0.0.0, ::1, fc00::/7). - Validation applied in RagTool.add() — catches all RAG search tools (JSON, CSV, PDF, TXT, DOCX, MDX, Directory, etc.) - Removed file:// scheme support from DataTypes.from_content() - CREWAI_TOOLS_ALLOW_UNSAFE_PATHS=true env var for backward compat - 27 tests covering traversal, symlinks, private IPs, cloud metadata, IPv6, escape hatch, and valid paths/URLs * fix: validate path/URL keyword args in RagTool.add() The original patch validated positional *args but left all keyword arguments (path=, file_path=, directory_path=, url=, website=, github_url=, youtube_url=) unvalidated, providing a trivial bypass for both path-traversal and SSRF checks. Applies validate_file_path() to path/file_path/directory_path kwargs and validate_url() to url/website/github_url/youtube_url kwargs before they reach the adapter. Adds a regression-test file covering all eight kwarg vectors plus the two existing positional-arg checks. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: address CodeQL and review comments on RAG path/URL validation - Replace insecure tempfile.mktemp() with inline symlink target in test - Remove unused 'target' variable and unused tempfile import - Narrow broad except Exception: pass to only catch urlparse errors; validate_url ValueError now propagates instead of being silently swallowed - Fix ruff B904 (raise-without-from-inside-except) in safe_path.py - Fix ruff B007 (unused loop variable 'family') in safe_path.py - Use validate_directory_path in DirectorySearchTool.add() so the public utility is exercised in production code Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * style: fix ruff format + remaining lint issues * fix: resolve mypy type errors in RAG path/URL validation - Cast sockaddr[0] to str() to satisfy mypy (socket.getaddrinfo returns sockaddr where [0] is str but typed as str | int) - Remove now-unnecessary `type: ignore[assignment]` and `type: ignore[literal-required]` comments in rag_tool.py Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: unroll dynamic TypedDict key loops to satisfy mypy literal-required Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * test: allow tmp paths in RAG data-type tests via CREWAI_TOOLS_ALLOW_UNSAFE_PATHS TemporaryDirectory creates files under /tmp/ which is outside CWD and is correctly blocked by the new path validation. These tests exercise data-type handling, not security, so add an autouse fixture that sets CREWAI_TOOLS_ALLOW_UNSAFE_PATHS=true for the whole file. Path/URL security is covered by test_rag_tool_path_validation.py. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * test: allow tmp paths in search-tool and rag_tool tests via CREWAI_TOOLS_ALLOW_UNSAFE_PATHS test_search_tools.py has tests for TXTSearchTool, CSVSearchTool, MDXSearchTool, JSONSearchTool, and DirectorySearchTool that create files under /tmp/ via tempfile, which is outside CWD and correctly blocked by the new path validation. rag_tool_test.py has one test that calls tool.add() with a TemporaryDirectory path. Add the same autouse allow_tmp_paths fixture used in test_rag_tool_add_data_type.py. Security is covered separately by test_rag_tool_path_validation.py. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * chore: update tool specifications * docs: document CodeInterpreterTool removal and RAG path/URL validation Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: address three review comments on path/URL validation - safe_path._is_private_or_reserved: after unwrapping IPv4-mapped IPv6 to IPv4, only check against IPv4 networks to avoid TypeError when comparing an IPv4Address against IPv6Network objects. - safe_path.validate_file_path: handle filesystem-root base_dir ('/') by not appending os.sep when the base already ends with a separator, preventing the '//'-prefix bug. - rag_tool.add: path-detection heuristic now checks for both '/' and os.sep so forward-slash paths are caught on Windows as well as Unix. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: remove unused _BLOCKED_NETWORKS variable after IPv4/IPv6 split * chore: update tool specifications --------- Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
215 lines
8.1 KiB
Plaintext
215 lines
8.1 KiB
Plaintext
---
|
||
title: Code Interpreter
|
||
description: The `CodeInterpreterTool` is a powerful tool designed for executing Python 3 code within a secure, isolated environment.
|
||
icon: code-simple
|
||
mode: "wide"
|
||
---
|
||
|
||
# `CodeInterpreterTool`
|
||
|
||
<Warning>
|
||
**Deprecated:** `CodeInterpreterTool` has been removed from `crewai-tools`. The `allow_code_execution` and `code_execution_mode` parameters on `Agent` are also deprecated. Use a dedicated sandbox service — [E2B](https://e2b.dev) or [Modal](https://modal.com) — for secure, isolated code execution.
|
||
</Warning>
|
||
|
||
## Description
|
||
|
||
The `CodeInterpreterTool` enables CrewAI agents to execute Python 3 code that they generate autonomously. This functionality is particularly valuable as it allows agents to create code, execute it, obtain the results, and utilize that information to inform subsequent decisions and actions.
|
||
|
||
There are several ways to use this tool:
|
||
|
||
### Docker Container (Recommended)
|
||
|
||
This is the primary option. The code runs in a secure, isolated Docker container, ensuring safety regardless of its content.
|
||
Make sure Docker is installed and running on your system. If you don’t have it, you can install it from [here](https://docs.docker.com/get-docker/).
|
||
|
||
### Sandbox environment
|
||
|
||
If Docker is unavailable — either not installed or not accessible for any reason — the code will be executed in a restricted Python environment - called sandbox.
|
||
This environment is very limited, with strict restrictions on many modules and built-in functions.
|
||
|
||
### Unsafe Execution
|
||
|
||
**NOT RECOMMENDED FOR PRODUCTION**
|
||
This mode allows execution of any Python code, including dangerous calls to `sys, os..` and similar modules. [Check out](/en/tools/ai-ml/codeinterpretertool#enabling-unsafe-mode) how to enable this mode
|
||
|
||
## Logging
|
||
|
||
The `CodeInterpreterTool` logs the selected execution strategy to STDOUT
|
||
|
||
|
||
## Installation
|
||
|
||
To use this tool, you need to install the CrewAI tools package:
|
||
|
||
```shell
|
||
pip install 'crewai[tools]'
|
||
```
|
||
|
||
## Example
|
||
|
||
The following example demonstrates how to use the `CodeInterpreterTool` with a CrewAI agent:
|
||
|
||
```python Code
|
||
from crewai import Agent, Task, Crew, Process
|
||
from crewai_tools import CodeInterpreterTool
|
||
|
||
# Initialize the tool
|
||
code_interpreter = CodeInterpreterTool()
|
||
|
||
# Define an agent that uses the tool
|
||
programmer_agent = Agent(
|
||
role="Python Programmer",
|
||
goal="Write and execute Python code to solve problems",
|
||
backstory="An expert Python programmer who can write efficient code to solve complex problems.",
|
||
tools=[code_interpreter],
|
||
verbose=True,
|
||
)
|
||
|
||
# Example task to generate and execute code
|
||
coding_task = Task(
|
||
description="Write a Python function to calculate the Fibonacci sequence up to the 10th number and print the result.",
|
||
expected_output="The Fibonacci sequence up to the 10th number.",
|
||
agent=programmer_agent,
|
||
)
|
||
|
||
# Create and run the crew
|
||
crew = Crew(
|
||
agents=[programmer_agent],
|
||
tasks=[coding_task],
|
||
verbose=True,
|
||
process=Process.sequential,
|
||
)
|
||
result = crew.kickoff()
|
||
```
|
||
|
||
You can also enable code execution directly when creating an agent:
|
||
|
||
```python Code
|
||
from crewai import Agent
|
||
|
||
# Create an agent with code execution enabled
|
||
programmer_agent = Agent(
|
||
role="Python Programmer",
|
||
goal="Write and execute Python code to solve problems",
|
||
backstory="An expert Python programmer who can write efficient code to solve complex problems.",
|
||
allow_code_execution=True, # This automatically adds the CodeInterpreterTool
|
||
verbose=True,
|
||
)
|
||
```
|
||
|
||
### Enabling `unsafe_mode`
|
||
|
||
```python Code
|
||
from crewai_tools import CodeInterpreterTool
|
||
|
||
code = """
|
||
import os
|
||
os.system("ls -la")
|
||
"""
|
||
|
||
CodeInterpreterTool(unsafe_mode=True).run(code=code)
|
||
```
|
||
|
||
## Parameters
|
||
|
||
The `CodeInterpreterTool` accepts the following parameters during initialization:
|
||
|
||
- **user_dockerfile_path**: Optional. Path to a custom Dockerfile to use for the code interpreter container.
|
||
- **user_docker_base_url**: Optional. URL to the Docker daemon to use for running the container.
|
||
- **unsafe_mode**: Optional. Whether to run code directly on the host machine instead of in a Docker container or sandbox. Default is `False`. Use with caution!
|
||
- **default_image_tag**: Optional. Default Docker image tag. Default is `code-interpreter:latest`
|
||
|
||
When using the tool with an agent, the agent will need to provide:
|
||
|
||
- **code**: Required. The Python 3 code to execute.
|
||
- **libraries_used**: Optional. A list of libraries used in the code that need to be installed. Default is `[]`
|
||
|
||
## Agent Integration Example
|
||
|
||
Here's a more detailed example of how to integrate the `CodeInterpreterTool` with a CrewAI agent:
|
||
|
||
```python Code
|
||
from crewai import Agent, Task, Crew
|
||
from crewai_tools import CodeInterpreterTool
|
||
|
||
# Initialize the tool
|
||
code_interpreter = CodeInterpreterTool()
|
||
|
||
# Define an agent that uses the tool
|
||
data_analyst = Agent(
|
||
role="Data Analyst",
|
||
goal="Analyze data using Python code",
|
||
backstory="""You are an expert data analyst who specializes in using Python
|
||
to analyze and visualize data. You can write efficient code to process
|
||
large datasets and extract meaningful insights.""",
|
||
tools=[code_interpreter],
|
||
verbose=True,
|
||
)
|
||
|
||
# Create a task for the agent
|
||
analysis_task = Task(
|
||
description="""
|
||
Write Python code to:
|
||
1. Generate a random dataset of 100 points with x and y coordinates
|
||
2. Calculate the correlation coefficient between x and y
|
||
3. Create a scatter plot of the data
|
||
4. Print the correlation coefficient and save the plot as 'scatter.png'
|
||
|
||
Make sure to handle any necessary imports and print the results.
|
||
""",
|
||
expected_output="The correlation coefficient and confirmation that the scatter plot has been saved.",
|
||
agent=data_analyst,
|
||
)
|
||
|
||
# Run the task
|
||
crew = Crew(
|
||
agents=[data_analyst],
|
||
tasks=[analysis_task],
|
||
verbose=True,
|
||
process=Process.sequential,
|
||
)
|
||
result = crew.kickoff()
|
||
```
|
||
|
||
## Implementation Details
|
||
|
||
The `CodeInterpreterTool` uses Docker to create a secure environment for code execution:
|
||
|
||
```python Code
|
||
class CodeInterpreterTool(BaseTool):
|
||
name: str = "Code Interpreter"
|
||
description: str = "Interprets Python3 code strings with a final print statement."
|
||
args_schema: Type[BaseModel] = CodeInterpreterSchema
|
||
default_image_tag: str = "code-interpreter:latest"
|
||
|
||
def _run(self, **kwargs) -> str:
|
||
code = kwargs.get("code", self.code)
|
||
libraries_used = kwargs.get("libraries_used", [])
|
||
|
||
if self.unsafe_mode:
|
||
return self.run_code_unsafe(code, libraries_used)
|
||
else:
|
||
return self.run_code_safety(code, libraries_used)
|
||
```
|
||
|
||
The tool performs the following steps:
|
||
1. Verifies that the Docker image exists or builds it if necessary
|
||
2. Creates a Docker container with the current working directory mounted
|
||
3. Installs any required libraries specified by the agent
|
||
4. Executes the Python code in the container
|
||
5. Returns the output of the code execution
|
||
6. Cleans up by stopping and removing the container
|
||
|
||
## Security Considerations
|
||
|
||
By default, the `CodeInterpreterTool` runs code in an isolated Docker container, which provides a layer of security. However, there are still some security considerations to keep in mind:
|
||
|
||
1. The Docker container has access to the current working directory, so sensitive files could potentially be accessed.
|
||
2. If the Docker container is unavailable and the code needs to run safely, it will be executed in a sandbox environment. For security reasons, installing arbitrary libraries is not allowed
|
||
3. The `unsafe_mode` parameter allows code to be executed directly on the host machine, which should only be used in trusted environments.
|
||
4. Be cautious when allowing agents to install arbitrary libraries, as they could potentially include malicious code.
|
||
|
||
## Conclusion
|
||
|
||
The `CodeInterpreterTool` provides a powerful way for CrewAI agents to execute Python code in a relatively secure environment. By enabling agents to write and run code, it significantly expands their problem-solving capabilities, especially for tasks involving data analysis, calculations, or other computational work. This tool is particularly useful for agents that need to perform complex operations that are more efficiently expressed in code than in natural language.
|