2.3 KiB
title, description
| title | description |
|---|---|
| (AgentOps) Observability using AgentOps | Understanding and logging your agent performance with AgentOps. |
Intro
Observability is a key aspect of developing and deploying conversational AI agents. It allows developers to understand how the agent is performing, how users are interacting with the agent, and how the agent is responding to user inputs.
AgentOps is a product, idependent of crewAI that provides a comprehensive observability solution for agents.
This notebook will provide an overview of AgentOps and how to use it with crewAI.
AgentOps
AgentOps provides session replays, metrics, and monitoring for agents. AgentOps Repo
Overview
AgentOps provides monotoring for agents in development and production. It provides a dashboard for monitoring agent performance, session replays, and custom reporting.
Additionally, AgentOps provides session drilldowns that allows users to view the agent's interactions with users in real-time. This feature is useful for debugging and understanding how the agent interacts with users.
Features
- LLM Cost management and tracking
- Replay Analytics
- Recursive thought detection
- Custom Reporting
- Analytics Dashboard
- Public Model Testing
- Custom Tests
- Time Travel Debugging
- Compliance and Security
Using AgentOps
Create a user API key here: app.agentops.ai/account
Add your API key to your environment variables
AGENTOPS_API_KEY=<YOUR_AGENTOPS_API_KEY>
Install AgentOps with:
pip install crewai[agentops]
or
pip install agentops
Before using Crew in your script, include these lines:
import agentops
agentops.init()
Crew + AgentOps Examples
Futher Information
To implement more features and better observability, please see the AgentOps Repo