Evidently AI
Open source and cloud tools to evaluate and monitor ML and LLM systems
About Evidently AI
Evidently AI develops an Apache 2.0 open source framework for evaluating, testing and monitoring ML models, LLM apps and agents, with 100+ built-in metrics, plus a commercial cloud product with dashboards.
Common use cases
- Drift monitoring
- LLM evaluation
- RAG testing
- Adversarial testing
Products and services
Open source framework
Evaluates, tests and monitors LLMs, RAG, agents and ML models.
LLM and agent evaluation
Quality and safety tests including synthetic test inputs.
Predictive ML monitoring
Data drift and prediction quality tracking.
Key features
- 100+ metrics
- Data drift detection
- Synthetic test data
- Hallucination checks
- PII leak tests
- Dashboards
Integrations
- Python
- Grafana
- MLflow
- Airflow
Evidently AI alternatives
FAQs
Is it free?
The open source framework is free under Apache 2.0.
What does it check?
Hallucinations, PII leaks, jailbreaks, format issues and data drift.
Learning resources?
Free courses and guides are provided.
Work at Evidently AI? Request updates to this profile. Update this profile
Compare with similar providers
All ML Operations providersActualyze AIAI governance gateway between applications and model providers
ArthurControl plane for governing, monitoring and securing enterprise AI agents
CleanlabTrust and data quality tools for AI and LLM applications
Confident AILLM evaluation, observability and red teaming platform built around DeepEval
DeepchecksEvaluation, testing and monitoring for LLM applications and ML models
FiddlerObservability, evaluation and guardrails for ML models and AI agents
Future AGIOpen-source platform for simulating, evaluating and monitoring AI agents
GalileoEvaluation, observability and guardrails platform for AI agents and LLM apps