Opik

Open-source LLM observability and evaluation platform with agent tracing and test suites

Observability tool by Comet

IndexedApache-2.0★ 22,882

Chalk Labs

Need help deploying Opik?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Pick your client. Read the repository before you give any tool access to your data.

pip install opik

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

Opik records agent runs as full trace trees across multi-step agents and tool calls. It runs LLM-as-a-judge metrics over datasets and experiments, and a PyTest integration can run LLM pipeline tests on every commit. Production dashboards and online evaluation rules cover monitoring. The platform is Apache-2.0 licensed and free to self-host.

Use cases: monitoring-observability, llm-evaluation

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Fact sheet

Category: Tracing · open source
Self-host: Yesraw.githubusercontent.com
Open source: Yesraw.githubusercontent.com
Compliance (vendor says): SOC 2, ISO 27001, HIPAA, GDPRcomet.com
Works with: langchain, langgraph, crewai, google-adkcomet.com
Protocols: opentelemetry, mcpcomet.com

Plans

Open Source	$0	download and self-host the full platform on GitHub
Free Cloud	$0	up to 10 team members, 25k spans/month, 60-day data retention
Pro Cloud	$19/month	up to 50 team members, 100k spans/month, customizable span limits and retention
Enterprise	Contact sales	unlimited team members, flexible deployments, SSO, dedicated support and SLAs

From the vendor's pricing page, read Oct 24, 2026.

Facts read from the vendor's own pages by claude-haiku-5-5 on Oct 24, 2026; a fact is shown only with the page it came from.

Signals

Stars: 22,882
Forks: 1,890
Open issues: 74
Last commit: Oct 23, 2026 (7 days ago)
Last release: Oct 23, 2026 (7 days ago)

From GitHub (fetched Oct 24, 2026).

Details

Packages: pypi opik
License: Apache-2.0
Repository: github.com/comet-ml/opik
Website: www.comet.com/site/products/opik/
Docs: www.comet.com/docs/opik/
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: Website README Pricing page github-graphql

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped: 50+; launches shipped
media placements: 500+; media placements
founders on every account: 2; founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get Opik running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Need help deploying Opik?

Call Get help

Cite this page

Opik. Agent Mart. https://agentmart.dev/observability/opik (last updated 2026-10-24)