MLflow Tracing

Open-source platform for tracing, evaluating and managing prompts for agents, LLMs and ML models

Observability tool by MLflow (Linux Foundation)

IndexedApache-2.0★ 28,516

Chalk Labs

Need help deploying MLflow Tracing?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Pick your client. Read the repository before you give any tool access to your data.

pip install mlflow

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

MLflow tracing captures the inputs and outputs of each step in agent and LLM applications, built on OpenTelemetry. The platform also includes evaluation with built-in metrics and LLM judges, prompt versioning and optimization, and an AI Gateway that routes requests, handles fallbacks and enforces rate limits.

Use cases: monitoring-observability, llm-evaluation

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Fact sheet

Category: Tracing · open source
Self-host: Yesraw.githubusercontent.com
Open source: Yesraw.githubusercontent.com
Protocols: opentelemetry, mcpraw.githubusercontent.com

Facts read from the vendor's own pages by claude-haiku-5-5 on Oct 24, 2026; a fact is shown only with the page it came from.

Signals

Stars: 28,516
Forks: 6,516
Open issues: 1,520
Last commit: Oct 24, 2026 (6 days ago)
Last release: Oct 21, 2026 (10 days ago)

Details

Packages: pypi mlflow
License: Apache-2.0
Repository: github.com/mlflow/mlflow
Website: mlflow.org/genai
Docs: mlflow.org/docs/latest/genai/tracing/
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: README Website Docs

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped: 50+; launches shipped
media placements: 500+; media placements
founders on every account: 2; founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get MLflow Tracing running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Need help deploying MLflow Tracing?

Call Get help

Cite this page

MLflow Tracing. Agent Mart. https://agentmart.dev/observability/mlflow-tracing (last updated 2026-10-24)