τ²-bench (tau-bench)
Simulated customer-service benchmark where an agent follows domain policies and uses tools while a simulated user also acts.
Reference by Sierra
Chalk Labs
Need help deploying τ²-bench (tau-bench)?
Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.
About
Use cases: llm-evaluation, customer-support
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
About the benchmark
- Benchmark site
- taubench.com/
- Current version
- v2.0.0 (adds six languages and voice)github.com
- Maintainer
- Sierrataubench.com
- Launched
- 2025-06arxiv.org
- Leaderboard
- taubench.com/
We link to the official leaderboard instead of copying scores. Benchmarks get gamed and saturate; we never use them to rank listings.
Signals
- Stars
- 2,310
- Forks
- 606
- Open issues
- 132
- Last commit
- Oct 24, 2026 (6 days ago)
- Last release
- Oct 20, 2026 (11 days ago)
From GitHub (fetched Oct 24, 2026).
Details
- Version
- v2.0.0 (adds six languages and voice)
- License
- MIT
- Repository
- github.com/sierra-research/tau2-bench
- Website
- taubench.com/
- Docs
- taubench.com/
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
More from Sierra
Done for you
Rather not set it up yourself?
Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.
See how we build AI agents →Read the case studies
Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.
- launches shipped
- 50+
- launches shipped
- media placements
- 500+
- media placements
- founders on every account
- 2
- founders on every account
Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block
Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.
Get τ²-bench (tau-bench) running in your business
Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.
Cite this page
τ²-bench (tau-bench) benchmark. Agent Mart. https://agentmart.dev/reference/tau2-bench (last updated 2026-10-24)