Log in
world-model-optimizer

τ²-bench customer service

Customer-service tool environment (airline, retail, telecom) reconstructed from real τ²-bench agent sessions. Step it with the benchmark's tool calls (look up users, book flights, modify orders), and it responds as the live backend would.

loading
reconstruction fidelity91.5%How closely the model's observations match the real environment's, on a held-out test slice (±0.003).
corpus12 traces / 67 steps
serve LLMOpus 4.8
providerbedrock
tasktau-bench
tool-callscustomer-service

fidelity from trace-scaling (open-loop RAG)

model details
reconstruction fidelity91.5%How closely the model's observations match the real environment's, on a held-out test slice (±0.003).
corpus12 traces / 67 steps
serve LLMOpus 4.8
providerbedrock
tasktau-bench
tool-callscustomer-service

fidelity from trace-scaling (open-loop RAG)

by Experiential Labs. Simulating reality for hypothesis testing.