DuetBench–Diagnosis

Real Duet diagnosis conversations replayed from the first human turn. A blinded judge compares model responses head to head on task outcome, investigation, tool use, and communication; the four relative ratings are averaged into Diagnosis Elo.

Last updated

Main Insights

Results

DuetBench–Diagnosis results, ranked by score (diagnosis elo), highest first. Last updated .
RankModelProviderScore (Diagnosis Elo)Cost (USD / task)Duration (seconds / task)
1Claude Opus 5Anthropic1,035$3.86326
2GLM 5.3Z.ai1,032$0.9083
3Claude 5 SonnetAnthropic1,022$1.00239
4Kimi K3Moonshot AI1,011$1.22143
5GLM 5.2Z.ai1,009$0.76189
6Claude Opus 4.6Anthropic998$3.27315
7GPT-5.6 SolOpenAI990$2.12118
8GPT-5.6 TerraOpenAI952$0.5565
9GPT-5.6 LunaOpenAI951$0.1086