Exchange

Resolve

Change a delivery appointment

Pick · 10 Nov

Highest (right answers per dollar) among models at least 90% right; no pick if none qualify.

GPT-6 Luna

870 right answers per $1

$1.15 per 1,000 right

Buy at OpenAI (opens OpenAI, another site)

Model comparison

How the models compare

50 items, same for every model.
ModelRight (%)Cost per 1,000 right
GPT-6 LunaPick100$1.15
GLM-5.3 Flash90$3.15
Gemini 3.1 Flash Lite74$10.96
Claude Haiku 5.530$16.84

The test

Goes in
A delivery change in a simulated conversation
Comes out
How the conversation ends
Right means
Right outcome; all six conversation checks pass
Checked by
A program checks allowed actions, identity, available appointments, consent, booking changes and whether the final reply matches what happened.

Models testedPreview Desk

Desk · Not open yet.

If another company’s model has higher than Desk that day, we’ll link you to the highest- model before you send a job. You will still be able to use Desk.