Version 1 · November 2026 · AutomationBench · 250 tasks · 750 paired runs · Claude Opus 5.5
Recurring automation benchmark
Type.com vs Claude Code (Opus 5.5)
Repeat runs were 30× faster on 97% less model spend than Claude Code, with no loss in accuracy.
- faster repeat runs
- 30×
- less model spend
- 97%