Back
RCreddit.com

I think Arena has fixed the benchmark for accurate real world coding capabilities: Astra logically sits at number 1

View original
OpenAI
benchmark
Time & source
Published
09/05, 20:06
Ingested
09/05, 22:00
Source type
Dev community
Tier
Community
Source status
Sync delayed
Tier is a per-source editorial setting, not a per-item score.

A simple analysis of performance between the numbers for Fable 5 and Sol, and how they improved to Fable 5.1 and Astra shows clearly that Astra should be a better coding agent. This captures it well.