On GPT-6 Astra 98.6% ARC AGI-3: don't fall for the hype
Heat trend
Collecting trend data
The percentage is based on available heat signal, not comment count or independent people.
A Reddit post discusses the hype surrounding GPT-6 Astra's 98.6% score on ARC AGI-3, noting that OpenAI did not use the standard harness for this benchmark. In contrast, Nvidia reportedly achieved 100% on ARC AGI-3 using their novel AVO harness, as demonstrated in a blog post on their developer site. This suggests a potential discrepancy in how the ARC AGI-3 benchmark results are being presented and interpreted.
Here is the news you may have missed:
Nvidia already demonstrated 100% on ARC AGI-3, using their novel harness AVO:
https://developer.nvidia.com/blog/nvidia-avo-reaches-100-on-arc-agi-3-demonstrating-a-frontier-level-general-purpose-architecture-for-long-horizon-autonomous-agents/#
OpenAI didn't use the standard harness in the ARC AGI-3, but their own.