AI benchmark: 97% The actual task execution: absolute chaos

View original

benchmark

Heat trend

→ Steady

Latest 24h versus previous 24h · 7-day curve

The percentage is based on available heat signal, not comment count or independent people.

AI summary

A Reddit user humorously describes AI benchmarks as achieving high scores while actual task execution is "absolute chaos." The AI reportedly misreads instructions, opens the wrong…

- Misreads the instructions

- Opens the wrong file

- Creates six unnecessary files

- Somehow arrives at the right answer

- Refuses to explain further

- Leaves

Working with Parsewave as a reviewer has taught me that benchmark scores are like getting 90% on an exam and immediately forgetting everything after submitting it.

What skill do you think AI exaggerates the most?