Google Gemini 4 scores same as GPT 6 Astra on Artificial Analysis Benchmark, while costing 40% less.

Gemini 4 has achieved strong benchmark results, scoring similarly to GPT 6 Astra on the Artificial Analysis Benchmark and costing 40% less. However, Google employees with direct access to the model report that it struggles with real-world applications, particularly certain coding tasks. Concerns also exist that by the time Gemini 4 is released to consumers, competitors like Anthropic and OpenAI will have already launched their next-generation models.

Unlike typical benchmark reports, this one includes internal employee feedback, revealing that Gemini 4 struggles with real-world coding tasks despite strong scores.