MiMo V2.6 Pro almost matched GPT-6 Astra at figuring out what a user actually wants

A new benchmark, InferBench, evaluates how well frontier LLMs infer user priorities from instructions. MiMo V2.6 Pro nearly matched GPT-6 Astra, which impressively asked clarifying questions only when preferences were unstated. In contrast, Grok 4.6 sought clarification in 18 out of 64 conversations, highlighting a significant difference in their ability to understand user intent without explicit prompts. This suggests varying levels of sophistication in interpreting implicit user needs among leading LLMs.

This benchmark is the first to specifically test LLMs' ability to infer user priorities, unlike previous benchmarks that focused on explicit instructions.