Introducing the FFASR Leaderboard: Benchmarking ASR in the Real World

The FFASR Leaderboard, a collaboration between Treble Technologies and Hugging Face, is the first open, community-driven benchmark for evaluating ASR models in realistic far-field acoustic conditions. It addresses the significant gap between clean-speech benchmarks and real-world performance, where reverberation and noise degrade accuracy. The leaderboard uses hybrid wave-based simulation across 14 diverse rooms, validated against real measurements, to assess models' robustness. It tracks Word Error Rate (WER) and RTFx, encouraging development of models suited for complex environments like AI voice agents and in-car assistants.