Introducing the FFASR Leaderboard: Benchmarking ASR in the Real World

Back to Articles

- Why far-field evaluation matters

- How the benchmark is constructed

- What the data already shows

- How to submit

- What is coming next

🚀 First open far-field ASR benchmark: community-driven evaluation across 14 simulated rooms, validated against real-world measurements: https://huggingface.co/spaces/treble-technologies/ffasr

📉 The gap is real and it is large: across all submitted models, far-field WER at low SNR is consistently several times higher than near-field WER on the same speech content

🔬 Methodology you can trust: hybrid wave-based simulation, sim-to-real validation, moving-source splits in beta, held-out audio, and standardized evaluation hardware across all submissions

⚡ Accuracy and speed together: the Pareto front plots average WER against RTFx so you can evaluate the tradeoff that is right for your deployment

👀 More is coming: multi-talker scenarios, microphone array support, and echo cancellation are on the roadmap

The gap between benchmark performance and real-worl