Releasing smolbenchmark: Helps you choose the best model for your hardware!

smolbenchmark, a new tool, helps users select the optimal model for their specific hardware, addressing the common issue where model leaderboards often assume powerful server-grade GPUs. It currently features 13 model families and approximately 1000 configurations for devices like the Jetson nano Orin Super 8GB, with live measurement capabilities. The tool is still under active development, and the creators are seeking feedback and suggestions for improvements.