返回
RCreddit.com
18
·17小时前·开发者社区 · RSS

Luth-2: New State-of-the-Art French Small Language Models

查看原文
模型发布

热度趋势

趋势数据积累中

百分比基于当前可用热度信号,而非评论数或独立用户人数。

Today we release Luth-2-0.8B and Luth2-2-2B , two non-reasoning models that set a new state of the art for French across a wide variety of tasks for their size 🚀

A few notable scores on French benchmarks compared to models 〜3 times their size:
 - Luth-2-2B scores 69.67 vs Gemma-4-E2B-it at 65.17 on Multi-IF.
 - Luth-2-0.8B scores 72.92 vs granite-4.0-h-micro at 55.60 on MGSM-Rev2.
 - Luth-2-2B scores 81.52 vs Gemma-4-E2B-it at 81.24 on Math-500.

Luth-2 builds on our previous work with several substantial improvements. We introduce a new 3B-token SFT mixture covering a broader range of domains, including mathematics, knowledge, code, tool calling, instruction following, multi-turn dialogue, and science. We also use reinforcement learning through expert specialisations and multi-domain on-policy distillation (MOPD) to further extend the models’ capabilities. Finally, we move to Qwen3.5 as the backbone, as we found it to be substantially more receptive to post-training.

The resulting models outperform every model in their size class across the selected French benchmarks, while staying competitive with much bigger models. Both are light enough to run locally for on-device use. More broadly, these results suggest that current multilingual SLMs still leave substantial capability on the table outside English, even for high-resource languages like French.

🤗 Models: Luth-2-0.8B | Luth2-2-2B | Luth-2-0.8B-GGUF | Luth2-2-2B-GGUF | 📚 Data: Luth-2-Post-Training-SFT | Luth-2-Post-Training-RL 💻 Code: https://github.com/kurakurai/Luth-2 ✏️ Blog: https://huggingface.co/blog/MaxLSB/luth-2 🏆 FR Leaderboard: https://huggingface.co/spaces/kurakurai/llm_leaderboard_fr

Luth-2: New State-of-the-Art French Small Language Models · BuzzRadr