返回
RCreddit.com
23
·3小时前·开发者社区 · RSS

New Google launch Deepmind SL2T lets deaf users sign into their phone instead of typing

查看原文
Gemini模型发布

热度趋势

趋势数据积累中

百分比基于当前可用热度信号,而非评论数或独立用户人数。

推荐理由

Gemini 相关模型动态已经出现,适合跟踪能力变化、生态影响和后续可用性。

Google released SL2T which is a DeepMind model that turns sign language directly into text, debuting on the Pixel 11 in Gboard and Live Transcribe letting deaf and hard of hearing users sign to their phone anywhere they'd normally type and searching, writing messages, or talking to Gemini

Kind of being pioneers into a real consumer product, not just a research demo plus an on-device model tracks pose points across the face, hands, arms and torso and only sends those coordinates to the server, so raw video never leaves your phone

It also handles one-handed and left-handed signing and includes hallucination prevention so it doesn't misread you just adjusting your grip

The dataset includes training on 100,000+ hours of data across 50+ languages, about a quarter of it ASL, which is why ASL to English is the only pair supported at launch

Currently Pixel 11-only, more languages and devices planned