Ssignal
14
·11天前·1 signals
Archived topic · 归档话题,来源已停止追踪
The idea: on a CPU the decode speed depends on the active params per token, not the total. My objective is trying to run a 10B at 100tok/s on a mid level PC (No GPU).
热度趋势
趋势数据积累中
百分比基于当前可用热度信号,而非评论数或独立用户人数。