Ssignal
14
·11 days ago·1 signals
Archived topic · source no longer tracked
The idea: on a CPU the decode speed depends on the active params per token, not the total. My objective is trying to run a 10B at 100tok/s on a mid level PC (No GPU).
Heat trend
Collecting trend data
The percentage is based on available heat signal, not comment count or independent people.