Back
RCreddit.com
26
·5 hr ago·Dev community · RSS

llama.cpp: Hy3 PR + GGUFs

View original

Early stages as the model was just released yesterday, but seems to be working already. Yay!

Getting coherent output from the Q2_K, at about 10-11t/s on a 5090 + Zen 4 w/ 96GB DDR5.

https://github.com/ggml-org/llama.cpp/pull/25395

https://huggingface.co/satgeze/Hy3-1M-GGUF

TopicsLlama
Keywords#ggufs#cpp#hy3#pr
View originalreddit.com
Single source, no cross-check yet
llama.cpp: Hy3 PR + GGUFs · BuzzRadr