Update on the “Monstrosity”. 6 BC-250 board cluster
A user has built a "Monstrosity" cluster using six BC-250 ex-mining boards, with five housed in an ASRock 4U12G case. The preferred setup involves four boards running Qwen Next Flash IQ2_XS, achieving 28 tok/s for short generations at 100k context and 24 tok/s at 50k with 115 ppt. The remaining two boards run 3.6 35b q4 at 60 tok/s with 100k context and 450 ppt. This system utilizes Llama with Vulkan and RPC over 1GB Ethernet, with a cardboard box and fans for intake cooling.
This report details a unique cluster build using six BC-250 ex-mining boards, unlike typical setups with new or purpose-built hardware.
Time & source
Times shown in UTC
Display time zone: UTC
Local time zone unavailable; showing UTC.
IngestedOffset at this time: UTC+0Oct 2, 2026, 10:00 UTC
- Ingested
- Oct 2, 2026, 10:00
- Source type
- Dev community
Full text isn't available here.
Read at source →