Update on the “Monstrosity”. 6 BC-250 board cluster

A user has built a "Monstrosity" cluster using six BC-250 ex-mining boards, with five housed in an ASRock 4U12G case. The preferred setup involves four boards running Qwen Next Flash IQ2_XS, achieving 28 tok/s for short generations at 100k context and 24 tok/s at 50k with 115 ppt. The remaining two boards run 3.6 35b q4 at 60 tok/s with 100k context and 450 ppt. This system utilizes Llama with Vulkan and RPC over 1GB Ethernet, with a cardboard box and fans for intake cooling.

This report details a unique cluster build using six BC-250 ex-mining boards, unlike typical setups with new or purpose-built hardware.