3k$ 128GB VRAM + 256GB RAM DDR4 Server

A user built a home inference server with 128GB VRAM and 256GB RAM DDR4 for $3k, after returning a Lenovo p620 workstation due to proprietary issues. The server, initially disappointing with Qwen3.8-27b speeds, now performs well with Qwen3.8-next-flash Autoround W4A16, achieving 1.3k prefill and 70tg code/60tg prose on 128k+ context using MTP-2 on a vllm fork. The user is satisfied and hopes for future optimizations.

This report details a custom home server build achieving 128GB VRAM and 256GB RAM for $3k, unlike commercial options, and includes specific performance metrics for Qwen3.8-next-flash.