Is Strix Halo (GMKtec EVO-X2, etc.) the closest thing we have to a "dream" local LLM box?

The discussion revolves around whether Strix Halo (GMKtec EVO-X2, etc.) represents the ideal local LLM box. Initially, custom accelerators like FPGA-based systems were thought to be the future for local inference. However, current observations suggest that memory capacity, rather than raw TOPS, remains the primary bottleneck for running modern 20B-32B models at reasonable quantizations like Q5/Q6, as opposed to INT4.