2 gaming PCs + an M4 Pro MacBook over Ethernet + 2 iPhone 17 Pro Maxes over USB-C: Qwen3.8 Flash Next at 37-39 tok/s at 60k context (262k layout in the works)

A user successfully ran the Qwen 3.8 Flash Next model, a 48-layer mixture-of-experts model, by chaining together multiple devices. This setup included two gaming PCs (one with an RTX 2060 Super, another with an RX 9060 XT), an M4 Pro MacBook, and two iPhone 17 Pro Maxes. The model achieved a performance of 37-39 tokens/second at 60k context, with a 262k layout in development. The user clarified that the prefill rate on the dashboard was high due to cached prompt tokens, but the decode numbers on screen were accurate.

Unlike typical single-device setups, this report details a novel approach to running Qwen 3.8 Flash Next by chaining five consumer devices, including iPhones, to achieve 37-39 tok/s.