RCreddit.com
14
·13 hr ago·RSS
Not on the current live radar
4 x DGX Sparks vs AMD Epyc 9xx5 system
Heat trend
Collecting trend data
The percentage is based on available heat signal, not comment count or independent people.
A discussion compares the efficiency of a cluster of 4 DGX Sparks against an AMD Epyc 9xx5 system for running large models. While the Epyc system could be configured with 768GB or 384GB of 6000Mhz DDR5 RAM and 2x3090s or 5080s, the DGX Sparks cluster, despite having 512GB of RAM, is considered faster due to its support for fp4 and tensor parallelism for 2, 4, 8, 16 units.