According to Kuaikeji (a Chinese tech outlet), Nvidia is dramatically cutting CPU-side system memory in its next-generation Vera Rubin NVL72 AI system due to surging LPDDR5X and HBM4 memory prices. The SOCAMM modules will be halved from 192GB to 96GB per unit, while total CPU memory per system drops from 54–55TB to 28TB.
Analysts at Bernstein estimate the cost per cabinet has risen from Morgan Stanley's prior projection of $7.8 million to $9.1 million. Without the memory reduction, LPDDR5X costs would account for roughly 29% of the system's bill of materials (approximately $2.1 million), far exceeding the comfortable 20% threshold. The cut is expected to lower LPDDR5X costs from $1.2 million to $586,000 per cabinet.