Intel Granite Rapids Xeon: 480MB Cache, 50% Boost

On January 22nd, reports surfaced regarding Intel's forthcoming sixth-generation Granite Rapids Xeon CPU, indicating a substantial increase in cache capacity to 480MB—a notable 50% enhancement compared to the recently unveiled fifth-generation Emerald Rapids Xeon CPU.

The fifth-generation Emerald Rapids Xeon CPU experienced a remarkable threefold surge in cache capacity, soaring from 105MB to 320MB. As per the latest entries in the Software Development Emulator (SDE) version 9.33.0 update, the highly anticipated sixth-generation Granite Rapids Xeon CPU, scheduled for release in the first half of 2024, is poised to feature an impressive 480MB of L3 cache. This significant advancement underscores Intel's commitment to competitive positioning against rival AMD.

In contrast, the standard AMD EPYC 9004 CPU boasts up to 384MB of L3 cache, reflecting a 25% increase over the previously launched Zen 4 variant in early 2023. Additionally, AMD offers the Genoa-X 3D V-Cache enhancement, showcasing an expansive 1152MB L3 cache. While Intel currently lacks a variant with such extensive cache capacity, they have articulated intentions to integrate 3D stacked cache in future chip designs. The application of this technology in Granite Rapids remains speculative, but AMD currently holds a technological edge and provides solutions for users inclined toward higher cache configurations.

According to Intel's disclosed data, the Granite Rapids Xeon CPU will be manufactured on the "Intel 3" node, introducing more cores for FP16, elevated frequencies, hardware acceleration, and support for 12 memory channels, including the novel MCR memory DIMM designed to significantly amplify memory throughput. Overall, Intel asserts a 2-3x increase in AI workloads, a 2.8x augmentation in memory throughput, and a 2.9x enhancement in DeepMD LAMMPS AI inference workloads.

The Granite Rapids Xeon CPU is set to compete with AMD's EPYC Turin chip, grounded in the Zen 5 core architecture and anticipated for release later this year. EPYC Turin is expected to deliver heightened cache capacity while adopting the 3D V-Cache "X" SKU. As AMD unveils its product, the 480MB L3 cache may not present a formidable obstacle.