During the NVIDIA GPU Technology Conference (GTC), Micron showcased huge MCR DIMM DDR5-8800 256GB memory modules. These modules are designed for next-generation servers, especially those with Intel Xeon Scalable Granite Rapids processors. Earlier, the company announced that the new 256GB MCRDIMM modules are undergoing customer testing.
Micron displayed a large 256GB DDR5-8800 MCRDIMM, but also plans to offer standard-height MCRDIMMs. Both 256GB MCRDIMM modules are based on 32GB DDR5 blocks, but the large one accommodates 80 DRAM chips on both sides of the module, while the standard one uses 2Hi packages, meaning they heat up slightly more due to poorer heat dissipation. The module consumes about 20 watts, which is not bad, considering that the 128GB DDR5-8000 RDIMM from Micron consumes 10 watts.
Multiplexer Combined Ranks (MCR) DIMM memory has dual-rank modules that allow both ranks to operate simultaneously with the help of a special buffer. The buffer enables two physical ranks to act as if they were two separate modules working in parallel. This achieves double the performance by simultaneously receiving 128 bytes of data per cycle. The buffer operates with its own memory controller using the DDR5 protocol at a speed exceeding the standard, in this case, 8800 MT/s.
Usually, modules with two physical ranks function as a single module - when the central processor (or memory controller) retrieves data from such a module, it is limited to 64 bytes of data at a time. MCRDIMM modules double this figure, increasing performance.
Considering that Micron showcased its MCRDIMM modules at GTC, organized by NVIDIA, it is quite likely that the company is positioning these products for AI servers. Such computers typically require a huge amount of memory for training, and the new high-capacity modules will be useful. Intel Xeon Scalable Granite Rapid processors have a 12-channel memory subsystem supporting two modules per channel. By using Micron's 256GB MCRDIMM modules, a Granite Rapid-based server could have 3TB of DDR5 memory with 12 slots and 6TB of DRAM with 24 slots.
Source: Tom`s Hardware
Comments (0)
There are no comments for now