SK hynix Inc. announced that it has begun mass production of the 192GB SOCAMM2, a next-gen memory module standard based on the 1cnm process (6th Gen of the 10-nanometer technology) LPDDR5X low-power DRAM.SOCAMM2 ⁽¹⁾ is a module that adapts low-power memory – which was previously used mainly in mobile products like smartphones – for server environments. It is designed to be a primary memory solution for next-gen AI servers.

The company emphasized that the 1cnm based SOCAMM2 product that is now in mass production delivers more than double the bandwidth with over 75% improved power efficiency compared to conventional RDIMM ⁽²⁾, providing an optimized solution for high performance AI operations.

In particular, the company noted that its SOCAMM2 products are designed for NVIDIA Vera-Rubin platform.

SK hynix expects the new SOCAMM2 product will fundamentally resolve the memory bottlenecks encountered during the training and inference of large language model (LLM) with hundreds of billions of parameters, thereby playing a pivotal role in dramatically accelerating the processing speed of the overall system.

The company stated that with the AI market shifting focus from inference to training, SOCAMM2 is gaining significant attention as a next-gen memory solution capable of operating LLMs with low power consumption. To meet the demands of its global Cloud Service Provider (CSP) customers, SK hynix has not only been providing a supply portfolio, but also stabilized its mass production system early on.

“By supplying the 192GB SOCAMM2, SK hynix has established a new standard for AI memory performance” Justin Kim, president and head, AI Infra (CMO, chief marketing officer), SK hynix said. “We will solidify our position as the most trusted AI memory solution provider, through close collaboration with our global AI customers.”

⁽¹⁾ SOCAMM2 (Small Outline Compression Attached Memory Module 2): An AI server–optimized memory module based on LPDDR. It offers a slim form factor and high scalability, while its compression connector enhances signal integrity and allows for easy module replacement.
⁽²⁾ RDIMM (Registered Dual In-Line Memory Module): DRAM module for server/workstation that includes a register or buffer chip to relay address and command signals between the memory controller and DRAM chip in a memory module

Read also :