SK Hynix has started mass production of its next-generation 192GB SOCAMM2 memory module for AI servers. The company said on Sunday it has begun full-scale mass production of the product, which uses 10-nanometre-class sixth-generation (1c) LPDDR5X low-power DRAM.
SOCAMM2 (Small Outline Compression Attached Memory Module2) is a module standard that adapts low-power memory used in mobile devices such as smartphones for server environments. It uses a compression connector structure to improve signal integrity and make module replacement easier.
The company said the product offers more than double the bandwidth of existing RDIMMs (Registered Dual In-line Memory Module) and improves energy efficiency by more than 75 percent. It said this is possible because applying the 1c nanometre process enables high-density DRAM. RDIMM is a DRAM module for servers and workstations that relays signals by adding a register chip inside the memory module. SK Hynix said the product is designed to fit Nvidia's next-generation Vera Rubin platform.
Vera Rubin is Nvidia's next-generation platform specialised for agentic AI and inference processing. It is designed for multi-step problem-solving and large-scale long-context workflow processing, and is structured to boost tokens processed per watt compared with the Blackwell architecture generation by removing memory movement and communication bottlenecks. SK Hynix expects the product to help ease memory bottlenecks that arise during the training and inference of ultra-large AI models with hundreds of billions of parameters.
A bottleneck refers to a decline in overall system performance when memory data supply lags behind GPU computing speed. The company said, "As the AI market shifts from training to inference, SOCAMM2, which can run large language models (LLMs) at low power, is drawing attention as a next-generation memory solution," adding, "We stabilised the mass production system early to meet demand from global cloud service provider (CSP) customers."
Joo-sun Kim (김주선), president and CMO of SK Hynix AI Infra, said, "By supplying the SOCAMM2 192GB product, we set a new standard for AI memory performance," adding, "Based on close cooperation with global AI customers, we will establish ourselves as the AI memory solution company customers trust the most."