| Mobile Web

HBM supply hits limits as memory race shifts from bandwidth to utilisation

Limits on expanding high-bandwidth memory are pushing the memory industry to focus on improving resource utilisation in AI servers rather than boosting bandwidth alone. With only about 50 to 60 percent of installed server memory used for computation, companies are pursuing technologies to pool and reallocate capacity, including CXL, PIM and high-bandwidth flash. Supply constraints and rising costs reinforce the shift toward a tiered memory approach combining different memory types.