AI & Enterprise
AI infrastructure optimisation puts focus on memory orchestration
Nvidia GPUs have accounted for a large share of AI infrastructure costs, but memory is emerging as a key factor, the article said. With hyperscalers expanding data centres, DRAM chip prices have jumped about sevenfold from a year earlier. TechCrunch reported that memory orchestration, which optimises memory so the right data reaches AI agents at the right time, is becoming important. Better orchestration can reduce token use, inference costs and server expenses, improving AI app profitability.
