| Mobile Web

Search results for vLLM

Industry

Rebellions to supply large volumes of homegrown NPUs for public CCTV control

A South Korean neural processing unit (NPU) will be deployed for the first time at a public safety infrastructure site. AI chip company Rebellions said on Aug. 3 it won server infrastructure contracts for Gyeongsangnam-do Provincial Government and Ulsan Metropolitan City CCTV control centres under a public AI CCTV conversion project led by the Ministry of Science and ICT and the National Information Society Agency. It plans to deliver its server-type NPU, ATOM-Max, from August.

AI & Enterprise

Dinotisia unveils KV cache compression technology to ease AI computing bottlenecks

AI infrastructure company Dinotisia said on Wednesday it has released a paper and source code for KV cache compression technology that stores previously read context on GPUs to avoid recalculation by large language models. The company said its STAR-KV technology, a joint effort involving UC San Diego’s VVIP Lab and Dinotisia researchers, was selected as an ICML 2026 Spotlight paper. It said tests showed up to 75 percent reduction and up to 20-fold compression.

AI & Enterprise

Red Hat says shift from AI consumer to provider to control costs

Red Hat is reshaping its platform strategy for the era of AI agents, focusing on an open-source full-stack platform spanning hardware to agents. CTO Chris Wright said token prices are falling but enterprise token consumption is rising sharply, making reliance on external APIs and proprietary frontier models difficult to sustain. He urged firms to shift from paying for outside services to operating AI on their own infrastructure, backed by Red Hat AI Enterprise.