Search results for KV Cache
AI & Enterprise
Dinotisia unveils KV cache compression technology to ease AI computing bottlenecks
AI infrastructure company Dinotisia said on Wednesday it has released a paper and source code for KV cache compression technology that stores previously read context on GPUs to avoid recalculation by large language models. The company said its STAR-KV technology, a joint effort involving UC San Diego’s VVIP Lab and Dinotisia researchers, was selected as an ICML 2026 Spotlight paper. It said tests showed up to 75 percent reduction and up to 20-fold compression.
Industry
AI demand debate clouds memory order visibility
Whether AI token demand is translating into real economic output has emerged as a key precondition for forecasting DRAM and high-bandwidth memory supply and demand. Executives at Computex 2026 projected token consumption to surge through 2030, while memory makers outlined capacity expansion plans. Analysts and industry sources noted, however, that AI outputs are often not captured in statistics, making it difficult to verify whether demand is structural or temporary and limiting order visibility.
AI & Enterprise
DeepSeek keeps prices 75% lower with GPT-level performance; memory efficiency seen as key
China\'s AI company DeepSeek is in talks to raise about 70 billion yuan while maintaining free model releases and a low-cost API strategy, with efficiency in computing and memory seen as its core edge. Analysts cited sharply lower memory use versus rivals and optimised cache design that cuts costs and improves inference speed even on lower-performance chips. The approach is also linked to constraints on access to Nvidia\'s newest AI chips.
-
Industry
Memory shortage shadow looms over Computex 2026 as HBM4 supply race intensifies
-
Industry
QLC SSD demand rises as HDD supply tightens on cold data surge
-
Industry
SK Hynix earnings surprise likely as NAND exports surge
-
Industry
Market uneasy despite outlook for record results at Samsung Electronics, SK Hynix
-
Industry
Dnotitia unveils AI storage strategy, aims to move beyond simple storage
-
AI & Enterprise
NC AI unveils industry-focused AI model VAETKI, cuts memory use 83 percent