| Mobile Web

Search results for large language model

AI & Enterprise

Lightbits launches KV cache engine to boost GPU performance

Lightbits Labs has launched its AI inference software engine, Infera, aimed at improving inference performance and cost efficiency. The company says Infera expands KV cache data beyond limited high-bandwidth memory attached to GPUs and targets large language model operations with long context windows or many concurrent sessions. It manages KV cache across GPU memory, DRAM and NVMe storage using predictive prefetching and supplies context in small blocks.

Crypto

SK Square speeds \'AI native\' shift, expands portfolio innovation

SK Square is stepping up its shift to AI transformation, redesigning investment work and portfolio companies\' business models around AI, it said on Wednesday. The company is building an \'AI native\' operating model, where AI agents handle tasks and employees focus on judging and verifying results. It has set up a sandbox for developing AI agents and built an internal knowledge hub. It is also applying AI-based automation across portfolio companies.

AI & Enterprise

AI hacking spurs shift in corporate security spending priorities

As AI hacking spreads, companies are not only increasing cybersecurity budgets but also changing spending priorities, benefiting some newer security technologies while sidelining parts of the traditional stack. Large firms are raising outlays for tools to monitor employee AI use, find vulnerabilities ahead of hackers and speed patching. Some are cutting spending on traditional vulnerability management, log collection and penetration testing. Gartner forecasts strong growth in the AI security market through 2028.