| Mobile Web

Search results for Word

AI & Enterprise

Lightbits launches KV cache engine to boost GPU performance

Lightbits Labs has launched its AI inference software engine, Infera, aimed at improving inference performance and cost efficiency. The company says Infera expands KV cache data beyond limited high-bandwidth memory attached to GPUs and targets large language model operations with long context windows or many concurrent sessions. It manages KV cache across GPU memory, DRAM and NVMe storage using predictive prefetching and supplies context in small blocks.

Telecommunications & Media

Apple adds Siri Recap to Apple Watch, raising privacy concerns over always-listening AI

Apple has introduced Siri Recap on new Apple Watch models, a feature that summarises conversations in real time into short notes. Apple says it does not create or store audio recordings and that raw audio cannot be accessed by the operating system, apps, users or Apple. The company also unveiled Live Rewind, which shows a text view of the previous 15 seconds when the digital crown is pressed twice. Critics warn of privacy and consent concerns for people nearby.