AI infrastructure software company Lablup said on Monday it will take part in the SC26 supercomputing exhibition in Chicago and showcase integrated AI infrastructure operations technology.
SC26 is an international event covering advanced computing technologies such as high-performance computing (HPC) and AI. The exhibition runs through Nov. 19. Lablup is participating for a fourth consecutive year.
Lablup will run a technical presentation program at its booth with participation from global semiconductor companies and partners as well as customers. A total of nine companies and institutions will take part, including three global chipmakers—AMD, Intel and Nvidia—and three South Korean neural processing unit (NPU) companies—Rebellions, FuriosaAI and HyperAccel.
They will share AI semiconductor-based infrastructure buildout and operations technologies, and real-world use cases. In particular, FuriosaAI will present a large language model (LLM) operations case combining its own AI accelerator with the Lablup platform, while the University of Southern California (USC) will introduce an AI computing service operations case for academic research.
Lablup will also present a "Token Factory" strategy to manage inference efficiency and operating costs for AI models at the event. It plans to introduce integrated management of heterogeneous AI accelerators through its own platform, Backend.AI, as well as technologies for managing token usage, costs and billing using "Continuum Enterprise".
It will also showcase an approach for running LLMs on closed networks in the financial sector, "AI:GO" for running AI models on personal PCs, and AI security technology using hardware-based trusted execution environments (TEE).
Lablup CEO Jungkyu Shin (신정규) said, "As AI infrastructure expands to diverse semiconductors and computing environments, the importance of software that can efficiently integrate and operate them is growing." He added, "We will promote Backend.AI's scalability and integrated operations strategy and respond to changes in the AI infrastructure market."