Cafe24 has released a service that addresses the problem of operating dispersed AI models through a single infrastructure. Cafe24 said on Monday it launched LLM Router, which enables integrated operation of more than 120 AI models, including ChatGPT, Claude and Gemini, through a single application programming interface. LLM Router is an intermediary coordination service that automatically selects, distributes and switches AI models to match user requests.

A Ministry of Science and ICT survey on value-added telecommunications service operators, released on June 3, showed that 53.2 percent of generative AI users use two or more AI platforms together. As choosing different AI tools for coding, translation, summarisation and content creation becomes common, the burden of separately managing accounts, costs and settings for each service has also increased.

Cafe24's LLM Router engine analyses the type of work in a user's request and automatically connects to models suited for coding, reasoning, translation and creation. If the scope of use is set in advance, automatic connections are made only within that range. Among multiple providers offering the same model, it automatically connects to the most suitable one based on cost, speed and throughput, and it also supports whitelist and blacklist functions to allow or exclude specific providers.

It also includes Auto Fallback, an automatic switching function in case the primary model does not respond. If the primary model fails to respond, a pre-designated alternative model automatically takes over the request. It also provides a real-time dashboard that shows, on a single screen, the cost share by model and request success and failure rates, as well as a bring-your-own-key mode that allows users to keep using their existing GPT, Claude and Gemini keys.

Chief executive Lee Jae-seok (이재석) said, "As the number of AI models rapidly increases, efficiently connecting and operating them is becoming a new challenge." He added, "We will faithfully serve as related infrastructure so users can use various AI tools more conveniently."

LLM Router is offered on a credit-based pay-as-you-go system, and it provides free credits immediately upon sign-up.