Databricks has launched Unity AI Gateway, a tool to help companies control AI costs, Axios reported on June 16.
Databricks introduced Unity AI Gateway after confirming that some customers unintentionally spent tens of millions of dollars on AI costs in a single month.
The company said it is becoming harder to predict enterprise software costs as the number of AI agents increases.
As AI agents that interact with models without human oversight spread, AI usage is rising. Scenes in which the costs exceed corporate budgets are also being frequently played out.
But existing cloud cost management tools often flag excessive spending only after it has already occurred.
Unity AI Gateway provides functions to set AI spending limits, prevent runaway spending and recommend ways to manage AI costs across multiple vendors. For tasks that use many tokens or do not require expensive models, it recommends cheaper models.
The gateway also monitors individual user sessions. Based on that, it provides feedback on the efficiency of AI use. If an employee uses the tool inefficiently, it can also remove access privileges or shift the user to a cheaper model.