AI & Enterprise
Upstage unveils 35 billion-parameter sLLM Solar Mini 4
Upstage unveiled its in-house small large language model, Solar Mini 4, on Wednesday. The model has 35 billion parameters and uses a mixture-of-experts architecture, activating 3 billion parameters during inference to reduce computation. It scored 24 points on Artificial Analysis\' Intelligence Index. Upstage said the model can run on a single GPU with quantization and be used in on-premise environments.