Search results for MMLU
AI & Enterprise
Upstage unveils \'Solar Open 2\' touting agent performance
Upstage unveiled its open-weight large language model \'Solar Open 2\' optimised for agent task execution and released the model weights on Hugging Face. Developed through a government sovereign AI foundation model project, it uses a mixture-of-experts design with 250 billion parameters and activates 15 billion in use. Upstage said it outperformed rival models on multiple benchmarks and plans broader deployments and AX services across industries.
AI & Enterprise
\"You are an expert\" prompts can backfire, lowering AI accuracy
Prompts that tell large language models \"you are an expert\" can reduce accuracy, a study found. A University of Southern California team tested six AI models with short and detailed expert-persona instructions. Complex expert prompts slightly improved writing and reasoning on MT-Bench but reduced quality in coding, math and humanities, and lowered overall performance on MMLU. Researchers said the instruction may divert resources from recalling facts. Results also showed gains in blocking unethical content on JailbreakBench.
Industry
Nvidia steps up push into South Korea\'s AI ecosystem with CUDA-style lock-in strategy
Nvidia has released 7 million synthetic Korean-language personas for free and then added the multimodal model Nemotron3 Nano Omni, signalling the rollout of a four-step lock-in package linking models, data, frameworks and hardware in South Korea. The Nemotron-Personas-Korea dataset is available on Hugging Face under a CC BY 4.0 licence. Nvidia is also expanding the Nemotron3 lineup and open-sourcing post-training tools in its Nemo framework, while tying performance to its Blackwell hardware features.