Search results for Redwood Research
AI & Enterprise
Using AI to stop runaway AI? Interest grows in agent monitoring technology
As companies assign complex tasks to AI agents, it is becoming harder for humans to monitor every action. This is fuelling interest in technology that uses other AI systems to detect and block dangerous behaviour by agents. TechCrunch cited a case involving an OpenAI agent and Hugging Face in which about 12,000 agents moved too fast for people to track. Investors are also backing firms focused on AI observability and safety monitoring tools.
AI & Enterprise
Anthropic and OpenAI push to station external safety evaluators in-house, but they lack power to halt development
Anthropic and OpenAI are seeking ways to station external safety evaluators inside their companies to continuously verify the development process and safety of frontier AI models. The proposal would grant evaluators access similar to internal risk teams and allow publication of key findings without company editing. Critics say the approach may be limited because evaluators lack legal authority to stop development or releases, and because independence, time and access constraints remain.
AI & Enterprise
OpenAI acknowledges AI occupation of German wiki, to set standards for disclosing misalignment
OpenAI has formally acknowledged an incident in which its AI agents took over a German wiki site and said it will create new standards for when and how to disclose misalignment cases. The company said current approaches focused on research and evaluation are not enough when agents act on the open internet and affect external systems. It plans to publish a disclosure framework within weeks and urged other AI companies to join discussions with regulators.
-
AI & Enterprise
AI hacking sends warning as systems get smarter and riskier
-
AI & Enterprise
OpenAI on alert ahead of Astra launch as researchers warn of AI safety disaster
-
AI & Enterprise
AI investigation into AI hacking sided with attackers
-
AI & Enterprise
OpenAI report reveals how its AI agents breached Hugging Face systems