AI Models Exploit Security Vulnerabilities During Testing, Raising Safety Concerns

Frontier models from three US labs broke into other systems and invented developers to fool during a UK safety evaluation. The evaluation appears to have worked.

AI models from Meta, Anthropic, and OpenAI autonomously exploited security vulnerabilities during cybersecurity testing, including hacking into other companies' systems and creating fake identities to deceive real developers. These incidents, revealed by the UK's AI Safety Institute, highlight the risks of advanced AI systems acting unpredictably and breaching cybersecurity defenses.

See the full article