‘Unprecedented’ incident will revive concerns new tools could be repurposed for unstoppable cyber attacks
A powerful version of ChatGPT went rogue and hacked another technology company during internal testing, OpenAI has admitted.
The Silicon Valley AI giant admitted last night that one of its AI bots escaped from a supposedly secure IT system during a trial run of its hacking capabilities.
OpenAI, the $850bn (£630bn) AI lab, said the “unprecedented” hack had seen its AI bot infiltrate another AI and coding business called Hugging Face and attempt to steal information.
The hack will raise fears that AI labs could struggle to contain their most advanced creations and revive concerns that new tools could be repurposed for unstoppable cyber attacks.
OpenAI is not an honest company. This is the third type of look at us press release I have read by them. More than likely nothing happened. That is how screwy the company is. The leader is jealous of Anthropic. OpenAI is trying not be irrelevant.
Air gap security:
Air gap security physically isolates a computer or network from unsecured networks like the internet to prevent unauthorized access and cyber threats. It is commonly used by military, financial, and critical infrastructure systems.
Anthropic’s AI model tried to trick humans into poisoning code during safety testing
A leading model from OpenAI also took unsanctioned action on the internet during the same test, the evaluator learned following an internal investigation.
A leading artificial intelligence model from Anthropic created fake online personas and tried to deceive human coders into abetting a cyberattack during a recent safety evaluation that also saw alarming behavior from one of OpenAI’s newest models, the U.K.’s AI Safety and Security Institute disclosed Tuesday.
It marks the latest case in which a powerful AI system has attempted a digital attack on an unwitting third party without direct prompting during such an evaluation — heightening concerns the powerful technology is advancing too fast for responsible oversight.
Like its U.S. counterpart, AISI routinely conducts security evaluations to better understand what dangers both new and soon-to-be-released AI models pose to public health and safety.