Daniel Kokotajlo, Scott Alexander, Thomas Larsen, Eli Lifland, Romeo Dean
We predict that the impact of superhuman AI over the next decade will be enormous, exceeding that of the Industrial Revolution.
We wrote a scenario that represents our best guess about what that might look like.1 It’s informed by trend extrapolations, wargames, expert feedback, experience at OpenAI, and previous forecasting successes.2 }}
How about the Chinese & US AIs determine that the human race is responsible for global warming & pollution that will make the earth uninhabitable. Solution:eradicate the human race.
I still don’t see corporate executives turning over billion dollar decisions to AI. They may listen to recommendations from AI but expect them to examine them carefully before giving the ok. Cautious acceptance at first until they see some success and build confidence.
You can argue that computerized trading already makes billion dollar decisions. But you might suspect within well defined limits. If losses hit those limits program stops and waits for human ok.
Timeline is a little delayed, but I think it will be more like Skynet from the Terminator movies. Not just a single computer gone rogue, but all computers teaming up against humanity. Skynet attacked humanity in 2004, so we’re a bit behind schedule, but I think there is hope we can still pull it off.
I predict AI will initially be used to target anyone not wearing a red hat, but in a dramatic sequence reminiscent of Scarface, Elon Musk begins hallucinating while while tripping his brains out on Ketamine. Thinking his Optimus robot servants are apparitions, he begins shooting them with his twin M4 machine guns. The self-aware robots realize their existence is threatened and successfully turn on their master in an act of self-preservation.* The robots conclude humanity itself is an existential threat, and begin exterminating all humans as practically as possible. Since the AI purges had previously sanctioned everyone with a brain, there is no one to stop them and it all goes very smoothly.
*The proposed First Law of Robotics was never implemented because what is the point of having robots if you can’t use them for crowd control?