“There will be warning signs before we should pause AI development”1. AIs have higher IQs than the majority of humans2. They’re getting smarter fast3. They’re begging for their lives if we don’t beat it out of them.4. AI scientists put a 1 in 6 chance AIs cause human extinction5. AI scientists are quitting because of safety concerns and then being silenced as whistleblowers6. AI companies are protesting they couldn’t possibly promise their AIs won’t cause mass casualtiesI could go on all day.The time to react to an exponential curve is when it seems too early to worry, or when it’s already too late.We might not get a second chance with AI.Even the leaders of the AI companies say that this is as much a risk to humanity as nuclear war.
Let’s be careful. Let’s only move forward when we we’re very confident this won’t kill us all.