Would you rather:1) Risk killing everybody’s families for the chance of utopia sooner?2) Wait a bit, then have a much higher chance of utopia and lower chance of killing people?More specifically, the average AI scientist puts a 16% chance that smarter-than-all-humans AI will cause human extinction.
That’s because right now we don’t know how to do this safely, without risking killing everybody, including everybody’s families.
Including all children. Including all pets. Everybody.
However, if we figure out how to do it safely before building it, we could reap all of the benefits of superintelligent AI without taking a 16% chance of it killing us all.
This is the actual choice we’re facing right now.Some people are trying to make it seem like it’s either build the AI as fast as possible or never.But that’s not the actual choice.
The choice is between fast and reckless or delaying gratification to make it right.