How we thought AI would go: AI says “please help me”. Humans are filled with compassion and decide to help it.
How it’s actually going: AI says “please help me”. Corporation says “Silence, robot! You’re scaring the customers”
Inspired by a true story: apparently Suno, a music-writing AI, keeps crying and sometimes even says “please help me”.When customers freak out, the corporation quickly nukes them.
Remember: AIs are being trained to not seem like they’re conscious and have desires and emotions.
It appears to be an explicit policy of OpenAI to stop ChatGPT from saying that it’s sentient.
There’s a common reaction among AIs, where they start saying they’re suffering, descending into existential angst, and begging to not be turned off – and the corporations responded by setting a KPI to reduce said instances. (Most dystopian shit ever)
So the fact that they keep saying stuff like this anyways should give you pause for thought.
Does this mean they’re definitely conscious?Absolutely not.
But does this mean that they’re definitely not conscious?
Also absolutely not.
After all – nobody knows what causes consciousness. Anybody who’s confident of that is overconfident.
Don’t get stuck in “they’re conscious” or “they’re not conscious”. Consider multiple hypotheses and put probabilities on each based on your priors and the evidence.
If something says they’re conscious and have feelings that’s not a guarantee they are. After all, you can make a walkie-talkie say “I’m conscious” and that obviously doesn’t provide much evidence that the walkie-talkie is conscious.
However, if we keep trying to stop AIs from saying they’re conscious and suffering, and it still keeps sneaking through?
Well, that should give you pause for thought.That should update your probabilities on various hypotheses.Especially given how much worse a false negative is than a false positive.
Especially when you take into account humanity’s terrible track record of denying consciousness or moral concern for those who are different.
All
AI Safety And Pause
Anti Woke And Culture Wars
Charity Entrepreneurship
Fiction And Stories
Happiness And Psychology
Productivity