This 6-month moratorium would be better than no moratorium. I have respect for everyone who stepped up and signed it. It’s an improvement on the margin. ...He goes on to tell about how his partner sent him an email about a little girl losing her first tooth.
Many researchers steeped in these issues, including myself, expect that the most likely result of building a superhumanly smart AI, under anything remotely like the current circumstances, is that literally everyone on Earth will die. Not as in “maybe possibly some remote chance,” but as in “that is the obvious thing that would happen.” It’s not that you can’t, in principle, survive creating something much smarter than you; it’s that it would require precision and preparation and new scientific insights, and probably not having AI systems composed of giant inscrutable arrays of fractional numbers. ...
We are not ready. We are not on track to be significantly readier in the foreseeable future. If we go ahead on this everyone will die, including children who did not choose this and did not do anything wrong.
Shut it down.
Maybe I am stupid, but I did not get the point of this little anecdote at all. Is this partner his wife, or a business partner? Is the girl their daughter? What is the big deal about the tooth? Why did he have to tell us he got persmission to tell this story? Maybe someone can explain it to me.
His concern is that super-intelligent bots will take over the world, and not be aligned with human values.
My fear is that lizard people have are already taking over the world, and they do not have my values.
I couldgive examples but I try to keep my political opinions off of this blog. I refer to this essay by physicist Lawrence M. Krauss:
Astrobiology: The Rise and Fall of a Nascent ScienceOkay, no one cares about Astrobiology anyway, but more important sciences are being ruined.
Premature claims, distorted results, and ‘decolonizing’ the search for extraterrestrial intelligence. ...
The once-great science magazine, Scientific American, which has degenerated in recent years as social justice concerns have taken priority over science, published an article entitled “Cultural Bias Distorts the Search for Alien Life” (“‘Decolonizing’ the search for extraterrestrial intelligence (SETI) could boost its chances of success, says science historian Rebecca Charbonneau”).