Tuesday, June 11, 2024

Situational Awareness

The AI world is buzzing with the predictions of Leopold Aschenbrenner. It has some overlap with the AI doomsayers who say AGI superintelligence will take over the world, except that he has inside knowledge from OpenAI, and he has specific arguments how it is all going to happen in the next five years.

Scott Aaronson raves about the analysis.

Interestingly, Aschenbrenner sees his fellow AI researchers as being among the first to be put out of work by the new superintelligence. There is a global arms race to create the best AI, and by 2030, the winner will be doing its own research to improve itself. No humans needed, except to keep mounting Nvidia computers into server farms.