The makers of popular chatbot ChatGPT say AI will power new superintelligence that will help solve the world’s most important problems and be the most consequential tech ever invented by humans.
“The vast power of superintelligence could also be very dangerous, and could lead to the disempowerment of humanity or even human extinction,” Mr. Sutskever and Mr. Leike wrote on OpenAI’s blog. “While superintelligence seems far off now, we believe it could arrive this decade.” “Currently, we don’t have a solution for steering or controlling a potentially superintelligent AI, and preventing it from going rogue,” Mr. Sutskever and Mr. Leike wrote. “Our current techniques for aligning AI, such as reinforcement learning from human feedback, rely on humans’ ability to supervise AI. But humans won’t be able to reliably supervise AI systems much smarter than us.”
The potential end of all humanity sounds bad but the OpenAI leaders said they remain hopeful they will solve the problem.