OpenAI disbands team dedicated to mitigating existential risk of AI

A new report claims OpenAI has disbanded its Superalignmnet team, which was dedicated to mitigating the risk of a superhuman AI system.

1 minute & 14 seconds read time

The team at OpenAI that was dedicated to reducing the existential risk of the emerging technology has reportedly been disbanded, only days after two of the company's founders quit.

OpenAI disbands team dedicated to mitigating existential risk of AI 165156156

According to a new report from Wired, OpenAI's Superalignment team, which was tasked on identifying risks of advanced artificial intelligence-powered systems going rogue and endangering humanity, has been disbanded by the report, and absorbed into its numerous research and development ranks. The report states research into the risk of AI-powered systems will now be headed by OpenAI cofounder John Schulman.

Notably, Ilya Sutskever and Jan Leike, founders of OpenAI, announced only a few days ago they were departing the company. Both Sutskever and Leike were top researchers focussing on AI risk mitigation, and following his departure from the company, Leike took to X explaining he had been fighting with OpenAI leadership for quite some time about its core values but, unfortunately, reached his tipping point this week.

Furthermore, Leike said the Superaligment has been "sailing against the wind" and is struggling to get enough compute power to conduct critical research. In a nutshell, Leike said that OpenAI needs to be more focussed on security and safety of its AI models.

"Currently, we don't have a solution for steering or controlling a potentially superintelligent AI, and preventing it from going rogue. But humans won't be able to reliably supervise AI systems much smarter than us, and so our current alignment techniques will not scale to superintelligence. We need new scientific and technical breakthroughs," said the Superalignment team when it launched in July 2023

Buy at Amazon

$10 -PlayStation Store Gift Card [Digital Code]

TodayYesterday7 days ago30 days ago
Buy at Newegg
* Prices last scanned on 6/12/2024 at 10:13 am CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Jak joined the TweakTown team in 2017 and has since reviewed 100s of new tech products and kept us informed daily on the latest science, space, and artificial intelligence news. Jak's love for science, space, and technology, and, more specifically, PC gaming, began at 10 years old. It was the day his dad showed him how to play Age of Empires on an old Compaq PC. Ever since that day, Jak fell in love with games and the progression of the technology industry in all its forms. Instead of typical FPS, Jak holds a very special spot in his heart for RTS games.

Newsletter Subscription

Related Tags