fbpx
News Hub

OpenAI announces creation of safety and security committee

Written by Thu 30 May 2024

Techerati News Image

US-based AI research organisation OpenAI, best known for its ChatGPT system, has established a new Safety and Security Committee. Led by notable board members, including CEO Sam Altman, the Committee is tasked with providing recommendations to the OpenAI board on important decisions about safety and security across the business.

The first task for the Committee is to assess and develop OpenAI’s processes and safeguards over the next three months.

“At the conclusion of the 90 days, the Safety and Security Committee will share their recommendations with the full Board. Following the full Board’s review, OpenAI will publicly share an update on adopted recommendations in a manner that is consistent with safety and security,” said the company in a blog post.

Growing safety concerns have challenged companies in the AI industry to do more to ensure AI risks are accounted for properly as these models become even more advanced. OpenAI are currently training what it calls its next ‘frontier model’ that will offer more capabilities than previous models and, in the process, introduce new safety concerns.

The public launch of the safety committee comes soon after OpenAI co-founder and chief scientist, Ilya Sutskever, resigned from the company, alongside researcher Jan Leike, who ran OpenAI’s “Super Alignment” team, which has now been disbanded. In a post on X, formerly Twitter, Leike said “I have been disagreeing with OpenAI leadership about the company’s core priorities for quite some time, until we finally reached a breaking point.”

Besides CEO Sam Altman, a number of internal technical and policy experts, including Lilian Weng, Head of Safety Systems, John Schulman, Head of Alignment Science, and Matt Knight, Head of Security, will sit on the committee.

Other external consultants including Rob Joyce, a former US National Security Agency cybersecurity director, will also advise OpenAI.

Written by Thu 30 May 2024

Tags:

AI cyber security news security
Send us a correction Send us a news tip