OpenAI Employees Say Company Is Neglecting Safety and Security Protocols: Report

As per the report, OpenAI planned the GPT-4o launch after-party without knowing if the model was safe to launch.

Written by Akash Dutta, Edited by Manas Mitul | Updated: 15 July 2024 14:50 IST

OpenAI Employees Say Company Is Neglecting Safety and Security Protocols: Report

Photo Credit: Unsplash/Levart_Photographer

OpenAI employees were reportedly pressured to speed through safety protocols

Highlights

OpenAI employee reportedly said that the team failed the safety process
OpenAI employees recently signed an open letter about similar concerns
In May, the AI firm created a Safety and Security Committee

OpenAI has been at the forefront of the artificial intelligence (AI) boom with its ChatGPT chatbot and advanced Large Language Models (LLMs), but the company's safety record has sparked concerns. A new report has claimed that the AI firm is speeding through and neglecting the safety and security protocols while developing new models. The report highlighted that the negligence occurred before the OpenAI's latest GPT-4 Omni (or GPT-4o) model was launched.

Some anonymous OpenAI employees had recently signed an open letter expressing concerns about the lack of oversight around building AI systems. Notably, the AI firm also created a new Safety and Security Committee comprising select board members and directors to evaluate and develop new protocols.

OpenAI Said to Be Neglecting Safety Protocols

However, three unnamed OpenAI employees told The Washington Post that the team felt pressured to speed through a new testing protocol that was designed to “prevent the AI system from causing catastrophic harm, to meet a May launch date set by OpenAI's leaders.”

OpenAI Working on Project 'Strawberry' for 'Deep Research' Capabilities

Notably, these protocols exist to ensure the AI models do not provide harmful information such as how to build chemical, biological, radiological, and nuclear (CBRN) weapons or assist in carrying out cyberattacks.

Further, the report highlighted that a similar incident occurred before the launch of the GPT-4o, which the company touted as its most advanced AI model. “They planned the launch after-party prior to knowing if it was safe to launch. We basically failed at the process,” the report quoted an unnamed OpenAI employee as saying.

This is not the first time OpenAI employees have flagged an apparent disregard for safety and security protocols at the company. Last month, several former and current staffers of OpenAI and Google DeepMind signed an open letter expressing concerns over the lack of oversight in building new AI systems that can pose major risks.

OpenAI Said to Have Revealed Five Levels to Create Superintelligent AI

The letter called for government intervention and regulatory mechanisms, as well as strong whistleblower protections to be offered by the employers. Two of the three godfathers of AI, Geoffrey Hinton and Yoshua Bengio, endorsed the open letter.

Microsoft Gives Up Observer Seat on OpenAI Board Amid Regulatory Scrutiny

In May, OpenAI announced the creation of a new Safety and Security Committee, which has been tasked to evaluate and further develop the AI firm's processes and safeguards on “critical safety and security decisions for OpenAI projects and operations.” The company also recently shared new guidelines towards building a responsible and ethical AI model, dubbed Model Spec.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: OpenAI, AI, Artificial Intelligence, GPT, LLM

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More