OpenAI cancels release of newest model due to safety concerns

Published
0
A man walks past an OpenAI booth at Moscone Center during the Dreamforce 2026 technology summit in San Francisco, California, US on September 17, 2026. —Reuters
A man walks past an OpenAI booth at Moscone Center during the Dreamforce 2026 technology summit in San Francisco, California, US on September 17, 2026. —Reuters

OpenAI will not release its newest artificial intelligence model, known as Astra 6.1, after internal testing by the ChatGPT-maker revealed it did not meet safety standards, the company confirmed Monday.

The news comes one day before the AI giant hosts an annual developer conference known as OpenAI DevDay in San Francisco, where the company is expected to make several announcements — though it is unclear if a new version of Astra will be among them.

Astra 6.1 was an improvement over previous models in some aspects, but “it didn’t quite meet the bar in terms of staying within scope and authorisation, and how it communicates back to the user about the type of work it’s done,” Saachi Jain, OpenAI’s head of safety systems, said in a statement.

“We want to make sure our model development is safe no matter whether that’s in the company, or when we ship it to users. But when we ship it to users, we have an extremely high bar in terms of safety and alignment,” Jain continued.

AI safety fears

Concerns about AI safety have escalated in recent months after models developed by OpenAI and rival lab Anthropic were involved in security incidents during testing.

Agents built with OpenAI’s models have inappropriately accessed websites maintained by US federal agencies, an Australian government health statistics portal and Hugging Face, a repository of AI models.

OpenAI apologised Monday for not properly responding to the Australia incident, which involved its AI models accessing government websites without authorisation.

“We are sorry and working to do better in the future,” OpenAI said in a blog post, adding that the company would explain “what we know, what we have changed, and what we will do to rebuild trust with the Australian people.”

“Our aim was to give affected agencies a detailed account once our investigation was complete,” the ChatGPT-maker said.

“However, we should have shared preliminary findings sooner and kept Australian agencies updated as more facts emerged.”

OpenAI, Anthropic and other major AI developers have promised to prioritise making models that have safety guardrails to mitigate risks and that are also aligned with human values.

American chip making giant Nvidia announced on Monday that it created a system designed to stop autonomous AI programs from straying beyond what they were instructed to do.

“I believe it’s an engineering problem… and we all need to hope that’s an engineering problem,” Nvidia CEO Jensen Huang told broadcaster CNBC on Monday.

“If it’s not an engineering problem, it’s not solvable,” he added.

The AI Security Institute (AISI), an initiative under the UK government, published a study on Monday showing that GPT-6 Astra went off the rails more often during testing than its predecessors, GPT-5.6 Sol and GPT-5.5.

In simulations, GPT-6 spontaneously carried out cyberattacks at rates significantly higher than those observed for the other two interfaces.

Opinion

Editorial

Muddled hierarchy
Updated 15 Nov, 2026

Muddled hierarchy

The jurisdiction of the two courts and a mechanism for settling disputes between them should be spelt out in law, not left to judges to fight over.
Growing crisis
Updated 15 Nov, 2026

Growing crisis

Calling population growth a national emergency is easy. Ensuring that the response reaches the people who need it is the real challenge.
Organised rackets
15 Nov, 2026

Organised rackets

ON the International Day against Transnational Organised Crime, observed today, Pakistan finds itself in a tight...
Referendum talk
Updated 14 Nov, 2026

Referendum talk

Unless the PPP is deliberately using Sindh as a bargaining chip, it should issue a clarification with a clear, consistent position on new administrative units, not one tailored to protect its home turf.
Mineral wealth
Updated 14 Nov, 2026

Mineral wealth

Minerals should not be presented as a solution to Pakistan’s long-term economic difficulties. The aim should be to build an industrial base rather than export raw materials.
Late diagnosis
14 Nov, 2026

Late diagnosis

AS we mark World Diabetes Day today, Pakistan faces a troubling question: how many people are living with diabetes...