NEW YORK: ChatGPT-maker OpenAI published on Monday its newest guidelines for gauging “catastrophic risks” from artificial intelligence in models currently being developed.

The announcement comes one month after the company’s board fired CEO Sam Altman, only to hire him back a few days later when staff and investors rebelled.

According to US media, board members had criticized Altman for favoring the accelerated development of OpenAI, even if it meant sidestepping certain questions about its tech’s possible risks.

In a “PreparednessFramework” published on Monday, the company states: “We believe the scientific study of catastrophic risks from AI has fallen far short of where we need to be.” The framework, it reads, should “help address this gap.” A monitoring and evaluations team announced in October will focus on “frontier models” currently being developed that have capabilities superior to the most advanced AI software.

The team will assess each new model and assign it a level of risk, from “low” to “critical,” in four main categories.

Only models with a risk score of “medium” or below can be deployed, according to the framework.

The first category concerns cybersecurity and the model’s ability to carry out large-scale cyberattacks.

The second will measure the software’s propensity to help create a chemical mixture, an organism (such as a virus) or a nuclear weapon, all of which could be harmful to humans.

The third category concerns the persuasive power of the model, such as the extent to which it can influence human behavior. The last category of risk concerns the potential autonomy of the model, in particular whether it can escape the control of the programmers who created it.

Published in Dawn, December 20th, 2023

Opinion

Editorial

A positive note
Updated 10 Feb, 2025

A positive note

With govt unable to press growth accelerator without upending fragile recovery, sufferings of low-middle-income households are unlikely to disappear soon.
Justice for all
10 Feb, 2025

Justice for all

ALONG with his domestic agenda, Donald Trump is busy ripping to shreds the post-World War II ‘rules-based...
Held back
10 Feb, 2025

Held back

IT is a crying shame how women are conspicuously absent from Pakistan’s civil services. Despite comprising half ...
Race against time
Updated 09 Feb, 2025

Race against time

While some bright spots emerged at Breathe Pakistan moot, we must streamline our climate governance.
Open door
09 Feb, 2025

Open door

THE door is still open for talks, National Assembly Speaker Ayaz Sadiq has reminded the PTI. What matters, however,...
Football suspension
09 Feb, 2025

Football suspension

ONCE again, Pakistan has been ousted from the global football family. FIFA recently suspended the Pakistan Football...