Facebook-owner Meta opens access to AI large language model

Published May 4, 2022
A man stands in front of a sign of Meta at its headquarters in Menlo Park, California, U.S. October 28, 2021.—Reuters
A man stands in front of a sign of Meta at its headquarters in Menlo Park, California, U.S. October 28, 2021.—Reuters

Facebook-owner Meta Platforms Inc is opening up access to a large language model for artificial intelligence research, the social media company said on Tuesday.

Meta said its model was the first 175-billion-parameter language model to be made available to the broader AI research community.

"Large language models" are natural language processing systems that are trained on massive volumes of text, and are capable of answering reading comprehension questions or generating new text.

In a blog post, Meta said the release of its "Open Pretrained Transformer (OPT-175B)" model would improve researchers' abilities to understand how large language models work.

Meta said restrictions on access to such models had been "hindering progress on efforts to improve their robustness and mitigate known issues such as bias and toxicity".

Artificial intelligence technology, which is a key area of research and development for several major online platforms, can perpetuate humans' societal biases around issues like race and gender. Some researchers have concerns about the harms that can be spread through large language models.

Meta said it "hoped to increase the diversity of voices defining the ethical considerations of such technologies."

The tech giant said to prevent misuse and "maintain integrity," it was releasing the model under a noncommercial license to focus on research use cases.

Meta said access to the model would be granted to academic researchers and people affiliated with the government, civil society, and academic organizations, as well as industry research laboratories. The release will include the pre-trained models and the code to train and use them.

Opinion

Editorial

Under siege
Updated 03 May, 2024

Under siege

Whether through direct censorship, withholding advertising, or sinister measures such as harassment, legal intimidation and violence, the press in Pakistan navigates a hazardous terrain.
Meddlesome ways
03 May, 2024

Meddlesome ways

AFTER this week’s proceedings in the so-called ‘meddling case’, it appears that the majority of judges...
Mass transit mess
03 May, 2024

Mass transit mess

THAT Karachi — one of the world’s largest megacities — does not have a mass transit system worth the name is ...
Punishing evaders
02 May, 2024

Punishing evaders

THE FBR’s decision to block mobile phone connections of more than half a million individuals who did not file...
Engaging Riyadh
Updated 02 May, 2024

Engaging Riyadh

It must be stressed that to pull in maximum foreign investment, a climate of domestic political stability is crucial.
Freedom to question
02 May, 2024

Freedom to question

WITH frequently suspended freedoms, increasing violence and few to speak out for the oppressed, it is unlikely that...