Facebook-Owner Meta Opens Access to Large Language Model for AI Research

Facebook-owner Meta will grant the access to academic researchers, people affiliated with government, civil society, academic organisations and industry research laboratories.

By Reuters | Updated: 4 May 2022 13:36 IST

Meta said access to model would be granted to academic researchers and people affiliated with government

Highlights

Meta said restrictions on access to such models was hindering progress
Access to the model would be granted to academic researchers
The release will include the pretrained models

Facebook-owner Meta Platforms Inc is opening up access to a large language model for artificial intelligence research, the social media company said on Tuesday.

Meta said its model was the first 175-billion-parameter language model to be made available to the broader AI research community.

"Large language models" are natural language processing systems which are trained on massive volumes of text, and are capable of answering reading comprehension questions or generating new text.

Samsung Wins Patent for a Tri-Fold Smartphone With Specialised Barrier Layer for Improved Durability

In a blog post, Meta said the release of its "Open Pretrained Transformer (OPT-175B)" model would improve researchers' abilities to understand how large language models work.

Meta said restrictions on access to such models had been "hindering progress on efforts to improve their robustness and mitigate known issues such as bias and toxicity".

Artificial intelligence technology, which is a key area of research and development for several major online platforms, can perpetuate humans' societal biases around issues like race and gender. Some researchers have concerns about the harms that can be spread through large language models.

Meta Accused of Infringing Infinity Logo, Switzerland’s Dfinity Files Lawsuit

Meta said it "hoped to increase the diversity of voices defining the ethical considerations of such technologies."

The tech giant said to prevent misuse and "maintain integrity," it was releasing the model under a noncommercial license to focus on research use cases.

Meta said access to the model would be granted to academic researchers and people affiliated with government, civil society, and academic organisations, as well as industry research laboratories. The release will include the pretrained models and the code to train and use them.

© Thomson Reuters 2022

Xiaomi 12 Pro is littered with features, but is that enough? We discuss this on Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.