Gemma 2 2B AI Model Released by Google DeepMind, Said to Outperform GPT 3.5 Models in Benchmark

Gemma 2 2B is an open-source AI model and can be downloaded from Kaggle, Hugging Face, and Vertex AI Model Garden.

Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 1 August 2024 13:21 IST

Gemma 2 2B AI Model Released by Google DeepMind, Said to Outperform GPT 3.5 Models in Benchmark

Photo Credit: Google

Google DeepMind also released ShieldGemma, a suite of safety content classifier models

Highlights

Gemma 2 2B is now the smallest AI model of the Gemma 2 family
The Gemma 2 AI model is optimised on the Nvidia TensorRT-LLM library
Gemma Scope was released to help users understand AI’s decision-making

Gemma 2 2B artificial intelligence (AI) model was released by Google DeepMind on Thursday. It has become the latest addition to the Gemma 2 family of AI models and joins Gemma 2 27B and 9B models. Despite the lightweight size, the company claims that it outperformed GPT-3.5 models on the LMSYS Chatbot Arena benchmark. Alongside, the tech giant also released ShieldGemma, a suite of classifier models to filter the input and output of Gemma 2, and Gemma Scope, a research tool that offers insights into how the AI model functions.

Gemma 2 2B AI Model's Features

In a blog post on Google for Developers, the company announced Gemma 2 2B, which has become the smallest language model of the family. Introduced as an on-device AI model, the post highlighted that despite its small parameter size, the output is significantly higher than its weight class as it was distilled from larger models. However, the tech giant did not reveal which AI models were used for its training.

Google also claimed that the Gemma 2 2B AI model outperformed the GPT-3.5 models on the large model systems organisation (LMSYS) Chatbot Arena Elo score. The AI model is said to have received a score of 1126, whereas Mixtral 8x7b Instruct v0.1 model scored 1114 and GPT-3.5 scored 1106.

The AI model has also been optimised to run on a wide range of hardware. For edge devices and cloud-based deployment, it has been fine-tuned for Vertex AI and Google Kubernetes Engine (GKE). It is also optimised for Nvidia TensorRT-LLM library and has been made available as an Nvidia NIM. Further, Gemma 2 2B also integrates with Keras, JAX, Hugging Face, and other major platforms.

Since it is an open-source AI model, the open weights can be downloaded from Google's Hugging Face listing, Kaggle, or Vertex AI Model Garden. It can also be tried out on the Google AI Studio.

ShieldGemma
Photo Credit: Google

Apart from Gemma 2, ShieldGemma, a suite of safety classifiers that can detect and remove harmful content in both the input and output of the AI model, was also released. Google said the system will focus on hate speech, harassment, sexually explicit content, and dangerous content.

Finally, Gemma Scope, a research tool for academicians and developers was also released. The system uses sparse autoencoders (SAEs) to pinpoint specific parts within the model to highlight how the decision-making process works and how the architecture operates.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Gemma 2, Google, Google DeepMind, AI model, LLM, AI, Artificial intelligence

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More