Mistral Large 2 Open Source AI Model Released, Said to Be on Par With Meta Llama 3.1 405B

Mistral Large 2 AI model has a 1,28,000 tokens context window.

Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 25 July 2024 18:28 IST

Mistral Large 2 Open Source AI Model Released, Said to Be on Par With Meta Llama 3.1 405B

Photo Credit: Unsplash/BoliviaInteligente

The company says Mistral Large 2 can follow and retain context of long multi-turn conversations

Highlights

The AI model comes with 123 billion parameters
Mistral Large 2 AI model supports more than 80 coding languages
The AI model will be available for research and non-commercial usage

Mistral released the new generation of its flagship open-source artificial intelligence (AI) model, Mistral Large 2, on Wednesday. The company claims the AI model offers significantly improved capabilities in code generation, mathematics, and reasoning. It also gets support for several new languages as well as advanced function calling capabilities. It is also said that despite being one-third the size of recently released Meta Llama 3.1 405B AI model, Mistral's flagship large language model (LLM) offers similar performance. Notably, Mistral Large 2 is only available for research and non-commercial usages.

Mistral Large 2 Features

The company announced the AI model in a newsroom post. The Mistral Large 2 comes with 1,28,000 tokens context window, which is similar to Meta's latest AI offering. Additionally, the flagship Mistral AI model supports several new languages including Arabic, Chinese, French, German, Hindi, Italian, Japanese, Korean, Portuguese, Russian, and Spanish. Alongside, it can also generate code in more than 80 coding languages.

Mistral's new AI model has a size of 123 billion parameters, and can run on a single node. The company said there were three main focus areas to improve the Large 2 model. First was code generation and the LLM was trained on a large volume of coding data. Second, to improve its reasoning capability and minimise instances of hallucination, the AI firm fine-tuned the model to be more cautious in responses. Finally, the AI model was trained to “acknowledge when it cannot find solutions or does not have sufficient information to provide a confident answer.”

Mistral Launches 8X22B AI Mixture of Experts Model in Open Source

Despite being one-third the size of Llama 3.1 405B, the company claims that its LLM outperforms it. Based on its internal benchmark testing, Mistral said its AI model fared better in code generation and math performance. It also claimed to outperform GPT-4o in Java code generation.

Further, the company claims that the Mistral Large 2 has enhanced function calling and retrieval skills that allows it to power complex business applications. Function calling is a capability of AI models to interact with external tools or functions. This allows them to procure data from various sources and provide more accurate, informative, and efficient responses.

The company has partnered with Google Cloud Platform to bring the Large 2 AI model to Vertex AI via a managed application programming interface (API). It also available on cloud via Azure AI Studio, Amazon Bedrock, and IBM Watsonx. Since it is an open source AI model, interested individuals can also access the LLM via its website under the name mistral-large-2407.

To download the instruct model, users can check its HuggingFace listing. Notably, it is available under the Mistral Research Licence which only allows usage and modification for research and non-commercial usages.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Mistral, AI Model, LLM, AI, Artificial Intelligence, Meta, Meta AI, LLama

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More