OpenAI GPT-4o Mini Launched As the Company’s Most Cost-Effective Small AI Model

OpenAI says the GPT-4o Mini is 60 percent cheaper than the GPT-3.5 Turbo.

Written by Akash Dutta, Edited by Manas Mitul | Updated: 19 July 2024 13:54 IST

OpenAI GPT-4o Mini Launched As the Company’s Most Cost-Effective Small AI Model

Photo Credit: Pexels/Sanket Mishra

GPT-4o Mini is also available as Assistants API, Chat Completions API, and Batch API

Highlights

GPT-4o Mini replaces GPT-3.5 Turbo as ChatGPT’s default model
The AI model has a context window of 128,000 tokens
OpenAI said GPT-4o mini scored 82 percent on MMLU benchmark

OpenAI released its latest artificial intelligence (AI) model, GPT-4o Mini, on Thursday. It is a small AI model, and the company says it is its most cost-effective model to date. While the ChatGPT maker did not specify the parameter size of the model, it highlighted that it was on par with other small language models (SLM). GPT-4o Mini is replacing GPT-3.5 Turbo on ChatGPT for all users as the default AI model. It will also be made available as application programming interface (API) for enterprises and developers.

OpenAI Releases GPT-4o Mini

In a blog post, the company announced the public release of its latest AI model. One of the main highlights of the new AI model is its cost-effectiveness. The company says it is 60 percent cheaper than GPT-3.5 Turbo, which was its previous cheapest small model. In actual numbers, processing one million input tokens will cost the company $0.15 (roughly Rs. 12), and per million output tokens will cost $0.60 (roughly Rs. 50).

Since GPT-4o Mini is a small model, it also offers low latency (time taken to show the response) which makes it one of the company's most efficient AI models. It currently supports text and vision (image processing) in the API, and OpenAI says it will support text, image, video and audio as both input and output in the future.

Whistleblowers Reportedly Accuse OpenAI of Enforcing 'Illegal' NDAs

While the AI firm did not share the parameter size of the new SLM, it revealed that GPT-4o Mini has a context window of 1,28,000 tokens and can support up to 16,000 output tokens per request (on API). Its knowledge cut-off is up to October 2023. Coming to performance, OpenAI said the AI model scored 82 percent on the Massive Multitask Language Understanding (MMLU) benchmark and outperformed the earliest model of GPT-4 on the independent AI chatbot ranking website Large Model Systems Organization's (LMSYS) leaderboard. However, the changes have not reflected on the website at the time of writing this.

OpenAI also claimed that the GPT-4o Mini outperformed Gemini Flash and Claude Haiku in reasoning text and vision-based tasks, based on its internal testing. It is also claimed to score 87 percent on the Multilingual Grade School Math (MGSM) benchmark and 87.2 percent on the HumanEval benchmark. These two benchmarks measure the AI model's math and coding proficiency, respectively.

For safety, the AI firm said it has used both automated and human evaluations as per its Preparedness Framework. The company also tested the AI model with 70 external experts from different disciplines to identify potential risks.

The GPT-4o Mini has been rolled out as the default AI model for ChatGPT for free, Plus, and Team users. The AI model will be extended to enterprise users starting next week. Further, it is also available as a text and vision model in the Assistants API, Chat Completions API, and Batch API. Fine-tuned variants of the model will also be released in the future.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: GPT, OpenAI, AI Model, LLM, AI, Artificial Intelligence

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More