Apple Releases MGIE AI Image Editing Tool Capable of Making Detailed Edits Using Text Prompts

Apple’s MGIE AI tool for image editing was trained on multimodal large language models (MLLM).

Written by Akash Dutta, Edited by David Delima | Updated: 8 February 2024 11:59 IST

Highlights

Apple’s MGIE AI image editing tool relies on diffusion models over GAN
MGIE stands for MLLM-Guided Image Editing
Researchers say it can do Photoshop-style edits, global and local edits

Apple’s MGIE AI image editing tool is available to download from GitHub

Photo Credit: Laurenz Heymann/Unsplash

Apple researchers have released an artificial intelligence (AI)-powered image editing tool called MGIE, which is capable of editing images using simple text prompts. MGIE, which stands for MLLM-Guided Image Editing, is capable of Photoshop-style edits, global optimisation, and local edits. The AI tool was released just a few days after Apple announced in its quarterly earnings call that it has been spending a “tremendous amount of time and effort” in generative AI. The image editing model shows an improvement on currently existing AI editing tools.

Researchers from Apple and from the University of California, Santa Barbara collaborated on the efforts to develop the tool. VentureBeat reports that the paper was presented at the International Conference on Learning Representations (ICLR) 2024. A preprint version of the research paper has also been hosted on arXiv.

The AI tool is capable of doing Photoshop-style edits which include cropping, resizing, rotating, adding filters, and more. It can also add global optimisation where it can alter the brightness, contrast, sharpness, colour balance, and even add generative elements to the image. Additionally, it can perform local edits where it adds, removes, or alters one particular object or element in the image.

Apple to Add AI Features to Devices ‘Later This Year’, says CEO Tim Cook

To make an edit, users can simply write a plain text prompt such as “make the sky brighter” or “make the house bigger”, which is then interpreted as an image command and is used to increase the brightness by a certain percentage or increasing the size of the house by certain metric. Users can also provide more complicated and granular edits such as “adjust between the dark and light areas to bring out the details of the leaves and the tree trunk.” The more detailed a prompt is, the closer to the desired result it will get.

While AI-based photo editing tools such as Photoshop's Generative Fill and under testing FireFly, Canva's Magic Design, and Luminar Neo already exist, they all require the user to interact with the software to either map out the edit location or to make granular changes. Apple's MGIE, on the other hand, can do the editing entirely on its own. It uses “instruction-based image editing” or “text-guided image editing”, which is made possible by taking a unique approach to artificial intelligence frameworks.

Instead of relying on the Generative Adversarial Network (GAN) framework, the AI model uses the diffusion model which is a more advanced architecture when it comes to realistic photo generation and instruction adherence. Next, the researchers shifted to using a multimodal large language model to ensure that it was capable of translating natural language into images and showing the desired effect. Further, human evaluators were also used during the process to rank the edits, and the feedback was used to further improve the model.

Apple's First Foldable iPhone Could Be a Clamshell-Style Folding Phone

The tech giant has made the MGIE AI image editing tool available to download as an open-source project through GitHub. At the moment, it is not known whether Apple plans to use this technology for its devices or not. However, Apple CEO Tim Cook has said that the company will announce generative AI features that it has been working on, later this year, while Apple is reportedly working on new AI-powered features for the iOS 18 update that is expected to arrive later this year.

Apple Watch Ultra With microLED Display Could Show Up by the End of 2026

Is the Samsung Galaxy Z Flip 5 the best foldable phone you can buy in India right now? We discuss the company's new clamshell-style foldable handset on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.