Microsoft Launches ‘Correction’, an AI Feature That Can Detect and Fix AI Hallucinations

Microsoft’s Correction feature is being added to Azure AI Content Safety’s groundedness detection system.

Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 25 September 2024 18:53 IST

Photo Credit: Reuters

AI hallucination is when an AI model generates incorrect or misleading information

Highlights

Microsoft claims this capability will make AI’s responses more accurate
Correction can show an explanation after pinpointing incorrect text
To use the feature, users must connect AI systems to Azure

Microsoft launched a new artificial intelligence (AI) capability on Tuesday that will identify and correct instances when an AI model generates incorrect information. Dubbed “Correction”, the feature is being integrated within Azure AI Content Safety's groundedness detection system. Since this feature is available only through Azure, it is likely aimed at the tech giant's enterprise clients. The company is also working on other methods to reduce instances of AI hallucination. Notably, the feature can also show an explanation for why a segment of the text was highlighted as incorrect information.

Microsoft “Corrections” Feature Launched

In a blog post, the Redmond-based tech giant detailed the new feature which is claimed to battle instances of AI hallucination, a phenomenon where AI responds to a query with incorrect information and fails to recognise its falsity.

The feature is available via Microsoft's Azure services. The Azure AI Content Safety system has a tool dubbed groundedness detection. It identifies whether a response generated is grounded in reality or not. While the tool itself works in many different ways to detect instances of hallucination, the Correction feature works in a specific way.

Copilot Will Soon Let Enterprises Use the AI Chatbot Collaboratively

For Correction to work, users must be connected to Azure's grounding documents, which are used in document summarisation and Retrieval-Augmentation-Generation-based (RAG) Q&A scenarios. Once connected, users can enable the feature. After that, whenever an ungrounded or incorrect sentence is generated, the feature will trigger a request for correction.

Put simply, the grounding documents can be understood as a guideline that the AI system must follow while generating a response. It can be the source material for the query or a larger database.

Then, the feature will assess the statement against the grounding document and in case it is found to be misinformation, it will be filtered out. However, if the content is in line with the grounding document, the feature might rewrite the sentence to ensure that it is not misinterpreted.

Microsoft Will Make Windows More Resilient to CrowdStrike-Like Incidents

Additionally, users will also have the option to enable reasoning when first setting up the capability. Enabling this will prompt the AI feature to add an explanation on why it thought that the information was incorrect and needed a correction.

Microsoft to Cut 650 Jobs in Latest Round of Xbox Unit Layoffs

A company spokesperson told The Verge that the Correction feature uses small language models (SLMs) and large language models (LLMs) to align outputs with grounding documents. “It is important to note that groundedness detection does not solve for ‘accuracy,' but helps to align generative AI outputs with grounding documents,” the publication cited the spokesperson as saying.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Microsoft, Azure, AI, Artificial Intelligence, Enterprise

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More