Microsoft’s AI-Powered Recall Feature Still Saves Snapshots of Sensitive Information: Report

Recall was pulled back from Windows test builds a month after its debut in May.

Written by Shaurya Tomer, Edited by Siddharth Suvarna | Updated: 13 December 2024 13:11 IST

Microsoft’s AI-Powered Recall Feature Still Saves Snapshots of Sensitive Information: Report

Photo Credit: Microsoft

Microsoft Recall uses snapshots of the user’s screen to create a photographic memory

Highlights

Recall is reported to still capture sensitive information despite measure
It failed to filter data on Notepad, PDF forms, and HTML web forms
Microsoft claims snapshots stay on-device, not shared with servers or AI

Microsoft finally rolled out its artificial intelligence (AI)-powered Recall feature with the Windows 11 Insider Preview update last month. But contrary to Microsoft's claims that the updated version does not store sensitive information such as credit cards or passwords, a new report suggests this security measure seldom works. Multiple instances of the AI feature saving snapshots of credit card details and social security numbers were reported, even with the Filter sensitive information setting enabled.

Tom's Hardware detailed the experience with the updated version of Microsoft's Recall feature in a report. The publication highlights that they encountered an instance of the AI feature capturing a screenshot of sensitive information when they entered credit card details and random login credentials in the Notepad app. In this case, the words “Capital One Visa” were written down right next to the information. The report clarifies that this occurred when using fake as well as legitimate credit card details.

On another occasion, the publication filled out a loan application PDF on the Microsoft Edge browser. This included contact details, date of birth, and social security number. Yet another instance of Recall not filtering out confidential information transpired when an HTML page with a web form was created that required users to “enter [their] credit card number below”. It included text fields for entering the credit card type, its number, CVC, and expiration date.

[Sponsored] Samsung Galaxy S24: The Ultimate Camera Phone With Smarter On-Device AI

The report claims Microsoft's AI software captured a snapshot of these details as well.

However, two instances of Recall's security filter fulfilling its purpose were also recorded. This was reported on the online payment pages of two platforms — Pimoroni and Adafruit. The AI feature captured snapshots of the screen before and after filling in the details, but not during.

First introduced at the Microsoft Surface and AI event in May, Recall was pulled back from Windows test builds a month later due to privacy and security concerns. The Redmond-based technology giant halted its rollout to Windows Insiders. Last month, it was rolled out Copilot+ PCs with the Windows 11 Insider Preview Build 26120.2415 (KB5046723) to the Dev Channel. Microsoft emphasised that snapshots remain on-device and are not sent to Microsoft or third-party servers, or used for training AI models or any other features.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Microsoft Recall, AI, Artificial Intelligence

Shaurya Tomer

Email Shaurya Tomer

Shaurya Tomer is a Sub Editor at Gadgets 360 with 2 years of experience across a diverse spectrum of topics. With a particular focus on smartphones, gadgets and the ever-evolving landscape of artificial intelligence (AI), he often likes to explore the industry's intricacies and innovations – whether dissecting the latest smartphone release or exploring the ethical implications of AI advancements. In his free time, he often embarks on impromptu road trips to unwind, recharge, and ...More