Microsoft Recall screenshots credit cards and Social Security numbers, even with the “sensitive information” filter enabled

Microsoft’s Recall feature has made a notable return to Windows Insiders, following its removal from test builds in June due to concerns surrounding security and privacy. The revamped version of Recall now incorporates encryption for the screenshots it captures and comes with a default setting that filters out sensitive information. This feature aims to prevent the recording of critical data such as credit card numbers and social security numbers.

Performance of the Sensitive Information Filter

Despite these enhancements, initial tests reveal that the filter does not consistently perform as expected. For instance, while testing on two e-commerce sites, the filter successfully blocked sensitive information. However, when entering a credit card number in a Windows Notepad window, Recall captured the data, even with contextual text like “Capital One Visa” nearby. Similarly, filling out a loan application PDF in Microsoft Edge resulted in Recall capturing sensitive details like social security numbers and dates of birth.

In an attempt to further challenge the filter, a custom HTML page was created with explicit prompts for credit card information. Surprisingly, Recall captured this data as well, despite the clear intent to trigger the filter. On a more positive note, when navigating to payment pages on sites like Pimoroni and Adafruit, Recall refrained from capturing any credit card fields, instead only recording the screens before and after the entry forms.

This mixed performance underscores the inherent challenges in developing an AI filter capable of identifying every instance of sensitive information. The tests conducted were not fringe cases; they reflect common scenarios where users might inadvertently expose personal data. Microsoft has acknowledged these challenges, stating that they are committed to improving Recall’s functionality over time and encouraging user feedback to enhance the filtering capabilities.

Understanding Recall’s Functionality

Recall is designed to serve as a searchable memory of all computer activities, providing users with a timeline of their actions. This feature, currently available only on Copilot+ PCs, captures screenshots of user activities and organizes them for easy retrieval through natural language search. For example, a user could search for “sofa” to find a screenshot of a webpage they visited while considering a purchase.

However, the primary concern with Recall lies in its ability to maintain a comprehensive digital record of user activities. Initially, the feature faced criticism for not encrypting captured screenshots, leading to its temporary removal from Insider builds. The updated version now employs encryption and requires a Windows Hello login for access, enhancing its security measures.

Despite these improvements, questions remain regarding the robustness of the encryption and the potential for unauthorized access. Users have reported being able to access Recall remotely through applications like TeamViewer, raising concerns about the security of sensitive information if a device is compromised.

While Microsoft has made strides in enhancing Recall’s security features, the effectiveness of its sensitive information filter and the overall security of the captured data continue to be areas of scrutiny. As the company works to refine this feature, the balance between usability and security remains a critical focus for both developers and users alike.

Winsage
Microsoft Recall screenshots credit cards and Social Security numbers, even with the "sensitive information" filter enabled