media search

Winsage
September 5, 2024
Microsoft has revised its Recall feature policy, now requiring users to opt in rather than having it activated by default, in response to backlash and to restore user trust. The delay in the feature's launch was due to a focus on enhancing security measures. Additionally, Microsoft is developing an "intelligent media search" feature that will scan and transcribe video and audio content, although its integration with Recall is still uncertain.
Winsage
September 4, 2024
Microsoft has confirmed that its upcoming Windows Recall feature will not be uninstallable, despite earlier indications that users might have the option to disable it. The Recall feature allows users to retrieve past activities on their PCs by taking periodic screenshots of the user's desktop. It is exclusively available on Copilot+ PCs equipped with advanced neural processing units (NPUs). The feature will not be enabled by default, requiring users to opt in to use it. Security concerns have arisen after researchers reportedly bypassed Windows security protocols to access stored images, although Microsoft assures that these images will only be accessible locally to the Recall user. There are also indications of an "intelligent media search" feature in development, which could raise further security concerns. Users have experienced challenges in uninstalling other Microsoft features like Cortana, Microsoft Teams, and OneDrive, leading to uncertainty about the Recall feature's uninstallability.
Winsage
September 4, 2024
Windows Search in Windows 11 has faced criticism for its performance, prompting Microsoft to work on enhancements using artificial intelligence (AI). Reports indicate that the improvements will allow users to search through audio and video files more effectively, including a feature for searching spoken words within indexed media. This functionality will involve transcribing content, making transcripts searchable, and indexing them for efficient searching. The feature is in development and may require users to have the latest hardware, including a neural processing unit (NPU). It is expected to utilize on-device AI to address privacy concerns by processing data locally.
Winsage
September 3, 2024
The updated Recall feature has raised concerns due to its previous ability to capture screenshots of user activity, leading to fears about potential data leaks and privacy issues. While the intelligent media search aims to enhance efficiency in locating files, users are apprehensive about granting unrestricted access to their personal data.
Winsage
September 2, 2024
Microsoft is introducing an 'intelligent media search' function in a Windows 11 Canary build, which allows users to search for specific spoken words within their stored audio and video files by transcribing them. This feature, spotted in build 27695, aims to enhance user experience by enabling functionalities like locating mentions in recorded meetings and helping content creators find specific moments. Users must consent to the scanning of their media files, and an AI model will be downloaded to transcribe and index the files. The feature is similar to the previously controversial Recall feature, which faced backlash over privacy concerns. Intelligent media search will be exclusive to Copilot+ PCs, equipped with a Neural Processing Unit capable of performing at least 40 trillion operations per second. Users have expressed concerns about potential misuse of scanned information and security risks associated with the feature.
Winsage
September 2, 2024
Microsoft is exploring a feature called "intelligent media search" in the latest Windows Insider Preview Build, which allows users to search indexed video and audio files by spoken words. This feature may utilize a Neural Processing Unit (NPU) for AI processing. Users are concerned about privacy and security, particularly regarding whether they will need to grant access to all media files or if they can limit the search to specific files or folders. The feature is still in the conceptual phase, and its implementation raises questions about user consent and the potential risks associated with AI indexing of personal media content.
Winsage
September 2, 2024
In Windows 11 Insider Preview Build 27695, a new feature called 'intelligent media search' has been introduced, which will use AI to scan, scrape, and transcribe media files on users' devices. This feature allows users to perform spoken word searches across indexed audio and video files, facilitating easier content location. Unlike the previously shelved Recall feature, intelligent media search enables users to choose which files to analyze. The feature is not yet available for testing, and its rollout may be forthcoming. Users will need to consent to scanning their media files, after which an AI model will be downloaded and set up to transcribe and index the files for search functionality. It is uncertain if this feature will be exclusive to PCs compatible with Windows Copilot+ and equipped with a Neural Processing Unit (NPU) of at least 45 TOPS.
Winsage
September 1, 2024
Windows 11 preview builds are introducing a feature called "Intelligent media search," which allows users to perform content-based searches in their local audio and video files by transcribing and indexing media content using an AI model. Users will receive notifications when they can start searching by spoken words in their indexed files. It is unclear if this feature will be exclusive to Copilot+ PCs, which have advanced NPUs, but current AI capabilities are compatible with traditional Intel and AMD systems. Additionally, users of Copilot+ PCs will have the option to uninstall Recall, and these devices now support DirectML and WebNN. Affordable models with an eight-core Snapdragon X Plus processor are expected to launch in September 2024.
Winsage
September 1, 2024
Microsoft is developing a new Windows Search for Windows 11 that will use a semantic index to improve search functionality, particularly for audio and video files, leveraging artificial intelligence. The Recall feature, initially part of Microsoft Copilot+ PCs, faced privacy concerns but is expected to return in October 2024. Recall allows users to search through past activities and may soon include enhancements like "Intelligent media search," which will enable users to find specific phrases or keywords in video and audio files, including exact timestamps. This feature is linked to the Semantic search capabilities introduced during the Copilot+ event and will be exclusive to Copilot+ PCs, which have the necessary hardware to support AI models. Microsoft will also allow third-party developers to integrate natural language search capabilities into their applications. Recall AI will be available for testers in October 2024, with an option to remove it through the Control Panel.
Winsage
September 1, 2024
Build 27695 from the Windows 11 Insider Canary Channel introduces references to a feature called "intelligent media search," which will allow users to search for spoken words in local audio files and videos using a local AI model. This feature transcribes and indexes media content stored on a Windows PC, enabling seamless searches for spoken words. Users will need to consent to scan their media files, and an AI model will be downloaded and installed in the background for transcription and indexing. The feature's discovery was made by @XenoPanther on X (formerly Twitter). Microsoft has not yet commented on intelligent media search, which is linked to the Recall feature that faced privacy concerns and is set to return to Insider builds in October. Recall requires a Windows Copilot+ compatible PC with a Neural Processing Unit (NPU) and specific storage capacities, but it is unclear if intelligent media search will have similar requirements.
Search