Google is set to launch Googlebooks, featuring an AI-powered Magic Pointer cursor that enhances user interaction by allowing users to point at their screens to communicate with Gemini, Google's AI system. The Magic Pointer app will not yet be operational on existing Android devices but will allow users to set the Google app as the default assist app and use a keyboard shortcut (Meta + g) for activation. The app will include gesture control for activation through a cursor wiggle, with sensitivity settings to prevent accidental activations.
Magic Pointer will analyze user interactions to categorize intent into four core capabilities: Understand, Transform, Ideate, and Execute. It will generate up to three relevant suggestion chips based on user input, ensuring suggestions are contextually specific and framed from the user's perspective. For example, if a user inputs an image of a long email thread, the suggestions might include "Summarize key decisions," "Draft a reply," and "Suggest next steps." The output will consist solely of these suggestion chips without additional text or formatting.