AI assistants

AppWizard
December 12, 2024
On a Tuesday, the author experienced a demonstration of Android XR, a new mixed reality operating system for headsets and smart glasses, featuring real-time translation through augmented reality. Google is re-entering the augmented reality market with Android XR, following the reimagining of Google Glass for enterprise use, amidst competition from Apple and Meta. Central to this initiative is Gemini, a multimodal AI that enhances interactions, capable of identifying objects and integrating with mobile apps from the Play Store. Samsung's Project Moohan, set to launch in 2025, aims to blend augmented and virtual reality with a lightweight design. The headset's features include eye calibration and context-aware communication, allowing users to interact intuitively. Google is focused on collaborating with partners and fostering developer engagement while promoting a diverse ecosystem of devices. The author noted the need for consumer acceptance and the importance of unrestricted interaction with the technology.
Winsage
November 20, 2024
Microsoft has introduced new services and products to enhance its AI agent portfolio at the Ignite 2024 conference, including significant upgrades to Copilot Studio with improved knowledge sources and tuning capabilities. The autonomous agents in Copilot Studio, currently in public preview, now feature multimodal capabilities for voice and image analysis. Updated security measures have been implemented, including encryption and data loss prevention, to ensure data protection. Microsoft plans to roll out autonomous capabilities in Copilot Studio by November. A Capgemini survey indicates that over 80% of executives intend to integrate AI agents within the next three years, with Toyota Motor Corporation already using generative AI agents. Gartner's Avivah Litan warned that by 2028, one in four enterprise breaches may be linked to AI agent misuse. KPMG is exploring AI agents but prioritizes establishing security measures before production. The deployment of agentic AI will require increased computing capacity, prompting Microsoft to develop customized chips and an Azure Boost DPU for enhanced security and workload optimization. Additionally, the Azure Integrated Hardware Security Module has been created to improve data center security.
Winsage
October 31, 2024
Microsoft's Copilot AI assistant underwent a significant update in early October, featuring a new user interface and next-generation AI capabilities, including Copilot Vision for web browsing via Edge. Access to these features requires a monthly subscription to Copilot Pro. User feedback has been largely negative, with many expressing dissatisfaction and some Microsoft employees stating that the update has "absolutely ruined" the user experience. Public ratings for Copilot have declined from 4.8 out of 5 to a surge in one-star reviews, with over 250 negative comments in October. Users criticized the update for reducing functionality, claiming it has "dumbed down" the assistant. Complaints within Microsoft's AI division include that Copilot does not perform as effectively as ChatGPT. In response, Microsoft launched Copilot Academy to help users improve their skills with the tool. ChatGPT continues to lead in the mobile AI space, especially following the launch of OpenAI's GPT-4o. Users have expressed frustration over the loss of chat history and suggested allowing toggling between old and new versions of Copilot.
Winsage
October 29, 2024
Microsoft has introduced a suite of tools, including GitHub Copilot for Azure, aimed at enhancing software development through AI. The tools are designed to reduce cognitive load on developers, who lose an average of 23 minutes per context switch between tools. A new role, the "AI engineer," is emerging as organizations integrate AI into applications. Microsoft’s tools, such as AI App Templates and GitHub Copilot, provide support for managing cloud resources and deploying applications within familiar coding environments. The rollout of these tools begins during GitHub Universe, with implications for businesses as they choose platforms that may lock them into specific ecosystems. Microsoft’s integration of GitHub Copilot with Azure positions it competitively against Amazon Web Services and Google Cloud, with 95% of Fortune 500 companies already using Azure.
Winsage
October 28, 2024
Microsoft introduced Windows Agent Arena, a benchmark for testing AI agents in realistic Windows environments. Multi-modal AI agents currently have a performance success rate of 19.5%, compared to the average human performance rating of 74.5%. The benchmark includes over 150 diverse Windows tasks and allows for evaluations in Azure, potentially completing assessments in 20 minutes. Microsoft Research developed a multi-modal agent named Navi, which demonstrated a 19.5% success rate in tasks like converting a website to a PDF. Privacy and security concerns are highlighted, with Microsoft recalling the Windows Recall feature to enhance user security. The open-source framework promotes research and the development of reliable AI models, with an emphasis on responsible AI practices. Other companies, like Anthropic, are also advancing AI capabilities, exemplified by their new API "Computer Use" for human-like interactions with computers.
Winsage
October 5, 2024
The latest version of Microsoft Copilot features a warmer, more approachable interface, reflecting Microsoft's goal to redefine AI as more than just a productivity tool. The concept of "agentic" AI, which can interact with apps and devices on behalf of users, is gaining interest, although many implementations still feel incomplete. OpenAI has secured .6 billion in funding and must now demonstrate effective investment strategies. A group of students has integrated facial recognition technology into smart glasses, and Sonos is attempting a comeback after app-related issues. The future of WordPress is uncertain, and the lightning round included farewells to cohost Alex Cranz, discussions on the Dish and DirecTV merger, Nintendo's actions against emulators, and Google's new web app for headphone management.
Search