October unfolded as a vibrant month, showcasing a plethora of applications that harness the capabilities of the Neural Processing Unit (NPU) on the new Copilot+ PCs, facilitating the deployment of AI innovations on the Windows platform. The diverse hardware ecosystem of Windows provides developers with an array of options, empowering them to create and implement AI solutions seamlessly. From client applications to web-based services, DirectML, foundational to Windows Copilot Runtime, is designed to simplify the scaling of AI innovations across Windows environments. By utilizing a unified, cross-hardware DirectX API, DirectML ensures compatibility across various hardware architectures, local device accelerators, and machine learning frameworks, fostering an open AI platform on Windows.
Adobe® Premiere® Pro is the first Adobe app to leverage NPU on Copilot+ PCs, powered by Intel® Core™ Ultra and DirectML
Adobe continues to lead the charge in machine learning for creative professionals, integrating a multitude of hardware-accelerated features across its product suite. The latest advancement comes with Adobe Premiere Pro, which now taps into the machine learning capabilities of Intel’s Core Ultra processors, expanding the possibilities for its users.
In collaboration with Intel and Microsoft, Adobe has introduced the Audio Category Tagger, a beta feature that utilizes Intel’s latest generation NPU via DirectML in Premiere Pro. This innovative tool automatically tags audio clips, categorizing them as sound effects, music, dialogue, or ambience, thereby streamlining the editing process for creatives. Each audio clip is marked with an Essential Sound Badge, which, when clicked, opens the Essential Sound Panel, providing access to the necessary parameters for that sound category.
<figure id="attachment57164″ aria-describedby=”caption-attachment-57164″ class=”wp-image wp-image–caption aligncenter”><figcaption id="caption-attachment57164″ class=”wp-caption-text”>Audio Category Tagger labeling A. Music B. SFX C. Dialogue D. Ambience
This partnership with Adobe exemplifies the potential of DirectML, as Adobe’s extensive array of applications and AI-driven scenarios serves as a unique testing ground for these innovations. The collaboration aims to enhance GPU- and NPU-accelerated applications further.
Capture One to bring NPU-enhanced Match Look and AI Crop features to Copilot+ PCs
Capture One, a leading imaging software favored by commercial studio photographers in the fashion and e-commerce sectors, is set to unveil two advanced AI-powered features on Copilot+ PCs, driven by the Qualcomm NPU. These innovations were showcased at the Snapdragon Summit, highlighting Capture One’s commitment to enhancing the creative process.
<figure id="attachment57165″ aria-describedby=”caption-attachment-57165″ class=”wp-image wp-image–caption aligncenter”><figcaption id="caption-attachment57165″ class=”wp-caption-text”>The Match Look feature being applied to an image in Capture One
The new Match Look tool allows users to instantly replicate the style or edits of a reference image, whether it originates from a previous project, a film still, or a mood board. Utilizing AI selection, this feature dynamically adjusts multiple editing sliders, providing a robust starting point for editing and color grading.
<figure id="attachment57167″ aria-describedby=”caption-attachment-57167″ class=”wp-image wp-image–caption aligncenter”><figcaption id="caption-attachment57167″ class=”wp-caption-text”>The AI Crop feature in use in Capture One
Additionally, the AI Crop feature enables users to achieve instant and consistent cropping, minimizing errors and reducing manual effort. By setting a crop reference on a single image, users can automatically generate consistent crops for all other images, even during the shooting process. Capture One’s integration of AI innovation aligns with its mission to preserve the creative artistry demanded by photographers, and DirectML is excited to support this vision.
Affinity Photo 2 accelerates Object and Subject Selection capabilities with NPU
Affinity Photo 2, a widely used image-editing application among digital creators, is embracing AI to enhance artist workflows. The introduction of AI-enhanced tools aims to eliminate tedious tasks, allowing creators to focus on their artistic expression. By leveraging DirectML on Copilot+ PCs, Affinity Photo 2 is set to scale these innovative features to its vast user base. As highlighted during the Snapdragon Summit, the optimized workflow of these AI experiences is powered by the Qualcomm® Hexagon NPU within the Snapdragon® X Elite Compute Platform.
The newly announced Object Selection feature automates the labor-intensive process of creating layer masks, utilizing machine learning to swiftly isolate and segment objects within an image. This automation provides artists with a shortcut to engage in the more creative aspects of their work, such as applying visual adjustments and effects to specific areas of an image. With the Qualcomm® Hexagon NPU, Object Selection tasks will significantly enhance overall efficiency and productivity for creators.
<figure id="attachment57168″ aria-describedby=”caption-attachment-57168″ class=”wp-image wp-image–caption aligncenter”><figcaption id="caption-attachment57168″ class=”wp-caption-text”>Object Selection being applied within Affinity Photo 2
Affinity is committed to identifying machine learning innovations that fulfill the promise of rapid, powerful, and precise image editing software, and DirectML looks forward to expanding this promise across the diverse hardware landscape of Windows.
What’s next?
The DirectML team remains enthusiastic about the creative and innovative ways developers are utilizing AI to enhance user experiences across Windows. As we continue to invest in features that support an open AI platform on Windows, more DirectML capabilities are on the horizon. For those eager to learn more about DirectML and to get started, visit aka.ms/directml or join us at various sessions during Microsoft Ignite.
