Windows 11, specifically the 24H2 version, will bring additional AI-based features that can run locally on Copilot+ PCs. Contrary to what some may think, this integration is not limited to surface-level web responses.
Third-party app developers will have the opportunity to leverage AI capabilities in their applications as well.
Copilot+ PCs, equipped with a combination of CPU, GPU, and NPU, are enabling Microsoft's AI integration plans for Windows 11. These powerful machines are capable of processing AI tasks locally, making them ideal for complex AI models. Microsoft encourages developers to take advantage of this hardware to enhance the performance of their Windows apps.
Incorporating AI Features in Third-Party Apps
To provide developers with comprehensive guidance, Microsoft has published a support document that outlines the scope of AI integration in non-native Windows apps.
The document covers various AI concepts, including AI models, AI frameworks like OnnxRuntime, and recommended programming languages such as C#, C++, and Python for developing Windows apps.
The support document recommends utilizing AI models, either locally or cloud-hosted, to incorporate AI capabilities into Windows client apps. Developers can leverage AI frameworks like OnnxRuntime to optimize the integration experience.
local and cloud-based AI-backed APIs offered by Microsoft
Microsoft provides developers with the Microsoft Copilot Runtime, which offers a range of local AI-backed APIs as well as cloud-based AI-backed APIs. These APIs enable developers to integrate various AI features into their applications.
Some examples of these APIs include Phi Sillica for text generation, OCR for text recognition, and DALL-E for image generation. Developers can access detailed information and code snippets on the official Microsoft learning page.
Using DirectML for enhanced real-time performance in apps and games
DirectML, a machine learning API, allows developers to offload machine learning tasks to GPUs, thereby improving real-time performance in apps and games. By harnessing the power of DirectML, developers can ensure their applications deliver optimal performance while utilizing AI-based features.
More AI Features in Windows 11 Apps
Native Windows apps like Microsoft Photos and Paint have already incorporated AI features for tasks such as transforming images and producing images.
Microsoft envisions a future where third-party app developers can leverage AI to create full-fledged applications capable of generating images, videos, and audio.
AI-focused applications are capable of automating activities such as responding to messages and creating reports or summaries. The possibilities are vast, and developers have the opportunity to unlock the true potential of AI in their applications.