AI is at the forefront of technology conversations – what it is, what it does, what it has the potential to do. Almost all these discussions pertain to the cloud or online experiences where AI helps power search, social media, and apps like ChatGPT. What many might not realize is that AI runs on devices too.

Generally speaking, AI on a device helps drive unique, personalised experiences. Next-generation neural processing units (NPUs) – domain-specific silicon within AI-enabled devices – can run AI locally instead of in the cloud, improving device performance.

Microsoft’s AI journey to date has mainly focused on assisting users running apps like Word, PowerPoint, Outlook, and Teams, or as a guide across data, e-mails, calendars, and meetings. These experiences unleash new innovation and increase productivity.At this year’s Microsoft Inspire, Matt Barlow, CVP of Windows + Surface Marketing at Microsoft, shared how Microsoft Surface devices add another layer to Microsoft’s AI story, with enhanced sensory experiences and performance.

For example, AI capabilities on Surface Pro 9 with 5G create a sharp contrast between backgrounds and a foreground image, eliminating those irksome moments when body parts, like hair or hands, disappear onscreen.  Auditory capabilities similarly separate a person’s voice from external distractions, like barking dogs and crying babies, so that only the person’s voice gets heard.

The AI-powered smart camera on Surface Hub 2S auto frames the speaker, adjusts tilt for more natural eye contact, and provides a wider view for remote participants, giving them the best possible view of the room. These types of functionality help people look and sound their best, leading to more personal connections with others.

Inside the Surface Pro 9 with 5G, next-generation NPUs enable AI to manage power and extend battery performance by offloading processing (when needed) from the central processing unit (CPU), delivering more computing power, and using less energy. Localised data increases user privacy levels, while additional layers of built-in Surface protection keep your device secure. These capabilities help drive responsible AI usage, a core part of Microsoft’s AI mission.

To gain a better understanding of these devices and how Surface brings together the full AI experience from the cloud and on the computer, watch Barlow’s talk from this year’s Microsoft Inspire event or these other sources:

    • Capture customer AI opportunities with Microsoft Surface: Harshitha Murthy, Sr Product Marketing Manager for Microsoft Surface shows viewers how Surface is developing the latest in AI technology and how partners can empower customers to modernize workforces with Surface as the endpoint.
    • The Future of Work with AI: Satya Nadella and Jared Spataro, CVP, Modern Work & Business Applications focus on how AI will power a whole new way of working for everyone.
    • The history of ARM: This article describes and reflects on the origins of Surface and Microsoft AI.
    • Microsoft Build 2022: Seth Juarez, Principal Program Manager, AI Platform at Microsoft and Harshitha Murthy, Sr Product Marketing Manager for Microsoft Surface demonstrates how AI is enabled on Surface.