HoloLens 2.0 will include AI capabilities

Mixing AI into mixed reality.
 By 
Lance Ulanoff
 on 
Original image replaced with Mashable logo
Original image has been replaced. Credit: Mashable

There will be a Microsoft HoloLens 2, and it will be smarter than ever.

During a speech at the 2017 Computer Vision and Pattern Recognition Conference (CVPR) on Sunday, Microsoft artificial intelligence and research group executive Harry Shum outlined plans to incorporate artificial intelligence into the mixed-reality headset.

To do so, Microsoft is building its own silicon, a brand-new AI co-processor that will be incorporated into the next version of the HoloLen's Holographic Processing Unit (HPU).

Microsoft's HoloLens is unusual in the virtual and augmented (or mixed) reality space in that it's stand-alone Windows 10 PC that blends the real world you see through the HoloLens visor with a 3D one that's projected in front of your eyes.

Unlike the immersive Oculus Rift headset, HoloLens doesn't require a tethered PC. All the processing and sensor interpretation happens locally, on the HPU, which also means it all runs off the HoloLens's single, internal battery.

Custom, native silicon is critical to building HoloLens 2.0's native AI capabilities, without introducing latency or draining the on-board battery too quickly.

Microsoft will use this new AI co-processor, which is fully programmable by Microsoft, to locally manage and implement Deep Neural Networks, a core component of AI and machine learning.

On-board AI also potentially means that the HPU, and therefore the HoloLens, could recognize new visual information more quickly and create even more impressive augmented reality interactions.

Shum apparently showed off an example of the still-under-development HPU 2.0's AI prowess during his keynote, but we were unable to find visual evidence of the demo at the time of publication.

Original image replaced with Mashable logo
Original image has been replaced. Credit: Mashable

While the promise of an AI-ready mixed reality headset is exciting, most consumers probably won't be able to experience it. HoloLens still costs between $3,000 and $5,000, depending on edition, and is not available for purchase by everyday consumers, only to certain developers. In fact, Microsoft shows no inclination to build a consumer HoloLens.

Instead, they've worked with partners to create tethered mixed reality headsets that rely on connected computers for all their processing power. It's unlikely that any of those will get the HPU 2.0.

Microsoft offered no detail on when HoloLens 2.0 with its new AI co-processor will ship.

Mashable Image
Lance Ulanoff

Lance Ulanoff was Chief Correspondent and Editor-at-Large of Mashable. Lance acted as a senior member of the editing team, with a focus on defining internal and curated opinion content. He also helped develop staff-wide alternative story-telling skills and implementation of social media tools during live events. Prior to joining Mashable in September 2011 Lance Ulanoff served as Editor in Chief of PCMag.com and Senior Vice President of Content for the Ziff Davis, Inc. While there, he guided the brand to a 100% digital existence and oversaw content strategy for all of Ziff Davis’ Web sites. His long-running column on PCMag.com earned him a Bronze award from the ASBPE. Winmag.com, HomePC.com and PCMag.com were all been honored under Lance’s guidance.He makes frequent appearances on national, international, and local news programs including Fox News, the Today Show, Good Morning America, Kelly and Michael, CNBC, CNN and the BBC.He has also offered commentary on National Public Radio and been interviewed by newspapers and radio stations around the country. Lance has been an invited guest speaker at numerous technology conferences including SXSW, Think Mobile, CEA Line Shows, Digital Life, RoboBusiness, RoboNexus, Business Foresight and Digital Media Wire’s Games and Mobile Forum.

Mashable Potato

Recommended For You



Leak: Samsung Galaxy S26 batteries include a surprising downgrade
Samsung logo on building HQ


Trending on Mashable
NYT Connections hints today: Clues, answers for April 3, 2026
Connections game on a smartphone

Wordle today: Answer, hints for April 3, 2026
Wordle game on a smartphone

Google launches Gemma 4, a new open-source model: How to try it
Google Gemma

NYT Strands hints, answers for April 3, 2026
A game being played on a smartphone.

What's new to streaming this week? (April 3, 2026)
A composite of images from film and TV streaming this week.
The biggest stories of the day delivered to your inbox.
These newsletters may contain advertising, deals, or affiliate links. By clicking Subscribe, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.
Thanks for signing up. See you at your inbox!