Microsoft is going full on 'Minority Report' in Windows 10

Leave your mouse behind.
 By 
Lance Ulanoff
 on 
Original image replaced with Mashable logo

Blame Tom Cruise.

Ever since Minority Report hit theaters in 2002 we've dreamed of controlling interfaces with our hands just like Cruise's crime-fighting character did in Steven Spielberg's film.

Our reality, though, tends to be more disappointing. We still don't have holographic interfaces (unless we wear a headset like Microsoft's HoloLens) and the gesture controls we have usually require you to keep your hands in some sort of virtual box, or wear some special device (e.g. Myo). Gesture control needs to be simple, obvious. It gets better when you combine, say, a Leap Motion with VR, but then you're mostly cut off from the outside world.

That's going to soon change for Microsoft Windows 10 PC users, though. On the night before Microsoft's Build developers conference in Seattle, the company showed me how developers can enable gesture control for Windows with the addition of a plug-and-play Gesture API.

Original image replaced with Mashable logo
Original image has been replaced. Credit: Mashable

Called Project Prague, the Gesture API uses Microsoft's Kinect motion sensor. I watched as a developer used his hands to manipulate images in PowerPoint, interact with emoji stickers in live video, and play a game. He didn't appear to worry much about precision or where his hands were. Obviously, Kinect has a pretty wide field of view (an advantage), though most people, even if they have one, don't have it connected to their PC (a disadvantage, though perhaps mitigated by future hardware).

Still in the early stages of development, the Gesture API is a product of Microsoft's new Cognitive Services Lab that was announced at Build on Wednesday. The software package will enable developers integrate a wide array of Microsoft cognitive APIs and services in their apps.

Mashable Image
Lance Ulanoff

Lance Ulanoff was Chief Correspondent and Editor-at-Large of Mashable. Lance acted as a senior member of the editing team, with a focus on defining internal and curated opinion content. He also helped develop staff-wide alternative story-telling skills and implementation of social media tools during live events. Prior to joining Mashable in September 2011 Lance Ulanoff served as Editor in Chief of PCMag.com and Senior Vice President of Content for the Ziff Davis, Inc. While there, he guided the brand to a 100% digital existence and oversaw content strategy for all of Ziff Davis’ Web sites. His long-running column on PCMag.com earned him a Bronze award from the ASBPE. Winmag.com, HomePC.com and PCMag.com were all been honored under Lance’s guidance.He makes frequent appearances on national, international, and local news programs including Fox News, the Today Show, Good Morning America, Kelly and Michael, CNBC, CNN and the BBC.He has also offered commentary on National Public Radio and been interviewed by newspapers and radio stations around the country. Lance has been an invited guest speaker at numerous technology conferences including SXSW, Think Mobile, CEA Line Shows, Digital Life, RoboBusiness, RoboNexus, Business Foresight and Digital Media Wire’s Games and Mobile Forum.

Mashable Potato

Recommended For You
Windows 11 Pro is down to $9.97 (if you’re still running Windows 10)
Woman using laptop

The NAACP is fighting back against AI data centers
Construction on the xAI data center in Memphis.

The 11 best Windows laptops for 2026
the microsoft surface laptop 7

The 12 best Windows laptops for 2026
the microsoft surface laptop 7

Microsoft 365 Outlook down: Microsoft breaks silence on outage
Microsoft logo

Trending on Mashable
NYT Connections hints today: Clues, answers for April 3, 2026
Connections game on a smartphone

Wordle today: Answer, hints for April 3, 2026
Wordle game on a smartphone


What's new to streaming this week? (April 3, 2026)
A composite of images from film and TV streaming this week.

You can track Artemis II in real time as Orion flies to the moon
Victor Glover and Reid Wiseman piloting the Orion spacecraft
The biggest stories of the day delivered to your inbox.
These newsletters may contain advertising, deals, or affiliate links. By clicking Subscribe, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.
Thanks for signing up. See you at your inbox!