New Apple patent reveals the tech giant is exploring 3D hand-tracking

Looking beyond facial recognition.
 By 
Mark Kaufman
 on 
Original image replaced with Mashable logo
Original image has been replaced. Credit: Mashable

A newly released patent shows Apple is exploring an iPhone feature that can identify hand movements and gestures.

The feature is called 3D hand-tracking and is one of 36 Apple patents just released by the U.S. Patent and Trademark office, as reported by Patently Apple. Most of the patents are related to mundane things like battery power and wireless hardware, but 3D tracking is much more interesting: The feature would use the iPhone X's TrueDepth camera system, which currently enables the iPhone X to recognize faces.

To accurately scan faces, the TrueDepth camera shoots out some 30,000 invisible, infrared dots onto an iPhone user's face, allowing the phone to accurately identify someone's unique facial features. Presumably, this same technology would be used to identify how a hand is moving or gesturing in 3D space.

If Apple ever realizes this idea, it could lead to some cool features. According to Patently Apple, this could mean touchless drawing and sign language interpretation.

Perhaps the most futurist-sounding possibility might be controlling different apps — perhaps Google Maps — by just pointing and gesturing at the screen. For now, however, 3D hand tracking is just an idea, but one Apple could potentially pursue.

Mashable Image
Mark Kaufman
Science Editor

Mark was the science editor at Mashable. After working as a ranger with the National Park Service, he started a reporting career after seeing the extraordinary value in educating people about the happenings on Earth, and beyond.

He's descended 2,500 feet into the ocean depths in search of the sixgill shark, ventured into the halls of top R&D laboratories, and interviewed some of the most fascinating scientists in the world.

Mashable Potato

Recommended For You
CES 2026: Meet RocX, the handheld camera with AI tracking at 50x zoom
RocX at CES Unveiled

CES 2026: Capture video with the AI-tracking, subscription-free XbotGo Falcon
XbotGo Falcon


Orastone hand warmers are 50% off and Mashable-tested
the orastone rechargeable hand warmers in polygon pattern on a pink and purple background

I'm a tech editor, and I found 37 Big Spring Sale tech deals at Amazon I'd actually shop
collage of tech products on sale during amazon big spring sale

More in Tech
How to watch Chelsea vs. Port Vale online for free
Alejandro Garnacho of Chelsea reacts

How to watch 'Wuthering Heights' at home: Margot Robbie and Jacob Elordi's controversial romance now streaming
Margot Robbie and Jacob Elordi embracing in still from "Wuthering Heights"

How to watch New York Islanders vs. Philadelphia Flyers online for free
Matthew Schaefer of the New York Islanders warms up

How to watch Mexico vs. Belgium online for free
Israel Reyes of Mexico reacts

How to watch Brazil vs. Croatia online for free
Vinicius Junior #10 of Brazil leaves

Trending on Mashable
NYT Connections hints today: Clues, answers for April 3, 2026
Connections game on a smartphone

Wordle today: Answer, hints for April 3, 2026
Wordle game on a smartphone

What's new to streaming this week? (April 3, 2026)
A composite of images from film and TV streaming this week.

Google launches Gemma 4, a new open-source model: How to try it
Google Gemma

NYT Strands hints, answers for April 3, 2026
A game being played on a smartphone.
The biggest stories of the day delivered to your inbox.
These newsletters may contain advertising, deals, or affiliate links. By clicking Subscribe, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.
Thanks for signing up. See you at your inbox!