Apple invents In-Air gestures to control UIs of both an Apple Watch & HMD + adding a user’s hands to avatars during HMD FaceTime calls
Today the U.S. Patent Office published two HMD related patents applications from Apple's that relate to hand-gestures to control both an Apple Watch and HMD user interface + being able to add your hands to your Vision Pro or future smartglasses Avatar that could be used during a FaceTime call as noted in our cover graphic.
User Interfaces for Gestures
In September 2022, Apple was granted a patent that directly related to “AssistiveTouch” (AssistiveTouch video). Today, one of Apple’s newly published patent applications illustrate how in-air gestures while wearing and Apple Watch will one day work to control/navigate a UI on your smartglasses #1510 (top portion device) and/or future version of Vision Pro #1510 at the bottom portion of both FIGS. 15CC AND 15G below.
(Click on image to Enlarge)
The in-air gestures will include a pinch, a double pinch, a pinch and hold air gesture and more to control a user interface both on the watch and in the headset for Apple Music or any app on the watch or headset.
It’s more of an inconspicuous way to control/navigate through a UI on your smartglasses than waving your hands in the air of asking Siri to navigate your UI when you’re on a crowded subway or bus. That could get your expensive smartglasses smashed along with your face.
For more on this, read Apple’s full patent application 20240370093.
Devices, Methods and GUIs for Display a Representation of a Person
With FaceTime on Apple Vision Pro you get realistic avatars as presented in video with iJustine, Mark Brownlee and Brian Tong below.
On September 19th, Patently Apple posted an IP report titled “Apple reveals a possible Future update to Vision Pro's 'Persona' Feature wherein it creates a Full Body Avatar of the user.
Today, Apple’s patent is an evolutionary step prior to getting to a full bodied avatar. In this patent, Apple will allow the user’s hands to be added to the avatar for expression and more. Below are just two examples of hand movement of the user being mimicked by the avatar.
Apple’s patent application (20240372968) is deeply detailed with many, many more graphics to explore.