Today the U.S. Patent and Trademark Office officially granted Apple a patent that relates to future smartglasses device that could record content including AR content with jitter reduction and more.
Apple notes that head-mounted displays are used to provide virtual reality, augmented reality, and/or mixed reality experiences for users. Video from a virtual reality or mixed reality experience may be recorded for later playback or analysis. Gaze-tracking sensors may be used to provide an indication of where a person is currently looking. Instead of a camera on the smartglasses frame simply recording what's in front of the user, the camera could be driven by where the user's eyes or gaze is shifting to.
Apple's patent FIG. 4 below is a block diagram of an example of a system configured to enable gaze-driven processing of video. The system consists of a pair of smartglasses and connected device for power and storage such as an iPhone, iPad or MacBook.
Apple's patent FIG. 1B below is an illustration of an example of a process for recording video in mixed reality or virtual reality applications with a gaze-driven region of interest; FIG. 1C is an illustration of an example of a process for recording video in mixed reality or virtual reality applications with a smoothed gaze-driven region of interest.
Apple's patent FIG. 6 below is a flowchart of an example of a process for gaze-driven processing of video.
Apple notes that smartglasses will be able to work with an iPhone, an iPad, a MacBook, a desktop computer, a smart TV, a smart speaker and more.
For more details, review Apple's granted patent 10,951,904