The U.S. Patent Office published a 2nd Apple Ring patent today that uses a Self-Mixing Interferometry Sensor-based Gesture System
Today the US Patent & Trademark Office published a second patent application from Apple relating to their smart ring project, this time using an alternative methodology than the first patent that we posted today. Apple's different methodology introduces a self-mixing interferometry (SMI) sensor-based gesture input system. The majority of the invention relates to a smart ring being used alone or in pairs, with or without an Apple Pencil for AR, VR and MR applications.
Apple notes that sensor systems may variously sense the presence of objects, distances to objects or proximities of objects, movements of objects (e.g., whether objects are moving, or the speed, acceleration, or direction of movement of objects), and so on.
Given the wide range of sensor system applications, any new development in the configuration or operation of a sensor system can be useful especially if they improve the sensitivity or speed of sensor system operations.
Gesture Input System using a Smart Ring
Apple's latest ring invention covers systems, devices, methods, apparatus and operation of an SMI-based gesture input system that includes one or more self-mixing interferometry (SMI) sensors.
In one instance, the SMI sensor(s) may be used to determine a relationship between a ring and a handheld device, such as an Apple Pencil.
More specifically, the patent relates to the configuration and operation of SMI-based gesture input systems--i.e., systems that can identify gestures made by a user using signals received from one or more SMI sensors.
An SMI sensor can be used to optically measure the relative motion (displacement) between the SMI sensor and a target (e.g., a surface or object), with sub-wavelength resolution.
When displacement measurements are associated with measurement times, the velocity of the target may also be measured. Furthermore, by modulating the SMI sensor with a known wavelength modulation (e.g., a triangular modulation), the absolute distance from the SMI sensor to the target may be measured.
In augmented reality (AR), virtual reality (VR), and mixed reality (MR) applications, as well as other applications, it can be useful to track a user's finger movement(s) and/or identify a user's gestures (e.g., gestures made with one or more fingers, a hand, an arm, etc.).
Apple's patent FIG. 1 below shows an example SMI-based gesture input system that includes a wearable device such as a smart ring (seen in-part); Apple's patent FIG. 7 shows smart rings placed on two of the user's fingers; FIG. 4 shows a wearable device having a set of SMI sensors, from which a processor of the device may select a subset of SMI sensors to determine a relationship between the wearable device and a surface.
Apple further notes that FIG. 7 illustrates dual rings used in context with Mixed Reality applications. Finger rings worn on a user's thumb and index finger, for example, may be used to identify gestures such as a pinch, zoom, rotate, and so on.
Apple's patent FIG. 6 shows an example of the system described with reference to FIG. 5 (further below), in which the wearable device is a finger ring and the object is an Apple Pencil (or digital marker or paintbrush). These figures are also in context with AR, VR and MR applications.
Apple's patent FIGS. 9C and 9D illustrate different beam-shaping or beam-steering optics that may be used with any of the SMI sensors; FIG. 13 shows an example method of identifying a type of gesture.
For more details, review Apple's patent application number US 20220382384 A1.
Listed Apple Inventors
Mark Winkler: Senior Engineering Manager, Laser & Optical Sensing
Mehmet Mutlu: Display Optics Design and Architecture Manager
Fatih Cihan: Senior Optical HW Engineer
Tong Chen: Optical Sensing Engineer