There has never been such a thing as "Thē iPhone Patent." The iPhone was a major project made up of thousands of patents. We now know that the Apple Vision Pro is made up of a minimum of 5,000 patents. So likewise, there is no such thing as "Thē Apple Vision Pro" patent. Apple's headset is made up from various technologies described a series of patents.

One of Apple's patents relating to the Apple Vision Pro was granted today titled "Mixed Reality System" which eliminates accommodation-convergence mismatch problems that detract from a user's enjoyment and endurance levels (i.e. tolerance) of virtual reality or mixed reality environments.

According to Apple, conventional VR and MR systems may suffer from accommodation-convergence mismatch problems that cause eyestrain, headaches, and/or nausea.

Accommodation-convergence mismatch arises when a VR or MR system effectively confuses the brain of a user by generating scene content that does not match the depth expected by the brain based on the stereo convergence of the two eyes of the user.

For example, in a stereoscopic system the images displayed to the user may trick the eye(s) into focusing at a far distance while an image is physically being displayed at a closer distance. In other words, the eyes may be attempting to focus on a different image plane or focal depth compared to the focal depth of the projected image, thereby leading to eyestrain and/or increasing mental stress.

Accommodation-convergence mismatch problems are undesirable and may distract users or otherwise detract from their enjoyment and endurance levels (i.e. tolerance) of virtual reality or mixed reality environments. This is the problem that Apple's granted patent sets out to eliminate.

Apple's granted patent covers various embodiments of a mixed reality (MR) direct retinal projector system designed to resolve the convergence-accommodation conflict in head-mounted AR, MR, and VR systems.

Embodiments of an MR headset (e.g., a helmet, goggles, or glasses) are described that may include or implement different techniques and components of the MR system. In some embodiments, an MR headset may include a reflective holographic combiner to direct light from multiple (e.g., three) projectors of a light engine into an eye box corresponding to the user's eye, while also transmitting light from the user's environment to thus provide an augmented or mixed view of reality.

The holographic combiner may be recorded with a series of point-to-point holograms; each projector interacts with multiple holograms to project light onto multiple locations (referred to as eye box points) in the eye box. The holograms may be arranged so that neighboring eye box points are illuminated by different projectors.

In some embodiments, only one projector is active at a given time; when activated, a projector projects light from a corresponding light source (e.g., an RGB laser) to all of its eye box points. However, in some embodiments, more than one projector, or all of the projectors, may be active at the same time.

In some embodiments, the MR headset may include a gaze tracking component implemented according to any of a variety of gaze tracking technologies that may, for example, provide gaze tracking input to the controller so that the light beams projected by the light engine can be adjusted according to the current position of the subject's eyes. For example, different ones of the light sources and projectors may be activated to project light onto different eye box points based on the current position of the subject's eyes.

Apple's patent FIG. 5 below illustrates a mixed reality (MR) system that uses a reflective holographic combiner to direct light from multiple projectors into a subject's eye, while also transmitting light from the environment to the subject's eye. Overall, FIG. 5 illustrates architecture, components, and operation of of a direct retinal projector MR system.

Apple's patent FIG. 10A below illustrates a slow axis scan performed by a scanning mirror of one of the projectors #512 to holograms on a holographic combiner #550 from a projection point #1000 corresponding to the projector.  

Apple's patent FIG. 11 above illustrates an embodiment of an MR system in which the projectors and light sources are contained in an on-frame unit.

For more details, review Apple's granted patent 11695913. At present, it's unknown how much of the technology described in this particular granted patent ended up in the final product.

Some of the Team Members on this Apple Project

• Richard Tsai, Sr.: Camera Design Engineer
• Paul Gelsinger: Optical Engineer
• Gregory Thomas: Senior Area Manager.