Today the US Patent & Trademark Office published a patent application from Apple that relates to computer systems that provide computer-generated experiences, including, but not limited to, electronic devices that provide virtual reality and mixed reality experiences via a display. In one strange example, Apple illustrates a future version of Apple Watch that will allow a user to take a Face ID image of themselves using the sensors on the back of the Apple Watch that could be used in mixed reality environments. The images captured by Apple Watch and Apple's XR Headset in the initial set-up stage is done to configure a 2D or 3D virtual representation, a (2D or 3D) avatar) of the user that will be used in virtual environments. 

Apple's patent covers a computer system that could capture information related to a user and use the captured information to generate a representation of the user. While the computer system is placed on a body of the user, the computer system prompts a user to remove the computer system from the body of the user and to use the computer system to capture the information related to the user.

The computer system detects that the computer system has been removed from the body of the user and, after detecting that the computer system has been removed from the body of the user, captures the information related to the user.

In some embodiments, the computer system is wearable computer system, such as a head-mounted display generation component and/or watch, that can be worn with a respective orientation and/or position relative to the body of the user.

In some embodiments, the computer system captures information related to a head and/or face of the user while the computer system is removed from the body of the user and captures information related to hands of the user while the computer system is placed on the body of the user.

In some embodiments, the computer system displays a first prompt on a first display generation component that prompts the user to remove the computer system from the body of the user and a displays a second prompt on a second display generation component that provides instructions for capturing the information related to the user while the computer system is removed from the body of the user.

In some embodiments, a computer system captures information about one or more physical characteristics of a user, generates a representation of the user based on the information about the one or more physical characteristics of the user, and displays the representation of the user in an extended reality environment, such an augmented reality environment and/or a virtual reality environment.

In some embodiments, the computer system displays the representation of the user to include a representative state that is a mirror image of a physical state of the user in a physical environment.

In some embodiments, the computer system animates and/or displays movement of the representation that is based on physical movement of the user in the physical environment.

In some embodiments, the computer system provides, while displaying the representation of the user in the extended reality environment, selectable options for editing the representation of the user and/or for recapturing the information about the one or more physical characteristics of the user.

In Apple's FIG. 7 series illustrated below, we see examples for capturing information that is used to generate a representation of a user. An Apple Watch instructs the user to take an image of themselves and their hand by using the sensors on the back of their Apple Watch. Various customizations are presented to the user.

The set up also applies to a user wearing Apple's XR Headset. The user would take off the headset, use the outside cameras to set up the user's Face ID and more. The Apple Watch and XR Headset could be in communication with each other in an extended reality environment via display devices of the first electronic device and the second electronic device.

Apple further notes that in some embodiments, electronic device #700 (Apple Watch) initiates the enrollment process when and/or in response to the watch being powered on (e.g., first being powered on prior to the  user signing into an account associated with their watch (or headset).

In some embodiments, the enrollment process is included within an initial setup process of this next-gen Apple Watch. In some embodiments, the initial setup process of this Apple Watch includes capturing the one or more physical characteristics of the user (e.g., via sensor 712 and/or sensors 720a-720j), capturing biometric information (e.g., facial features, eye features, and/or fingerprints) of the user, an input calibration process (e.g., Apple Watch captures information that enables the watch to detect, recognize, and/or respond to user inputs, such as eye gaze user inputs, air gestures, voice commands, and/or tap gestures).

The images captured of the user on Apple Watch and Apple's XR Headset in the initial set-up is to configure a 2D or 3D virtual representation, a (2D or 3D) avatar) of the user.  

Apple's patent is miles deep in details about Apple Watch and Apple's future XR Headset setting up 3D avatars and interacting in virtual environments. Check out Apple's patent application number 20230171484 for more.