The U.S. Patent and Trademark Office officially published a series of 66 newly granted patents for Apple Inc. today. In this particular report we cover Apple's patent that relates to next-gen wearable user input devices with haptic feedback elements incorporated to create an immersive computing environment, especially for virtual reality applications. The patent covers next-gen gloves, partial gloves and other wearable attachments that could be used with VR applications and beyond.

Apple's granted patent describes systems, devices, and techniques related to wearable user input devices, such as a glove, patch, thimble, partial hand covering, glasses, clothing, and/or other wearable items attachable to a user.

The user input device includes a flexible fabric and/or conformable material configured to attach to a user at one or more locations. For example, the flexible fabric may include a first portion (or first attachment piece) configured to attach to a user at a first location and a second portion (or second attachment piece) configured to attach to a user at a second location. The first and second portions may expand and contract to conform the flexible fabric to the user. The device facilitates an immersive environment within which a user may interact with a computing device.

The flexible fabric or other material of the user input device may define a wearable item (e.g., such as a glove or separate attachment pieces configured to conform to a user's hand) that includes an array of sensors or measurement circuitry that detect motion of the user input device as it moves through a three-dimensional space.

The user input device may be positioned or moved in, or moved through, a variety of input configurations (e.g., including motion patterns, gestures, signs, finger or hand positions, or the like) that are used to provide input to a computing device free of any defined or static user input surface.

In one embodiment, a first portion of the flexible fabric may be moved relative to a second portion of the flexible fabric to define an input configuration. The input configuration may correspond to a predetermined function executable by an interconnected computing device. Accordingly, the user input device may be positioned or moved into an input configuration in the air and/or relative to any appropriate or adjacently disposed surface to control a computing device. In this regard, the user input device may be suitable for use with various electronic devices (e.g., a computer, laptop, tablet, smart phone, or the like).

The user input device may be used to control or interact with a virtual environment represented on a virtual reality device. The virtual reality device may include any appropriate device configured to create a visually immersive three-dimensional environment.

For example, the virtual reality device may be defined by glasses, goggles, headsets, or the like that are configured to encompass or substantially surround a user's eyes to create a sensory experience that simulates a user's presence in a virtual environment.

Additionally, or alternatively, a virtual reality device may be a computing device configured to create a holographic projection in real space (See FIGS. 19A and 19B below).

In this regard, it will be appreciated that as used herein, the term "computing device" may be any manner of virtual reality device, according to the embodiments described herein. Accordingly, a virtual object represented by, or on, a computing device may be a virtual object represented within the visually immersive three-dimensional environment created by a virtual reality device.

Further, manipulations of the user input device in real space (e.g., such as that corresponding to a particular input configuration) may also be represented within the virtual environment. In some instances, the manipulation of the user input device may alter the virtual environment. In turn, the user input device may produce various haptic effects (including haptic effects localized to particular portions of the user input device) in response to the altering of the virtual environment. Accordingly, the combination of the user input device and the virtual reality device may create an encompassing sensory experience that allows a user to experience, interact, and/or control a virtual environment in a manner analogous to a user's interactions with a corresponding physical environment.

The user input device may generate a user input signal to control a computing device (including a virtual reality device), for example, by detecting motion of the user input device. This motion may be detected by various techniques, according to the embodiments disclosed herein. For example, motion of the user input device may be determined relative to a "current point." The "current point" may be defined as a static or resting position of the user input device. Additionally or alternatively, motion of the user input device may be detected by reference to a fixed reference point with respect to which the wearable item is calibrated. In one embodiment, the user input device detects motion based on a measured magnitude of an acceleration of the user input device as measured over a period of time. This may allow the user input device to detect various properties, including velocity, traveled distance, and changes in position in order to determine an input configuration.

Apple's patent FIG. 1 below depicts an example user input device #104 which may include measurement circuitry to determine a position and/or input configuration of the user input device. The user input device may also include a haptic feedback structure configured to provide haptic feedback based on the identified input configuration of the user input device and/or in response to an instruction from an associated computing device.

The user input device may include a flexible fabric #128 configured to attach to a user in any appropriate manner such as a glove or other wearable item that is attachable to a user to create an immersive environment within which a user may interact with a computing device. In some instances, the flexible fabric may form a set of attachment piece that individually attach to a user's fingers.

Apple's patent FIGS. 4A-4D below depict example user input devices 404a, 404b, 404c, and 404d which may detect an input configuration for controlling a computing device. The user input devices may include similar software, firmware, and/or hardware components that provide haptic feedback structures, primary sensing regions, secondary sensing regions, strain-sensitive elements, capacitive sensors, and so on.

Patent FIGS. 5A-5C above depict example user input devices 504a, 504b, and 504c, may include various communication modules, antennas, and/or other appropriate features to receive electrical power and data communication from the docking stations 508a-508c. This may allow the user input devices 504a-504c to operate free of a power source or processing unit directly attached, or integrated within, the user input devices 504a-504c.

The docking station may include a wrist band, watch, patch, or other electronic device. In some cases, the docking station may be configured to engage or store a respective one of the user input devices 504a-504c (or portions thereof) during period of non-use. This may enhance the adaptability and portability of the user input devices 504a-504c.

In Apple's patent FIG. 8 below depicts an example computing system #100 including the user input device and a computing device #108. The user input device #104 may be configured to be used with a variety of electronic devices. For example, the computing device 108 may be substantially any type of electronic device operable to receive user input, including a virtual reality device.

Such input may facilitate the device's operation, such as executing a predetermined function in response to the input. Some examples of electronic devices may include a desktop computer, laptop, smart phone, portable media player, or the like.

Other examples of electronic devices may include wearable devices (including watches, glasses, rings, or the like), health monitoring devices (including pedometers, heart rate monitors, or the like), and other electronic devices including digital cameras, printers, scanners, security systems or devices, or electronics for automobiles, among other electronic devices.

Patent FIGS. 9A and 9B above depict the user input device #104 typing on a virtual keyboard. For example, the user input device may be manipulated into various input configurations relative to an array of input regions #908 in order to generate a user input signal corresponding to a keyboard command.

Patent FIGS. 10A and 10B above depict the user input device 104 selecting a file represented by a computing device. In this regard, the user input device 104 may be manipulated into various input configurations to indicate a selection of information represented by a computing device.

Patent FIGS. 13A and 13B above depict the user input device #104 resembling holding an Apple Pencil, although no pencil is present. In this regard, the user input device may be manipulated into various input configurations to control a pencil or other drawing implement represented by a computing device.

Apple's patent FIGS. 14A and 14B below depict the user input device #104 resembling holding a baseball bat, although no baseball bat is present. In this regard, the user input device may be manipulated into various input configurations to control a function of a computer application executing on a computing device, such as an application directed to playing baseball.

Patent FIGS. 15A and 15B below depict the user input device #104 resembling holding a video game controller, although no video game controller is present. In this regard, the user input device may be manipulated into a variety of input configurations to control a function of a computer application that is executing on a computing device, such as an application directed to racing a car.

In Patent FIG. 18A above, the user input device #804a may include a light source configured to display a user input surface #882a having an array of user input regions contained therein (such as the user input region #886a) at a surface of the flexible fabric #828a. Each user input region may include various markings, symbols, or other indicia to indicate a function associated with the user input region. For example, in the depicted embodiment of FIG. 18A, the user input region #886a may be configured to resemble an arrow, for example, for controlling an aspect of a computing device.

In patent FIG. 18B above, the user input device #804b may include a light source configured to project a user input surface #882b having an array of user input regions contained thereon (such as the user input region #886b) at any adjacently disposed surface (such as surface 890). Each user input region may include various markings, symbols, or other indicia to indicate a function associated with the user input region. For example, in the indicated embodiment of FIG. 18B, the user input region #886b may be configured to resemble an arrow, for example, for controlling an aspect of a computer application depicted at the display.

The position of the user input device #804b may be detected in relation to the user input surface #882b projected onto a surface #890. Based on the position of the user input device a user input signal may be generated to control a computing device.

Apple's patent FIGS. 19A-19B above depict an example computing system #1900 including user input device #1904 and virtual reality device #1982. The virtual reality device 1982 may be configured to produce a holographic projection #1986. The virtual reality device may produce the holographic projection using various lights, lasers, or other optical effects that cause a two-dimensional or three-dimensional image to appear in real space.

The virtual reality device 1982 may produce the holographic projection 1986 in real space free from any defined or static screen or user input surface. The holographic projection may represent a virtual environment with which a user may interact using the user input device. In this regard, the virtual reality device may dynamically depict various objects within the holographic projection that the user may interact with or otherwise manipulate using the user input device.  As shown in FIGS. 19A-19B, the holographic projection depicts a virtual sphere #1990.

The user input device #1904 may interact with the holographic projection in order to control a function of the virtual reality device or other interconnected computing device. As one example, the user input device may be manipulated into a variety of input configurations relative to one or more portions of the holographic projection to control a function of the virtual reality device.

The latter patent figures 20A and 20B don't really explain the devices that the glove is interacting with. With these two figures, Apple spends more time discussing magnetic fields with the magnets using ferrofluid. The input devices are to be used within a virtual reality environment to control various elements within a VR environment.  

Apple's granted patent was originally filed in Q2 2017 and published today by the US Patent and Trademark Office. The patent was never published publicly prior to it being granted. The main inventor is noted as being Paul X, Architect, Product Design. Wang who has appeared on many of Apple's futurist product patents.