Apple has won its First Smart Ring Patent with Biometrics, Touch Pad & Siri to Control devices including a TV
Apple Wins Headset Patent designed to work with Games, but more importantly, with Applications like Excel and more

Apple wins Patent Covering their 3D Augmented Reality 'Measure' App and Beyond

1 Cover  AR Measurement App

 

The U.S. Patent and Trademark Office officially published a series of 59 newly granted patents for Apple Inc. today. In this particular report we cover Apple's patent relating to electronic devices for virtual/augmented reality, including but not limited to electronic devices for measuring physical spaces and/or objects using virtual/augmented reality environments. While the invention technically covers Apple's iOS "Measuring" app, it also covers how furniture could be rearranged in a room with accurate measurements in 3D augmented reality space.

 

Apple notes that Augmented Reality environments are useful for making measurements of physical spaces and objects therein, by providing a view of the physical space and enabling a user to superimpose measurements on the physical space and objects therein. But conventional methods of measuring using augmented reality are cumbersome, inefficient, and limited. In some cases, conventional methods of measuring using augmented reality are limited in functionality. In some cases, conventional methods of measuring using augmented reality require multiple separate inputs (e.g., a sequence of gestures and button presses, etc.) to achieve an intended outcome (e.g., through activation of numerous displayed user interface elements to access different measurement functions). In addition, conventional methods take longer than necessary, thereby wasting energy. This latter consideration is particularly important in battery-operated devices.

 

The above deficiencies and other problems associated with user interfaces for measuring using virtual/augmented reality are reduced or eliminated by the disclosed invention.

 

Apple's invention covers computer systems with improved methods and interfaces for measuring using virtual/augmented reality environments. Such methods and interfaces optionally complement or replace conventional methods for measuring using virtual/augmented reality environments.

 

Such methods and interfaces reduce the number, extent, and/or nature of the inputs from a user and produce a more efficient human-machine interface. For battery-operated devices, such methods and interfaces conserve power and increase the time between battery charges.

 

In some embodiments, the computer system includes a desktop computer. In some embodiments, the computer system is portable (e.g., a notebook computer, tablet computer, or handheld device). In some embodiments, the computer system includes a personal electronic device (e.g., a wearable electronic device, such as a watch).

 

In some embodiments, the computer system has (and/or is in communication with) a touchpad. In some embodiments, the computer system has (and/or is in communication with) a touch-sensitive display (also known as a "touch screen" or "touch-screen display").

 

In some embodiments, the computer system has a graphical user interface (GUI), one or more processors, memory and one or more modules, programs or sets of instructions stored in the memory for performing multiple functions.

 

In some embodiments, the user interacts with the GUI in part through stylus and/or finger contacts and gestures on the touch-sensitive surface. In some embodiments, in addition to an augmented reality-based measurement function, the functions optionally include game playing, image editing, drawing, presenting, word processing, spreadsheet making, telephoning, video conferencing, e-mailing, instant messaging, workout support, digital photographing, digital videoing, web browsing, digital music playing, note taking, and/or digital video playing. Executable instructions for performing these functions are, optionally, included in a non-transitory computer readable storage medium or other computer program product configured for execution by one or more processors.

 

In some embodiments, the electronic device determines (1118) a classification of the physical object (e.g., a classification of the physical object as a respective structural feature (such as a window, a wall, a floor, etc.) or as a respective piece of furniture or fixture (such as a table)). In some embodiments, the information about the measurement includes a label indicating the classification of the physical object (e.g., as described herein with reference to label 5186-a in measurement management interface 5184, FIG. 5BM). In some embodiments, the electronic device classifies the physical object based on image processing (e.g., using feature recognition) of the representation of the field of view of the one or more cameras. Automatically classifying and labeling the physical object, without requiring further user input, enhances the operability of the device and makes the user-device interface more efficient by reducing (or eliminating) the need for the user to manually classify and label physical objects.

 

Apple's patent figures below illustrate examples of user interfaces for making measurements of a physical space using an augmented reality environment

 

2 x Apple Measuring via Augmented Reality tool  App

 

In some embodiments, the electronic device determines a classification of the physical object (e.g., a classification of the physical object as a respective structural feature (such as a window, a wall, a floor, etc.) or as a respective piece of furniture or fixture (such as a table)).

 

In some embodiments, the electronic device classifies the physical object based on image processing (e.g., using feature recognition) of the representation of the field of view of the one or more cameras. Automatically classifying and labeling the physical object, without requiring further user input, enhances the operability of the device and makes the user-device interface more efficient by reducing (or eliminating) the need for the user to manually classify and label physical objects.

 

While displaying the representation of the physical space, the electronic device receives a first set of one or more inputs to create a virtual annotation (e.g., a shape, line, rectangle, measurement, or the like) in the representation of the physical space (e.g., an input to drop a point followed by movement of the electronic device relative to the physical space followed by another input to drop a point).

 

Apple's granted patent 10,444,005 was originally filed in Q3 2018 with some work done in Q2 2018 and published today by the US Patent and Trademark Office.

 

Some of the Inventors

 

Lisa Forssell: Creativity, Technology, Energy. Projects include AR Quick Look and Measure.

Allison Dryer: Designer. Allison previously worked as design Manager at Twitter

Jeff Faulkner: Apple Design Director, Human Interface Design. Jeff previously worked as Creative Director at Microsoft.

Giancarlo Yerkes: Art Direction & Motion Design

Rich Lyons: Designer

Stephen Lemay: UI Designer

 

10.52FX - Granted Patent Bar

About Making Comments on our Site: Patently Apple reserves the right to post, dismiss or edit any comments.

Comments

The comments to this entry are closed.