Today the US Patent & Trademark Office published a patent application from Apple that relates to dynamic image stabilization built into mobile devices so that users will be able to view messages or read content when walking, Jogging, running on a treadmill or riding in a car with bumpy roads.

Apple's invention includes dynamic image stabilization circuitry in devices that may include a usage scenario detection circuit configured to determine a current usage scenario of the device from a list of predetermined usage scenarios.

Each usage scenario in the list of predetermined usage scenarios may require a different amount of compensation (i.e., a different amount or type of adjustment to the image content).

The dynamic stabilization circuitry may further include a content displacement compensation calculation circuit configured to compute an amount by which to adjust the image content based on the current usage scenario of the device as determined by the usage scenario detection circuit.

The dynamic stabilization circuitry may be used to adjust the image content by dynamically shifting the image content along the plane of the display or dynamically magnifying/minifying the image content in a direction that opposes the movement of the electronic device.

When the device has stopped moving, the image content may gradually drift back to the center of the display.

Lastly, the electronic device may further include a head tracking system configured to detect the motion of the user's head relative to the device. The image content should be adjusted only when the motion of the user's head is out of sync with that of the device.

Apple's patent FIG. 1 above is a schematic diagram of an illustrative electronic device; FIG. 3 is a diagram showing an optional cushion that can be provided around an image content to prevent content clipping during dynamic image stabilization; and FIG. 5 is a diagram of an illustrative usage scenario detection circuit.

Head/Face Tracking

In respect to head and face tracking, Apple notes that Input-output circuitry #22 of FIG. 1 above may further include a user tracking system head (or face) tracking system #16.

The head tracking system may include cameras, light sources, and/or other equipment that is used to monitor the position of a user's head or face relative to the position of device #10 which could be an iPhone, iPad Pro, a head mounted display, Apple Watch, a heads-up display on vehicle windshield, a Mac or television.  

Generally, no image compensation should be applied when the movement of device is in sync with the user's head (i.e., when the user is intentionally moving around device in a predictable and controlled manner such that their gaze can be adequately maintained). In other words, image content compensation should only be applied when the movement of the device is out of sync (or uncoordinated) with the user's head (e.g., when the user's head is moving faster than the device or when the device is moving faster than the user's head).

Thus, by taking into account the data generated by head tracking system in addition to the data generated by the sensors, dynamic image stabilization circuitry can more accurately determine scenarios where image content compensation is required and also the degree of compensation that is required which improves the accuracy and effectiveness of dynamic image stabilization circuitry.

Towards the end of the patent filing, Apple added that additional external devices (e.g., AirPods, Apple Watch, a pair of glasses, a head-mounted device, etc.) paired with the electronic device may gather additional sensor data that can help further improve the accuracy of the compensation provided by the dynamic image stabilization circuitry.

Apple's patent FIG. 8 below is a flow chart of illustrative steps for operating an electronic device of the type that includes dynamic image stabilization circuitry; FIG. 10 is a diagram of an illustrative system in which the electronic device is configured to receive additional sensor data from one or more accessory devices to help improve the accuracy of dynamic image stabilization.

Apple's patent application 20190317659 that was published today by the U.S. Patent Office was filed back in Q1 2019 with work on it dating back one year. Considering that this is a patent application, the timing of such a product to market is unknown at this time.

About Making Comments on our Site: Patently Apple reserves the right to post, dismiss or edit any comments.