When I think of quality 3D content, one of the first companies that comes to mind is Pixar whose wondrous works have dazzled millions worldwide and made us laugh. It was Steve Jobs who acquired a low key 3D software tool developer company and turned it into a 3D animation powerhouse that finally drove Disney to acquire them in 2006. So do I have faith in Apple being able to reinvent 3D for computer displays and televisions in the future? Duh …Yes, of course – and the good news on this front is that a recent patent application reveals one of the many ways that Apple is preparing to deliver this next generation entertainment beast. Although Apple's patent application goes out of its way to never use the words TV or television, they do describe the shortcomings of wearing 3D polarized glasses in context with a display. If that's not describing a future 3D TV application - then I don't know what is. Then again, it's not only about entertainment anyways. It's also about a future 3D version of OS X or perhaps even iOS. And if you follow Apple's patent history, then you know that such advancements in delivering truer 3D imagery will eventually spill over to other professional fields such as medical, aerospace, gaming and far beyond.
The Problem with Today's Limited 3D TV Trickery
Many electronic components, devices and/or systems utilize two-dimensional display devices. Creating the illusion of a three-dimensional image on a two-dimensional display has been the subject of ongoing technological research and development, and is experiencing a worldwide resurgence due to recent developments in computer-generated imagery and high-definition video.
Currently, the perception of depth of a three-dimensional image may be created by computer graphics that are used to enhance a displayed two-dimensional image, such as through shading or brightness effects, or by the creation of a stereoscopic image.
Many such techniques are imperfect. For example, adjusting the brightness or shading of an image may enhance the realism of a two-dimensional image, but could only enhance the perceived depth of a flat image to a limited extent.
Further, most stereoscopic display devices often require that the viewer use an optical device, such as color-filter glasses or polarized glasses, to see a stereoscopic image in simulated three dimensions, and/or expensive projection equipment for generating and displaying the stereoscopic images. As such, most stereoscopic display devices are not practical for personal use.
Apple's 3D Display Solution for Appropriate 3D Content
Apple's invention takes a different approach to today's 3D TV trickery by rethinking the entire delivery process of 3D imagery. Apple's approach begins with utilizing a sophisticated multilayered display system.
For those interested in every variation of Apple's latest invention, we'll provide you with the appropriate patent number at the end of this report so that you could further research this document. But in short, Apple is basically describing a next generation smart 3D display system. The system consists of three or more separate displays that are encased in one enclosure like an iMac. The displays are in close proximity with each other and are controlled by their own independent GPU so as to deliver different pieces of an image that will produce a genuine 3D-like image without the need of polarized glasses. Finally someone is thinking outside the box.
Overview of Apple's Sophisticated Multilayered Display System
Apple's patent FIG 1B presents the three display panels as patent points numbers 101, 103 and 105 which could be spaced apart by a preset distance D1, D2, such as between approximately 1-2 mm, to create the perception of depth for a viewer. In particular, the distance D1, D2 between the display panels may provide a depth effect so that the human eye may discern that images displayed on the rear panel are at a further distance from the viewer than images displayed on the front and middle panels.
The Distance between the Layered Displays Could be Altered
Apple gives you the impression that there may be a mechanism within this next generation display that could actually alter the distances between the three displays to pull-off a desired effect. Apple specifically states that "the distance D1, D2 [shown below] between the display panels 101, 103 and 105 may be uniform or in other embodiments the front and middle panels 101, 103 may be separated by a larger or smaller distance than the middle and rear panels depending on the desired depth effect. For example, spacing the panels at a larger distance apart may cause images displayed on the back panel to appear further away, thereby increasing the depth effect, while spacing the panels a shorter distance apart may cause images displayed on the back panel to appear closer, thereby lessening the depth effect."
Differing Display Thickness is another Method of Creating Visual Depth
Apple further states that the perception of depth, or actual depth, may be created by using thicker display panels, rather than varying the spacing between the panels. For example, the depth effect may be increased or decreased by using thicker or thinner panels. In one embodiment, the front and middle display panels 101, 103 may be OLEDs that are attached to a transparent substrate layer having a desired thickness and positioned either in front of or behind the corresponding OLED, thereby increasing the perceived depth of the images displayed on the panels. The thickness of the panels of the display device may vary. For example, the front panel may be thicker or thinner than the middle and/or rear panels. Other embodiments may vary perceived or actual depth through a combination of panel spacing and panel thickness.
Superior Control of Lighting, Tints and Shades
Apple notes that the front and middle panels could be transparent OLED panels. As such, the pixels of the OLED panels may remain transparent (or partially transparent) when an OLED panel is in use. In one embodiment, the transparent portions of the front panel may allow a viewer to see images displayed on the middle and rear panels while the transparent portions of the middle panel may allow a viewer to see images displayed on the rear panel.
Certain OLED panels are partially transparent as opposed to fully transparent. Embodiments employing such partially transparent OLED panels may increase the brightness and/or intensity of graphics and/or other data displayed on the middle and back screens to account for the partial opacity and possible light-filter effects of the front and middle panels. In such embodiments, the brightness and/or color intensity of graphics displayed on the middle panel may be enhanced or increased by a percentage or amount to appear, to a user, to have the same optical qualities as graphics displayed on the front panel. Likewise, graphics on a rear panel may be even further enhanced than those on a middle panel. Thus, the graphical enhancement may at least partially offset or overcome the filtering effects of the semi-transparent OLED panels in front of the panel displaying the enhanced graphic.
In another embodiment, light emitted from overlapping pixels of the front and middle panels may be combined to produce a light having an increased illumination when compared to the light emitted by either one of the two panels 101, 103 individually. In a further embodiment, light emitted from overlapping pixels may be combined to result in different tints or shades of emitted colored light.
The Brains behind Apple's Multilayered 3D Display System
Although Apple delves into every aspect of patent FIGS. 2 and 3 illustrated below, the brains of the system includes an advanced GPU layout which could consist of a single GPU as noted in FIG.2 or multiple GPUs as presented in FIG. 3. Apple also states that the system's microprocessor could be any type of processor including a single or multi-chip CPU configuration, an SoC (a system-on-a-chip), and could be an 8-bit, 16-bit, 32-bit, 64-bit, or multicore design. And of course, the brain of any system must be intimately connected to Apple's OS.
According to Apple's sole inventor Pete Mahowald, the operating system (noted as both patent points 203 and 303 noted in our graphic above) may be programmed to separate certain constituent graphical elements of itself and/or the application software (202) with respect to the three panels noted above. That is, the operating system (or a specialized driver) may break a two-dimensional display into separate elements and assign each such element to a layer of the display device.
As one example, these graphical elements may be various features of the GUI of the operating system and/or application software. The applications may be grouped by the status of an application, for example, whether an application is active, inactive, open, closed, and so on and so forth. The applications may also be grouped by application type, for example, whether the application is a window, an onscreen button or icon, a menu, a menu bar, and so on. This could be one of the secrets behind Apple's proposed high end 3D OS interface.
3D Photos or Videos as Desktop Backgrounds
Towards the end of Apple's patent, they present an example of a 3D Desktop Background whereby the background image may be an unmoving PNG or JPEG image, or, in other embodiments, may include a video clip or animation. In certain embodiments, the background image may be split into separate elements and displayed across the various panels of the display. For example, if the background image shows a tree and a bird in flight, the bird and tree may be defined as separate elements. The bird may then be displayed on the front or middle panel while the tree is shown on the rear panel. In this manner, three dimensionality of the background image may likewise be achieved or simulated. It should be noted that any graphic may be separated and displayed in such a fashion. By placing certain portions of a graphic on a panel nearer the user than other portions, aspects of the graphic may be emphasized to a user.
3D Patents: A Trend is Forming
Apple's multilayered 3D display system in and of itself is fascinating and powerful in that the end result could mean playing 3D TV, movie and gaming content with truer 3D realism in the future. It also could assist surgeons in viewing sophisticated 3D imagery associated with digital X-rays, assist 3D gaming developers, CAD users and others while providing a new level of visual excitement to a future version of OS X.
It's very powerful in that this current invention isn't a standalone idea. Apple's research teams have been working on advanced 3D interfaces for some time now. In April 2010 we learned of Apple's unique 3D Ambient Light Feature. In May 2010 we learned of Apple's Extraordinary Multifunctional 3D Widgets and in January 2010 Apple revealed how 3D could be coming to iOS devices as well. When you combine these varying Apple inventions along with Apple's head tracking proposal of 2009 – we're able to see the making of something extraordinary.
While I'd love to see this technology surface next year, I don't think that this is short term thinking at Apple. Reengineering OS X for 3D is going to take a lot of work. Then again, nothing stops Apple from slowly introducing various 3D elements into the mix to test out some of their inventions. It could be as simple as providing new 3D desktop background options to cause a stir.
The good news is that earlier this month Apple revealed that they were working on a new 3D CAD app that could work on a future iPad – and so Apple's work is slowly turning into a real trend that is gaining momentum in Apple's labs. And with rumors of Apple entering the TV market in the coming years, 3D content and advanced user interaction on tap could once again give Apple another revolutionary product that we could look forward to.
Apple's patent application 20110175902 was originally filed in Q1 2010 by inventor Peter Mahowald who was behind Apple's 2010 patent application concerning Solar Powered MacBooks. Related material: 3D and Display Archives.
Notice: Patently Apple presents a detailed summary of patent applications with associated graphics for journalistic news purposes as each such patent application is revealed by the U.S. Patent & Trade Office. Readers are cautioned that the full text of any patent application should be read in its entirety for full and accurate details. Revelations found in patent applications shouldn't be interpreted as rumor or fast-tracked according to rumor timetables. Apple's patent applications have provided the Mac community with a clear heads-up on some of Apple's greatest product trends including the iPod, iPhone, iPad, iOS cameras, LED displays, iCloud services for iTunes and more.
About Comments: Patently Apple reserves the right to post, dismiss or edit comments.
Here are a Few Great Community Sites covering our Original Report
MacSurfer, Business Insider , StockTwits, Money.CNN, Twitter, Facebook, Apple Investor News, Google Reader, UpgradeOSX, TechWatching, Macnews, iPhone World Canada, CBS MarketWatch, MacMagazine Brazil, Techmeme, The Atlantic Wire, El Mundo Spain, Winandmac China, Yahoo! News, TICbeat Spain, and more.
