A new patent application from Apple this morning shows us that they're looking at delivering a little more buzz to future iOS devices. Then again, it could be a pulse, vibration and/or other sensation because what's being described here is advanced haptics. The buzz before the launch of the "new iPad" was that Apple was going to introduce haptics from Senseg that would give users the ability to actually feel textures on their new Resolutionary Retina Display. I was stunned at the quality of the Retina display and I would have flipped if they would have added this feature. But it wasn't meant to be, just yet. Apple first introduced the idea of bringing haptics to the iPhone a year ago and today's patent sheds a little more light on the subject. Advanced haptics will freak us out at the realism it could bring to science books, artwork, photography – and yes, games. Advanced Haptics could very well end up being a game changer for the senses, to be sure. With a little patience, we'll one day have our cake and eat it too.
Today's Multi-Touch Surfaces Lack Haptic Feedback
Existing touch-based user interfaces typically have a touch panel and a visual display component. The touch panel may include a touch sensitive surface that, in response to detecting a touch event, generates a signal that can be processed and utilized by other components of an electronic device. The touch sensitive surface may be separate from the display component, such as in the case of a trackpad (or Magic Mouse surface), or may be integrated into or positioned in front of the viewable area of the display screen, such as in the case of a display touchscreen.
In either case, the display component may display textual and/or graphical display elements representing selectable virtual buttons or icons, and the touch sensitive surface may allow a user to navigate the content displayed on the display screen.
Typically, a user may move one or more objects, such as a finger or a stylus, across the touch sensitive surface in a pattern that the device translates into an input command. As an example, some electronic devices allow the user to select a virtual button by tapping a portion of the touch sensitive surface corresponding to the virtual button. Other electronic devices include a touch sensitive surface that can detect more than one simultaneous touch events in different locations on the touchscreen.
Existing touch-based user interfaces do not provide haptic feedback to a user. Haptic feedback may be any type of tactile feedback that takes advantage of a user's sense of touch, for example, by applying forces, vibrations, and/or motions to the user. The user can typically only feel the rigid surface of the touch screen, making it difficult to find icons, hyperlinks, textboxes, or other user-selectable input elements that are being displayed.
A touch-based user interface may help a user navigate content displayed on the display screen by incorporating haptic feedback. For example, localized haptic feedback can enable a user to feel what is being displayed by providing feedback when a user locates a virtual button, selects the virtual button and/or confirms the selection of the virtual button.
Apple's Haptic Solution
One of the latest Apple inventions revealed today by USPTO relates to touch-based user interface devices that can both receive an input from a user and provide haptic feedback based on the input from the user. In one embodiment, a touch-based user interface device may include a haptic feedback layer that includes one or more piezoelectric actuators that are embedded in a nonconductive material.
The haptic feedback layer may be the outermost layer of the touch-based user interface device so that the mechanical stimulation provided by the actuators can be felt by a user. However, in other embodiments, the haptic feedback layer may be covered by a protective coating or cover layer.
Adding Displacement Sensor and/or Force Sensor
In some embodiments, a printed circuit board layer may be positioned underneath the haptic feedback layer. The printed circuit board layer may include one or more metallic traces that are configured to supply a voltage to each of the piezoelectric actuators embedded in the haptic feedback layer. Some embodiments may also include input sensors, such as a displacement sensor and/or force sensor for recognizing and distinguishing between various touch-based input gestures from a user.
Force sensors may allow for distinguishing between various input gestures that may be associated with different commands. In one embodiment, the force sensors may be used to differentiate between a click and a scroll command. As an example, the processing device may associate a higher amount of force, such as from a tapping motion, with a click command and a lower amount of force, such as from a gliding motion, with a scroll command (or vice versa).
Embedding Actuators into New Haptic Feedback Layer
One embodiment may take the form of a touch-based user interface that includes a haptic feedback layer including one or more actuators configured to supply a haptic feedback. The one or more actuators may be embedded in a nonconductive material. The touch-based user interface may further include a printed circuit board layer underlying the haptic feedback layer. The printed circuit board layer may include one or more conductive traces configured to supply a voltage to the one or more actuators.
Embedded actuators may serve to insulate the actuators and separate the actuators from one another. In other embodiments, the nonconductive material may be an organic or compliant material that has a sufficiently high modulus of elasticity to deform with the attached embedded piezoelectric actuators. In this embodiment, the nonconductive material may increase and decrease in height as the attached embedded actuators increase and decrease in height. Some examples of organic materials that may be used include elastomers, silicon, thermoplastics, and so on and so forth.
Another embodiment may take the form of a method for manufacturing a haptic feedback layer. The method may include arranging one or more piezoelectric actuators so that the one or more piezoelectric actuators are spaced apart from one another, and filing any spaces between the piezoelectric actuators with a nonconductive material.
Another embodiment may take the form of a method for manufacturing a haptic feedback layer. The method may include arranging one or more piezoelectric actuator strands so that the one or more piezoelectric actuator strands are spaced apart from one another, filling any spaces between the piezoelectric actuator strands with a nonconductive material to form a blank, and cutting the blank to form a haptic feedback layer.
The Advanced Piezoelectric Actuator
Apple's patent FIGS. 1A to 1C illustrate some examples of electronic devices that incorporate various embodiments of touch-based user interfaces that could take advantage of advanced haptic feedback. Even a MacBook trackpad will be able to provide users with haptic feedback by confirming a user's selection of a particular virtual icon or button on screen like an icon found in OS X Lion's Launchpad. This would be true with Apple's Magic Mouse as well. These are examples of the haptic layer not being directly connected to a display.
Apple's patent FIG. 2 shows us a perspective view of a single piezoelectric actuator. The piezoelectric actuator may provide some type of mechanical stimulation, such as a pulse, vibration, or other feedback, upon actuation.
The piezoelectric actuator may include electrodes 102 and 104 and piezoelectric material 106, any or all of which can be transparent, opaque, or a combination thereof. The piezoelectric material can include, for example, a ceramic, polyvinylidene fluoride, one or more natural crystals (such as, e.g., Berlinite, cane sugar, quartz, Rochelle salt, topaz, and/or any tourmaline group mineral(s)), man-made crystals (such as, e.g., Gallium orthophosphate or langasite), bone, polymers, and/or any other material that is able to mechanically deform in response to an applied voltage.
Manufacturing a Haptic Feedback Layer
Apple's patent FIG. 3A shown below illustrates a top down view of one embodiment of a touch-based user interface. As shown in FIGS. 3A and 3B, the touch-based user interface 300 may include an optional cover layer 305, a haptic feedback layer 301, a printed circuit board ("PCB") layer 307, and one or more force sensors 315.
Apple's patent FIGS. 7B illustrates an embodiment of a method for manufacturing a haptic feedback layer. In one embodiment, the nonconductive material may be heated to a liquid state, and then poured over the array of piezoelectric strands. In other embodiments, the nonconductive material, in solid form, may be placed around the piezoelectric strands, and the strands and the nonconductive material may be heated so that the nonconductive material is melted and fills the gaps between the strands. In one embodiment, adhesive 308 may be applied to the side edges of the strands before the nonconductive material is added to the mold.
The formed composite blank may then be cut to form different configurations of touch-based user interface devices. In one embodiment, shown in FIG. 7B the blank may be cut along a plane perpendicular to the direction of extension of the strands to form a haptic feedback layer
Patent Credits
Apple's patent application was originally filed in Q3 2010 by inventors Paul Puskarich and Michael Pilliod.
Apple's "iPad Smart Cover" Patent Bonanza
This past Tuesday we presented a granted patent report titled "Apple Wins First Coded Magnet Patent for iPad Smart Cover." The standard patent process is that we first see the patent application followed by a granted patent some time later - like 18 months for example. The iPad Smart Cover granted patent was in reverse. We got to see the granted patent first. This was confirmed today when the US Patent and Trademark Office published a whopping ten iPad Smart Cover patent applications. The Patent Figures are the same as those presented in this week's report, so we're not going to rehash old news. Here's a temporary link to just one of these new applications but remember, temporary links are only good for a few days. So if you miss it within the first three days after the date of this report, you could be sent to another unrelated patent: Temp link
Notice: Patently Apple presents a detailed summary of patent applications with associated graphics for journalistic news purposes as each such patent application is revealed by the U.S. Patent & Trade Office. Readers are cautioned that the full text of any patent application should be read in its entirety for full and accurate details. Revelations found in patent applications shouldn't be interpreted as rumor or fast-tracked according to rumor timetables. Apple's patent applications have provided the Mac community with a clear heads-up on some of Apple's greatest product trends including the iPod, iPhone, iPad, iOS cameras, LED displays, iCloud services for iTunes and more. About Comments: Patently Apple reserves the right to post, dismiss or edit comments.
Check out our Latest Patent Report on Patent Bolt Titled:
Lenovo Dreams of Waterproof Notebooks & Acrobatic Displays
Here are a Few Sites covering Patently Apple's Original Report
MacSurfer, Twitter, Facebook, Apple Investor News, Google Reader, Macnews, iPhone World Canada, MarketWatch, Forbes, and more.
