Apple Explores Keyboards using an Advanced Air Feedback System
This appears to be the year of the keyboard. Apple began the year working on several keyboard projects including one involving a leap to a next generation virtual keyboard system for desktops while working on a secondary parallel bridging keyboard project that involved implementing a hybrid keyboard using advanced motion tracking. In Apple's latest keyboard project, which was published today by the US Patent and Trademark Office, we see a more practical approach to advancing keyboards in the shorter scheme of things by using advanced sensors and a unique air-based feedback system primarily for Mac keyboards. In the longer scheme of things, Apple is actually eyeing the concept of using deformable keyboard systems.
The Problem to Solve
As a result of ever thinner computer designs such as the MacBook Air, input devices associated with those devices, such as keyboards and key pads, have become correspondingly smaller with lower-profiles for both practical and esthetic reasons.
In the cases of input devices such as keyboards and key pads, a relatively lower profile design dictates keys with relatively reduced travel relative to more conventionally sized devices. However, that reduced travel also changes, and typically limits, the tactile feedback experienced by a user. Thus, in many cases, such reduced travel input devices do not provide a fully satisfactory user experience for users accustomed to more conventional designs. In many cases, this less than fully satisfactory user experience includes less than satisfactory tactile feedback to the user, due to the limited travel of the keys.
Apple's patent covers embodiments of input devices for computing systems as well as methods of operation of the input devices to provide enhanced user experiences. In some examples, the user experience will be impacted by a change in the tactile feedback relative to conventional devices. One example of changed tactile feedback as described herein includes providing feedback to a user before actual contact with the key. That may be done by detecting the proximity of a user to a key of the input device that suggests an imminent user actuation of the key, and in response to detected proximity, to flow air from the input device proximate the key in question to provide tactile feedback to the user before physical contact with the key surface. In some cases, the air pressure may be applied in a manner to oppose motion of the user toward the key surface.
Advanced Keyboard Feedback Elements
According to Apple's patent, each key assembly includes at least one feedback element. In one example, a feedback element includes a plurality of air flow openings in a key surface of key through which air may be forced to provide direct pneumatic feedback to a user. In an alternative embodiment, a feedback element could include an actuator to which air may be supplied or withdrawn to move the respective key and provide a pneumatically assisted key stroke.
In the embodiments wherein air is expelled from the input devices, such as through apertures (preferably micro-perforations) in the keys, the objective is to provide a tactile user interaction even before contact with the key. For example, since the key travel will be relatively limited, air can be used to engage a user's finger even before contact with the key, to provide resistance to the user prior to actual contact. In these systems, the presence of a user can be detected at a proximity that is identifiable as likely indicating that physical actuation of the key is imminent, and that sensed proximity can be used to trigger the expelling of air proximate the key to provide a resistance sensation to the user.
In Apple's patent FIG. 4B below we see a top view of a key assembly illustrating a key surface which includes a plurality of openings (410) depicted as micro-perforations. Other sizes of opening are also possible, so long as they permit air flow at an appropriate volume for the specific application.
Micro Perforated Keys for LED-Key Illumination
As an alternative to a generally uniform grid of micro-perforations, Apple is considering using one or more light sources, such as LEDs, to illuminate the key through the perforations. Alternatively, such LEDs may be used in an optical proximity or contact system, to detect the presence of a user, as described herein.
The System could also apply to Virtual Keyboards on iOS Devices
As a twist to this patent, Apple goes on to describe that flowing of air could also be implemented in a virtual keyboard, wherein each key location is merely a defined region on a solid surface, where contact with that surface region will generate a defined input signal.
Such virtual keyboards may have no moveable surfaces. In such configurations, notwithstanding the absence of a moveable surface, the flowing of air through apertures in the surface may be used to provide a tactile resistance to a user's actuation motion and/or to absorb at least a portion of the actuation force.
The System could also apply to Deformable Keyboards
In another alternative configuration, the key assemblies might not be in the form of a mechanical key but rather include deformable regions. Such deformable regions may be formed of compressible materials (such as a gel or foam), by an air-filled (or other gas filled) pocket, or by a supported membrane. This was discussed in great detail by Apple in a June 2010 patent which described shape shifting device interfaces.
Apple credits Aleksandar Pance, Michael Sinclair and Brett Bilbrey as the inventors of patent application 20110107958, originally filed in Q4 2009.
Another Noteworthy Patent Application Published Today
Apple Patent Reveals New Braille Mirroring System
Another noteworthy patent of Apple's that was published today reveals that they're working on a new Braille Mirroring System. According to Apple, content is converted into Braille content, and then formatted for each of a plurality of Braille displays. The formatted content is then sent to each of the Braille displays. In another aspect, data identifying a primary Braille display in a plurality of Braille displays is stored. Input requesting that a data processing apparatus perform an action is received from one of the Braille displays, and it is determined whether to perform the action, based in part on whether the requesting Braille display is the primary Braille display. For more information, see Apple's patent 20110111376.
Notice: Patently Apple presents only a brief summary of patents with associated graphic(s) for journalistic news purposes as each such patent application is revealed by the U.S. Patent & Trade Office. Readers are cautioned that the full text of any patent application should be read in its entirety for further details. Patents shouldn't be digested as rumors or fast-tracked according to rumor time tables. Apple patents represent true research that could lead to future products and should be understood in that light. About Comments: Patently Apple reserves the right to post, dismiss or edit comments.
Here are Some Great Community Sites that are Covering our Original Report
Techmeme, MacSurfer, Apple Investor News, Google Reader, UpgradeOSX, iPhone World Canada, CBS MarketWatch, Macnews, Cliqz, MacPlus France, OS X Daily, BGR, Mac Life Germany, Vesti Russia, Geeky Gadgets, MacKozer Poland, MaximumTech Russia, and more.