The Apple Pencil team filed a patent for a new squeeze feature back in April 2022 that came to life this week during Apple's iPad event. Today the U.S. Patent and Trademark Office officially published another patent application from the Apple Pencil team that envisions a possible future MacBook with a built-in Apple Pencil retainer. To advance this idea even further, the Apple Pencil in the retainer will illuminate F-Key functionality.  

Mountable Tool Computer Input

Apple's patent relates to a computing systems in which a computing device (MacBook) is configured to interact with an input tool such as Apple Pencil that could be stored in or on a the MacBook chassis.

The future input tool / Apple Pencil could be used as a first type of input device (e.g., a touch- or force-sensitive writing instrument). In a second application, the Apple Pencil chassis could provide a set of simulated F-Keys.

The future input tool / Apple Pencil could be touch-sensitive at its outer surfaces in a manner that allows a user to tap, touch, or press the outside of the tool to provide a signal to the MacBook whether or not the tool is mounted to the computing device. Also, in some cases, the input tool or chassis could comprise features for displaying information to a user, and the information could be visible to the user on or through the input tool when it is handheld or mounted to the chassis.

Accordingly, a future Apple Pencil could also be used to replace or replicate many of the functions and capabilities of an ancillary touch screen while also being able to provide separate stylus-like functionality.

In addition, the future input tool / Apple Pencil could comprise an internal display or set of indicators that interacts and electrically communicates with a keyboard or other associated computing device when the tool is positioned in a socket or recess of the keyboard chassis, and the tool could therefore function similar to an ancillary touch screen or a set of keyboard keys when it is the socket or recess.

Removing the tool from the chassis could change the function of the tool or change the meaning and function of its electrical and sensor signals so that it is operable as a stylus or wand input device.

Apple's patent FIG. 1 below illustrates an Apple Pencil that could be attached to a future MacBook; FIG. 2 illustrates the Apple Pencil sitting in its own recessed groove or tool retainer above the keyboard. 

In some embodiments, pieces of information (#250 and #252) shown on the display screen (#210) could include a menu or set of graphical symbols indicating a status of the input tool (Apple Pencil #218). For example, movement of the input tool could cause the computing system (MacBook #200) to display information regarding the battery state of charge or other information about the settings or features of the input tool. The information could be shown persistently or temporarily on the display screen.

In Patent FIG. 7 above when contact with other portions of the surface of the Apple Pencil could be detected and produce other outputs, such as the outputs of other function keys (e.g., F1, F2, etc.), system function controls (e.g., screen brightness, keyboard backlight brightness, volume controls, power, sleep, display settings, application settings (e.g., font, size, or color for a word processing or art application), etc.), or other conventional keyboard outputs (e.g., letters, symbols, modifier keys, etc.).

Apple's patent FIG. 3 below illustrates that beyond the grooved retainer area holding Apple Pencil, the Pencil could be attached to the side or bottom of the MacBook chassis; In FIGS. 4A-C The input tool can be prevented from rolling off of the housing by contacting side surfaces of the recess as it rotates.

Further, the rotation of the input tool could be measured and tracked as a user input to the electronic device. In some embodiments, the rotation of the input tool could be used to control functions of an electronic device that are conventionally controlled by a rotatable wheel-like device, such as a mouse wheel that controls scrolling, zoom, or size adjustment functions. For instance, rotating the input tool 1604 about its longitudinal axis could cause a mouse or text cursor to move vertically across the main display.

Apple's patent FIG. 11 below illustrates how Apple Pencil could be illuminated so as to illustrate traditional F-Keys; In FIG. 17 we see the Apple Pencil used as mouse. For example, a motion of the user object detected by the trackpad could be supplemented when a user object causes movement of the input tool. One hand of the user could provide input to the trackpad while the other hand could provide input to the input tool. Accordingly, multiple functions of the electronic device could be controlled independently and simultaneously by the trackpad and input tool.

Apple's patent FIG. 19 below illustrates another embodiment of a housing (#1900) having a recess (#1902) containing an input tool (#1904). In this embodiment, the input tool comprises an internal feedback driver (#1906) and a sensor (#1908) configured to detect a user object 1909 contacting or applying a force to the outer surface (#1910) of the input tool.

Further, the feedback driver could comprise a haptic, audible, or visual feedback generator configured to actuate in response to a signal generated by the sensor (or a connected controller) when the user's finger (#1909) is detected. For example, in some embodiments, the feedback driver could be a light source. The feedback driver can therefore indicate to the user (via feel, sight, or sound generated within the input tool) that the sensor has detected the user's finger.

Apple's patent FIG. 23 above illustrates another diagrammatic side view of a housing (#2300) having a recess (#2302) holding an input tool (Apple Pencil #2304). This input tool is shown with an inertial measurement unit (IMU) (#2306) configured to transduce translation or rotation of the input tool.

For instance, the IMU could track rotation of the input tool about its longitudinal axis. The IMU could also be used to track tilt and translation of the input tool. Thus, output signals of the IMU could be used to determine whether the input tool  is positioned external to or within the recess or whether or not the tool is positioned on a flat surface.

When the input tool is tilted or determined to be outside a recess or out of contact with the housing, the input tool could provide a first type of functionality, such as functionality similar to a pen input device, input tool, and a first set of touch signals when a user touches or presses against the outer surface of the input tool.

To review the full details of this invention, check out patent application 2024015221. Apple originally began to work on this project back in 2020. Today's patent application marks their third patent on this project which adds 20 new patent claims.