The Problem to Solve

Apple's patent related documentation first lays out the problem that their proposed invention is to solve. According to Apple's engineers, Computer-aided design (CAD) programs and other drafting applications allow users to create two-dimensional and three-dimensional graphical objects on a virtual drafting area. However, conventional CAD user interfaces often require users to act in non-intuitive ways. For example, if a user wants to draw a straight line, the user typically moves a cursor from the drafting area to a tool menu or bar, selects a tool for drawing a straight line, then returns the cursor to the drafting area and specifies the start and end points for the line. These multiple steps are time consuming and can result in inefficient drafting.

Overview of Apple's Proposed Solution

Apple's invention covers techniques and systems supporting the use of virtual tools in a drafting application. These techniques could be used to match user input defining a tool to a virtual tool, and process user input using the tool.

In one aspect, a user interface is presented on a display of a device. A first touch input including touch inputs at two or more locations is received, and a virtual tool corresponding to the relative positions of the two or more locations is identified. A second touch input interacting with the virtual tool is received, and a graphical object corresponding to the identified virtual tool and the second touch input is presented in the user interface.

Particular embodiments of the subject matter described in this specification could be implemented to realize one or more of the following advantages. Users could intuitively interact with a drafting application. Users could indicate what drafting tools are desired by the position of their fingers (or other input devices), without needing to interact with menus or other user interface elements in the drafting application. Users could easily indicate whether graphics objects should be draft objects without needing to interact with menus in the drafting application. Users could easily indicate the appropriate thickness of lines making up graphics objects without needing to interact with menus in the drafting application.

Apple's Proposed Multi-Touch Drafting App

In the beginning, we see that Apple's patent application emphasizes iOS devices though it must be clarified that their proposed drafting application could be utilized equally on a MacBook or iMac using OS X Lion's advanced multi-touch touchpad capabilities. The application could work with multiple fingers, chording, and other interactions – as well as a stylus. See Patently Apple's "Smart-Pen" Archives for a peek at Apple's in-lab advances in this area.

In Apple's patent FIG. 1 illustrated above, we see window 104 corresponding to a drafting (or drawing) application. When the drafting application is launched on the device, the device enters a drafting mode. In drafting mode, the user could use virtual tools to indicate what shapes, lines, and other graphical objects should be displayed in application view window 112. Apple's patent FIG. 8 illustrates example software architecture 800 for implementing virtual drafting tools.

Drafting App Tools: The Virtual Ruler

Virtual tools could correspond to physical tools that are commonly used by drafters. Some examples of virtual tools of this type include a ruler, a t-square, a protractor, a compass, and various stencils that can be traced.

Virtual tools could also correspond to user-defined tools. User defined tools are tools defined by a user to have particular properties, and need not correspond to physical drafting tools. In some implementations, selectable representations of tools, for example, user defined tools, are displayed in the drafting user interface to allow a user to edit data for the tool. In some implementations, the device allows a user to interact with multiple tools simultaneously.

The Block of four illustrations noted below in Brief: Apple's patent FIG. 2A illustrates an example drafting user interface displayed on a device; FIG. 2B illustrates an example visual representation of a virtual ruler; FIG. 2C illustrates a user entering touch input and interacting with the virtual ruler of FIG. 2B; FIG. 2D illustrates a graphical object resulting from the touch input of FIG. 2C.

Various Other Virtual Ruler Notes

In some implementations, the user will be able to use pinching gestures to adjust the overall length of the ruler tool 220 by moving his or her fingers further apart (resulting in a longer ruler) or closer together (resulting in a shorter ruler) on the drafting user interface.

In some implementations, the ruler tool could be detached or "float" on the draft UI to allow the user to use one or more fingers to drag or rotate the ruler tool in the drafting UI.

Apple's patent FIG. 2B illustrates an example visual representation of virtual ruler 220. The length of the ruler is defined by the distance between touch inputs 202 and 204 and could be manipulated using a pinching gesture. .

In some implementations, other aspects of the visual appearance of the ruler tool could also be determined according to user preferences. For example, the user could specify one or more of the preferred units (e.g., metric units, English units, or both) displayed on the ruler tool, the color of ruler tool, it's transparency, width and even material (wood, metal, plastic, etc.).

Drafting App Tools: Virtual Protractor

The Block of three illustrations noted above in Brief: Patent FIG. 3A illustrates an example drafting user interface on a device receiving touch input from a user specifying a virtual protractor; FIG. 3B illustrates an example visual representation of the virtual protractor of FIG. 3A, and touch input interacting with the virtual protractor; and FIG. 3C illustrates a graphical object resulting from the touch input of FIG. 3B.

Drafting App Tools: Virtual Compass

The Block of four illustrations noted above in Brief: Patent FIG. 4A illustrates an example drafting user interface receiving touch input from a user specifying a virtual compass; FIG. 4B illustrates an example visual representation of the virtual compass of FIG. 4A; FIG. 4C illustrates an example of a user entering touch input interacting with the virtual compass of FIG. 4B; and patent FIG. 4D illustrates a circle generated in response to the touch input of FIG. 4C.

Drafting App Tools: Virtual Stencil Tool

The Block of four illustrations noted above in Brief: Patent FIG. 5A illustrates an example drafting user interface on a device receiving touch input from a user specifying a virtual triangle stencil; FIG. 5B illustrates example user touch input tracing the virtual stencil of FIG. 5A; FIG. 5C illustrates a graphical object resulting from the user touch input of FIG. 5B; and patent FIG. 5D illustrates an example of modifying the graphical object of FIG. 5C after it has been drawn.

Another New Hardware Twist Mentioned in Apple's Documentation

In describing the hardware architecture powering this device and application, we once again read that Apple is considering the use of a hybrid positioning system like that from Rosum Corporation that we first pointed to earlier this month in addition to a secondary location aware program from Skyhook.

One More Thing: Possible Cloud Services

Apple states that virtual tool services provide virtual tool definitions and data to a user device, and may also generate graphical objects corresponding to user input, for example, as described above. Drafting services provide drafting application functionality to a user. As noted in FIG. 10 below, it would appear that the noted services may relate to Cloud Services. 

For those that are really interested in a possible new drafting app from Apple may want to check out patent application 20110175821a little more closely for greater detailing. Apple's patent application was originally filed in Q1 2010 by inventor Nicholas King.

Other Noteworthy Patent Applications

In a number of Patently Apple reports such as our June and August 2010 as well as our March 2011 we pointed to Apple's fanatical attention to detail from including Nitriding Stainless Steel to specialty glass or liquid metal into the current or future iPhones. In a new patent application that surfaced late last week we learned of yet another twist in the aesthetics of iOS devices in respect to Apple applying a dichroic coating to the glass of such devices.

Apple's Patent Application 20110177300 Abstract: A dichroic coating could be applied to a glass window of an electronic device to enhance the cosmetic and aesthetic appeal of the device. Different processes could be applied to the glass window in combination with a dichroic coating. For example, a layer of ink could be applied to the glass window in addition to one or more layers of dichroic material. The material layers could cover any suitable portion of the glass. For example, the material layers could include holes or openings. As another example, the material layers could be constructed from several distinct shapes placed on the glass. In some cases, software applications could be used to define a desired color profile for a coating, and to retrieve a suitable combination of dichroic and other layers to provide the desired color profile.

Notice: Patently Apple presents a detailed summary of patent applications with associated graphics for journalistic news purposes as each such patent application is revealed by the U.S. Patent & Trade Office. Readers are cautioned that the full text of any patent application should be read in its entirety for full and accurate details. Revelations found in patent applications shouldn't be interpreted as rumor or fast-tracked according to rumor timetables. Apple's patent applications have provided the Mac community with a clear heads-up on some of Apple's greatest product trends including the iPod, iPhone, iPad, iOS cameras, LED displays, iCloud services for iTunes and more.

About Comments: Patently Apple reserves the right to post, dismiss or edit comments.

Here are a Few Great Community Sites covering our Original Report

MacSurfer, Twitter, Facebook, Apple Investor News, Google Reader, UpgradeOSX, TechWatching, Macnews, iPhone World Canada, CBS MarketWatch, MacDailyNews, iPadevice Italy, MacMagazine Brazil, and more.