On April 12, 2012, the US Patent & Trademark Office published a patent application from Apple that reveals a new electronic content authoring tool in the works that's configured to optimize authored content for one or more intended devices. According to Apple, the existing solutions on the market today are simply not adequate to eliminate barriers between content creators and the presentation of high quality electronic content on a variety of platforms. Today's report presents you with a grand overview of Apple's new authoring tool which includes a few cool user interface elements that we're likely to see surface in the not-too-distant future.
Apple's Patent Background on Today's Inadequate Web Authoring Tools
In many instances, computer-programming languages are a hindrance to electronic content creation and, ultimately, delivery to content consumers. Often content creators and designers simply lack the skill and the knowledge to publish their mental creations to share with the world.
To begin to bridge this gap, content creators can use some electronic-content-development tools which allow content creators to interact with a graphical user interface to design the content while an electronic-content-development tool puts the computer-programming code in place to represent the electronic content on a user's computer.
One type of such tool is a web page development tool, which allows a user to create webpages with basic features by designing the webpage graphically within the electronic-content-development tool. However, in most instances, such tools can only assist users with basic features. Users wanting customized elements must still have knowledge of one or more computer-programming languages. For example, while some web-content development tools can assist with the creation of basic hyper-text markup language (html) content, these tools have even more limited capabilities to edit cascading style sheet (CSS) elements. Often variables within the CSS code must be adjusted directly in the code. Such adjustments require knowledge of computer-programming languages, which again, many content creators lack.
Another challenge in the creation and delivery of electronic content is that the capabilities of user terminals for receiving and displaying electronic content vary greatly. Even if a content creator successfully creates his electronic content, it is unlikely that the content is optimally configured for each device on which the user will view the content. Originally, digital content was created without having to account for device capabilities. The digital content was going to be viewed on a computer or television having a display of at least a certain size, with at least a certain resolution, if not multiple resolutions. Accordingly, it was possible to generate only one version of the electronic content and that version could be expected to be presented properly by the user's device. However, more recently, smaller displays with fixed resolutions, paltry computing resources, inferior browser technologies, and inconsistent network connectivity such as associated with handheld communication devices have made it so that electronic content isn't always adequately displayed on every device for which a user is expected to view it.
Due to such diverse devices having such diverse capabilities, content must now be created not only once, but often several times so that it can be configured for multiple device types. This development has introduced a new barrier to content creation and delivery. To reduce this barrier, an early technology could create mobile versions of web content by converting a web page intended for viewing on a desktop computer or laptop. Such technology is not suitable for most purposes, because the content creator does not get to see the finished product before it is severed to the mobile device. Another problem is that such technology uses a lowest-common denominator approach, wherein the content is converted so that it can be displayed on any mobile device, despite the fact that many mobile devices can display greatly enhanced content.
A further difficulty in creation of electronic content is that assets can frequently overlap each other when developing an application's interface that includes even rudimentary animation. Since the assets can overlap, it is often difficult to work with assets, to view them unobstructed by other objects, and/or to select the assets to work with.
Accordingly, the existing solutions are not adequate to eliminate barriers between content creators and the presentation of high quality electronic content on a variety of platforms.
Apple's Advanced Content Authoring Tool Solution
Apple's invention provides technology relating to a digital content authoring tool for amateur and professional content developers alike, without the need to understand or access any computer code. Additionally, the authoring tool is further equipped with the ability to manage digital assets and configure them for distribution and viewing on a variety of electronic devices – many of which have diverse hardware capabilities. Accordingly, the presently described technology eliminates many barriers to creating and publishing deliverable electronic content.
Authoring Tool Templates
Apple's authoring tool receives a collection of assets and other files collectively making up deliverable electronic content. In some instances, the authoring tool provides one or more templates, such as a menu navigation template or one of the pre-defined objects referenced above, as starting points for the creation of electronic content. The templates can include containers configured to receive digital assets so a content creator can modify the templates according to his or her vision. In some embodiments, the authoring tool is configured to receive digital assets by importing those assets into the authoring tools asset library. The assets can be imported through a menu interface or through drag and drop functionality. The assets then may be added to the templates by, for example, dragging the asset onto the desired container on the template or through a menu interface.
Inspector Widget for Modifying CSS
Relating Actions to a Time Axis
Apple further states that the assets can also be modified with animation. Each animation can be controlled by an action, and the actions can be tied to a time axis for execution. In some embodiments the actions associated with the assets can be visibly displayed in a menu; in some embodiments the menu can be a sidebar though any graphical user interface element for displaying the actions should be considered within the scope of the present technology. The action can be displayed along a visible time axis, however, throughout this description a time axis can refer to both a visual time axis, or time axis maintained by a computing device and used to relate the relative start and stop times of the associated actions. By relating actions to a time axis, animations based on the actions can be more easily viewed and reviewed.
Easier to Focus on the Design of a Single Element or Asset
In some embodiments, Apple states that the system can clear a page of all but a selected asset so that it may be more easily worked with. This can be true in embodiments wherein many assets overlap during the duration of the full time axis needed to portray all animations associated with all assets on a given page. In such embodiments, all assets except for the selected asset can be hidden so that the user can more easily view or work with the selected asset. In some embodiments, not all assets need be hidden, for example, a background asset might remain visible along with the selected asset.
A Graphical User Interface Inspector Tool
As an example of the functioning of this abstraction layer, a code for a "Button" defines its user-modifiable parameters (size, position, color, etc.), and required parameters that may be managed by the system without the users knowledge (event handling behaviors, error handling, etc.). The application outputs the information required to construct a "Button", and simulates this in the application user-interface, possibly using the same implementation that will be used at runtime, but there is a possibility that a modified or entirely different implementation will be provided at runtime.
Because the code defining the object meets the common scheme defining user-modifiable objects in the authoring tool, this extra functionality required only at authoring time (user input validation, special handling of authoring environment preview functionality, etc.) is removed when the content is published.
As illustrated, a user has selected the Carousel element #452 and dragged and dropped the Carousel element onto the menu page. Such action transforms the listing of links on the menu page into a rotatable 3-D Carousel as illustrated in FIG. 9B.
Above the wall, there can be pictures or logos (#802) and text (#840) for informational, descriptive, branding, etc. purposes. Below the wall, there can be intriguing visual effects, such as virtual mirror reflections (#810) of the row or rows, or descriptive text (#812) on wall "floor. A user can use a swiping gesture to "scroll" and navigate along the wall to different files or items. Furthermore, the row or rows can optionally wrap around to form a virtual infinite loop of items for the user to scroll through.
In Apple's patent FIG. 15B we see how a user can tap or select an item to cause it to "pop out" or "fly out" and enlarge (#814) to show more details (#816) about it. Moreover, additional pictures (i.e. album cover art # 818), data (i.e. song titles), or links (i.e. to an online digital content store such as Apple's iTunes) can be provided to give information to the user or to enable the user to directly purchase the file or item without having to go to an online store to search for it.
Apple notes that the pinwheel can also be spun, so that a random item is chosen. This allows for an interactive and engaging way for the user to choose a random item. There can also be a detail portion on the screen that displays more information about the selected item. Tapping the selected item again or pressing a button on the screen can bring the user to a new page with even more detailed information.
Editing Functions for a Multi-Image 3-D Zoetrope
Apple's development tool can also include an interesting editing function for multi-image displays such as a zoetrope. Apple's patent FIG. 33 shown below illustrates an exemplary multi-image display wherein an image of a smart phone is shown being rotated to in a simulator. The 3-D view can be created by displaying multiple views in sequence, just as frames in a movie or a zoetrope.
Apple's patent FIGS. 34a and 34b illustrate exemplary editing embodiments. Patent FIG. 34a illustrates several of the images used by the zoetrope, with the highlighted image being available for editing. Each of the images used in the zoetrope can be selected and edited. Additionally we see an embodiment wherein an image can be added or removed from the collection of images used by the zoetrope. FIG. 34b illustrates an additional cell added to the zoetrope wherein an additional image can be added.
Apple's Publishing & Validation Tools
The finished product can be validated for distribution to one or more known devices that are intended targets for the deliverable content. The publishing tool can determine device criteria associated with each of the devices that are intended to receive the deliverable content from a library of devices or known device criteria. In some embodiments, the device criteria comprises of hardware capabilities of a given device. For example, the device criteria can include screen size, resolution, memory, general processing capabilities, graphics processing, etc.
The validation comprising analyzing assets and files for compatibility with the device criteria and, in some instances, expected network connection states, including connection types such as cellular connections or Wi-Fi, connection reliability, and measured connection speeds.
Once validated, the deliverable content that is compatible with the device criteria can be compiled into a content package for delivery to content consumers using one of the known devices.
A Content Delivery Server
And lastly, Apple notes that a content delivery server can store a collection of versions of assets, each being compatible with different device or network criteria. In such embodiments, the content delivery server can be configured to select an appropriate version of the asset based on run-time network conditions and the device criteria associated with the device that is requesting the content from the content delivery server.
Patent Credits & Cover Graphic Information
Apple's patent application was filed in Q4 2011. The inventors include Senior UI Designer Genevieve Garand, UX designer Steve Marmon, Director of Engineering – Apple Online Store Ralph Zazula and Design Manager (Pro Apps) Michael Stern.
Our Cover Graphic includes patent FIG. 17C illustrates an exemplary transition effect on an iPhone while patent FIG. 19 illustrates an exemplary menu of potential actions for modifying content.
Notice: Patently Apple presents a detailed summary of patent applications with associated graphics for journalistic news purposes as each such patent application is revealed by the U.S. Patent & Trade Office. Readers are cautioned that the full text of any patent application should be read in its entirety for full and accurate details. Revelations found in patent applications shouldn't be interpreted as rumor or fast-tracked according to rumor timetables. Apple's patent applications have provided the Mac community with a clear heads-up on some of Apple's greatest product trends including the iPod, iPhone, iPad, iOS cameras, LED displays, iCloud services for iTunes and more. About Comments: Patently Apple reserves the right to post, dismiss or edit comments.
Check out Our Latest Report on Patent Bolt Titled:
Here are a Few Sites covering our Original Report
MacSurfer, Tech Whirl (About Technical Communications),Twitter, Facebook, Apple Investor News, Google Reader, Macnews, iPhone World Canada, MarketWatch, 9to5 Mac, Mac Life Germany, Forbes, MacDailyNews, AppleCaffe Italy, TUAW, Macgasm, Techmeme, and more.