On March 31. 2022, Patently Apple posted a report titled "Apple invents a variety of future Game Controllers to be magnetically attached to an iDevice & include smart foldable carrying cases."

We've seen the likes of Assassin's Creed Mirage, Death Stranding, and Resident Evil Village make their way onto the latest Apple devices, and it was revealed at WWDC24 that loads of AAA titles are set to enter the line-up in the coming months. As Apple gains more triple-A games, providing users with more gaming device options could be advantageous and today's granted patent covers this.

Today Apple was granted a patent that once again covers potential  game controllers. The first style covered pertains to attachable game controller handles for iPhone and iPad as presented in patent FIGS. 6A, 6B, 6F, 6J below.

A second style of game controller relates to an iPhone gaming folio. Here Apple shares a number of concepts presented below that their engineering team have worked on. The part of the folio that will sit opposite to the iPhone display for game content, could actually be a full or partial secondary display that could provide users with messages about the game, like your gaming character is low in health, or that the user is receiving a text, email of FaceTime call from friends, family or business associates. It could also be used to accept other players wanting to join a multiplayer game.

In one particular example, FIG. 6L, we see an iPad (device #500) detects that input device #610 has been unfolded into its mounted position such that the input mechanisms of input device are accessible  at a respective angle (e.g., as shown in side view #605).

In some embodiments, the iPad includes a directional pad $614a and a plurality of action buttons $614b in a gaming accessory cover.

In some embodiments, the iPad includes a display generation component (e.g., a display screen, a touch screen, a projector, etc.), which is capable of receiving display information from the cover device (device #500) and displaying a user interface (optionally on the same surface as the input mechanisms).

Apple later notes that there's a need for efficient interfaces for electronic devices that receive user inputs from remote input devices. In some implementations, an electronic device displays respective user interfaces associated with games in response to detecting that a remote input device has been connected to the electronic device.

In some implementations, an electronic device displays a reduced user interface in response to detecting that a cover has covered a portion of the display of the electronic device.

In some implementations, an electronic device displays a user interface via a display generation component of a remote input device.

In some embodiments, an electronic device projects a user interface via a projection device of a remote input device. In some embodiments, an electronic device directs inputs to different user interfaces depending on the mode of operation of a remote input device. Such techniques can increase the efficiency of providing inputs to the electronic device, especially while playing a game, and reduce the cognitive burden on a user who uses such devices. Further, such techniques can reduce processor and battery power otherwise wasted on redundant user inputs.

The patent also describes the gaming controller working with Apple TV with a television or monitor to present a gaming UI and allow for a virtual keyboard.

In another instance, Apple notes that "the respective input device projects the respective user interface onto a wall behind a television(s) (e.g., display generation component(s)) connected to the potential target electronic device(s). Displaying the respective user interface as a projected user interface on a nearby surface places the respective user interface at an accessible distance, thereby enhancing user-device interactions and reducing errors in usage."

For full details, especially Apple's deep dive into the gaming user interface, review granted patent 12028474.