Last Thursday, the U.S. Patent Office published a patent application of Apple's that relates to Input devices for computer systems. More specifically, it relates to a head-mounted device (HMD) and a handheld controller for the HMD with a shapeable lanyard. It could be used as a pointing device, a game controller, a writing tool and much more.  

Apple notes that a lanyard may be removably attached to the handheld input device. The lanyard may include visual markers, such as infrared light-emitting diodes and/or fiducials, that can be detected by an external camera and used to track a location, orientation, and/or motion of the lanyard.

For example, the lanyard may be fabric, and the visual markers may be incorporated into the fabric or attached to the fabric. The external camera may then take images of the visual markers, and image recognition may be used to track the visual markers and therefore to track the lanyard.

The lanyard may alternatively or additionally include motion sensors, visual-inertial odometry cameras, or other sensors to determine the location of the lanyard.

The lanyard may communicate its location to the head-mounted device and/or the handheld input device over a wired or wireless connection.

The lanyard may be electrically coupled to the handheld input device, such as to transfer power and/or data. For example, the lanyard may be electrically coupled to the handheld input device over a USB-C port, lightning port, or other port.

In more depth, Apple notes that the electronic devices that are configured to be held in the hand of a user may be used to gather user input and to provide a user with output.

For example, electronic devices that are configured to control one or more other electronic devices, which are sometimes referred to as controllers, handheld controllers, input devices, or handheld input devices, may be used to gather user input and to supply output.

An input device may, as an example, include an inertial measurement unit with an accelerometer for gathering information on input device motions such as swiping motions, waving motions, writing movements, drawing movements, shaking motions, rotations, etc., may include wireless communications circuitry for communicating with external equipment such as a head-mounted device, may include tracking features such as active or passive visual markers that can be tracked with an optical sensor in an external electronic device, may include input devices such as touch sensors, force sensors, buttons, knobs, wheels, etc., and/or may include sensors for gathering information on the interactions between the handheld input device, the user's hands interacting with the input device, and the surrounding environment.

The handheld input device may include a haptic output device to provide the user's hands with haptic output and may include other output components such as one or more speakers.

One or more handheld input devices may gather user input from a user. The user may use the input devices to control a virtual reality, augmented reality, or mixed reality device (e.g., head-mounted equipment such as glasses, goggles, a helmet, or other device with a display).

During operation, the input device(s) may gather user input such as information on interactions between the input device(s) and the surrounding environment, interactions between a user's fingers or hands and the surrounding environment, and/or interactions associated with virtual content displayed for a user.

The user input may be used in controlling visual output on a display (e.g., a head-mounted display, a computer display, etc.). Corresponding haptic output may be provided to the user's fingers using the input device.

Haptic output may be used, for example, to provide the fingers of a user with a desired sensation (e.g., texture, weight, torque, pushing, pulling, etc.) as the user interacts with real or virtual objects using the handheld input device.

Haptic output can also be used to create detents, to provide localized or global haptic feedback in response to user input that is supplied to the input device, and/or to provide other haptic effects.

Input devices can be held in one or both of a user's hands, or may otherwise be coupled to a user. Users can use the input devices to interact with any suitable electronic equipment.

For example, a user may use one or more input devices to interact with a virtual reality or mixed reality system (e.g., a head-mounted device with a display), to supply input to a desktop computer, tablet computer, cellular telephone, watch, ear buds, or other accessory, to control household items such as lighting, televisions, thermostats, appliances, etc., or to interact with other electronic equipment.

In some arrangements, the lanyard may be coupled to an item without electronics such as a pen, a pencil, a paint brush, an eating utensil, or other handheld item. When the lanyard is placed on the item, the user can use the item normally (e.g., by writing with the pen or pencil, eating with the eating utensil, and/or performing other tasks with the item), while the lanyard provides input-output capabilities by tracking the motion of the item, sensing information about the environment, providing haptic feedback, etc.

For full details, review Apple's patent application 20250044880 that was published on Thursday February 6, 2025. The lead inventor listed on the patent is Paul X Wang, Senlor Manager, Product Design. Wang is one of the most creative designers at Apple.