Apple has been granted a patent (number 10,088,909) for a “sessionless pointing user interface” that hints at a Mac user interface that utilizes gesture controls in much the same manner its Leap Motion’s Leap control device. Other Apple patents for this technology include 9885495, 20180059925, 2017018516, 20170185161, 94176706, and 9,449,758.
The invention involves a method, including receiving, by a computer, a sequence of three-dimensional maps containing at least a hand of a user of the computer, and identifying, in the maps, a device coupled to the computer. The maps are analyzed to detect a gesture performed by the user toward the device, and the device is actuated responsively to the gesture.
In the patent filing, Apple notes that many different types of user interface devices and methods are currently available. Common tactile interface devices include the computer keyboard, mouse and joystick. Touch screens detect the presence and location of a touch by a finger or other object within the display area.
Infrared remote controls are widely used, and “wearable” hardware devices have been developed, as well, for purposes of remote control. Computer interfaces based on three-dimensional (3D) sensing of parts of the user’s body have also been proposed, and Apple apparently thinks this is an idea worth considering.
Of course, Apple files for — and is granted — lots of patents by the U.S. Patent & Trademark Office. Many are for inventions that never see the light of day. However, you never can tell which ones will materialize in a real product.