Apple has filed for a patent (number US 20250078577 A1) that hints that users may be able to customize vision-based hand gestures on future Apple devices.
About the patent filing
The patent filing involves Macs, iPhones, iPads, Vision Pros, AirPods, Apple Watches, external displays, and other devices. In the patent filing Apple notes that different hand gestures performed by a user can be detected and analyzed to facilitate user interaction with digital interfaces. This technology may employ computer vision for recognizing gestures, serving various applications, such as gaming and virtual reality.
Summary of the patent filing
Here’s Apple’s abstract of the patent filing: “The subject technology provides vision-based hand gesture customization. An apparatus receives input data having image representations of a first hand gestures corresponding to different types of gestures. For each of the first hand gestures, the apparatus extracts features from one of the image representations of the first hand gestures to produce a skeleton-based feature representation of a corresponding hand gesture.
“The apparatus produces a first trained machine learning model by training a neural network with a first dataset having skeleton-based feature representations associated with the first hand gestures to predict a classification for the first hand gestures. The apparatus generates a second dataset having training samples representing at least a second hand gesture customized by a user. The apparatus produces a second trained machine learning model by training the first trained machine learning model based on the second dataset to predict a classification for the second hand gesture.”
I hope you’ll help support Apple World Today by becoming a patron. Patreon pricing ranges from $2 to $10 a month. Thanks in advance for your support.
