I’m a big fan of the Apple Vision Pro. However, one big drawback is that folks wearing the spatial computer can’t interact or share the same virtual environment.
However, that may be about to change. Apple has been granted a patent for “Shared Data and Collaboration for Head-Mounted Devices.”
About the patent
The patent relates generally to head-mounted devices such as the Vision Pro, and, more particularly, to a system of head-mounted devices that share view and other information. With the spatial computer, visual information is, of course, provided on a display. The display allows a user to observe an environment outside of the head-mounted device. Other outputs provided by the head-mounted device can include audio output and/or haptic feedback.
A user may further interact with the head-mounted device by providing inputs for processing by one or more components of the head-mounted device. For example, the user can provide tactile inputs, voice commands, and other inputs while the device is mounted to the user’s head.
Apple’s patent would allow multiple Vision Pros to operate in concert to leverage their combined sensory input and computing power, as well as those of other external devices to improve sensory perception, mapping ability, accuracy, processing workload, and thermals mitigation. For example, sharing sensory input between multiple head-mounted devices can complement and enhance individual units by interpreting and reconstructing objects, surfaces, and/or an external environment with perceptive data from multiple angles and positions, which also reduces occlusions and inaccuracies.
As more detailed information is available at a specific moment in time, the speed and accuracy of object recognition, hand and body tracking, surface mapping, and/or digital reconstruction can be improved. Also, Apple says that such collaboration can provide more effective and efficient mapping of space, surfaces, objects, gestures and users.
Summary of the patent
Here’s Apple’s summary of the patent: “A system can include head-mounted devices that collaborate to process views from cameras of the respective head-mounted devices and identify objects from different perspectives and/or objects that are within the view of only one of the head-mounted devices. Sharing sensory input between multiple head-mounted devices can complement and enhance individual units by interpreting and reconstructing objects, surfaces, and/or an external environment with perceptive data from multiple angles and positions, which also reduces occlusions and inaccuracies.
“As more detailed information is available at a specific moment in time, the speed and accuracy of object recognition, hand and body tracking, surface mapping, and/or digital reconstruction can be improved. Such collaboration can provide more effective and efficient mapping of space, surfaces, objects, gestures and users.”
About the Vision Pro
Demos of the Apple Vision Pro at Apple Stores in the U.S. can be reserved on Apple.com. To reserve a free Vision Pro demo online, go here, then follow the steps to book an appointment at your local Apple Store.
Pricing for the Vision Pro starts at US$3,499 with 256GB of storage. ZEISS Optical Inserts are available: $99 for reading lens and $149 for prescription lens.
I hope you’ll help support Apple World Today by becoming a patron. Patreon pricing ranges from $2 to $10 a month. Thanks in advance for your support.
