Apple has been granted a patent (number 10,854,008) for “synchronized, interactive augmented reality displays for multifunction devices.” It involves the rumored “Apple Glasses,” an augmented reality/virtual reality/mixed reality head-mounted display (HMD) and its ability to share data with other devices..
Augmented reality (AR) technology combines a live view of a real-world, physical environment with computer-generated imagery. Information about the real world environment can be stored and retrieved as an information layer which can be overlaid on the live view and interacted with by a user.
However, Apple says that despite strong academic and commercial interest in AR systems, many existing AR systems are complex and expensive making such systems unsuitable for general use by the average consumer. The tech giant wants to change this with Apple Glasses that can receive live video of a real-world, physical environment on a touch sensitive surface. One or more objects can be identified in the live video.
An information layer can be generated related to the objects. This layer can include annotations made by a user through the touch sensitive surface. The information layer and live video can be combined in a display of the device.
What’s more, data can be received from one or more onboard sensors indicating that the device is in motion. The sensor data can be used to synchronize the live video and the information layer as the perspective of video camera view changes due to the motion. The live video and information layer can be shared with other devices such as Macs, iPhones, and iPads over a communication link.
When it comes to Apple Glasses, such a device will arrive next year or 2022, depending on which rumor you believe. It will be a head-mounted display. Or may have a design like “normal” glasses. Or it may be available in both. The Apple Glasses may or may not have to be tethered to an iPhone to work. Other rumors say that Apple Glasses could have a custom-build Apple chip and a dedicated operating system dubbed “rOS” for “reality operating system.”