Apple patent involves viewing computer-generated reality content with ‘Apple Glasses’

Apple has been granted a patent (number 11,379,033) for augmented devices. It involves the rumored “Apple Glasses,” an augmented reality/virtual reality head-mounted display (HMD).

About the patent

In the patent, Apple says that many electronic devices are configured with input and output capabilities. For example, a laptop computing device may include a display and a keyboard that are used to display content and receive user input, respectively. Similarly, a smart watch may include a touchscreen that both displays content and receives input. In another example, a smart home speaker device may be configured to produce audio output via a speaker and receive audible voice commands as input via a microphone. 

Additional devices may be used to supplement the input and output capabilities of an electronic device. For example, a user may connect a larger monitor to a laptop or use a head-mounted device (HMD) to view a virtual screen corresponding to a laptop’s output (e.g., a virtual desktop). 

Apple says that, however, existing techniques that use one device to supplement the output or input capabilities of another device may be limited with respect to capability, usability, or efficiency and generally may not provide user experiences that sufficiently augment the input and output capabilities of those electronic devices. The tech giant wants to change this.

Summary of the patent

Here’s Apple’s abstract of the patent: “Implementations use a first device (e.g., an HMD) to provide a CGR environment that augments the input and output capabilities of a second device, e.g., a laptop, smart speaker, etc. In some implementations, the first device communicates with a second device in its proximate physical environment to exchange input or output data. 

“For example, an HMD may capture an image of a physical environment that includes a laptop. The HMD may detect the laptop, send a request the laptop’s content, receive content from the laptop (e.g., the content that the laptop is currently displaying and additional content), identify the location of the laptop, and display a virtual object with the received content in the CGR environment on or near the laptop. The size, shape, orientation, or position of the virtual object (e.g., a virtual monitor or monitor extension) may also be configured to provide a better user experience”

About Apple Glasses

When it comes to Apple Glasses, the rumors are abundant. Such a device will arrive in mid-to-late 2023. Or maybe 2024. It will be a head-mounted display. Or may have a design like “normal” glasses. Or it may be eventually be available in both. The Apple Glasses may or may not have to be tethered to an iPhone to work. Other rumors say that Apple Glasses could have a custom-build Apple chip and a dedicated operating system dubbed “rOS” for “reality operating system.”