Apple patent is for ‘virtual paper’ for use with the upcoming Vision Pro

Apple has been granted a patent (number 11,328,497) for “virtual paper.” It involves a visual representation of, well, paper in 3D form on the upcoming Apple Vision Pro.

The US$3,499 (and up) Vision Pro was previewed at June’s Apple Worldwide Developer Conference. However, it won’t be available until early 2024 — and then, apparently, only in limited quantities.

About the patent

In the patent filing, Apple notes that previously available computer-generated reality (CGR) experiences, 2D virtual content and stereoscopic (or 3D) virtual content are typically displayed in accordance with one set of world coordinates characterizing a user CGR environment. In turn, the range of display and user interaction possibilities associated with both 2D and stereoscopic virtual content are limited to rendering and displaying the virtual content based on the set of world coordinates characterizing the user CGR environment. 

When it comes to paper, Apple wants you to be able to use it in a CGR environment much as you would in the real world. In other words, you’ll be able to bend, fold, turn, and crumple it.

Apple has already been granted one patent (number 11,328,497) for “virtual paper.”

Summary of the patent

Here’s Apple’s abstract of the patent filing: “In one embodiment, a method of intermingling stereoscopic and conforming virtual content to a bounded surface is performed at a device that includes one or more processors, non-transitory memory, and one or more displays. The method includes displaying a bounded surface within a native user computer-generated reality (CGR) environment, wherein the bounded surface is displayed based on a first set of world coordinates characterizing the native user CGR environment. 

“The method further includes displaying a first stereoscopic virtual object within a perimeter of a first side of the bounded surface, wherein the first stereoscopic virtual object is displayed in accordance with a second set of world coordinates that is different from the first set of world coordinates characterizing the native user CGR environment.”