Apple has filed for a patent (number 20220253136) for “methods for presenting and sharing content in a [3D] environment.” And it involves other Apple devices beyond the rumored “Apple Glasses,” an augmented reality/mixed reality headset.
About the patent filing
In the patent filing, Apple notes that the development of computer systems for augmented reality (AR) has increased significantly in recent years. Example augmented reality environments include at least some virtual elements that replace or augment the physical world. Input devices, such as cameras, controllers, joysticks, touch-sensitive surfaces, and touch-screen displays for computer systems and other electronic computing devices are used to interact with virtual/augmented reality environments.
Example virtual elements include virtual objects include digital images, video, text, icons, and control elements such as buttons and other graphics. However, Apple says that methods and interfaces for interacting with environments that include at least some virtual elements (e.g., applications, AR environments, mixed reality environments, and virtual reality environments) are “cumbersome, inefficient, and limited.” The tech giant says, for example, systems that provide insufficient feedback for performing actions associated with virtual objects, systems that require a series of inputs to achieve a desired outcome in an AR environment, and systems in which manipulation of virtual objects are “complex, tedious and error-prone, create a significant cognitive burden on a user, and detract from the experience with the virtual/augmented reality environment.”
Apple says there’s a need for computer systems with improved methods and interfaces for providing computer generated experiences to users that make interaction with the computer systems more efficient and intuitive for a user. Such methods and interfaces optionally complement or replace conventional methods for providing extended reality experiences to users. One of those is “gaze detection” on Macs and iPads. In other words, you could be able to control some control some user interface elements with your eyes. And in a shared 3D and/or AR environment, multiple users could control objects via gaze detection.
Another input method would be motion and gesture detection. A Mac, iPad, or Apple Glasses could be equipped with hand-tracking components.
Summary of the patent filing
Here’s Apple’s abstract of the patent filing: “In some embodiments, an electronic device selectively de-emphasizes a three-dimensional environment in which content is presented. In some embodiments, an electronic device modifies the boundaries of content in a user interface. In some embodiments, an electronic device shares content with users in a three-dimensional environment.”
