Apple files for patent for an augmented reality display system for a vehicle

Apple may have canceled its Apple Card project, but the company continues to be granted patents or file for patents related to vehicles. The latest patent filing (number US 20240185539 A1) is for “Adaptive Vehicle Augmented Reality Display Using Stereographic Imagery.”

About the patent

In the patent filing, Apple says that real-time augmented reality in vehicles faces a variety of challenges when it is a primary display technology in a vehicle traveling at various speeds and angles through ever changing environments. Weather conditions, sunlight, and vehicle kinematics, are just a few of the elements that may impact the rendering but that also limit a system’s overall capabilities. 

This is especially true since on-board sensors have a fixed range and often require algorithms for optimizing queries which impact overall quality and response time. Apple wants to overcome such issues.

Summary of the patent

Here’s Apple’s abstract of the patent filing: “An AR system that leverages a pre-generated 3D model of the world to improve rendering of 3D graphics content for AR views of a scene, for example an AR view of the world in front of a moving vehicle. By leveraging the pre-generated 3D model, the AR system may use a variety of techniques to enhance the rendering capabilities of the system. The AR system may obtain pre-generated 3D data (e.g., 3D tiles) from a remote source (e.g., cloud-based storage), and may use this pre-generated 3D data (e.g., a combination of 3D mesh, textures, and other geometry information) to augment local data (e.g., a point cloud of data collected by vehicle sensors) to determine much more information about a scene, including information about occluded or distant regions of the scene, than is available from the local data.”