Apple has been granted a patent (number US 11961195 B2) for a “Method And Device For Sketch-based Placement Of Virtual Objects.”
About the patent
The patent generally relates to computer graphics, and in particular, to systems, methods, and devices for sketch-based placement of computer-generated graphical objects. In the patent Apple says that, in some instances, a user may populate their computer-generated room by selecting virtual objects from a pre-existing library. However, this limits the customizability of the computer-generated room.
Apple wants users of the Vision Pro to be able to sketch virtual objects and place them in a computer-generated environment. This would, I assume, involve the user of an iPad and Apple Pencil in tandem with the spatial computer.
Summary of the patent
Here’s Apple’s abstract of the patent: “In some implementations, a method of sketch-based placement of computer-generated graphical objects includes: obtaining an input directed to a content creation region within a user interface, wherein the input corresponds to a sketch of a candidate object, and wherein the user interface includes the content creation region and a presentation region for computer-generated content; and in response to obtaining the input directed to the content creation region: presenting the sketch within the content creation region; obtaining a three-dimensional (3D) model using the input that corresponds to the sketch of the candidate object; generating a computer-generated graphical object using the obtained 3D model; and causing presentation of the computer-generated graphical object together with imagery obtained using the one or more cameras of the device within the presentation region while maintaining presentation of the sketch within the content creation region.”
