Apple has been granted a patent (number 11,442,549) for the “placement of 3D effects based on 2D paintings.” The tech giant wants to make it easier to place such effects on paintings using an iPad and perhaps even an iPhone or Mac.
About the patent
Apple says that creating visual effects in 3D content can be very time consuming, non-intuitive, and difficult. Such creation often requires using a mouse or other computer-based input device to painstakingly select, position, and rotate visual effects in precise positions and relative to 3D objects.
Apple wants to simplify this. In one implementation, an iPad could identify a user selection of a visual effect based on what the user has selected. For example, the device may identify a user’s selection based on tracking a position or gesture of the user’s hand.
In another implementation, the iPad could track thea movement path of the user’s hand relative to a reference position in the environment. In yet another implementation, a device — perhaps a Mac equipped with “gaze detection technology” may track the position or movement of the user’s hand relative to one or both of the user’s eyes, for example, during a painting motion that the user makes with his or her hands or fingers.
Summary of the patent
Here’s Apple’s abstract of the patent: “Various implementations disclosed herein include devices, systems, and methods that enable more intuitive and efficient selection and positioning of visual effects. In some implementations, a visual effect is selected and a surface of a physical element is identified for application of the visual effect based on tracking one or more positions or gestures of a user’s hand.”