Apple and Google have been ordered to take down apps that can “nudify” or “undress” people and told that they must stop profiting from the harmful technology, according to cease-and-desist letters sent to the companies seen by WIRED.
On July, San Francisco city attorney David Chiu sent legal notices to the two companies demanding that they remove from their app stores 13 face-swapping apps. Such apps allow users to create AI-generated nonconsensual nude images.
The letters say the Apple and Google should stop “aiding and abetting” the sale of explicit deepfake images and “sever” business relationships with the app developers.
“Generating non-consensual intimate images is illegal, harmful, and completely unacceptable,” Chiu tells WIRED. The city attorney, whose office previously took legal action against 16 popular deepfake websites, says Apple and Google have likely “made millions of dollars in fees” from apps that offer nudification, and they should improve their moderation processes to stop them appearing in their stores in the first place. These companies have responsibility to ensure that apps on their platforms do not facilitate sexual abuse.”
The city’s legal letters say California’s laws prohibit supporting services that create deepfake pornography. Researchers have repeatedly found and reported apps in Apple’s App Store and Google’s Play Store that allow people to generate sexual images using AI—including some apps being rated as suitable for use by children.
WIRED notes that both Apple and Google have developer policies that prohibit pornography, abuse, and harassment on their platforms. The companies have previously removed dozens of nudify and deepfake apps, after reports by researchers and journalists.
I hope you’ll help support Apple World Today by becoming a patron. Almost all our income is from Patreon support and sponsored posts. Patreon pricing ranges from $2 to $10 a month. Thanks in advance for your support.
