Key Takeaways
- San Francisco City Attorney David Chiu sent cease-and-desist letters to Apple and Google.
- The letters demand the removal of 13 apps capable of creating nonconsensual AI-generated intimate images.
- Chiu's office claims these apps can be used without consent, potentially earning millions for the companies.
Apple and Google have been ordered to remove specific applications from their app stores after receiving cease-and-desist letters from San Francisco City Attorney David Chiu. The letters target 13 'nudify' apps that can generate explicit deepfake images without consent, according to Wired.
Chiu's office identified these apps as a significant threat, arguing they violate California’s laws prohibiting supporting services for creating deepfake pornography. The city attorney specifically warned both companies of potential legal action if they fail to comply with the demands.
The Tech Transparency Project reported that despite Apple and Google's policies against sexual content, some 'nudify' apps were still appearing in their stores. These apps were rated ‘E’ for Everyone, allowing children unrestricted access. The project also noted that search terms like 'nudify' or 'undress' could lead users directly to these harmful applications.
Google responded by stating it had removed hundreds of such apps and emphasized its commitment to enforcing policies against sexual content. However, Apple did not provide a comment before publication, leaving the situation unclear regarding their stance on the matter.
This action is part of an ongoing effort to address the growing issue of AI-generated nonconsensual imagery. Other tech giants like Meta’s Oversight Board have also faced pressure to improve protections for users targeted by deepfakes. Similarly, Elon Musk's xAI has been scrutinized over similar issues.
The issue has become more urgent as advancements in AI image tools make it easier to create realistic fake content from ordinary photos. Regulators, researchers, and child-safety advocates are now pushing platforms to enforce stronger moderation before harmful apps reach users.
For Apple and Google, the cease-and-desist letters raise a direct question: whether app stores should be held accountable for hosting potentially illegal or harmful applications.
