San Francisco City Attorney David Chiu has sent cease-and-desist letters to Apple and Google, demanding the removal of thirteen applications that enable nonconsensual sexual deepfakes. The legal action targets eight apps on the App Store and five on the Google Play Store. These apps, advertised as face-swapping or photo editing tools, actually allow users to generate explicit images of real people without consent. According to the City Attorney's Office, the apps violate California laws that prohibit services supporting deepfake pornography.
Investigated apps disguise as face-swappers but produce explicit content
The thirteen apps under investigation by the City Attorney's Office broadly present themselves as face-swapping tools. However, their real functionality becomes apparent once users engage with them. One app, with over one million downloads, displays a dozen AI image styles on its website, including bikini queen curvy, calm busty, and cinematic intimacy, many showing sexualized images of women. Another app's homepage claims to produce free and uncensored videos. Chiu's letter notes that both Apple and Google have been profiting from this harmful technology, likely making millions of dollars in fees through in-app purchases.
Sponsored Protocol
California law prohibits facilitation of deepfake pornography
The legal letters cite state laws that forbid supporting services that create deepfake pornography. The apps rely on in-app payments, from which the tech companies take a cut. These companies have a responsibility to ensure that apps on their platforms do not facilitate sexual abuse, Chiu said in a statement. The fact that some of the world's largest and most established technology companies are facilitating this has to stop. The action follows a Tech Transparency Project report that revealed dozens of nudify apps on the App Store six months ago, and an April investigation showing Apple's own search suggestions and ads had steered users to them.
Sponsored Protocol
Apple and Google respond amid ongoing scrutiny
A Google spokesperson stated that the company takes action against apps reported for policy violations, while Apple did not comment before publication. Apple has previously stated that nudify apps violate its App Review Guidelines and that it proactively rejects and removes such apps. However, the persistence of these applications raises concerns about enforcement. Similar issues have been highlighted in other areas of AI safety: for instance, 54% of enterprises already experienced security incidents involving AI agents. The need for robust platform safeguards extends to consumer apps as well. According to Wired's report, the letter emphasizes that both companies have likely made millions from these apps. Possible penalties include fines and mandated policy changes.
Sponsored Protocol
