AI Deepfake App Crackdown
San Francisco Attorney Demands Apple, Google Remove AI Nudify Apps Amid Deepfake Concerns
Anonymous
Key Points
1
Chiu has previously pursued enforcement against AI deepfake platforms, including a lawsuit against 16 websites that enable turning real images into pornographic AI-generated content, signaling a broader approach beyond app-store actions.
2
Independent researchers reported Nudification apps frequently bypass moderation and some were promoted on major stores, with certain titles even marketed as suitable for broad audiences ('E' for Everyone), raising concerns about minor access.
3
Concrete example of scale: at least one nudify app had more than one million downloads, and Google publicly indicated that five affected apps were suspended from Google Play in response to the action.
4
Breakdown by store: the targeted 13 apps comprise eight on Apple's App Store and five on Google Play; reporting notes Google has deleted hundreds of nudifying apps for policy violations, and Apple tightened its App Store guidelines in June.
San Francisco City Attorney David Chiu has sent cease-and-desist letters to Apple and Google, demanding they remove 13 AI "nudify" apps from their app stores. The apps let users strip clothing from photos of real people without consent — a practice Chiu says violates California law and causes serious harm to victims. Ars Technica reported that Chiu accused both companies of "aiding and abetting" illegal activity by hosting and profiting from these tools.
Eight of the targeted apps are on Apple's App Store and five are on Google Play. Android Headlines reported that Google has already suspended several of the flagged apps for policy violations. The action is part of a broader push by Chiu, who has also sued 16 websites for enabling AI-generated pornography.
Apps That Strip Photos Found Skirting Store Rules
Independent researchers found that nudify apps regularly slip past moderation on both major app stores. Some titles were even labeled "E for Everyone" — meaning children could download them freely. AppleInsider noted that at least one nudify app had more than one million downloads before action was taken, showing how widely these tools had spread.
Chiu's letters demand more than just removal. He wants Apple and Google to cut ties with the app developers entirely and stop processing in-app payments. In short, he wants the companies to stop making money from tools he says are built to harm people.
California Law Makes Hosting Deepfake Porn Illegal
Chiu's legal argument rests on California state law. The law bans services that help create deepfake pornography — fake explicit images made with AI using real people's faces or bodies. By hosting these apps and collecting payment fees, Chiu argues, Apple and Google are not just passive bystanders. They are active participants in the harm.
Ars Technica reported that Chiu's office described the apps as tools that "victimize women and children." Officials say victims have suffered damaged reputations, mental health crises, and in some cases, suicidality. The harm is real, Chiu argues, and the platforms enabling it must be held responsible.
Google Acts Fast; Apple Tightened Rules in June
Google moved quickly after receiving the letter. Android Headlines reported that five apps on Google Play were suspended in direct response to Chiu's action. Google has also deleted hundreds of nudifying apps in past enforcement sweeps for policy violations, suggesting the company already had rules in place — though critics say enforcement has been uneven.
Apple tightened its App Store guidelines in June, but AppleInsider noted that some apps still made it through. The gap between written policy and actual enforcement is exactly what Chiu is targeting. His letters push both companies to move from rule-writing to rule-enforcing.
SF's Broader War on AI Deepfake Pornography
This app-store action is not Chiu's first move against AI deepfakes. He previously filed a lawsuit against 16 websites that turn real photos into pornographic AI content. That case signals a wider strategy: go after every part of the ecosystem, from the websites to the app stores that distribute the tools.
Newsy Today reported that Chiu said he is prepared to use "all legal options" to force compliance. The San Francisco push fits into a national conversation about protecting people — especially women and minors — from AI-generated sexual abuse imagery. With federal law still catching up, city and state officials are stepping into the gap.
Sentiment
Mostly NegativeNEGATIVENEUTRALPOSITIVE
Publishers
22
Articles
15
Reach
37
A
AnonymousAuthor