San Francisco Demands Apple and Google Delete AI ‘Nudify’ Apps From App Stores
What happened
San Francisco’s City Attorney’s Office ordered Apple and Google to remove 13 “face-swap” apps from their app stores. The apps use AI to create fake “nudified” images by digitally removing clothing from photos, and are predominantly used to target women and girls. The city’s legal action includes cease-and-desist letters demanding that the tech giants stop profiting from these apps immediately.
Why it matters
This enforcement move pressures Apple and Google to take stronger responsibility for the types of apps they allow on their platforms, especially those exploiting AI to violate privacy and consent. Developers behind these apps monetize harmful face-swap technology that can be weaponized to harass or exploit individuals without their permission. By targeting the app stores, San Francisco aims to reduce the availability and reach of predatory AI applications that erode digital trust and safety.
What to watch next
How Apple and Google respond will test their commitment to content moderation around emerging AI risks. If they comply, it sets a precedent for platforms to vet AI-powered apps more rigorously. Noncompliance or weak enforcement could encourage similar apps to proliferate elsewhere. Regulators in other jurisdictions may follow San Francisco’s lead in pressuring tech companies to better police AI misuse that infringes on personal rights, especially gender-based abuse.
AI Quick Briefs Editorial Desk
