{"id":63724,"date":"2026-07-17T10:24:48","date_gmt":"2026-07-17T14:24:48","guid":{"rendered":"https:\/\/overcentral.com\/en\/?p=63724"},"modified":"2026-07-17T10:24:48","modified_gmt":"2026-07-17T14:24:48","slug":"san-francisco-demands-nudify-app-removal","status":"publish","type":"post","link":"https:\/\/overcentral.com\/en\/san-francisco-demands-nudify-app-removal\/","title":{"rendered":"San Francisco Demands Apple and Google Delete AI Nudify Apps"},"content":{"rendered":"<p>The city attorney of <a href=\"https:\/\/overcentral.com\/en\/san-francisco-police-drone-leak\/\" title=\"San Francisco Police Drone Leak Exposes Urban Surveillance\" data-iacss-internal=\"1\">San Francisco<\/a> has formally demanded that Apple and Google remove from their app stores a set of applications designed to generate nonconsensual deepfake nude images, escalating the legal pressure on the two technology giants to police a harmful category of software that has been linked to widespread abuse. Cease-and-desist letters sent by David Chiu, the San Francisco city attorney, and reviewed by WIRED, accuse Apple and Google of profiting from what California law defines as unlawful supporting services for the creation of deepfake pornography. The letters identify 13 specific face-swapping applications that allow users to upload a photograph and, using generative artificial intelligence, produce a realistic nude image of the person depicted without their consent. Chiu argues that by hosting these applications and collecting a revenue share from in-app purchases, both companies are aiding and abetting the distribution of illegal content and must sever all business relationships with the developers immediately.<\/p>\n<h2>What the Legal Action Demands From Apple and Google<\/h2>\n<p>The legal notices, sent on Thursday, require Apple and Google to remove the identified applications from their respective stores and to implement stricter moderation processes that prevent similar apps from appearing in the future. The letters cite <a href=\"https:\/\/leginfo.legislature.ca.gov\/faces\/codes_displaySection.xhtml?lawCode=CIV&amp;sectionNum=1708.86.\" target=\"_blank\" rel=\"noopener noreferrer\" data-iacss-external=\"1\">California Civil Code Section 1708.86<\/a>, which explicitly prohibits supporting services that facilitate the creation of nonconsensual deepfake pornography. Chiu stated that the companies have likely made millions of dollars in fees from these applications, which typically charge users for credits or subscriptions to generate images. The demand is not limited to the removal of the 13 named apps; it calls for a systemic change in how both companies review and approve software that has the capacity to generate sexually explicit material without verification of consent.<\/p>\n<h2>The Scale of the Nudify App Problem<\/h2>\n<p>Researchers and journalists have repeatedly documented the widespread availability of nudify applications in both Apple&#8217;s App Store and Google&#8217;s Play Store, including instances where apps carrying age ratings suitable for children were capable of producing sexualized images. Over the past five years, a lucrative ecosystem of deepfake &#8220;nudification&#8221; technology has emerged across apps, websites, and bots, allowing users\u2014predominantly men\u2014to upload pictures of women and girls and digitally remove clothing or place them into explicit scenarios. The underlying generative AI technology has improved rapidly, producing increasingly realistic results often in seconds, with some services offering limited functionality for free and others charging small fees for higher-quality outputs. Previous investigative reporting has uncovered incidents involving deepfake sexual abuse images of minors in at least 90 schools globally. Separately, xAI&#8217;s Grok was reported to have been used to create millions of sexualized images in January of this year alone, illustrating the scale at which this technology is being abused.<\/p>\n<h3>How Nudify Apps Evade Existing Platform Policies<\/h3>\n<p>Both Apple and Google maintain developer policies that explicitly prohibit pornography, harassment, and abusive content. Both companies have previously removed dozens of nudify and deepfake applications after reports from researchers and journalists. Google stated that it has already suspended hundreds of violating apps and restricted search terms such as &#8220;nudify&#8221; within its store. Despite these enforcement actions, applications continue to appear, often using vague descriptions or ostensibly legitimate face-swapping functionality to bypass automated and human review processes. The city attorney&#8217;s office argues that the current moderation regime is insufficient and that companies must take proactive steps to identify and block these applications before they are made available to users, rather than relying on external reporting to trigger enforcement.<\/p>\n<h2>What Are Nudify Apps and Why Are They Dangerous?<\/h2>\n<p>Nudify applications use artificial intelligence to generate realistic nude images of individuals from standard photographs, all without the subject&#8217;s knowledge or consent. The danger lies in the ease of use and the potential for widespread abuse: a single photograph and a few clicks are sufficient to produce a convincing deepfake image that can be used for harassment, extortion, reputational damage, or child sexual abuse. The technology disproportionately targets women and girls, and the nonconsensual nature of the content places it squarely outside the protections of free expression. The creation and distribution of such images is illegal in multiple jurisdictions, including California, where the law specifically targets those who provide services that enable this form of abuse.<\/p>\n<h2>Platform Responsibility and the Limits of Self-Regulation<\/h2>\n<p>The legal action raises fundamental questions about the responsibility of platform operators when their infrastructure is used to facilitate illegal activity. By taking a revenue share from in-app purchases made within nudify applications, Apple and Google <a href=\"https:\/\/overcentral.com\/en\/signal-president-warns-ai-chatbots\/\" title=\"Signal President Warns AI Chatbots Are Not Your Friends\" data-iacss-internal=\"1\">are not<\/a> merely hosting content but are deriving direct financial benefit from transactions that underwrite the creation of nonconsensual intimate images. The cease-and-desist letters argue that this constitutes aiding and abetting under state law. While both companies have responded to individual reports of violations, the letters contend that reactive enforcement is insufficient and that a duty exists to prevent these applications from being listed in the first place. The outcome of this action could set a precedent for how app store operators are held accountable for the software they distribute, particularly when that software is designed specifically to circumvent consent and privacy.<\/p>\n<h2>What Affected Users Should Do Now<\/h2>\n<p>If you suspect that an image of you has been used in a deepfake nudify application, the first step is to document all evidence, including screenshots of the app, the image in question, and any associated account information. Report the content directly to the platform where it appears and file a complaint with local law enforcement. For broader protection, consider using a reputable digital monitoring service that can scan for unauthorized use of your likeness online. Enable two-factor authentication on all accounts to reduce the risk of your private photographs being accessed or stolen. For those seeking to reduce their exposure to this type of abuse more generally, be cautious about sharing high-resolution personal photographs on public social media profiles, and review the privacy settings on <a href=\"https:\/\/overcentral.com\/en\/linkedin-ai-generated-content\/\" title=\"LinkedIn Leads All Platforms with 41% AI-Generated Long-Form Posts\" data-iacss-internal=\"1\">all platforms<\/a> to limit who can download or screenshot your images. If you encounter a nudify application in an app store, report it immediately through the store&#8217;s abuse reporting mechanism. The most effective long-term protection is regulatory pressure and platform accountability, but individual vigilance remains a necessary complement while enforcement catches up to the technology.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The city attorney of San Francisco has formally demanded that Apple and Google remove from their app stores a set of applications designed to generate nonconsensual deepfake nude images, escalating the legal pressure on the two technology giants to police a harmful category of software that has been linked to widespread abuse. Cease-and-desist letters sent [&hellip;]<\/p>\n","protected":false},"author":7,"featured_media":83968,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/cards.overcentral.com\/cards\/en\/63724.png","fifu_image_alt":"San Francisco Demands Apple and Google Delete AI Nudify Apps","footnotes":""},"categories":[349],"tags":[],"class_list":["post-63724","post","type-post","status-publish","format-standard","has-post-thumbnail","category-articles"],"fifu_image_url":"https:\/\/cards.overcentral.com\/cards\/en\/63724.png","fifu_image_alt":"San Francisco Demands Apple and Google Delete AI Nudify Apps","_links":{"self":[{"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/posts\/63724","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/comments?post=63724"}],"version-history":[{"count":0,"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/posts\/63724\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/media\/83968"}],"wp:attachment":[{"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/media?parent=63724"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/categories?post=63724"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/overcentral.com\/en\/wp-json\/wp\/v2\/tags?post=63724"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}