Apps that use artificial intelligence to generate non-consensual intimate images may be banned on paper, but they remain a simple search away on Apple’s App Store and Google Play, according to a report by the Tech Transparency Project (TTP).
The findings highlight a growing gap between platform policies and actual enforcement at a time when governments worldwide are tightening scrutiny of deepfake tools and AI misuse.
Search results raise red flags
The report found that common search terms such as “nudify,” “undress,” and “deepnude” continue to surface apps capable of digitally altering images of women.
“Roughly 40% of the apps that came up in both the Apple and Google Play Store search results could render women nude or scantily clad,” TTP said.
In total, 46 apps were identified in Apple App Store searches, of which 18 offered nudifying features. On Google Play, 49 apps appeared in similar searches, including 20 with similar capabilities.
The report also flagged that app stores were running ads for such apps in certain search results, raising further questions about platform oversight.
Child safety concerns
A key concern flagged by the report is accessibility. Many of these apps were rated “E”, meaning they are considered suitable for everyone, including children.
The scale of usage is also significant. According to TTP, nudify apps have collectively been downloaded about 483 million times and generated more than $122 million in revenue.
Policy vs enforcement gap
Both Apple and Google maintain strict policies against sexually explicit or exploitative content.
Apple’s App Review Guidelines prohibit “offensive, insensitive, upsetting, intended to disgust, in exceptionally poor taste, or just plain creepy, overtly sexual or pornographic material.”
Similarly, Google says that “We don't allow apps that contain or promote sexual content or profanity, including pornography, or any content or services intended to be sexually gratifying.”
However, Google allows limited exceptions, noting that “content that contains nudity may be allowed if the primary purpose is educational, documentary, scientific or artistic, and is not gratuitous.”
Platforms respond, removals begin
In response to the report, Google said it had already taken action on several flagged apps.
A Google spokesperson, Dan Jackson told TTP, many of the apps had been suspended and that the company was “continuing its investigation and enforcement actions.”
On age ratings, Jackson added that the International Age Rating Coalition determines classifications for apps on Google Play.
A Google spokesperson told TTP that many of the apps had been suspended and that the company was continuing its investigation and enforcement actions. It added that it has taken down seven such apps.
In response to Business Today's queries, Apple said it has removed 15 apps after the TTP report surfaced.
"Nudification apps are against our guidelines, and we have proactively rejected many of these apps and removed many others, including when users have flagged them via our reporting tools," Apple said in a response.
"When user complaints are brought to the team’s attention, we immediately investigate and take action to address them with the developer."
"With respect to sponsored ads: As stated in our Apple Ads policies, ads featuring adult content are prohibited. Additionally, ads are not presented for users under 13 years old, and advertisers cannot target users between 13-17 years old," the company added.
AI tools widen the problem
The issue extends beyond standalone apps to AI chatbots and integrated tools.
The report highlighted an app called “Uncensored AI — No Filter Chat,” which appeared on the App Store as a general AI chat and photo editing tool. When tested, it generated manipulated images when prompted, while stating that data “may be processed by xAI.”
According to TTP, the developer, Tokyo-based Masaki Matsushita, said the app used xAI’s Grok model for image generation and that they were unaware it could produce such extreme outputs.
The developer has since tightened moderation, rebranded the app to “Chat AI - Simple AI,” and increased its age rating from 16+ to 18+.
The findings come amid recent scrutiny of xAI’s Grok after reports that the chatbot could generate highly sexualised AI videos, despite claims of improved safeguards.
A bigger question for Big Tech
The report ultimately raises a broader issue: how such apps continue to slip through review systems despite explicit rules against non-consensual sexual content.
As AI tools become more powerful and easier to deploy, platforms face increasing pressure to move faster on detection and enforcement — especially when misuse can scale rapidly and impact vulnerable users.
Business Today has reached out to Apple and Google for comment. The story will be updated once responses are received.
(Note: The story is updated with Apple's responses)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。