The rise of generative artificial intelligence has logically led to the appearance of new, sometimes problematic, practices. One of the most recent cases concerns the production of modified images from real faces, in sensitive contexts.
For example, at the beginning of January, Elon Musk’s Grok AI was questioned after generating sexual images representing clearly identifiable people, some of whom were minors. Three American senators then demanded its immediate removal from the App Store, denouncing a lack of safeguards.
A new report from the Tech Transparency Project now reveals that applications available on the App Store can also generate nude images from simple portraits.
Sex deepfake apps in the App Store
Report lists 47 iOS apps capable of producing this type of images in just a few clicks. Unlike Grok, which was diverted from its initial objective, these tools are designed from the start to obtain results of a sexual nature. Some applications highlight as soon as they are opened effects intended to simulate undressing or accentuate body parts, leaving little doubt as to their purpose. Others opt for more vague descriptions, without masking the real nature of the content offered.
No products found.
Income that raises questions
According to AppMagic, these applications have been downloaded more than 700 million times worldwide and generated nearly $117 million. Apple receives a cut from each transaction, which raises a question of liability, especially since this content a priori violates its own internal rules. Indeed, one of the applications highlighted in the report until recently displayed a “9+” classification”, despite the explicit nature of the images it allowed to obtain.
The tests carried out by the Tech Transparency Project rely only on AI-generated faces, to avoid any real exploitation. The majority of apps provide results without blocking, even for clearly sexual requests. Apple explains that it filters each app via automated control, reinforced by human verification. The data also show that this double filter remains insufficient to stop these drifts.
By: Keleops AG
