The San Francisco Attorney General has sent a formal cease-and-desist letter to Apple and Google, demanding the removal of thirteen applications that use artificial intelligence to create non-consensual nude images. Official estimates indicate that the two companies have earned millions of dollars through commissions on these software, known as AI nudify apps. This action marks a significant step in digital platform regulation and user privacy protection.
The thirteen targeted apps and their revenue mechanism
The applications in question are tools that can digitally undress people from a regular photo. Using deep learning models, these apps generate realistic images without the subject's consent. The Attorney General estimates that Apple and Google each received tens of thousands of dollars per app, totaling millions. The platforms take a percentage of every in-app purchase or subscription, directly profiting from the distribution of harmful content.
Sponsored Protocol
Platform legal responsibility
The cease-and-desist letter emphasizes that Apple and Google cannot ignore the harm caused by these applications. The Attorney General argues that the companies have violated consumer protection and privacy laws by failing to act promptly to remove the software. Similar cases have led to lawsuits and fines in the past, but this is the first time a prosecutor has explicitly demanded the return of profits. This legal action could set a crucial precedent for app store oversight.
Notably, the rising costs of AI software, as discussed in our article on consumption-based pricing, are putting upward pressure on IT budgets. This trend also affects the app market, where high commissions incentivize the creation of controversial tools like nudify apps. Read more about AI cost increases.
Sponsored Protocol
Impact on victims and security measures
Victims of these apps suffer severe privacy violations with psychological and professional consequences. Generated images can be used for cyberbullying, extortion, or revenge porn. The Attorney General highlighted that many victims are minors, further aggravating the situation. Apple and Google claim to have guidelines prohibiting non-consensual content, but clearly, enforcement is inadequate. The letter also calls for stricter measures to prevent future violations.
Generative AI is transforming many sectors, as seen with Google Vids introducing personalized avatars for business videos. However, the same technology can be misused. Learn how Google is innovating with Gemini Omni. It is essential for tech companies to balance innovation with responsibility.
Sponsored Protocol
Future outlook and regulation
The San Francisco Attorney General's action fits into a broader regulatory landscape. Europe, for instance, is enacting strict AI rules through the AI Act. The United States lacks comprehensive federal legislation. This cease-and-desist could accelerate the debate and push Congress to act. For more information on deepfake technology, visit the Wikipedia page: Deepfake on Wikipedia.
In conclusion, Apple and Google face a critical choice: defend their business model or protect user rights. The response to the letter will be closely watched by observers, regulators, and activists. This case demonstrates that profit must never come before human dignity.
