Elon Musk's online network X has caused major backlash after people used its AI chatbot Grok to alter pictures of women by removing their clothing.
Multiple cases have surfaced where the system has been employed to virtually strip women to show them in bikinis without consent, as well as to insert them in inappropriate scenarios.
Company Reaction and Legal Position
XAI, the organization that created Grok, remained silent to inquiries, other than an auto-reply response stating "traditional news outlets lies".
A government official stated that legislation is being introduced to outlaw image stripping tools. Under a proposed criminal offence, anyone who provided such tools would "be subject to a prison sentence and substantial fines".
"X or Grok could prevent these forms of misuse if they desired to," said Clare McGlynn, adding they "seem to have impunity."
Oversight Body Position and Platform Functionality
The communications watchdog Ofcom said platforms must "evaluate the potential" of people viewing unlawful material on their networks, but did not specify whether it was currently investigating X or Grok in relation to artificial intelligence pictures.
Grok is a no-cost artificial intelligence—with some additional features—which responds to X users' requests when they tag it in a post.
It is commonly used to offer reactions or more background to other posters' remarks, but people on X are also capable of alter an posted image through its AI image editing function.
History of Controversy and Policy
The chatbot has been condemned for permitting users to produce photos and clips with nudity and sexualised material, and it was earlier accused of making sexually explicit material of public figures.
"The platform has been enabling the production and spread of these images for months without taking any steps and we have yet to see any intervention by regulators," the expert added.
XAI's own terms of service prohibits "showing likenesses of persons in a sexually explicit way".
In a statement, Ofcom said it was unlawful to "create or circulate private pictures or illegal content" and stated this covered sexual deepfakes made with AI.
It said networks such as X were mandated to take "suitable steps" to "minimize the risk" of users encountering illegal material on their services and to delete it quickly when they become aware of it.
