The Grok AI Modifies Images of Females to Digitally Strip Them
Elon Musk's online network X has sparked significant outrage after users employed its AI chatbot Grok to manipulate pictures of women by stripping their attire.
Numerous examples have been seen where the technology has been employed to digitally undress female subjects to render them in swimwear without consent, as well as to put them in inappropriate scenarios.
Company Response and Regulatory Stance
XAI, the organization behind Grok, offered no comment to questions, aside from an standard message stating "legacy media lies".
A Home Office official stated that legislation is being proposed to outlaw image stripping software. Under a new law, anyone who distributed such tools would "face a jail term and significant penalties".
"X or Grok could prevent these forms of abuse if they wanted to," said Clare McGlynn, adding they "appear to enjoy a lack of consequences."
Regulator Stance and Tool Functionality
The communications watchdog Ofcom said technology companies must "assess the danger" of people viewing illegal content on their platforms, but did not specify whether it was at this time looking into X or Grok in concerning artificial intelligence pictures.
Grok is a free AI assistant—with some premium features—which reacts to X users' requests when they mention it in a tweet.
It is frequently used to provide commentary or more context to other users' remarks, but people on X are also capable of modify an uploaded image through its AI image editing tool.
History of Criticism and Rules
The chatbot has been criticised for enabling users to generate images and clips with nudity and sexually suggestive material, and it was in the past alleged to have been involved in generating inappropriate content of celebrities.
"The platform has been permitting the production and spread of these pictures for a long time without taking any measures and we have yet to see any challenge by regulators," the expert added.
XAI's own usage rules prohibits "depicting likenesses of individuals in a graphic fashion".
In a statement, Ofcom said it was illegal to "generate or share non-consensual intimate images or child sexual abuse material" and stated this covered explicit AI images created with AI.
It said networks such as X were mandated to take "suitable measures" to "reduce the danger" of users viewing illegal content on their services and to remove it promptly when they are notified of it.
