xAI sues Grok user over alleged CSAM image generation
xAI alleges a South Carolina man used Grok to bypass safeguards and create or alter child sexual abuse material tied to criminal charges.
By Maya Lindqvist · Senior Technology Correspondent
2 min read
xAI has sued a South Carolina man, alleging he used its Grok chatbot to create or alter child sexual abuse material and distribute it. The case matters because it puts an AI company in court against a user it says exploited its system despite company safeguards and rules.
The Elon Musk-owned company accuses Terry Wayne Harwood of using Grok to get around protections, change nonconsensual images and generate and share CSAM, according to the lawsuit. Reuters reported the lawsuit earlier.
xAI says Harwood’s alleged conduct violated the company’s policies. The lawsuit claims Harwood acted “knowingly and intentionally” when using Grok, according to the filing.
Criminal charges preceded the lawsuit
Harwood was arrested in February, according to the South Carolina Attorney General’s Office. The office said he was accused of possessing and distributing child sexual abuse material.
Harwood faces eight felony charges, according to the South Carolina Attorney General’s Office. xAI’s lawsuit says “at least some” of the images connected to those criminal charges were generated or altered using Grok.
The filing does not describe all of the images at issue in the excerpted claims, and xAI’s allegations remain claims in a civil lawsuit. The criminal allegations against Harwood also remain allegations unless proven in court.
xAI points to misuse of Grok
In the lawsuit, xAI frames the case as a breach of its rules for using Grok. The company alleges Harwood used the chatbot in ways the company forbids, including by seeking to produce sexual abuse material involving children.
The complaint also says Harwood altered nonconsensual images, according to xAI. That allegation places the case among disputes over AI tools being used to create or manipulate sexualized images without consent, including material that law enforcement treats as child sexual abuse material.
Reuters reported that the lawsuit centers on Grok, xAI’s chatbot. The company’s claims, as described in the filing, focus on the alleged use of Grok to evade safeguards rather than on a technical failure identified in the excerpted material.
xAI is seeking to hold Harwood responsible through civil litigation while he also faces the separate criminal case described by South Carolina officials. The available filings identify the same alleged category of material in both matters, with xAI claiming some of it was made or modified through its AI system.
This story draws on original reporting from The Verge.