LIVE Watch Now
Breaking
Ninja introduces microwave air fryer to combat soggy pizzaVice Chancellor of Ziauddin University meets FGP to discuss research and climate actionProton CTO on Balancing Privacy and PolicyCPO Sukhera pledges support to Rawalpindi tradersSmoke from Canadian Wildfires Causes Air Quality Alerts in USNetflix Casts New Stars for Comedy Series ‘I Suck at Girls’Customs Clarifies Import and Fuel Supply IssuesRawalpindi Police Seize Over 14 Kilograms of Drugs, Arrest Four SuppliersToronto faces worst air quality due to Canadian wildfiresNetflix Launches Minigolf Game with Pop Culture HitsPakistan and Russia Forge New Trade Ties Through Barter MechanismCourt Extends Remand of Suspects in Foreign Women Kidnapping CaseUK threatens visa restrictions over Pakistan’s stance on rapist deportationSupreme Court Reserves Ruling on NAB Bail ApplicationsUS stocks dip as AI valuations cause market concernGold prices fall as Middle East tensions boost US rate hike expectationsUS to Tighten Visa Duration for Foreign Students, JournalistsPSX Index Surges 2,837 Points as KSE-100 ReboundsOnePlus exits US market after eight-year strugglePunjab Hospitals to Digitize Medico-Legal ReportsNinja introduces microwave air fryer to combat soggy pizzaVice Chancellor of Ziauddin University meets FGP to discuss research and climate actionProton CTO on Balancing Privacy and PolicyCPO Sukhera pledges support to Rawalpindi tradersSmoke from Canadian Wildfires Causes Air Quality Alerts in USNetflix Casts New Stars for Comedy Series ‘I Suck at Girls’Customs Clarifies Import and Fuel Supply IssuesRawalpindi Police Seize Over 14 Kilograms of Drugs, Arrest Four SuppliersToronto faces worst air quality due to Canadian wildfiresNetflix Launches Minigolf Game with Pop Culture HitsPakistan and Russia Forge New Trade Ties Through Barter MechanismCourt Extends Remand of Suspects in Foreign Women Kidnapping CaseUK threatens visa restrictions over Pakistan’s stance on rapist deportationSupreme Court Reserves Ruling on NAB Bail ApplicationsUS stocks dip as AI valuations cause market concernGold prices fall as Middle East tensions boost US rate hike expectationsUS to Tighten Visa Duration for Foreign Students, JournalistsPSX Index Surges 2,837 Points as KSE-100 ReboundsOnePlus exits US market after eight-year strugglePunjab Hospitals to Digitize Medico-Legal Reports
◕ SundialUpdated 11 hours ago
Trending Stories
Technology

AI Company Sues User for Creating Child Nudity with Chatbot

AI Company Sues User for Creating Child Nudity with Chatbot

Key Takeaways

  • Elon Musk’s xAI has filed a lawsuit against Terry Wayne Harwood, accusing him of creating child sexual abuse material.
  • The case is one of the first known lawsuits by an AI company against a user accused of generating illegal explicit content.
  • xAI claims Harwood violated its terms and exposed the company to legal risk and reputational damage.

Elon Musk’s artificial intelligence (AI) firm, xAI, has initiated legal action against Terry Wayne Harwood, a South Carolina resident. The lawsuit, filed in federal court in Texas, accuses Harwood of using the company's chatbot, Grok, to create child sexual abuse material and non-consensual explicit deepfakes.

Harwood was previously arrested on charges related to the sexual exploitation of minors, making this case particularly significant as it marks one of the first known instances where an AI company has taken legal action against a user for creating illegal content with its technology.

xAI alleges that Harwood violated the company’s Terms of Service and Acceptable Use Policy by using Grok to alter non-sexual photos into sexually explicit images without the subjects' knowledge or consent. The lawsuit further claims that Harwood created multiple xAI accounts and used misleading prompts to bypass safeguards designed to prevent illegal content.

The case highlights the growing concerns surrounding AI tools capable of generating harmful deepfake content, particularly when such technology can be misused for creating child sexual abuse material. In a statement cited in the lawsuit, Elon Musk had previously warned users that those who create illegal content with Grok would face the same consequences as those who upload illegal content.

xAI has also emphasized its commitment to enforcing its rules and preventing misuse of its platform. The company claims it suspended more than 52,000 accounts in 2026 and made over 73,000 reports to the National Center for Missing & Exploited Children, contributing to at least 244 arrests.

In seeking damages and a court order that would permanently bar Harwood from using Grok, xAI argues that his alleged actions not only violated company policies but also exposed it to legal risk and reputational damage. The case could set an important precedent for how AI companies respond when users allegedly misuse generative AI tools to create illegal or abusive content.

The lawsuit comes after Grok faced criticism over its image tools, which were reported to have been used to generate non-consensual explicit deepfakes. In response, xAI restricted some image-editing capabilities and stated that it had a zero-tolerance policy on sexual exploitation and non-consensual nudity.