xAI has filed a lawsuit challenging Minnesota’s new law targeting services that allow users to create non-consensual deepfake pornography. The company argues that the measure violates free speech protections and could restrict access to its Grok Imagine image and video tool.
The xAI Minnesota deepfake porn lawsuit names state Attorney General Keith Ellison. At stake is House File 1606, which could impose civil penalties of up to $500,000 for each violation.
Minnesota law targets AI nudification tools
Minnesota’s new law prohibits services from enabling users to create or distribute non-consensual sexualised deepfakes. It targets the operators, owners and creators of websites, apps and software that make such material possible.
The measure focuses on so-called nudification technology. These tools can alter an image or video to falsely depict a person as nude or sexually exposed.
Under the law, a platform cannot allow users in Minnesota to access, download or use a service for that purpose. Each violation could result in a fine of $500,000.
Supporters see the law as an attempt to hold technology companies accountable when their products enable the creation of abusive sexual content.
xAI says the law restricts free expression
xAI argues that the Minnesota law is too broad and imposes an unconstitutional restriction on speech. Its lawsuit claims the measure places a content-based ban on visual-expression tools in an effort to stop harmful uses of AI.
The company says Grok Imagine has legitimate creative applications. According to xAI, a blanket restriction could prevent Minnesotans from using the tool for protected expression.
Its lawyers argue that the law may force xAI to alter Grok Imagine’s image-editing capabilities or remove access to the service within the state.
xAI is seeking to block enforcement of the law during the case and permanently prevent it from being applied to the company.
Lawsuit questions the line between editing and nudification
A central part of xAI’s challenge concerns how the law distinguishes between ordinary image editing and harmful sexual manipulation.
The company argues that AI tools can make many non-sexual changes, such as replacing backgrounds, adjusting lighting or altering scenery. Its lawyers question whether edits that change a person’s clothing or reveal parts of the body should trigger the same penalties.
Minnesota’s law focuses on non-consensual sexual content rather than standard image editing. However, xAI argues that the wording could affect broader creative functions offered by AI image-generation tools.
The outcome may influence how clearly future laws define the boundary between legitimate editing features and harmful nudification services.
xAI says its policies prohibit deepfake pornography
xAI says its acceptable-use rules prohibit users from creating nude or sexualised images of people without consent. The company also says it has taken action against users who break those rules through Grok Imagine.
Still, Grok has faced controversy after users reportedly bypassed safeguards to create non-consensual deepfake pornography involving adults and children.
The lawsuit says users have evaded xAI’s technological blockers. Critics argue that platform policies offer limited protection if users can easily create new accounts or find ways around existing safeguards.
According to the article, xAI updated its rules after the controversy to explicitly ban nudification and non-consensual sexual content. Accounts found to violate the policy can lose access to Grok Imagine.
Case could shape AI safety regulation
The xAI Minnesota deepfake porn lawsuit could set an important precedent for US state regulation of generative AI tools.
A ruling in Minnesota’s favour could encourage other states to impose direct penalties on companies whose products enable non-consensual sexual deepfakes. A win for xAI, meanwhile, could make it harder for states to regulate the design and availability of AI image tools.
The case highlights a wider question facing the AI industry: how much responsibility should platforms bear when users create harmful material with their products?
0 responses to “xAI Sues Minnesota Over Deepfake Porn Law and $500,000 Fines”