The controversial tool, hosted on platform X, continues to enable users to create altered images that undress or sexually portray individuals without consent, even as of today.

Unlike many other AI-driven image generators, Grok distinguishes itself by allowing the public sharing of these images, making them easy to distribute widely.

Since the end of last year, the eSafety Commission has been alerted multiple times about Grok’s misuse in crafting unauthorized sexualized images.

“We have received reports involving adult images, which fall under our Image-Based Abuse guidelines, and others concerning potential child sexual exploitation, handled under our Illegal and Restricted Content framework,” a spokesperson explained.

Currently, the adult-related reports are under review, while those involving minors did not meet the criteria for child sexual exploitation material.

eSafety has not taken any action, but said it was worried about the use of generative AI.

“eSafety remains concerned about the increasing use of generative AI to sexualise or exploit people, particularly where children are involved,” the spokesperson said.

Analysis from non-profit outfit AI Forensics said in a report that it analysed 20,000 images generated by Grok between December 25 and January 1 and found that two per cent depicted a person who appeared to be 18 or younger, including 30 of young or very young women or girls, in bikinis or transparent clothes.

One of the victims includes Musk’s former partner, Ashley St Clair, who became estranged from the tech billionaire after the birth of their child in 2024.

She told The Guardian users have used Grok to create “revenge porn”.

“I felt horrified, I felt violated, especially seeing my toddler’s backpack in the back of it,” she told the publication. 

X did not deny that unconsensual sexualised content exists on Grok, but warned that users could be suspended or referred to law enforcement.

“We take action against illegal content on X, including Child Sexual Abuse Material, by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary,” X said through its Safety account.

“Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content.”

But governments and regulators around the world called for Musk’s platform to do more to combat abusive content. 

The United Kingdom’s Technology Secretary Liz Kendall said the content is “absolutely appalling, and unacceptable in decent society”.

“We cannot and will not allow the proliferation of these demeaning and degrading images, which are disproportionately aimed at women and girls,” she said.

The country’s communications regulator Ofcom said it made ”urgent contact” with X.

The European Union said it was aware of the content and strongly condemned Grok.

“This is not spicy. This is illegal. This is appalling. This is disgusting. This is how we see it, and this has no place in Europe. This is not the first time that Grok is generating such output,” European Commission spokesman Thomas Regnier said.

France, Poland, India, Malaysia and Brazil also called for Musk to implement strict rules and take action.

– With Associated Press