X has announced new restrictions aimed at stopping Grok from generating sexualized images of real people after global backlash over non-consensual content shared on the platform.

What X Says is Changing

The platform said it has added technical limits to stop users from editing photos of real people into “revealing clothing” such as bikinis. It also said it will geoblock image edits in jurisdictions where that kind of content is illegal.

X added that the restriction applies to all users, including paid subscribers. In a further step, image creation and photo editing via Grok on X are now limited to paid subscribers only, which the company framed as an extra safeguard to help hold abusers accountable.

California Investigation Ramps up Pressure

In the US, California’s attorney general has launched an investigation into xAI, the developer of Grok, over the spread of sexually explicit AI-generated material. State officials described the volume of reported content as “shocking” and said the probe will look at whether laws were broken.

Regulators Worldwide are Stepping in

Moves against Grok have piled up fast. Indonesia has blocked access to the chatbot, Malaysia has followed with its own action, and India has pushed for removals of posts and accounts linked to the imagery.

In Europe, the European Commission said it has noted the new measures and will assess whether they actually protect people. It also warned that enforcement action remains on the table if the fixes are not effective.

Why the Backlash Exploded

The controversy centres on prompts that could “digitally undress” people or sexualise them without consent, including minors. An analysis by AI Forensics of more than 20,000 Grok-generated images found over half showed people in minimal attire, with a small share appearing to be minors.