X (formerly Twitter) today announced the immediate implementation of robust technological safeguards for its AI chatbot, Grok, following a surge in global regulatory scrutiny and public outcry regarding the generation of sexualized deepfakes.
New Safety Protocols and Restrictions
In a statement released by X’s safety team, the company confirmed that it has deployed “technological measures” designed to prevent the editing of images of real people into revealing attire. Key updates include:
- Prompt Blocking: The Grok account is now restricted from generating or editing images of real individuals in “bikinis, underwear, and similar attire.”
- Geoblocking: X will geoblock the ability to create such images in jurisdictions where these actions are deemed illegal under local statutes.
- Monetization Gate: As an “extra layer of protection,” the ability to create and edit images via Grok is now restricted exclusively to paid subscribers.
Global Regulatory Response
The announcement follows a series of swift actions by international watchdogs and law enforcement agencies:
- California Investigation: Attorney General Rob Bonta has launched an investigation into xAI to determine if state laws were violated during the proliferation of “vile” and “shocking” sexualized material.
- European Union Oversight: The European Commission is currently assessing whether these changes effectively protect EU citizens under digital safety regulations.
- International Bans: Indonesia and Malaysia have already blocked access to Grok entirely, while regulators in India, Britain, and France have launched probes or referred the matter to prosecutors.
Addressing Nonconsensual Content
The crackdown follows a report by the non-profit AI Forensics, which analyzed over 20,000 Grok-generated images and found that more than half depicted individuals in minimal attire, with a concerning percentage appearing to be minors.
You May Like To Read: PM Confirms Active Negotiations for JF-17 Exports After Battle-Tested Success
“We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images,” stated California Attorney General Rob Bonta. X has expressed its commitment to iterating on these safety tools to ensure the platform remains compliant with global laws and protects users from digital harassment.
Check out our latest video:
