X Rolls Out Geoblocking for Grok AI After India's Stern Warning
Microblogging platform X has activated technological barriers to stop its artificial intelligence chatbot Grok from creating images of real people wearing revealing clothes like bikinis and underwear. This decisive move comes after the company faced severe backlash from Indian authorities over obscene deepfakes generated by the AI tool.
New Restrictions Apply to All Users
The company announced these measures through a post on its official 'Safety' account. X stated it now geoblocks all users from generating such images via Grok in jurisdictions where the practice is illegal. This restriction covers everyone, including users who pay for premium subscriptions.
"We now geoblock the ability of all users to generate images of real people in bikinis, underwear, and similar attire via the Grok account and in Grok in X in those jurisdictions where it's illegal," the platform declared.
Furthermore, X has limited image creation and editing capabilities through Grok to paid subscribers only. The company explained this adds an extra layer of protection. It helps ensure individuals who try to misuse the Grok account to break laws or violate platform policies can be held accountable.
India's Firm Stance Triggered the Action
The IT Ministry of India had earlier issued a strong directive to X. Officials demanded the immediate removal of all vulgar, obscene, and unlawful content generated by Grok. The ministry warned of legal action if the platform failed to comply.
Government authorities highlighted that Grok AI, developed by X and integrated on the platform, was being misused. Users created fake accounts to host, generate, publish, or share obscene images or videos of women in a derogatory manner.
"Importantly, this is not limited to creation of fake accounts but also targets women who host or publish their images or videos, through prompts, image manipulation and synthetic outputs," the ministry had asserted.
The government made it clear that compliance with the IT Act and its rules is mandatory, not optional. Officials warned X that any failure to observe due diligence obligations would result in loss of legal protections and liability under Indian laws.
X Admits Mistake and Takes Corrective Steps
Following the government's pressure, X acknowledged its error. The platform removed approximately 3,500 pieces of content and deleted over 600 accounts linked to the obscene material. X assured Indian authorities it would comply with local laws and regulations.
The company emphasized its commitment to safety in its official communication. "We remain committed to providing a safe platform for everyone and continue to have zero tolerance for any forms of child sexual exploitation, non-consensual nudity, and unwanted sexual content," X stated.
X outlined its ongoing efforts to combat violations:
- Working around the clock to add additional safeguards
- Taking swift action to remove illegal and violating content
- Permanently suspending accounts where appropriate
- Collaborating with local governments and law enforcement
- Reporting accounts seeking child sexual exploitation materials to authorities
Global Pressure Mounts on AI Platforms
India is not alone in its concerns. Governments worldwide, including the United Kingdom and the European Union, have increased pressure on X regarding the Grok deepfake issue. Regulators are intensifying scrutiny of generative AI engines over content moderation, data safety, and non-consensual explicit images.
The initial response from X to India's notice was considered insufficient by the IT Ministry. Officials felt the reply missed key information about specific actions taken on the Grok AI obscene content issue and future prevention measures. This prompted the government to demand more detailed explanations.
X has now accepted its oversight and told the government it will adhere to Indian laws. The platform asserts that its existing safety protocols remain unchanged. All AI prompts and generated content posted to X must strictly follow stipulated rules, regardless of how the content is created or whether users are free or paid subscribers.
The company's Safety team continues to enforce these policies vigorously, aiming to maintain platform integrity while navigating complex regulatory landscapes across different jurisdictions.
