Social media platform X has taken significant corrective action, including the removal of thousands of pieces of content and hundreds of accounts, following a stern warning from the Indian government regarding the misuse of its artificial intelligence chatbot, Grok. The move comes after the Ministry of Electronics and Information Technology (MeitY) raised serious concerns about the platform's content moderation lapses.
Government Directive and Platform's Response
On January 2, MeitY issued a formal directive to X, highlighting the circulation of vulgar, obscene, and unlawful content created using the Grok AI tool. The ministry specifically pointed to the generation of non-consensual sexualised images of women. The government gave the platform 72 hours to submit a detailed report on the actions taken and the safeguards implemented to prevent such incidents in the future.
According to government sources, X's initial response was deemed insufficient, as it lacked specific details on content removal and preventive measures. This prompted MeitY to seek additional clarifications and issue a legal warning. The ministry cautioned that failure to meet due diligence obligations could lead to the loss of safe harbour protection under Section 79 of the IT Act, potentially exposing the company to legal consequences under other statutes, including the Bharatiya Nyaya Sanhita (BNS).
Corrective Measures and Global Scrutiny
Following the government's push, X has now acknowledged its mistakes and initiated corrective steps. Approximately 3,500 pieces of content linked to Grok have been taken down, and over 600 user accounts have been deleted for policy violations. The platform has assured Indian authorities of its commitment to comply with local laws and enforce stricter policies to curb the misuse of AI for generating harmful imagery.
The controversy surrounding Grok is not confined to India. Regulatory bodies in the United Kingdom and the European Union have also expressed concerns. The UK's communications regulator, Ofcom, has sought explanations from X and its affiliated AI company, xAI, regarding steps taken to fulfill legal obligations. Similarly, the European Commission has reportedly asked the platform to preserve documents related to the chatbot for further examination.
Ongoing Monitoring and Future Compliance
Government sources indicated that Indian authorities will continue to monitor X's compliance closely. The focus remains on ensuring that the platform adheres to online safety norms and its statutory obligations to prevent the spread of illegal and harmful AI-generated content. X has publicly stated that it takes action against illegal material, including child sexual abuse content, by removing it, suspending accounts, and cooperating with law enforcement agencies globally.
The company had previously warned that "anyone using or prompting Grok to make illegal content will face the same consequences as if they uploaded illegal content." With global scrutiny mounting, the pressure is on for tech platforms to establish robust technical and organizational safeguards to govern the rapidly evolving landscape of generative AI.
