Britain's media watchdog, Ofcom, has initiated a formal investigation into the social media platform X, formerly known as Twitter, following alarming reports about its AI chatbot, Grok. The probe comes days after UK Prime Minister Keir Starmer condemned AI-generated photos from the platform as "disgusting" and "unlawful."
What Sparked the Ofcom Investigation?
The regulator's action was triggered by deeply concerning reports that the Grok AI tool on X was being used to create and disseminate "undressed" images of real people without their consent and to produce sexualised depictions of children. Ofcom stated that this content may constitute intimate image abuse, pornography, or even child sexual abuse material (CSAM).
In an official statement, Ofcom confirmed it will determine whether X, owned by Elon Musk, breached the United Kingdom's stringent online safety laws. These laws mandate that technology platforms must implement robust measures to shield users from illegal content. The investigation will scrutinise if X adequately assessed the risk of its British users encountering such harmful AI-generated material.
Key Focus Areas of the Probe
Ofcom's inquiry will centre on three critical aspects of X's operations and safeguards. Firstly, the investigation will examine whether the platform properly evaluated the likelihood of its UK users being exposed to illegal AI-generated content.
Secondly, it will assess if X deployed sufficient protective measures to prevent the creation and distribution of child sexual abuse material. Thirdly, the regulator will analyse whether the existing restrictions placed on the Grok AI chatbot meet the minimum legal standards required to prevent its misuse for generating unlawful imagery.
It is crucial to note that under British law, creating or sharing AI-generated non-consensual intimate images is a criminal offense. The potential consequences for X are severe. Ofcom has warned that in case of non-compliance, it could seek court orders to compel payment providers and advertisers to withdraw services from the platform or even require internet service providers to block access to X within Britain.
Global Scrutiny and X's Response
The controversy surrounding Grok's output has attracted international attention beyond the UK. French authorities have already referred X to prosecutors for hosting "manifestly illegal" content. Similarly, India has demanded a formal explanation from the platform regarding the chatbot's problematic generations.
In response to the growing backlash, X has stated that accounts used to prompt the AI to create illegal content will face permanent suspension. The company emphasised, "Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content directly."
This investigation marks a significant escalation in regulatory pressure on major tech platforms concerning the ethical and legal deployment of generative AI tools, setting a potential precedent for how such technologies are governed globally.
