Indonesia and Malaysia block Grok access, UK threatens ban as explicit deepfake problem grows

Grok access has been cut off for users in Indonesia and Malaysia following concerns that the xAI chatbot's safeguards were ineffective.

Both countries issued temporary suspensions intended to remain in effect until xAI implements safeguards that comply with regulators' demands.

"The government views the practice of non-consensual sexual deepfakes as a serious violation of human rights, dignity, and the security of citizens in the digital space," wrote Indonesia’s minister of communications and digital affairs Meutya Hafid in a statement released Saturday. Indonesia has sweeping internet censorship laws governing content deemed "obscene."

Malaysia had recently launched an investigation into "misuse of artificial intelligence (AI) tools on the X platform," part of a wave of intervening actions taken by regulators. That investigation followed on the heels of an Indian IT ministry notice directing X to take immediate action on Grok's alleged misuse. The notice alluded to potential violations of the country's Information Technology Act.

French authorities in the Paris prosecutor's office and other foreign governments, including the UK and an EU probe, have announced similar investigations into xAI's technology and its regulation under relevant online safety laws. Australian prime minister Anthony Albanese also issued a statement concerning Grok's deepfake problems, reiterating the country's decision to ban social media for users under the age of 16. In addition, the U.S. based National Center on Sexual Exploitation (NCOSE) has called on the Department of Justice and Federal Trade Commission to investigate X under existing child sexual abuse material (CSAM) laws and the recent Take It Down Act.

UK technology secretary Liz Kendall recently said she would support blocking X outright, should the UK's Office of Communications (Ofcom) conclude the platform violates the Online Safety Act. Kendall said she expects a decision to made in the next few days.

Elon Musk, who has previously said users should face consequences for "uploading illegal content" on X, responded to the threats of a ban by accusing the UK government of being overly eager to censor the company. In a post on X, Musk wrote: "They just want to suppress free speech." Musk also shared several X posts claiming that Grok is being targeted by government officials.

A recent Wired investigation found that the desktop and app versions of Grok Imagine were able to produce sexually violent and graphic material, depictions of celebrities in sexual scenarios, and potential AI-generated CSAM, despite built-in safeguards. The chatbot has a now well-documented track record of producing sexualized deepfakes, including at the request of users who ask Grok to non-consensually "undress" individuals in publicly-uploaded photos.