Grok ban: Organizations ask U.S. government to halt chatbot use, Indonesia lifts block

A coalition of organizations are calling on the U.S. government to sever ties with Elon Musk's xAI, as Grok weathers a child sexual abuse material (CSAM) scandal and international investigations.

In an open letter shared exclusively with TechCrunch, advocacy groups like Public Citizen, Center for AI and Digital Policy, and Consumer Federation of America call on the Office of Management and Budget (OMB) to decommission use of the Grok chatbot by federal agencies in light of user safety concerns.

xAI signed a deal with the U.S. General Services Administration (GSA) last year, offering Grok to federal agencies. Grok later brokered a contract to offer services to the Department of Defense and Pentagon officials, prompting security concerns. The Department of Health and Human Services also actively uses Grok, according to TechCrunch.

"Our primary concern is that Grok has pretty consistently shown to be an unsafe large language model,” one of the letter's authors, JB Branch, told TechCrunch. “But there’s also a deep history of Grok having a variety of meltdowns, including antisemitic rants, sexist rants, sexualized images of women and children.” The coalition has penned similar letters expressing concern over Grok in the past, and is demanding the OMB investigate Grok's safety failures.

Over the last month, foreign and domestic leaders have called on xAI to implement stronger safeguards or risk facing widespread bans, with India, France, the United Kingdom, and the European Union announcing official investigations into Grok's deepfake problem. California Attorney General Rob Bonta later sent a cease and desist letter to xAI, stating the company was violating California public decency laws and new AI regulations.

Indonesia, which had previously blocked access to Grok while country officials waited xAI's response, lifted its temporary ban on Feb. 1, citing a letter sent to the Ministry of Communication and Digital Affairs by Musk's company. According to the letter, xAI has implemented new safety measures designed to prevent further misuse. The Indonesian ministry said it will continue to monitor and test Grok's safety guardrails and will reinstate the ban if any more illegal content surfaces.

The chatbot has been accused of lacking robust safeguards that prevent the chatbot from creating non-consensual intimate imagery of real people and minors. According to a report by the Center for Countering Digital Hate (CCDH), Grok produced an estimated 3 million sexualized images, including ones depicting children, over an 11-day period.