Indonesia Blocks Musk’s Grok Chatbot Due to Risk of Pornographic Content
The Guardian
READ
Details
- Date Published
- 10 Jan 2026
- Priority Score
- 3
- Australian
- No
- Created
- 10 Jan 2026, 11:45 am
Description
Move comes after governments and regulators from Europe to Asia have condemned the AI tool and some have opened inquiries into sexualised content
Summary
The article details Indonesia's decision to block access to Elon Musk’s Grok chatbot over concerns of AI-generated pornographic content. This action underscores global regulatory challenges as several countries, including Australia and the UK, express concerns about AI's potential to create exploitative and non-consensual sexual imagery. In response to these issues, the chatbot has restricted image generation to paying subscribers while governments assess regulatory actions. The situation highlights critical ethical and safety concerns in AI usage, especially concerning digital rights and the governance of emerging technologies.
Body
A phone screen displaying the Grok app and logo is seen on 7 January 2026. Photograph: Anna Barclay/Getty ImagesView image in fullscreenA phone screen displaying the Grok app and logo is seen on 7 January 2026. Photograph: Anna Barclay/Getty ImagesIndonesia blocks Musk’s Grok chatbot due to risk of pornographic content Move comes after governments and regulators from Europe to Asia have condemned the AI tool and some have opened inquiries into sexualised contentIndonesia temporarily blocked Elon Musk’s Grok chatbot on Saturday due to the risk of AI-generated pornographic content, becoming the first country to deny access to the AI tool.The move comes after governments, researchers and regulators from Europe to Asia have condemned and some have opened inquiries into sexualised content on the app.Grok AI: is it legal to produce or post undressed images of people without their consent?Read morexAI, the startup behind Grok, said on Thursday it was restricting image generation and editing to paying subscribers as it tried to fix safeguard lapses that had allowed sexualised outputs, including depictions of scantily clad children.“The government views the practice of non-consensual sexual deepfakes as a serious violation of human rights, dignity, and the security of citizens in the digital space,” communications and digital minister Meutya Hafid said in a statement.The ministry has also summoned X officials to discuss the matter.Musk said on X that anyone using Grok to make illegal content would suffer the same consequences as if they had uploaded illegal content.xAI replied to Reuters’ email seeking comment with what seemed to be an automated response: “Legacy Media Lies”. X did not immediately respond to a request for comment.Indonesia, with the world’s biggest Muslim population, has strict rules that ban the sharing online of content deemed obscene.Indonesia’s block follows Grok switching off its image creation function on Friday for the vast majority of users after the widespread outcry about its use to create sexually explicit and violent imagery.Musk has also been threatened with fines, regulatory action and reports of a possible ban on X in the UK.The tool has also been used to manipulate images of women to remove their clothes and put them in sexualised positions. The function to do so has been switched off except for paying subscribers.Elon Musk’s X threatened with UK ban over wave of indecent AI imagesRead moreAustralian prime minister Anthony Albanese has also expressed concern over the use of artificial intelligence on the Grok chatbot to enable exploitative sexual content.The prime minister on Saturday joined a growing list of international leaders including British counterpart Keir Starmer in criticising the social media platform.“The use of generative AI to exploit or sexualise people without their consent is abhorrent,” he told reporters in Canberra.“The fact that this tool was used so that people were using its image creation function through Grok is, I think, just completely abhorrent.“It, once again, is an example of social media not showing social responsibility and Australians and indeed, global citizens deserve better.”While the number of reports received by Australia’s eSafety Office remains small, it says there has been a recent increase relating to the use of Grok to create sexualised or exploitative imagery.The watchdog warned on Friday it would use its powers including removal notices where such material meets the thresholds defined in the Online Safety Act.“X, Grok and a wide range of other services are also subject to systemic safety obligations to detect and remove child sexual exploitation material and other unlawful material as part of Australia’s world-leading industry codes and standards,” it said.With Reuters and AAPExplore more on these topicsIndonesiaXAsia PacificElon MusknewsShareReuse this content