Malaysia blocks Grok AI over sexual content and misuse

The Malaysian communications and multimedia commission (MCMC) has temporarily blocked Grok AI for users in Malaysia, effective 11 January 2026. 

In statement, MCMC said the move follows "repeated misuse of Grok to generate obscene, sexually explicit, indecent, grossly offensive and non-consensual manipulated images," including content involving women and minors.

Formal notices have been issued to X and xAI. MCMC said it issued notices to both entities on 3 January 2026 and 8 January 2026 to "demand, amongst others, the implementation of effective technical and moderation safeguards to prevent AI-generated content that may contravene Malaysian law." 

Don't miss: How brands can thrive, not just survive, on social media in 2026 

"However, the responses submitted on 7 January 2026 and 9 January 2026 by X. Corp relied on user-initiated reporting mechanisms and failed to address the inherent risks posed by the design and operation of the AI tool," added the MCMC. 

Access to Grok will remain restricted until effective safeguards are implemented to prevent content involving women and children. The MCMC also urges the public to promptly report harmful online content to MCMC and lodge police reports with the Royal Malaysia Police. 

Indonesia was the first country to block Grok AI over sexualised images. Indonesia's communication and digital ministry director general of digital space supervision, Alexander Sabar, said on Wednesday (8 Jan) that early inquiries show Grok AI currently lacks clear safeguards to stop the creation and circulation of pornographic material using real photos of Indonesian citizens.

“This risks serious violations of citizens’ privacy and self-image rights,” Sabar added.

The ministry views the manipulation of personal photos not merely as a moral issue, but as a serious infringement on individual control over visual identity, potentially causing psychological, social and reputational harm.

Malaysia’s focus on online safety

Malaysia has long taken a serious stance on protecting its online space, particularly for children. In March last year, the digital ministry introduced AI adaptation guidelines aimed at ensuring the ethical and responsible adoption of AI in the public sector. The 158-page framework outlined AI principles, stakeholder responsibilities, risk management strategies, adaptation methods, and self-assessment tools to help public sector organisations understand and mitigate AI’s impact.

By July 2025, communications minister Fahmi Fadzil highlighted the need for greater transparency in digital content creation, noting that the government was considering mandatory labelling of AI-generated content.

Efforts to safeguard children online have remained a priority. In November 2025, the government announced it would enforce a social media age limit, barring users under 16 from creating accounts starting in 2026. Early conversations with agency leaders in 2024 indicated broad support for such measures.

"As we have seen in Malaysia with kids being exposed to social media from an early age, it has had a negative impact as it has driven children to have a consumerist mindset early on. Also, with social media platforms having relaxed age parameters this leads to children being exposed to unwanted content," Suzen Chai, general manager, LOKi Digital, said. "Hence, this would help in reducing these occasions. I welcome this type of legislation in guarding young children from the addictive and harmful effects of social media."

Tanner Nagib, strategic advisor at REBL, added, “"This law reflects a growing concern about the mental health, privacy, and safety of children in the digital space. Social media offers both opportunities and risks, especially for younger users who are vulnerable to cyberbullying, exposure to inappropriate content, and the pressures of social comparison."

"Setting a minimum age of 16 acknowledges these risks, but we must also recognise that when humans are told they can’t do something, they often find a way to do it anyway or shift to something else. Teens may turn to unregulated apps or more extreme online environments to bypass restrictions, potentially leading to even more severe consequences," explained Nagib. 

Related articles:  
Indonesia may ban Grok AI and X amid nonconsensual deepfake surge   
X tightens the screws on parody and fan accounts 
Elon Musk: X hit by cyberattacks again