New Delhi: The Ministry of Electronics and Information Technology (MeitY) has issued a formal notice to social media platform X over the alleged misuse of its artificial intelligence chatbot Grok for generating and circulating obscene, indecent, and sexually explicit synthetic content. The action follows government findings that the AI tool has been used to create and share objectionable images and videos, including content targeting women and children, in violation of Indian law.
Allegations of Obscene AI-Generated Content
According to the Ministry, Grok AI services are being exploited by users operating fake or anonymous accounts to host, generate, publish, and disseminate obscene visuals portraying women in a derogatory and vulgar manner. Authorities flagged that such content includes synthetic and morphed images created without consent, raising serious concerns about online abuse, exploitation, and harm to personal dignity. The Ministry stated that unchecked AI-generated content poses a direct threat to the safety of vulnerable groups.
Regulatory Non-Compliance Highlighted
The notice, addressed to X’s Chief Compliance Officer for India Operations, stated that the platform has failed to adhere to mandatory due-diligence requirements under Indian digital laws. MeitY emphasised that compliance with the Information Technology Act, 2000, and the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, is a statutory obligation for all intermediaries operating in India. The Ministry clarified that regulatory compliance cannot be selectively applied or deferred.
Legal Provisions Applicable to the Case
The government cited specific sections of the IT Act that apply to the alleged violations. Section 66E penalises the violation of privacy through the capture or transmission of private images without consent. Section 67 deals with the publication or transmission of obscene material in electronic form. Section 67A covers sexually explicit content, while Section 67B criminalises electronic material involving sexual exploitation of children. The Ministry noted that AI-generated or synthetic content is fully covered under these provisions.
Due Diligence Obligations Under IT Rules, 2021
Under Rule 3 of the IT Rules, intermediaries are required to remove unlawful, obscene, or sexually explicit content and prevent its continued hosting. Rule 4 imposes additional obligations on Significant Social Media Intermediaries, including the appointment of designated compliance officers and implementation of mechanisms for grievance redressal and content traceability. The Ministry warned that failure to meet these obligations could lead to the loss of safe harbour protection under Section 79 of the IT Act.
Invocation of Bharatiya Nagarik Suraksha Sanhita
The notice also invoked the Bharatiya Nagarik Suraksha Sanhita (BNSS), 2023, which mandates that digital platforms must inform law enforcement agencies when they detect serious cognisable offences, particularly those involving women or children. The Ministry stated that acts involving the generation or circulation of obscene AI content may independently attract penal action under BNSS and other criminal laws.
Directive to Remove Unlawful Content
MeitY has directed X to remove or disable access to all content found to be in violation of applicable Indian laws. The platform has been instructed to carry out removals within the timelines specified under the IT Rules, 2021, while ensuring that evidence related to such content is preserved and not compromised. The Ministry stated that failure to act promptly would be treated as a serious breach.
Action Taken Report Sought
The government has asked X to submit an Action Taken Report detailing immediate corrective measures implemented to prevent the hosting, generation, and dissemination of obscene, nude, indecent, or sexually explicit content through AI-based services. The Ministry cautioned that inadequate or delayed responses would invite further regulatory and legal action.
Order for Comprehensive Audit of Grok AI
In addition to content removal, MeitY has ordered X to conduct a comprehensive technical, procedural, and governance-level audit of its Grok chatbot. The audit is intended to assess how the AI system processes user prompts, the adequacy of safeguards in place, and whether existing controls are sufficient to prevent the generation of unlawful imagery. Grok operates as a separate AI entity under X’s holding structure but maintains automated interaction capabilities on the platform.
Parliamentary Intervention and Political Response
The issue gained national attention following a letter from Shiv Sena (UBT) Rajya Sabha MP Priyanka Chaturvedi to Information Technology Minister Ashwini Vaishnaw, flagging concerns about the misuse of Grok AI. The matter has since been discussed within the broader context of parliamentary oversight of social media platforms and artificial intelligence governance.
Government’s Broader Position on Platform Accountability
IT Minister Ashwini Vaishnaw stated that social media platforms must take responsibility for content hosted or enabled by their services, including AI-generated material. He also referred to recommendations made by the Parliamentary Standing Committee on Information Technology advocating stricter legal measures to curb obscene content online. Earlier, the Ministry had issued an advisory directing all social media platforms to proactively identify and remove obscene and pornographic material.
Deadline and Warning of Legal Consequences
X has been directed to submit its Action Taken Report by January 5, 2026. The notice warned that failure to comply with the directions may result in strict legal consequences without further notice. Action may be initiated against the platform, its responsible officers, and users involved under the IT Act, IT Rules, BNSS, Bharatiya Nyaya Sanhita, and other applicable laws.
Implications for AI Governance in India
The notice to X underscores India’s evolving regulatory approach to artificial intelligence and digital intermediaries. Authorities have reiterated that innovation must operate within clearly defined legal and ethical boundaries. The case is expected to influence future enforcement strategies related to AI-generated content, online safety, and platform accountability.
Conclusion
By issuing a detailed notice to X over the alleged misuse of Grok AI, the Indian government has reinforced its commitment to protecting women and children from online exploitation. The action signals that AI tools deployed on social media platforms will be subject to strict scrutiny and enforcement. As generative technologies become more widespread, the outcome of this case is likely to shape how artificial intelligence is governed in India’s digital ecosystem.
Frequently Asked Questions (FAQs)
1. Why did the Indian government issue a notice to social media platform X?
The Ministry of Electronics and Information Technology issued the notice after observing the misuse of X’s AI chatbot Grok to generate and circulate obscene, indecent, and sexually explicit synthetic images and videos. Authorities found that such content, including material targeting women and children, violated Indian information technology laws and due-diligence requirements applicable to digital platforms.
2. What role did Grok AI play in the alleged violations?
Grok, an AI chatbot associated with X, was allegedly used by users operating fake or anonymous accounts to create and share morphed and synthetic images without consent. The government stated that inadequate safeguards allowed the tool to respond to prompts that resulted in the generation of objectionable content, raising concerns about privacy, dignity, and online safety.
3. Which Indian laws are applicable in this case?
The case involves provisions of the Information Technology Act, 2000, including Sections 66E, 67, 67A, and 67B, which address privacy violations, obscene material, sexually explicit content, and child sexual exploitation. The IT Rules, 2021, and the Bharatiya Nagarik Suraksha Sanhita, 2023, also apply, particularly regarding due diligence and mandatory reporting of serious offences.
4. What actions has the government directed X to take?
X has been instructed to remove or disable access to all unlawful content within prescribed timelines, preserve evidence, submit an Action Taken Report, and conduct a comprehensive audit of its Grok AI system. The government has warned that failure to comply may result in legal action against the platform, its officers, and users found violating the law.
5. What are the broader implications of this notice for AI and social media platforms?
The notice highlights India’s strict approach to regulating AI-generated content and enforcing platform accountability. It signals that artificial intelligence tools deployed in India must operate within legal and ethical boundaries, with strong safeguards to prevent misuse, particularly where women and children are concerned.
