Alert: The dangerous face of AI! Women are being targeted through its misuse..
AI Misuse and Deepfakes: The misuse of artificial intelligence is no longer just a technical problem, but a serious threat to women. The controversy surrounding obscene content linked to the Grok AI tool on the X (formerly Twitter) platform is an example that this crisis is not limited to India. The United Nations and several countries consider the increasing digital attacks on women a human rights violation. In India, the National Commission for Women has also demanded stricter laws on AI. The Indian government has issued a notice to X, demanding that it take stringent measures.
AI Misuse Crisis Deepens Beyond India
The case of creating obscene images of women using AI Grok on the X platform is not limited to India. The United Nations Population Fund (UNFPA) has expressed concern over the increasing online attacks on women and gender minorities. According to the report, the misuse of AI has led to a rapid increase in crimes such as cyberstalking, fake profiles, sharing photos and videos without consent, and deepfakes. Experts believe that this is no longer just online harassment, but a serious human rights issue.
National Commission for Women's Strong Warning and Demands
India's National Commission for Women (NCW) has demanded immediate changes to cyber laws regarding the digital safety of women. The commission says that deepfakes and AI-generated content are proving existing laws inadequate. This is endangering the safety of women on social media and causing delays in justice. NCW Chairperson Vijaya Kishore Rahatkar has demanded that AI-generated fake content be declared a clear crime and that social media companies be held accountable.
Government Takes Strict Action Against X and Grok
Following questions raised by Rajya Sabha MP Priyanka Chaturvedi, the Ministry of Electronics and Information Technology (MeitY) has issued a notice to the X platform. The government stated that the Grok AI tool is being misused to create obscene and indecent content of women, which is a violation of the IT Act 2000 and IT Rules 2021. The ministry has directed X to take corrective measures within 72 hours, remove the objectionable content, and suspend or terminate the accounts of users who violate the rules.
The growing threat of deepfake cases
Cases involving actress Girija Oak and social media influencer Kamiya Buch have highlighted this threat. According to a McAfee report, 75 percent of people in India view deepfake content, and 38 percent become victims of it. Government data shows that cybercrimes against women increased by 118 percent between 2020 and 2024. Experts believe that this threat can only be contained in time by strengthening lower courts and cyber cells.
Disclaimer: This content has been sourced and edited from TV9. While we have made modifications for clarity and presentation, the original content belongs to its respective authors and website. We do not claim ownership of the content.
