Government gets tough on AI content on Facebook and Instagram; seeks report from Meta.

The central government has intensified pressure on Meta regarding deepfakes and AI-generated content. In a series of meetings, the company has been asked to provide answers regarding the removal of Child Sexual Abuse Material (CSAM) and unlabeled AI-generated videos. The government has made it clear that it expects concrete results, not just assurances.

The central government has further increased pressure on Meta concerning the rise of deepfakes, fake videos, and AI-generated content on social media. Detailed discussions took place between the government and Meta’s technical team during a meeting held for the third consecutive day. The company was asked to address critical issues such as deepfakes, CSAM, unlabeled AI-generated videos, and content moderation. The government emphasized that it wants to see tangible outcomes rather than mere assurances.

Government expresses concern over deepfakes and AI content.

A major issue discussed in the meeting was the reappearance of AI-generated videos and images on the platform even after they had been identified. The government questioned why, despite existing IT rules, there are difficulties in completely removing unlabeled AI-generated content.

According to sources, the government has asked the company to take swift and effective action in such cases and to share regular progress reports.

Emphasis on Indian languages ​​in content moderation

The government suggested to Meta that content moderation should not rely solely on automated systems. It highlighted the need for greater human oversight to better understand Indian languages ​​and local contexts.

Officials believe that without a proper understanding of local languages ​​and cultural contexts, objectionable or misleading content often fails to be removed in a timely manner.

How did Meta respond?

During the meeting, Meta’s team shared details about its AI systems and content moderation processes with the officials. The company claimed that it possesses technical solutions to tackle issues like deepfakes, CSAM, and bot accounts, and is working towards further strengthening these measures. Meta had previously acknowledged these challenges and pledged to take corrective measures. Now, the government has stated that it will conduct regular reviews of these claims.

Another meeting likely next week

According to sources, the government and Meta may hold another meeting next week to discuss these issues. This time, the discussion is expected to focus on the progress of technical measures and their impact.

The government maintains that its objective is not to impose censorship on any social media platform, but rather to ensure full compliance with Indian laws and provide users with a safe digital environment.

Stricter stance following the Prime Minister’s post controversy

This series of meetings with Meta began after an incident where an AI-based system temporarily blocked a Facebook post by Prime Minister Narendra Modi. Meta subsequently restored the post, attributing the incident to a technical error, and issued a public apology. Following this, the government initiated a detailed review regarding the company’s content algorithms, AI filters, and compliance with Indian laws.