In a recent report, it has been revealed that Meta has been running advertisements that feature AI-generated images related to child sexual abuse, with numerous instances occurring in India. This revelation follows a prior directive from the Indian government to Meta, urging the removal of such content from Instagram, after a BBC investigation brought the issue to light.
Extent of the Issue
The Tech Transparency Project (TTP), based in Washington, has identified 332 ads containing child sexual abuse material (CSAM) that were displayed on Facebook and Instagram. Of these, 274 ads were disseminated in August alone. Notably, 84 of the ads were targeted at Indian audiences, with 78 being published after the government issued an order for their removal.
The TTP report highlights that some of these ads involved manipulated images of real children, including prominent figures like a member of a European royal family. Despite being notified, Meta platforms still displayed more than twelve of these ads. The BBC’s outreach to Meta regarding these findings led to a statement asserting the company’s zero-tolerance policy towards such content, whether real or AI-generated.
Response and Legal Actions
Following the BBC’s investigation, Indian authorities, including the National Commission for Protection of Child Rights and the National Human Rights Commission, have begun examining the situation. In India, the distribution of CSAM is a criminal offense, and Meta’s ad policies explicitly prohibit content that exploits or endangers children.
Bhuwan Ribhu from Just Rights for Children has criticized Meta’s response as insufficient. His organization has filed a petition with India’s Supreme Court, demanding stronger measures for reporting and identifying those who promote CSAM.
Meta has stated that any apparent child exploitation is reported to the National Center for Missing and Exploited Children (NCMEC) in the United States, in line with their legal requirements. However, TTP’s findings indicate that the ads persisted even after being reported through Meta’s channels.
Challenges and Further Findings
The TTP report accuses Meta’s ad agency partners in China, known as “resellers,” of placing several ads promoting CSAM. These partners did not respond to inquiries from TTP. The ads often directed users to AI apps capable of generating or viewing CSAM, predominantly developed by Chinese companies.
Meta has acknowledged the challenges in its moderation system, which primarily relies on automation to review and approve ads. This system checks various elements such as images, text, and target audience. Despite these measures, the report indicates ongoing issues, with new ads appearing even after Meta was informed.
Broader Implications
The BBC’s investigation also uncovered links between Meta’s ads and the messaging app Telegram, where users could purchase material for a minimal fee. Telegram claims to have stringent measures against CSAM, utilizing both automated and human moderation to curb its spread.
Shikha Goel, a senior cyber police officer in India, emphasized the difficulty in tracking offenders due to their ability to switch platforms easily. She expressed optimism that the Indian government would address these challenges in discussions with social media companies.
