The Dark Side of AI Influencers

AI-generated virtual influencers are taking over social media platforms, with some earning up to $11,000 a month.,Deepfaking faces of AI models onto real women's bodies is a growing concern, exploiting both AI and human victims.,Meta plans to label AI-generated content, but the task is enormous and technically challenging.

Introduction

Artificial intelligence (AI) and artificial general intelligence (AGI) are transforming various sectors across Asia, but their rapid growth has also brought unforeseen consequences.

One such issue is the rise of AI-generated virtual influencers who deceive social media users by stealing identities and profiting from deepfake content. This article explores the dark side of AI influencers, their impact on real people, and the challenges platforms face in addressing this problem.

AI-Generated Virtual Influencers: A Lucrative Trend

In recent years, AI-generated virtual influencers have infiltrated social media platforms like Instagram and TikTok. These AI-powered characters appear as real people, gaining substantial followings and even earning significant income. For example, Aitana, a 25-year-old pink-haired AI character from Barcelona, nets her creators at Spanish agency The Clueless up to $11,000 a month.

Deepfakes: Exploiting AI and Human Victims

The situation turns more sinister when creators use deepfake technology to superimpose AI-generated faces onto the bodies of real women, often models and sex workers. One account, "Adrianna Avellino," posts AI-generated content alongside videos of real women with her AI-generated face deepfaked. This practice raises ethical concerns, as it exploits both the AI models and the real individuals whose bodies are used without consent. You can learn more about spotting AI video with our #1 clue.

The Face-Swapping Technique

The technology behind face-swapping is no secret. Numerous detailed videos explain how to paste an AI influencer's face over a real video. Additionally, face-swap apps have gained popularity, enabling users to create deepfakes on their smartphones. This accessibility contributes to the rapid spread of this concerning trend. For instance, YouTube's Secret AI might be already bending reality with its editing capabilities.

Platforms Struggle to Moderate

Meta (formerly Facebook) has started to take action against AI-generated accounts after being alerted to high-profile AI-generated models with hundreds of thousands of followers on Instagram. The company plans to label AI-generated content beginning next month. However, the task of identifying and moderating deepfakes among the deluge of AI influencers is monumental and technically challenging, especially when distinguishing between real and AI-generated content. Meta's AI Chat is also making waves in ad targeting.

A Call for Responsible AI Development

The rise of AI influencers and deepfake content highlights the urgent need for responsible AI development and regulation. As AI and AGI continue to advance and impact various industries in Asia, it is crucial to address the ethical implications and protect both AI and human victims from exploitation. The National Institute of Standards and Technology (NIST) AI Risk Management Framework offers a comprehensive guide to managing AI risks. This growing concern ties into broader discussions about deliberating on the many definitions of Artificial General Intelligence.

Comment and Share

Have you encountered any AI influencers or deepfake content on your social media feeds? Share your experiences and thoughts on this growing trend. Don't forget to Subscribe to our newsletter for updates on AI and AGI developments and join our community discussion below.