Investigating the AI-Generated Deepfake Porn Crisis in South Korea
Learn how deepfake porn is created, its rise in South Korea and India, how to protect yourself, and how businesses can use deepfake technology ethically. Explore solutions from XpndAI.
Deepfake technology refers to the use of artificial intelligence (AI) and machine learning to create hyper-realistic fake videos, audio, or images. By using deep neural networks, AI models can learn to replicate facial movements and body language, resulting in synthetic media that closely mimics real-life individuals. While this technology offers exciting opportunities in entertainment and business, it has increasingly been weaponized, particularly in creating non-consensual pornography.
History of Deepfake Technology
The term “deepfake” is derived from "deep learning" and "fake," and it first gained public attention in 2017. It was primarily used on online forums to superimpose celebrity faces onto adult content. However, as AI capabilities have improved, so has the quality of these videos, making it difficult to distinguish between real and fake.
Initially, deepfake techniques were used in Hollywood to de-age actors or bring deceased performers back to life on screen. However, as the technology became accessible to the public, it quickly turned into a tool for online abuse.
How Deepfake Porn is Created
The process involves training an AI model using thousands of images of a person. These images are often collected from social media platforms like Instagram or Facebook. Once trained, the AI can convincingly recreate a person’s face or voice, which can then be applied to other bodies in pornographic videos.
Programs like DeepFaceLab and DeepNude are popular among creators. DeepNude, for instance, was an app that undressed images of women using AI before it was shut down. However, copies of the app still circulate online.
Once created, these deepfakes are often distributed across encrypted messaging apps (such as Telegram) or on the dark web. Victims are usually unaware until the content has spread widely across forums, causing irreversible damage.
Deepfake Porn: Numbers on the Rise
The use of deepfake pornography has surged over the last few years. A study by Sensity AI in 2020 revealed that 96% of all deepfake videos online were pornographic, and the vast majority targeted women without their consent. The situation has worsened since then:
In 2021, South Korea reported 156 cases of deepfake crimes, which nearly doubled by mid-2024
The number of deepfake pornographic videos globally is estimated to increase by over 900% since 2019, according to Sensity AI.
Many victims in South Korea and India have had to remove their entire social media presence to prevent further exploitation
The Deepfake Crisis in South Korea
South Korea has been one of the hardest-hit countries by deepfake porn. Women, particularly K-pop celebrities and influencers, have found their images manipulated into adult content. The societal impact is significant, as many survivors face public humiliation and lifelong trauma. Despite protests from advocacy groups, the legal response has been criticized for its slowness and lack of strict enforcement
Victims have resorted to removing personal images from their online profiles, but this has not been enough. The rising cases have pressured the South Korean government to implement stricter penalties for deepfake crimes. However, without global cooperation, such crimes continue to grow.
Deepfake Crimes in India
India, too, has seen a sharp rise in deepfake cases. As AI tools become more affordable and accessible, anyone with basic technical knowledge can create and distribute deepfakes. Victims range from celebrities to regular social media users. The sheer size of the internet population in India makes it a prime target for deepfake creators.
How Women Can Protect Themselves
Here are a few tips to reduce the risk of becoming a victim of deepfake porn:
Set Social Media Profiles to Private: Restrict access to your photos and videos by adjusting privacy settings on platforms like Instagram and Facebook.
Limit Sharing High-Quality Images: Avoid posting high-resolution images publicly as they can be used to create deepfakes.
Use Reverse Image Search: Regularly search for your images online to detect unauthorized use.
Report Suspicious Content: If you encounter deepfake content using your likeness, report it to the platform and seek legal assistance immediately.
How XpndAI Can Help Build Deepfake Detection Systems
At XpandAI provides deepfake detection services utilizing advanced AI technology. We support social media platforms in identifying and removing harmful fake content, assist government and law enforcement agencies in tracking non-consensual media to aid in justice, and help businesses ensure their digital marketing content remains authentic by detecting subtle deepfake manipulations.
Business Applications of Deepfake Technology
Despite its association with malicious activities, deepfake technology also has legitimate uses in the business world. XpndAI helps businesses leverage deepfake technology responsibly for creative and marketing purposes.
Deepfake-Based Marketing Campaigns
Deepfake technology offers brands new ways to engage with their audience:
Personalized Content: Companies can use AI to create personalized messages for their customers. For example, a famous actor’s likeness can be used to deliver customized birthday greetings or product recommendations, creating a unique user experience.
Localized Ads: Brands can use deepfakes to seamlessly adapt advertisements for different languages and markets. Instead of reshooting an ad, deepfake technology can alter an actor's speech to match a new language or cultural context, allowing for faster and cheaper global campaigns.
At XpndAI, we assist businesses in building such AI-driven campaigns by ensuring that all deepfake content is created ethically, and we develop safeguards to detect misuse.
Training and Simulations
Deepfakes also enable companies to create lifelike simulations for training employees. For example, customer service representatives can engage in training exercises with realistic virtual avatars, providing a more immersive experience.
The Future of Deepfake Technology: Pros and Cons
Pros:
Creative Opportunities: Deepfakes can enhance creativity in filmmaking and marketing.
Cost-Effective Solutions: Businesses can save time and money by using AI-generated media instead of hiring actors for every ad or video.
Cons:
Ethical Issues: The misuse of deepfakes, particularly in creating non-consensual pornography, raises serious ethical concerns.
Security Threats: Deepfakes can be used to spread misinformation or defame public figures, posing a threat to public trust.
Deepfake Technology: Tools and How It Works
The core technology behind deepfakes is Generative Adversarial Networks (GANs), where two neural networks compete to improve the realism of generated content. Additionally, autoencoders are used to compress and reconstruct images. When trained with vast datasets, these AI models become capable of creating highly realistic yet entirely fabricated videos or images.
Popular tools include:
DeepFaceLab: Widely used for creating deepfakes in films, and also misused for creating pornographic content.
FaceSwap: Another deepfake tool, initially built for entertainment purposes but often exploited for malicious content.
DeepNude: An app that automatically undresses images of women using AI, which, although taken down, continues to circulate.
Conclusion
Deepfake technology offers immense potential for creativity and innovation in marketing, training, and content creation. However, the rapid rise in deepfake porn and misinformation has brought significant challenges, especially for women who are disproportionately targeted. Countries like South Korea and India are grappling with an increase in non-consensual deepfake content, with victims often left without adequate legal protection.
At XpndAI, we strive to provide solutions to both sides of the deepfake dilemma. Our advanced AI systems help detect harmful content, while our expertise in AI-driven marketing allows businesses to ethically leverage the power of deepfake technology for creative campaigns. By using AI responsibly and maintaining strong legal and ethical guidelines, deepfakes can serve as a valuable tool for innovation without compromising security or privacy. for more detail visit agent.xpndai.com and Book a call with us.