Deepfake technology has become a significant concern in South Korea, as the country grapples with the widespread use of AI-generated fake pornography. The issue came to light when journalist Ko Narin published an article revealing the presence of deepfake porn rings operating in major South Korean universities. The scandal has deeply affected the victims, many of whom are young women and girls, and has exposed the inadequacies of the messaging app Telegram, which is being used as a platform for the distribution of these explicit images.
The use of deepfake technology involves using AI algorithms to create realistic but fake videos or images by superimposing one person’s face onto another person’s body. In the case of the South Korean scandal, deepfakes were created by combining real pictures of women and girls with pornographic content. This practice has led to the creation of numerous chat groups on Telegram, where users share these explicit images and request the creation of more deepfakes using pictures of individuals they know. These groups, referred to as “humiliation rooms” or “friend of friend rooms,” have strict entry terms and are dedicated to specific high schools, middle schools, and universities.
The revelations about these deepfake porn rings have shocked the South Korean public and led to widespread outrage and calls for action. The government has promised to investigate these crimes and impose stricter punishments for those involved. However, women’s rights activists argue that the authorities have allowed sexual abuse on Telegram to flourish for too long. They accuse the government of neglecting the issue, citing a previous sex ring scandal in 2019 that used the app to coerce women and children into creating explicit images. At the time, Telegram ignored requests for assistance from the police, and no action was taken against the platform due to concerns about censorship.
The consequences of the deepfake scandal are far-reaching. Victims, many of whom are underage, have experienced immense trauma and anxiety. They worry about who has seen their deepfake images and fear further exploitation. The scandal has also led to a wave of censorship, as women and teenagers remove their photos from social media or deactivate their accounts altogether. This censorship is a frustrating response for the victims, who argue that they should not be the ones altering their behavior when they have done nothing wrong.
The issue at the heart of this scandal is the messaging app Telegram. Its private, encrypted nature makes it difficult for authorities to access and regulate illegal activities. While the app claims to proactively search for illegal content, including child sexual abuse, it has been criticized for not doing enough. Critics argue that the app’s founder, Pavel Durov, has enabled the sharing of child pornography by failing to cooperate with law enforcement agencies.
Women’s rights organizations and activists have called for stricter regulation or even a ban on Telegram in South Korea. They believe that if tech companies like Telegram refuse to cooperate, the government needs to step in to protect its citizens. These advocates argue that new AI technology, while making deepfake creation easier, is just the latest form of misogynistic behavior online. South Korea has faced previous crises related to gender-based online abuse, such as verbal abuse and the spy cam epidemic. They contend that the root cause of these issues is structural sexism and that the solution lies in achieving gender equality.
In addition to advocating for regulation, women’s rights organizations are also providing support for victims of deepfake pornography. Organizations like the Advocacy Centre for Online Sexual Abuse Victims (ACOSAV) counsel victims, track down harmful content, and work with online platforms to have it removed. However, the sharp increase in the number of victims seeking help, along with the increasingly widespread use of deepfakes, has put a strain on these organizations.
To address the issue, the South Korean government has promised to increase criminal sentences for those who create and share deepfake images. It also plans to punish those who view the pornography. This response comes after criticism that not enough offenders were being held accountable. One challenge in prosecuting these crimes is that the majority of offenders are teenagers who are typically tried in youth courts, where they receive more lenient sentences.
While efforts have been made to shut down the chatrooms involved in the deepfake scandal, the nature of Telegram makes it likely that new rooms will emerge in their place. The anxiety and vigilance caused by the scandal have affected almost every teenage girl and young woman in South Korea. Women like Ah-eun, a university student, now find themselves suspicious of their male acquaintances and hyper-vigilant in their interactions with people. The deepfake scandal has had a significant impact on the social fabric of South Korea and highlights the pressing need for stricter regulation and comprehensive education about consent and sexual abuse.
Source link
