Police arrest teen for circulating AI-generated nude images of 50 high school girls

An Australian teenager has been arrested for creating and sharing AI-generated nude images of more than 50 female students at his school.

Bacchus Marsh Grammar School in Victoria reported that its students' images had been manipulated with artificial intelligence to create highly offensive and explicit content. These edited images were then shared on social media platforms like Instagram and Snapchat.

According to the report, the manipulated images came from the social media accounts of high school students. On Friday June 7, authorities received reports that several explicit images had been sent to someone in the Melton area via an online platform.

In response, a teenager was arrested by the police in connection with the distribution of these images online. He has since been released and further investigations are ongoing. School principal Andrew Neal described the incident as “appalling”.

“This is something that touches the hearts of students, especially girls growing up at this age. They should be able to learn and go about their business without this kind of nonsense,” he told ABC News.

Principal Neal emphasized that the school is providing support services to affected students. The school is also actively working with investigators to ensure the complete removal of manipulated images from social media platforms.

The rise of non-consensual AI imagery and its impact

Although the nature of these images suggests a possible connection to someone within the school community, Principal Neal assured that the school and authorities are thoroughly exploring all possibilities.

A mother recalls picking up her 16-year-old daughter from a sleepover and finding her in extreme distress. The girl, visibly shaken, became physically ill after encountering the manipulated images with their disturbing graphics. The teenager was “very upset and she was vomiting”, her mother told ABC Radio Melbourne.

“I mean, they're kids. The photos were mutilated and so graphic. I almost threw up when I saw them,” she said. “Fifty girls is a lot. It's really worrying. How can we reassure them that once the measures are put in place, this won't happen again?”

Victorian Premier Jacinta Allan criticized the incident and stressed that women and girls deserve respect. “My thoughts are with the young women of Bacchus Marsh Grammar and their families. There is no place for this shameful and misogynistic conduct in Victoria,” Ms Allan said.

Further condemning the behavior, she said: “Women and girls deserve respect in the classroom, online and everywhere else in our community. That's why we've passed laws against this behavior, and we teach respectful relationships in schools to stop violence before it starts. “.

The dangers of AI

Despite the potential of AI-generated images, there are worrying applications. Malicious actors have misused this technology to create deepfakes, which are manipulated images or videos that can be very realistic and often target women, including celebrities.

In one incident in 2018, a face-swapping app was used to create non-consensual pornography featuring celebrities. The legal implications of AI-generated content continue to evolve. In 2017, an incident involving an AI-generated video featuring “Wonder Woman” star Gal Gadot sparked concerns.

This highlights the potential for creating deepfakes of celebrities without their consent, which may be illegal in some jurisdictions.