Student AI deepfake images reflective of porn crisis

The disturbing doctoring of photos of about 50 teenage girls to create fake nude images is part of an epidemic that's causing great harm, experts warn.

Australia's eSafety Commissioner Julie Inman Grant on Wednesday said rapidly developing technology is making it harder to determine what content is fake.

It follows the arrest of a teenage boy after manipulated images were shared of girls in years 9 to 12 at Bacchus Marsh Grammar, northwest of Melbourne.

"Deepfakes, especially deepfake pornography, can be devastating to the person whose image is taken and altered without their knowledge or consent, no matter who they are," Ms Grant said.

"Image-based abuse, including the production of deepfaked images and videos, is a persistent online harm which also represents one of the most egregious invasions of privacy."

Julie Inman Grant
Australia's eSafety Commissioner Julie Inman Grant is concerned by the use of deepfake images.

Sexual Assault Services Victoria chief executive Kathleen Maltzahn said the images reflect a broader pornography-driven crisis in schools.

"The availability of online AI programs meant boys and men could create and distribute deepfake porn," she said.

"We're seeing significant levels of children using sexual harm against others.

"We need to get ahead as much as possible of the deepfake stuff and have structures or resources in place so we can work with schools, so that we can move boys away from this behaviour."

The Victorian Department of Education needed to be better resourced to respond to sexual violence in schools, and the federal government should step up its regulation of social media companies, Ms Maltzahn said.

"Schools are not equipped to deal with this, and they come to our services, and our services are not funded at the level we need to be able to go into schools and give an emergency response," she said.

"Pornography is significantly carried by Twitter and Facebook and Instagram and the rest, so we can do something about those companies."

A person using a smartphone
Online programs mean boys and men can 'create and distribute deepfake porn'.

Laws cracking down on the sharing of sexually explicit AI-generated images and deepfakes without consent were introduced to federal parliament on June 5.

However, some politicians remain concerned about the persistent availability of online programs to create deepfake images.

Several apps offered prompts including "undressing someone", "body retouch", "hot looks", "spicy images" and "pushing the boundaries" - usually under subscriber content.

Face swaps, replicating outfits to "short uniforms", overlaying faces on pornographic content and inserting sexually explicit photos were accessible within half a dozen clicks.

Bacchus Marsh Grammar, northwest of Melbourne, has said it is counselling students after it was made aware of the production and circulation of video content including images of about 50 students.

"Bacchus Marsh Grammar is taking this matter very seriously and has contacted Victoria Police," acting principal Kevin Richardson said in a statement.

Victoria Police officers arrested a teenager over the explicit images circulated online and he was released pending further inquiries.

Bacchus Marsh Grammar school sign
Students at Bacchus Marsh Grammar have expressed horror over their images being manipulated.

The mother of one 16-year-old student learned of the images on Saturday and picked up her daughter from a sleepover.

"She was very upset, and she was throwing up and it was incredibly graphic," Emily - who did not provide her surname - told ABC Radio Melbourne on Wednesday.

"She was cropped out but there's just that feeling of 'Will it come up, will this happen again?'"

Health Minister Mary-Anne Thomas described the incident as "absolutely abhorrent" and said it was a wake-up call to families and the community to have direct conversations with young people about respect.

"Quite clearly, young people are accessing material on the internet, and through social media, that is influencing their behaviours in ways that ... (are) actually causing real harm to other young people," she said.

1800 RESPECT (1800 737 732)

National Sexual Abuse and Redress Support Service 1800 211 028

License this article

What is AAPNews?

For the first time, Australian Associated Press is delivering news straight to the consumer.

No ads. No spin. News straight-up.

Not only do you get to enjoy high-quality news delivered straight to your desktop or device, you do so in the knowledge you are supporting media diversity in Australia.

AAP Is Australia’s only independent newswire service, free from political and commercial influence, producing fact-based public interest journalism across a range of topics including politics, courts, sport, finance and entertainment.

What is AAPNews?
The Morning Wire

Wake up to AAPNews’ morning news bulletin delivered straight to your inbox or mobile device, bringing you up to speed with all that has happened overnight at home and abroad, as well as setting you up what the day has in store.

AAPNews Morning Wire
AAPNews Breaking News
Breaking News

Be the first to know when major breaking news happens.

Notifications will be sent to your device whenever a big story breaks, ensuring you are never in the dark when the talking points happen.

Focused Content

Enjoy the best of AAP’s specialised Topics in Focus. AAP has reporters dedicated to bringing you hard news and feature content across a range of specialised topics including Environment, Agriculture, Future Economies, Arts and Refugee Issues.

AAPNews Focussed Content
Subscription Plans

Choose the plan that best fits your needs. AAPNews offers two basic subscriptions, all billed monthly.

Once you sign up, you will have seven days to test out the service before being billed.

AAPNews Full Access Plan
Full Access
  • Enjoy all that AAPNews has to offer
  • Access to breaking news notifications and bulletins
  • Includes access to all AAPNews’ specialised topics
Join Now
AAPNews Student Access Plan
Student Access
  • Gain access via a verified student email account
  • Enjoy all the benefits of the ‘Full Access’ plan at a reduced rate
  • Subscription renews each month
Join Now
AAPNews Annual Access Plan
Annual Access
  • All the benefits of the 'Full Access' subscription at a discounted rate
  • Subscription automatically renews after 12 months
Join Now

AAPNews also offers enterprise deals for businesses so you can provide an AAPNews account for your team, organisation or customers. Click here to contact AAP to sign-up your business today.

Download the app
Download AAPNews on the App StoreDownload AAPNews on the Google Play Store