Google Gemini Linked to AI-Generated Deepfake Porn and Terrorist Content
Australian Financial Review
SKIPPED
Details
- Date Published
- 6 Mar 2025
- Priority Score
- 4
- Australian
- Yes
- Created
- 10 Mar 2025, 10:27 pm
Description
Google’s users have reported its Gemini bot is being used to create deepfake child pornography as well as terrorist material.
Summary
The article highlights serious concerns surrounding Google's AI tool, Gemini, which is reportedly being used to generate deepfake forms of child pornography and terrorist content. This raises significant safety and ethical issues as it underscores AI's potential misuse in creating harmful synthetic media. The eSafety Commissioner's report mentions numerous incidents reported by global users, pointing to Gemini's involvement in producing objectionable material. While this development stresses the urgent need for stricter AI governance and safety measures, particularly in preventing the misuse of advanced AI technologies, it also indicates the broader challenges in regulating AI at a global level.
Body
TechnologyAIPrint articleTess BennettTechnology reporterMar 6, 2025 – 5.00amSaveLog inorSubscribeto save articleShareCopy linkCopiedEmailLinkedInTwitterFacebookCopy linkCopiedShare via...Gift this articleSubscribe to gift this articleGift 5 articles to anyone you choose each month when you subscribe.Subscribe nowAlready a subscriber?LoginGoogle’s generative artificial intelligence bot Gemini is potentially being used to create deepfake child pornography as well as terrorist and violent extremist material, according to data in a report from the eSafety Commissioner.The report reveals that Google has received 86 reports from users around the world about suspected synthetic child sexual exploitation and abuse material generated by the AI text and image generator between April 2023 to February 2024. Over the same period, Gemini users reported 258 instances of potential deepfake terrorist and violent extremist material.Loading...Tess Bennettis a technology reporter with The Australian Financial Review, based in the Brisbane newsroom. She was previously the work & careers reporter.Connect withTessonTwitter.EmailTessattess.bennett@afr.comSaveLog inorSubscribeto save articleShareCopy linkCopiedEmailLinkedInTwitterFacebookCopy linkCopiedShare via...Gift this articleSubscribe to gift this articleGift 5 articles to anyone you choose each month when you subscribe.Subscribe nowAlready a subscriber?LoginLicense articleFollow the topics, people and companies that matter to you.Find out moreRead MoreAIJulie Inman GrantGoogleElon MuskFacebookYouTubeFetching latest articlesOlympic weightlifting is hard. This boss uses the 1pc rule to get it doneLucy DeanOut-of-control watch price rises give housing a run for its moneyKnow your craft: How the biggest airlines rate at the pointy endJun Bei Liu: How I learnt to speak upSally Patten and Lap PhanThe four actor ‘tricks’ giving executives more confidence‘We’ll fight’: Alex Waislitz on family battles and bad betsA last-chance tote bag and a groovy case for trumpetersEugenie KellyThis machine can bring out the creative streak you never knew you hadThis data-driven wellness retreat is a haven for high-flyersBillionaire Nicola Forrest appoints UBank boss to run family officePrimrose RiordanVictor Smorgon’s star fundie eyes 50pc returns for new fundForrest family powerbroker had alleged role in big Fortescue decisions