Paedophiles create nude AI images of children to extort from them, says charity | Internet safety | The Guardian (www.theguardian.com)
from Bebo@literature.cafe to technology@lemmy.world on 23 Apr 2024 12:32
https://literature.cafe/post/9251516

Internet Watch Foundation has found a manual on dark web encouraging criminals to use software tools that remove clothing. The manipulated image could then be used against the child to blackmail them into sending more graphic content, the IWF said.

#technology

threaded - newest

autotldr@lemmings.world on 23 Apr 2024 12:35 next collapse

This is the best summary I could come up with:


Paedophiles are being urged to use artificial intelligence to create nude images of children to extort more extreme material from them, according to a child abuse charity.

The Internet Watch Foundation (IWF) said a manual found on the dark web contained a section encouraging criminals to use “nudifying” tools to remove clothing from underwear shots sent by a child.

Last month the Guardian revealed that the Labour party was considering a ban on nudification tools that allow users to create images of people without their clothes on.

Hargreaves added that the Online Safety Act, which became law last year and imposes a duty of care on social media companies to protect children, “needs to work”.

According to research published last week by the communications regulator, Ofcom, a quarter of three- to four-year-olds own a mobile phone and half of under-13s are on social media.

The government is preparing to launch a consultation in the coming weeks that will include proposals to ban the sale of smartphones to under-16s and raise the minimum age for social media sites from 13 to as high as 16.


The original article contains 542 words, the summary contains 184 words. Saved 66%. I’m a bot and I’m open source!

WallEx@feddit.de on 23 Apr 2024 12:51 next collapse

I am disgusted but not surprised.

norbert@kbin.social on 23 Apr 2024 14:36 collapse

Pretty sure I remember people saying this kind of stuff would happen as soon as deepfakes started being a thing accessible to the public.

We really don't have any solution to this yet. The tech is advancing so quickly at this point; every other month there's a significant jump in capabilities. I feel like the cat is out of the bag, photorealistic AI images are available to the home user with virtually no technical restrictions or limits and no amount of regulation is going to put the genie back in the bottle.

quindraco@lemm.ee on 24 Apr 2024 12:22 collapse

We really don’t have any solution to this yet.

We do, and always have, but good luck with implementation. Humanity hates acting like an adult.

  1. Critical thinking: society knows to a certainty deepfakes exist and hence should be intrinsically skeptical of any image they see, demanding the image’s source establish some reason to trust the image. We could be less blindly trusting.
  2. Body acceptance: for 0 seconds of humanity’s history has it made credible sense to shame someone over having seen them naked. We could choose not to.
  3. Competence: Appeasing these people only encourages them. If people would just understand that giving your blackmailer what they want is always strictly worse than not doing so, it would remove the incentive to blackmail. Why would you trust your blackmailer to keep your secret? Makes no sense.
norbert@kbin.social on 24 Apr 2024 14:35 collapse

I agree with everything you said but I don't actually see a solution you've posted. Yes we could grow up and have a more mature view of sex and the human body but that doesn't change the ease of access or manufacturing potentially illegal material right now.

quindraco@lemm.ee on 24 Apr 2024 15:51 collapse

If we could implement maturity and so on, ease of access to the tools would be a non-issue. And the tools would be as legal as crayons or pencils, and the “material” as legal as any cartoon. But I agree with you that this is a super real practical problem, because we can’t.

Kit@lemmy.blahaj.zone on 24 Apr 2024 16:21 collapse

Bro are you actually advocating for CP right now?

quindraco@lemm.ee on 24 Apr 2024 17:59 next collapse

No.

Kit@lemmy.blahaj.zone on 24 Apr 2024 18:01 collapse

I must have misunderstood your post. Can you explain it to me in simpler terms?

quindraco@lemm.ee on 24 Apr 2024 19:03 collapse

Uh… I’ll try.

Society can’t be trusted to handle things like adults should. If it could, very well-done drawings of minors depicting them as nude would be a non-issue as blackmail material both because society would just shrug off any such images being published as inconsequential and because minors would be raised to know that cooperating with blackmailers accomplishes nothing productive.

Kit@lemmy.blahaj.zone on 24 Apr 2024 19:21 collapse

Thank you, I understand you now. I still disagree, but I can see where you’re coming from.

interdimensionalmeme@lemmy.ml on 25 Apr 2024 09:19 collapse

I suggest we send all sex taboo enforcers, to die in prison. At least for as long as it takes for violence to become less acceptable than sex.

[deleted] on 23 Apr 2024 13:11 next collapse

.

stevedidwhat_infosec@infosec.pub on 23 Apr 2024 13:32 next collapse

Pedophile apologists*

Nobody interested in the development of AI would be interested in defending pedos, unless they’re pedos. That’s reality.

Why lump the two groups together?

In fact, AI is used by these orgs to prevent workers from having to look at these images themselves which is partially why mod/admin/content filter people’s burnout is so high.

Everytime some nasty shit (pedo shit, gore, etc) is posted on tumblr, Facebook, Instagram, etc, those reports go through real people (or did prior to these AI models). Now imagine smaller, upcoming websites like lemmy instances that might not have the funds or don’t know of this AI solution.

AI fixes problems too - the root of the problem is cyber extortion. Whether that means the criminals are photoshopping or using AI. They’re targeting children for Christ sake, besides that being fucked up all by itself, it’s not hard to fool a child. AI or not. How criminals are contacting and blackmailing YOUR CHILDREN is the problem imo

admin@lemmy.my-box.dev on 23 Apr 2024 17:00 collapse

Why lump the two groups together?

Because it’s very hard to make a “think of the children” argument out of this without doing so.

stevedidwhat_infosec@infosec.pub on 23 Apr 2024 17:59 collapse

Hadn’t thought about it that way!

someguy3@lemmy.world on 23 Apr 2024 13:48 next collapse

AI apologists? AI and pedophilia are very different things.

[deleted] on 23 Apr 2024 15:08 collapse

.

Grimy@lemmy.world on 23 Apr 2024 15:30 collapse

Restricting AI will only kill the open source scene and make all AI products subscription based. Since we are moving quickly to an AI driven society this would give our whole economy to google and Microsoft.

Some of us understand what’s at stake.

The individuals doing such actions should absolutely be prosecuted, it needs to be illegal to make deep fakes of someone, triply so when it’s used to extort that person.

But if you catch someone drunk driving, you prosecute him for drunk driving, you don’t ban cars.

But obviously, if someone says “think of the children”, you should always mindlessly give up whatever freedoms they are asking you too.

[deleted] on 23 Apr 2024 15:39 collapse

.

Grimy@lemmy.world on 23 Apr 2024 15:57 next collapse

There are no seatbelts. Its either cars or only public transport.

Can you explain what’s wrong in what I said instead of saying “you are one of those that is against restrictive regulations, therefore are wrong”

We should be very vocal about it, Openai and their friends are. They have lobbyists in Washington trying to convince the government AI is too dangerous for people to have free access to it. They are using the media to dessimate hate and trigger people’s emotional response.

[deleted] on 23 Apr 2024 16:35 collapse

.

rebelsimile@sh.itjust.works on 23 Apr 2024 16:56 next collapse

I think the question is: should we have designed the internet such as to have made it impossible to find bomb plans on it? And to be honest, I don’t think the internet would be what it is if it were possible to have that level of filtering and censorship. Child porn is reprehensible in any form. To me, it makes more sense to blame the moron with the hammer than to blame the hammer.

Grimy@lemmy.world on 23 Apr 2024 18:58 collapse

What you are asking for is equivalent to stopping people from writing literotica about children using word.

Nobody is advocating for child literotica or defending it, but most understand that it would take draconian measures to stop it. Word would have to be entirely online and everything written would have to pass through a filter to verify it isn’t something illegal.

By it’s very nature, it’s very difficult to remove such things from generative models. Although there is one solution I can think of which would be to take children completely out of models.

The problem is this isn’t a solution that is being proposed, sadly all current possible legislations are meant to do one thing and that is to create and cement a monopoly around AI.

I’m ready to tackle all issues involving AI but the main current issue is a handful of companies trying to rip it out of our hands and playing on people’s emotions to do so. Once that’s done, we can take care of the 0.01 % of users that are generating CP.

stevedidwhat_infosec@infosec.pub on 23 Apr 2024 16:40 collapse

Except you’re not trying to ask for seatbelts. You’re arguing we get rid of the cars.

Ai being the vessel for the problem which is cyber extortion.

You handle the extortion bit by making seatbelts. Not seatbelts that auto buckle. Not cars that don’t start without one. But by providing the safe guards to the people who can then make the decision to wear them and to punish those that put others at risk by their misuse.

You don’t ban alcohol because of alcoholics. You punish those who refuse to use them safely and appropriately and, most of all, those who put others at risk.

That’s freedom. That’s the American way. Not anything else.

[deleted] on 23 Apr 2024 17:09 collapse

.

stevedidwhat_infosec@infosec.pub on 23 Apr 2024 17:58 collapse

No I don’t. You want me to think that because it makes it easier to be aggressive towards.

I’ve obviously misunderstood you, so I’m sorry about that. I should’ve led with questions instead of assumptions and that’s on me.

I think any mature adult who’s for AI, knows that some safeguards and changes are necessary- just like they are for any new invention

r3df0x@7.62x54r.ru on 23 Apr 2024 18:27 next collapse

Use of child porn is never victimless. Not even if it’s fully AI generated.

Llewellyn@lemm.ee on 24 Apr 2024 14:57 collapse

Not even if it’s fully AI generated.

Who is a victim in that case?

r3df0x@7.62x54r.ru on 24 Apr 2024 16:01 collapse

It enables pedophilia.

Llewellyn@lemm.ee on 24 Apr 2024 17:02 collapse

But who is a victim here

r3df0x@7.62x54r.ru on 24 Apr 2024 17:37 collapse

All of the children who end up getting abused because the pedophile escalated their fantasies.

A society that tolerates pedophilia on any level is morally guilty.

Llewellyn@lemm.ee on 24 Apr 2024 18:08 collapse

All of the children who end up getting abused because the pedophile escalated their fantasies.

That’s a reach.

With that logic you can blame, say, videogames for shootings.

misc@lemmy.sdf.org on 23 Apr 2024 19:38 collapse

I mean i agree with you they are everywhere even on lemmy .

card797@champserver.net on 23 Apr 2024 13:39 next collapse

More castration is needed.

nieceandtows@programming.dev on 23 Apr 2024 14:40 collapse

Lobotomy might be better

[deleted] on 23 Apr 2024 18:48 collapse

.

JoMiran@lemmy.ml on 23 Apr 2024 14:34 next collapse

These sickos could just wank off to the AI-gen stuff, but I suspect that the real thrill is in the abuse.

Time to look at memes before I get more upset.

BrianTheeBiscuiteer@lemmy.world on 23 Apr 2024 16:44 next collapse

Long ago on Reddit I read a comment about inmates beating up on child sex offenders partly because it’s a sick thing to do and partly because they don’t want them to get the slightest foothold of influence over another inmate. They thrive on exerting power over weaker individuals and manipulating them.

Appoxo@lemmy.dbzer0.com on 24 Apr 2024 07:52 next collapse

You mean the offender gaining influence?

BrianTheeBiscuiteer@lemmy.world on 24 Apr 2024 12:03 collapse

Yes

AceFuzzLord@lemm.ee on 24 Apr 2024 14:50 collapse

I’ve heard at least one story of an inmate getting a longer prison sentences for actually killing at least one or more pedos in the same jail as him. I’m not a fan of prison violence, but that is something I could turn a blind eye to.

HubertManne@kbin.social on 23 Apr 2024 18:12 collapse

and while obvious I also did not even think about this which, man, the level of wrong here is insane.

nieceandtows@programming.dev on 23 Apr 2024 14:39 next collapse

Fucking pieces of shit

ChocoboRocket@lemmy.world on 23 Apr 2024 14:49 collapse

Government/police insist on having basically unlimited ability to spy on people within the US, and then maybe catch a part of one operation after collecting heaps of evidence over months/years with tons of victims irrevocably harmed - and eventually a few main people get like 3-5 years in prison on a plea deal.

I get the whole “building a case” thing, but letting multiple children get abused, while other sickos learn the ropes to eventually “get enough evidence” so a few people can plead guilty for a comparatively light prison sentences is absurd. Shut anything about it down immediately. Even if it doesn’t go to trial/conviction I’m sure the police have creative capacities to deal with child abusers outside of prison.

And people still think sex education in school is about teaching children how to preform sex acts, instead of helping them avoid predators.

SlopppyEngineer@lemmy.world on 23 Apr 2024 15:10 next collapse

Meanwhile when police do get more ability to spy, they’ll raid the houses of environmental groups or other activists they spied on within a month.

LustyArgonianMana@lemmy.world on 23 Apr 2024 15:57 next collapse

Govt is spying on us to force us into espionage or other acts (eg witness testimony). They don’t care about harm done to others unless there’s an outcry.

r3df0x@7.62x54r.ru on 23 Apr 2024 18:23 next collapse

There’s a huge difference between teaching sex acts and helping kids avoid predators.

The lack of action against pedophiles is just going to fuel Qanon conspiracy theories and lead to vigilantism.

uriel238@lemmy.blahaj.zone on 24 Apr 2024 04:29 collapse

Neither QAnon nor the federal government cares much about kids. A guarantee of food and medical care would save a lot more lives than hunting child predators. Most child sexual abuse comes from people they know: parents, relatives, ministers, teachers, neighbors. Online stalkers count for a very tiny portion of crimes against children.

This is a moral panic piece, like terrorism scare pieces in the 2010s

r3df0x@7.62x54r.ru on 24 Apr 2024 16:02 collapse

That doesn’t mean we need to divert attention away from pedophilia.

interdimensionalmeme@lemmy.ml on 25 Apr 2024 09:29 collapse

Yes, that’s exactly what that means. Stop falling for the circus show. Anarchists, communists, gays, terrorists, trans people, pedophiles. Do you see the pattern ? A common enemy is a powerful thing to wield. It doesn’t matter if they exist or how many there are. The unbelievers are witches anyway, burn them, BURN THEM !

interdimensionalmeme@lemmy.ml on 25 Apr 2024 09:24 collapse

Hint, police doesn’t actually give a shit about hypothetical children getting harmed. This all a ploy to get the idiotic population to accept and even demand the police to invade everyone privacy.

Imagine Bill Clinton’s secret service agents on Epstein’s loliplane. Think they gave too shits about old people fucking 17 year olds ?

HubertManne@kbin.social on 23 Apr 2024 15:14 next collapse

and that is a way to abuse that technology that never crossed my mind. do I actually belong to this species?!

TimeSquirrel@kbin.social on 23 Apr 2024 16:32 next collapse

Yes, you do. We all have the potential for the most horrific acts of evil you can imagine in the right circumstances. That's why we usually have such a hard time when we give people power to rule over others and need a convoluted system of checks and balances to make sure nobody becomes a dick. Yet it still happens. Benevolence is not the default human state. You have to work to stay that way. That ability separates us from the brutal world of the wild.

misc@lemmy.sdf.org on 23 Apr 2024 19:35 collapse

Not everyone tho i believe everyone is different that’s why some good people will never get into power or will be killed after getting power or just get the power taken from them because they are not corrupt enough to keep it kinda like why there are no ethical multi billionaires (atleast that i know of as of yet).

Llewellyn@lemm.ee on 24 Apr 2024 14:55 collapse

Everyone is not that different: after all, we all are the same biological species: homo sapiens

misc@lemmy.sdf.org on 24 Apr 2024 15:13 collapse

Bruh so is every dog or cat the same ?

Llewellyn@lemm.ee on 24 Apr 2024 16:14 next collapse

Everyone is not that different

Syn_Attck@lemmy.today on 25 Apr 2024 03:30 collapse

Every wild dog will chase and eat prey and their own poop, and attack any dog that challenges them or their pack.

Every wild cat will chase and catch their prey, and then play with it while keeping it alive for a while until it ultimately dies.

Humans are basically dogs or cats that have 1000’s of societal incentives not to chase and play with prey, drilled into most of us from the beginning, but everyone still has that innate ability that will come out under the right circumstances. If civilization ended today, who you think you are, and what you think you are not capable of today, ends today.

misc@lemmy.sdf.org on 25 Apr 2024 05:02 collapse

U know what i used to think like that in some ways i still do but still gotta say there are and always will be some good people in the world maybe they are one in a billion but still they do exist . What shapes a human is their memories, thoughts , the people they know , the things they did etc. So its is impossible that everyone is the same while our primal urges maybe same, some of us still overcome that and can be different .

Azzu@lemm.ee on 24 Apr 2024 07:37 collapse

Be honest: you never had any dark thoughts? Never did anything bad?

Yes, you might not be doing this particular bad thing. Yes, your inhibition of your dark thoughts might be better. Yes, you might be very sheltered and have a loving upbringing.

But I’m pretty sure if you truly look inside yourself without shying away, you will see that yes, you belong to this species.

Appoxo@lemmy.dbzer0.com on 24 Apr 2024 07:57 next collapse

I do have some dark thoughts at time.
But they never include minors.

Syn_Attck@lemmy.today on 24 Apr 2024 12:33 collapse

you never had any dark thoughts? Never did anything bad?

Yes, you might not be doing this particular bad thing.

You: Yeah sure, but I never did this particular bad thing.

Welcome to the species, bud. We’re all a little mad here.

HubertManne@kbin.social on 24 Apr 2024 13:53 collapse

oh sure. fleeting flights of fancy. thats why people get killed in moments of passion type of thing. but think about it. they have the thoughts about the kids and they have ai that pretty much should theoretically get what they want but no. that is not good enough. they need to use it to extort them. this really is beyond me. im pretty sure in this scenario I would stop at jacking to the ai solution. its like I might kill someone to defend my life or a loved ones life or maybe an innocents life and maybe I could be angry enough to do it as well. but like kill just to kill or something. thats wack.

chalupapocalypse@lemmy.world on 23 Apr 2024 16:36 next collapse

I expected AI to destroy humanity, but more with killer robots and less job theft and creepy weirdos making porn

paraphrand@lemmy.world on 23 Apr 2024 17:39 collapse

Have you not heard neckbeards explain how technology is driven by porn before? They are very proud and excited to explain it to you.

Edit: see? they can’t resist. Note that I never weighed in on the validity.

phoenixz@lemmy.ca on 23 Apr 2024 17:47 next collapse

Well they’re not wrong, tech had been and still is for a huge part driven by sex. Nothing to be proud or ashamed about, it simply is what it is, we’re humans and as much as we pretend to all be prudes, we looooove a good sex.

[deleted] on 23 Apr 2024 18:08 next collapse

.

Appoxo@lemmy.dbzer0.com on 24 Apr 2024 07:50 next collapse

Well that and financial incentives, right?

BreakDecks@lemmy.ml on 25 Apr 2024 00:46 collapse

I mean, it would be nice if demand for sex was just pushing us towards AI VR waifus or something. Let the neckbeards put on a haptic suit and bang all the Evangelian characters or something. Kinda fucked that we’re going straight to fully-automated sexual exploitation of kids…

I wish we lived in a cool cyberpunk dystopia instead of the horror show that is present day reality.

phoenixz@lemmy.ca on 25 Apr 2024 01:33 collapse

Well honestly, if pedos having a go at VR AI kids keeps them from harming actual children … People do fucked up things, if we can give them a VR AI outlet then let’s go

TheGrandNagus@lemmy.world on 25 Apr 2024 07:04 collapse

Lmao why are you so upset dude

paraphrand@lemmy.world on 25 Apr 2024 16:18 collapse

I’m no more upset than the person calling them creepy weirdos.

r3df0x@7.62x54r.ru on 23 Apr 2024 18:21 next collapse

This is an example of why every responsible parent should forbid their children from uploading any pictures of themselves online, or better yet, bar them from social media entirely. This might be a hot take here, but parents should install monitoring software on all of their children’s devices and be open about it. Not doing so is negligent.

Your kids could end up on the pedo registry if they take a picture of themselves and someone changes it into porn.

We could deal with this easily by banning the distribution of porn entirely.

misc@lemmy.sdf.org on 23 Apr 2024 19:33 next collapse

Ah yes the good ol " don’t dress like that if you don’t want to be raped " idea.

r3df0x@7.62x54r.ru on 23 Apr 2024 19:37 collapse

I don’t even understand how that even connects.

misc@lemmy.sdf.org on 23 Apr 2024 19:39 collapse

Welp you were never that bright .

r3df0x@7.62x54r.ru on 23 Apr 2024 19:52 collapse

There’s no reason why children should be using social media. I support legislation that will bar them from it. They need to go touch grass.

uriel238@lemmy.blahaj.zone on 24 Apr 2024 04:23 collapse

Most kids are banned from social media anyway. But it means nearly every kid in the US has broken the CFAA, committing a felony typically given a twenty-five year prison sentence. I don’t know how that will play out in the EU, but we really don’t like putting our kids in prison for creating social media accounts on false pretenses.

Or their parents, for that matter. Especially since we work all our adults so much they have neither time nor energy to parent.

Blanket solutions are not going to fix this.

Appoxo@lemmy.dbzer0.com on 24 Apr 2024 07:56 next collapse

Not like Twitter officially has an +18 rating in Germany…

Just checked:
Why the fuck is Facebook, Instagram and TikTok +12 here?!
Facebook is basically an extremists training ground. Insta and TikTok aint much better >_>

r3df0x@7.62x54r.ru on 24 Apr 2024 16:03 collapse

No one is going to prison for creating accounts of websites.

BreakDecks@lemmy.ml on 25 Apr 2024 00:48 collapse

We could deal with this easily by banning the distribution of porn entirely.

Easily? This would cause riots.

r3df0x@7.62x54r.ru on 25 Apr 2024 14:26 collapse

The average coomer would rage out in their basement and nothing would happen.

If people are that addicted to porn, it’s proof that it needs to be taken away.

Caligvla@lemmy.dbzer0.com on 24 Apr 2024 00:53 next collapse

If you needed any more reason not to post photos of your kids online, well…

Allero@lemmy.today on 24 Apr 2024 15:32 collapse

And also to talk with children about predators

Llewellyn@lemm.ee on 24 Apr 2024 14:54 next collapse

Now, is it “paedophiles” or “pedophiles”?

clark@midwest.social on 24 Apr 2024 15:08 collapse

British vs American spelling, no?

Bebo@literature.cafe on 25 Apr 2024 10:38 collapse

Yes, exactly.

BreakDecks@lemmy.ml on 25 Apr 2024 06:21 collapse

I want to be happy that the IWF exists and is collecting data about this kind of thing. This is extremely difficult and important work.

But they are also lobbying to ban encryption, arguing that privacy only helps criminals.

Sorry, but if Facebook is too dangerous for kids, instead of banning encryption so the authorities can more easily catch child abusers, let’s just ban children from using Facebook before they fall victim to abuse.

interdimensionalmeme@lemmy.ml on 25 Apr 2024 09:14 collapse

The premise is ridiculous, this is “think of the children” type social panic mongering.