this post was submitted on 21 Nov 2024
147 points (97.4% liked)

Technology

59562 readers
3187 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Today, a prominent child safety organization, Thorn, in partnership with a leading cloud-based AI solutions provider, Hive, announced the release of an AI model designed to flag unknown CSAM at upload. It's the earliest AI technology striving to expose unreported CSAM at scale.

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 20 points 18 hours ago (1 children)

Man... That AI is going to be so fucked up when it gains sentience

[–] [email protected] 4 points 7 hours ago (1 children)

Skynet's real origin story. We might just deserve judgement day.

[–] [email protected] 0 points 5 hours ago

Oh we definitely do! Definitely for this, and definitely for many other things.

[–] [email protected] 12 points 20 hours ago* (last edited 20 hours ago) (2 children)

Jesus Christ. If someone ever got their hands on this model they could use it to generate new material. The grossest possible AI model to date

[–] [email protected] 21 points 18 hours ago (1 children)

No. This is an inference model, not a generative model. You generally cannot train a model for both, unless you do it on purpose, and they certainly did not (especially since inference models are way easier to train than generative models).

[–] [email protected] 6 points 18 hours ago* (last edited 18 hours ago) (1 children)

A generative model uses the classifier as part of its training. If you generate a picture of pure random noise, then iteratively pick random noise that the classifier says "looks" more like csam, then you can effectively generate images that the classifier says it's 100% certain is csam. Whether or not that looks anything like what a human would consider to be csam depends on other factors but it remains a possibility.

[–] [email protected] 6 points 15 hours ago

You are describing the way deepdream works, not the way modern Diffusion models work. It's the difference between psychedelic dog faces and a highly adherent generative image of a German Sheppard.

I can't imagine you're going to get anything out of this model that actually looks like CSAM, unless there's some sort of breakthrough in using these models for previously unrealized generative purposes.

[–] [email protected] 1 points 20 hours ago

I thought being able to do that was already a thing. This is designed to do the opposite.

I know, I know.. bad actors and such.

[–] [email protected] 2 points 18 hours ago* (last edited 18 hours ago)

me
no
rikey

[–] TheHobbyist 124 points 1 day ago* (last edited 1 day ago) (1 children)

Thorn, the company backed by Ashton Kutcher and which tried to get its way to monitor all messages in the EU via Chat Control. No thanks.

https://fortune.com/europe/2023/09/26/thorn-ashton-kutcher-ylva-johansson-csam-csa-regulation-european-commission-encryption-privacy-surveillance/

[–] [email protected] 63 points 1 day ago (2 children)

Just remember folks. Kutcher is a slimeball too.

The guy went from a D list star and hanging out with the likes of Danny Masterson and going to Diddy’s infamous parties - to suddenly overnight courting the US government and being the face of ‘helping’ children everywhere.

Yeah right…..

[–] [email protected] 23 points 1 day ago (3 children)

I’d be wary of calling him guilty by association. Maybe when he realized who he was really hanging out with he was so horrified and disgusted that he just had to get involved and do something to fight back?

[–] [email protected] 1 points 9 hours ago

Nah, it's much easier to chastise people for not knowing what nobody knew

load more comments (2 replies)
[–] [email protected] 19 points 1 day ago

People can grow and change. Not saying he did or didn’t. Just saying that people aren’t a monolith. It’s plausible he just grew and his views changed / evolved.

That being said, it’s highly convenient where he’s positioned himself these days…

[–] [email protected] 130 points 1 day ago (2 children)

Not a single peep about false positives.

I'm sure it won't be abused though. And if anyone does complain, just get their electronics seized and checked, because they must be hiding something!

[–] [email protected] 13 points 20 hours ago

It could also, of course, make mistakes, but Kevin Guo, Hive's CEO, told Ars that extensive testing was conducted to reduce false positives or negatives substantially. While he wouldn't share stats, he said that platforms would not be interested in a tool where "99 out of a hundred things the tool is flagging aren't correct."

I take this to mean it is at least 1% accurate lol.

[–] [email protected] 80 points 1 day ago (4 children)

Reminds me of the A cup breasts porn ban in Australia a few years ago, because only pedos would watch that

[–] [email protected] 13 points 20 hours ago

This sort of rhetoric really bothers me. Especially when you consider that there are real adult women with disorders that make them appear prepubescent. Whether that's appropriate for pornography is a different conversation, but the idea that anyone interested in them is a pedophile is really disgusting. That is a real, human, adult woman and some people say anyone who wants to live them is a monster. Just imagine someone telling you that anyone who wants to love you is a monster and that they're actually protecting you.

[–] [email protected] 40 points 1 day ago (2 children)

There was a a porn studio that was prosecuted for creating CSAM. Brazil i belive. Prosecutors claimed that the petite, A-cup woman was clearly underaged. Their star witness was a doctor who testified that such underdeveloped breasts and hips clearly meant she was still going through puberty and couldn't possible be 18 or older. The porn star showed up to testify that she was in fact over 18 when they shot the film and included all her identification including her birth certificate and passport. She also said something to the effect of women come in all shapes and sizes and a doctor should know better.

I can't find an article. All I'm getting is GOP trump pedo nominees and brazil laws on porn.

[–] [email protected] 4 points 14 hours ago

I'm just glad they protected her

[–] [email protected] 12 points 20 hours ago

Pretty sure the adult star was lil Lupe. She was everywhere at the time because she did, indeed, look underage.

[–] [email protected] 46 points 1 day ago (2 children)

Awe man, I love all titties. Variety is the spice of life.

[–] [email protected] 43 points 1 day ago

Not to mention the self image impact such things would have on women with smaller breasts, who (as I understand it) generally already struggle with poor self image due to breast size.

[–] [email protected] 19 points 1 day ago (1 children)

Believe it or not, straight to jail.

[–] [email protected] 23 points 1 day ago (1 children)

If this is the price I must pay, I will pay it, sir! No man should be deprived of privately viewing a consenting adults perfectly formed small tit's. They can take my liberty, they can take my livelihood, but they will never take away my boner for puffy nipples on a small chested half Japanese woman!

[–] [email protected] 13 points 1 day ago

What is the charge? Biting a breast? A succulent Chinese breast?

load more comments (1 replies)
[–] [email protected] 40 points 1 day ago* (last edited 1 day ago) (1 children)

It's the earliest AI technology striving to expose unreported CSAM at scale.

horde-safety has been out for a year now. Just saying... It's not a trained AI model in this way, but it's still using Neural Networks (i.e. "AI Technology")

[–] [email protected] 5 points 20 hours ago* (last edited 20 hours ago) (1 children)
[–] [email protected] 6 points 20 hours ago

haha, nah people reported some unexpected censors, and we investigated what part of their prompt might be causing it.

[–] [email protected] 22 points 1 day ago (5 children)

And will we get that technology to keep the Fediverse and free platforms safe? Probably not. All the predecessors have been kept away for sole use of the big players, despite populism always claiming we need to introduce total surveillance to keep the children safe...

[–] [email protected] 3 points 20 hours ago (1 children)

IFTAS is already working with Thorn towards this goal. But you already have access to such technology through my toolset.

[–] [email protected] 2 points 19 hours ago* (last edited 19 hours ago) (1 children)

This one? I loosely followed your work... Maybe I should try it someday. See how it does on a regular VPS. Thanks for the link to the IFTAS. Seems they have curated some useful links... I'll have a look at their articles. Hope they get somewhere with that. At this point, I don't think there is any blocklist accessible to the average Fediverse admin?!

Edit: Thx, saw your other comment with the link to horde-safety.

[–] [email protected] 2 points 19 hours ago (1 children)

Ye, a normal VPS would be too slow for production use, as a GPU is recommended. But you can plug in any home PC to do it without risks

[–] [email protected] 1 points 18 hours ago* (last edited 18 hours ago) (1 children)

Do you think this approach would be worth a try for the threaded Fediverse (aka Lemmy)? I mean your use-case is very different. We have some rudimentary image detection to flag other kinds of unwanted images in Piefed. I could experiment with something like https://github.com/monatis/clip.cpp. Have it go through the media cache and see if it can do something useful for us. But I don't think it'd be worth all the effort unless the whole approach is somewhat accurate and runs in real time on average VPSes.

[–] [email protected] 3 points 18 hours ago* (last edited 18 hours ago)

This approach was developed precicely for threaded fediverse. The initial use-case was protecting my own lemmy from CSAM! Check out fedi-safety and pictrs-safety

load more comments (4 replies)
load more comments
view more: next ›