this post was submitted on 05 Dec 2023
6 points (75.0% liked)

Stable Diffusion

5004 readers
5 users here now

Discuss matters related to our favourite AI Art generation technology

Also see

Other communities

founded 2 years ago
MODERATORS
db0@lemmy.dbzer0.com
Even_Adder@lemmy.dbzer0.com
6
a16z Funded AI Platform Generated Images That “Could Be Categorized as Child Pornography,” Leaked Documents Show (www.404media.co)
submitted 2 years ago by db0@lemmy.dbzer0.com to c/stable_diffusion@lemmy.dbzer0.com
8 comments fedilink hide all child comments
 

While I think this is a bit overblown in sensationalism, any company that allows user generative AI, especially as open as using LoRas and any amount of checkpoints, needs to have very good protection against synthetic CSAM like this. To the best of my knowledge, only the AI Horde has taken this sufficiently seriously until now.

you are viewing a single comment's thread
view the rest of the comments
[–] ReallyActuallyFrankenstein@lemmynsfw.com 1 points 2 years ago (1 children)

I'd agree with the caveat that a model that may be trained on actual CSAM is a problem. Anything that is an actual product of, or cannot exist without, child abuse should be absolutely prohibited and avoided.

I'm not sure whether there is such a model out there, but now that I imagine it, I assume it's inevitable there will be one. Apart from being disturbing to think about, that introduces another problem - which is, once that happens how will anyone know the model was trained on such images?

[–] HubertManne@kbin.social 3 points 2 years ago

Oh I can totally agree with the training part but that can't be fought at the ai level it needs to be stopped at the csam level.