this post was submitted on 27 Jan 2024
259 points (81.5% liked)

Technology

73698 readers
3787 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
259
Poisoned AI went rogue during training and couldn't be taught to behave again in 'legitimately scary' study (www.livescience.com)
submitted 2 years ago by L4s@lemmy.world to c/technology@lemmy.world
54 comments fedilink hide all child comments
 

Poisoned AI went rogue during training and couldn't be taught to behave again in 'legitimately scary' study::AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

you are viewing a single comment's thread
view the rest of the comments
[–] Daxtron2@startrek.website 40 points 2 years ago (13 children)

LLM trained on inflammatory data produces inflammatory results, shocking.

[–] JustMy2c@lemm.ee -1 points 2 years ago (12 children)

I know we don't like them here but the word reddit is not banned (yet)

[–] Daxtron2@startrek.website 14 points 2 years ago (11 children)

What? What does my comment have anything to do with Reddit?

[–] JustMy2c@lemm.ee -4 points 2 years ago (3 children)

So you're saying that "Inflammatory data" isn't a reference to reddit? :D

[–] Daxtron2@startrek.website 2 points 2 years ago (1 children)

Not inherently, I'm sure that's part of it but it's really everywhere. Even here on Lemmy I've run into nasty folk

[–] JustMy2c@lemm.ee -1 points 2 years ago (1 children)

True but it's reddit that's served as a base for most models....

[–] Daxtron2@startrek.website 1 points 2 years ago (1 children)

Not just reddit, LAION is a huge dataset

[–] JustMy2c@lemm.ee 0 points 2 years ago (1 children)

Obviously but reddit is in the goldilocks zone where you get coherent intelligent stuff and humor and facts.

But it's still toxic for an Ai.

[–] Daxtron2@startrek.website 2 points 2 years ago (1 children)

Saying it served as the base for most models is just objectively incorrect though

[–] JustMy2c@lemm.ee 1 points 2 years ago

Correcto but maybe it DOES apply to most asked questions, if you know where I'm going with that

[–] kent_eh@lemmy.ca 2 points 2 years ago (1 children)

I'd say using Twitter and Facebook would be worse than reddit. Or, and I shudder to think about it, truth social...

[–] JustMy2c@lemm.ee 0 points 2 years ago

Reddit is used more for Ai models as those....

[–] Chocrates@lemmy.world 0 points 2 years ago (1 children)

No, LLM is the AI, OP is saying if you train it with hate it's gonna spit out hate

[–] JustMy2c@lemm.ee -1 points 2 years ago

And I'm saying that reddit data is sublime for Ai. And specifically that it's invested with toxicity

load more comments (7 replies)
load more comments (7 replies)
load more comments (7 replies)