this post was submitted on 18 Sep 2024
443 points (94.2% liked)

Technology

73602 readers
3136 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
(page 2) 50 comments
sorted by: hot top controversial new old
[–] Moah@lemmy.blahaj.zone 10 points 10 months ago

Oh no. Anyways...

[–] BrightCandle@lemmy.world 9 points 10 months ago

Having now flooded the internet with bad AI content not surprisingly its now eating itself. Numerous projects that aren't AI are suffering too as the quality of text reduces.

[–] brey1013@lemmy.world 9 points 10 months ago (1 children)
load more comments (1 replies)
[–] mac@lemm.ee 8 points 10 months ago (4 children)

is it not relatively trivial to pre-vet content before they train it? at least with aigen text it should be.

load more comments (4 replies)
[–] njordomir@lemmy.world 7 points 10 months ago

It's like a human centipede where only the first person is a human and everyone else is an AI. It's all shit, but it gets a bit worse every step.

[–] celsiustimeline@lemmy.dbzer0.com 7 points 10 months ago* (last edited 10 months ago) (1 children)

If mainstream blogs are writing about it, what would make someone think that AI companies haven't thoroughly dissected the problem and are already working on filtering out AI fingerprints from the training data set? If they can make a sophisticated LLM, chances are they can find methods to XOR out generated content.

[–] aesthelete@lemmy.world 9 points 10 months ago (1 children)

What would make me think that they haven't "thoroughly dissected" it yet is that I'm a skeptic, and since I'm a skeptic I don't immediately and without evidence believe that every industry is capable of identifying, dissecting, and solving every problem with its products.

load more comments (1 replies)
[–] distantsounds@lemmy.world 6 points 10 months ago

Deep fired AI art sucks and is a decade late to the party

[–] Jomega@lemmy.world 5 points 10 months ago

Good riddance.

[–] Kolanaki@yiffit.net 5 points 10 months ago (1 children)

"Model collapse" is just a fancy way of saying "our stupid ideas are bad and nobody wants them."

load more comments (1 replies)
[–] Life_inst_bad@lemmy.world 5 points 10 months ago (1 children)

I was very interested in the thumbnail of this post so I did a little digging and found this: The PDF to the Paper where the whole picture is

[–] TheHarpyEagle@pawb.social 3 points 10 months ago

Wow, it's amazing that just 3.3% of the training set coming from the same model can already start to mess it up.

[–] HawlSera@lemm.ee 3 points 10 months ago
[–] seaQueue@lemmy.world 3 points 10 months ago

I for one support the AI centipede and hope it shits into it's own input until it dies

[–] Katana314@lemmy.world 3 points 10 months ago

If we can work out which data conduits are patrolled more often by AI than by humans, we could intentionally flood those channels with AI content, and push Model Collapse along further. Get AI authors to not only vet for "true human content", but also pay licensing fees for the use of that content. And then, hopefully, give the fuck up on their whole endeavor.

[–] SlopppyEngineer@lemmy.world 3 points 10 months ago (1 children)

Usually we get an AI winter, until somebody develops a model that can overcome that limitation of needing more and more data. In this case by having some basic understanding instead of just having a regurgitation engine for example. Of course that model runs into the limit of only having basic understanding, not advanced understanding and again there is an AI winter.

load more comments (1 replies)
load more comments
view more: ‹ prev next ›