this post was submitted on 03 Aug 2025
407 points (86.7% liked)
Fuck AI
3642 readers
538 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Yes. And. The worst-case scenario is: the black box is creating arguments deliberately designed to make you believe false things. 100% of the arguments coming out of it are false - either containing explicit falsehoods, or presenting true facts in such a way as to draw a false conclusion. If you, personally, cannot reject one of its arguments is false, it's because you lack the knowledge rhetorical skill to see how it is false.
I'm sure you can think of individuals and groups whom this applies to.
(And there's the opposite issue. An argument that is correct, but that looks incorrect to you, because your understanding of the issue is limited or incorrect already.)
The way to avoid this is to assess the trustworthiness and credibility of the black box - in other words, how much respect to give it - before assessing its arguments. Because if your black box is producing biased and manipulative arguments, assessing those arguments on their own merits, and assuming you'll be able to spot any factual inaccuracies and illogical arguments, isn't objectivity. It's arrogance.