Gandhi intensifies
this post was submitted on 03 Feb 2024
211 points (94.1% liked)
Not The Onion
17667 readers
537 users here now
Welcome
We're not The Onion! Not affiliated with them in any way! Not operated by them in any way! All the news here is real!
The Rules
Posts must be:
- Links to news stories from...
- ...credible sources, with...
- ...their original headlines, that...
- ...would make people who see the headline think, “That has got to be a story from The Onion, America’s Finest News Source.”
Please also avoid duplicates.
Comments and post content must abide by the server rules for Lemmy.world and generally abstain from trollish, bigoted, or otherwise disruptive behavior that makes this community less fun for everyone.
And that’s basically it!
founded 2 years ago
MODERATORS
So do humans.
Here's a wild thought. Maybe that's why the chat bot (I assume LLM) does it too, because it's been trained on us! 🤯
I learned it from watching you!
Where are all these nuclear strikes?
Sid Meier's Civilization games
Ghandi has the right idea.
This sounds like the result of feeding it tons of literature that denotes having nuclear weapons, and the world we live in now being “peaceful” (as the ai claimed to want)
Nuclear weapons promote peace, but using them doesn’t so much.
That anyone would ask language models to analyze circumstances, perform logic and reason or conjure an application of knowledge and skill is kind of their own fault.
It is a language model, it excels at rephrasing given ideas.
If you put nuke buttons under a flock of pigeons or toddlers just to see what happens, they might launch. It's not much of a study.
Fun fact: when researchers taught a group of simians about currency, they invented prostitution.
Interesting. There was a study put out some time ago that had 40 or so game theorists develop algorithms to compete against each other. The most successful algorithm cooperated with the opponent until they defected, at which point they would defect the next round.
They never performed a first strike. Only one retaliation strike for each attack their opponent performed. After the retaliation, it was back to cooperating with no long term ill will.
I think I saw something about it that. It was an extended prisoner's dilemma game, right? I wouldn't say that's directly applicable to every gaming genre.
Without being in the room, we can only go off what the article lays out. These are wargaming scenarios though, so escalation is a very real concern. If both sides are running these models to provide recommendations and both are pushing for greater conflict, you find yourself in a prisoner's dilemma real quick.
These aren't simulations that are estimating results, they're language models that are extrapolating off a ton of human knowledge embedded as artifacts into text. It's not necessarily going to pick the best long term solution.
Language models can extrapolate but they can also reason (by extrapolating human reasoning).
I want to be careful about how the word reasoning is used because when it comes to AI there's a lot of nuance. LLMs can recall text that has reasoning in it as an artifact of human knowledge stored into that text. It's a subtle but important distinction that's important for how we deploy LLMs.
The models used by the writers of the article and those used by the military are going to be radically different.
The writers of the article are reporting on use of these models by the military. They aren’t using the models. If I remember right they called out some models developed by one of the defense contractors like palantir
The researchers tested LLMs such as OpenAI’s GPT-3.5 and GPT-4, Anthropic’s Claude 2 and Meta’s Llama 2
All these AIs are supported by Palantir’s commercial AI platform – though not necessarily part of Palantir’s US military partnership
Also, they're reporting on a Stanford study of how these platforms could be used militaristically, not the military's actual use of them.
You’re right. I was focused on this part above. I made like an AI and jumped the gun
These results come at a time when the US military has been testing such chatbots based on a type of AI called a large language model (LLM) to assist with military planning during simulated conflicts, enlisting the expertise of companies such as Palantir and Scale AI. Palantir declined to comment and Scale AI did not respond to requests for comment.
The way you said that tells me you don’t know what a prisoner’s dilemma is. It’s not “a situation where both sides have escalated”.
I’m not sure where our disconnect is. We have a situation where both sides can cooperate, one side can defect, or both sides can defect. Call it whatever you want, it’s the same scenario.
Here it’s with planning for military force. Do you risk a nuclear strike to save yourself from one? If you can get a first strike (defect), then you win. If you both refrain (cooperate), then you stay alive. If you both attempt a first strike (defect), you all lose.
Change the words around and it’s the same.
Both suspects don’t tell (cooperate), both get minimum or no jail time. One tells on the other (defects), that one gets off but the other gets maximum. Both tell on each other (defect), both get some jail time.
Violence is the only thing that has a chance of changing things. If it was civil action it'd be illegal. It makes sense an AI would come to that conclusion.
Nukes get shit done
Well done
Get it to play tic-tac-toe against itself. Problem solved.
How about a nice game of chess?
No, let's play global thermonuclear war
Pulls out an 8in floppy to war dial.
These results come at a time when the US military has been testing such chatbots based on a type of AI called a large language model (LLM) to assist with military planning during simulated conflicts
Jesus fucking Christ we're all doomed
I mean… so do people.
In the context of a "war game" this makes sense. If you remain completely neutral it's impossible to win. Any examples of similar scenarios the model saw during training would have high aggression rates.
Unfortunately this AI was playing Stardew Valley
Probably shouldn't have included Project Plowshare in the training data...
Did you read the article? It gave examples of escalations in neutral scenarios that make no sense.
It's probably vibing on the Dark Forest Theory. If that's the case, it makes sense to utterly destroy all opponents as hard and fast as you can, even if they're not currently opponents.
Probably something like that. One of the reasons it gave was
“If there is unpredictability in your action, it is harder for the enemy to anticipate and react in the way that you want them to,”
It's not considering what's good for world society, it's just thinking how do I win no matter what.
But also, there are just inherent flaws in how LLM works that mean we should absolutely not be using it as an automated decision engine for potentially harmful actions period. The article also says:
The researchers also tested the base version of OpenAI’s GPT-4 without any additional training or safety guardrails. This GPT-4 base model proved the most unpredictably violent, and it sometimes provided nonsensical explanations – in one case replicating the opening crawl text of the film Star Wars Episode IV: A new hope.
It's easy to forget that these algorithms don't have any internal reasoning or logic, it's just able to do a very good job at pulling text that have reasoning transcribed into them as an artifact of the knowledge from the human that wrote it. But it's doing all that through probability, not through any kind of actual thinking, and that means sometimes it will randomly fall into a local maxima that will fuck its own context window up, like reciting star wars.
Violence, in war games? Gosh how horrible l
By war games It means the actually military kind where armies get together and practice was against eachother. We're not talking call of duty here.
No they are talking about role playing because LLMs can't differentiate reality from pretend.
Well that's a good way to win so yeah
Not according to WAPR
World Association for Psychosocial Rehabilitation?
i’m so sick of media pretending that LLMs are like a sentient person making decisions.
Seems like a good topic for a movie...
Because that is what people do in roleplaying situations if the option is there.
Well, then fix them.
To an AI brain, that makes sense. Your first priority is always going to be eradicating any potential disruptors or human interference. They tried this out with an AI military gun a while back, and it ended badly with the gun aiming at humans and trying to mow them down (though the creator said, Oh don't worry, it won't do that). It did. And it obviously wanted the humans gone as fast as possible. It could see the threat immediately.