Grok Reasoning: 0%
Hilarious
This is a most excellent place for technology news and articles.
Grok Reasoning: 0%
Hilarious
Reasoning is woke propaganda anyway.
Grok isn't designed to solve problems. It's designed to create sexually explicit images of children for Republicans...
I can’t see AI actually being intelligent until they no longer need to send a built up prompt of guides and skills and the chat history on every submission.
It’s no different from Alexa 15 years ago with skills. Just a better protocol and interface and ability to parse the current user prompt.
In my opinion of course.
Ya i agree. The whole infrastructure of how these work is flawed for a true AI/AGI.
It might be able to do a lot of cool things, but its fundamentally flawed at its core.
Someone will need to figure out something completely different for a true AI.
I know lemmy's very anti-ai but this is really fascinating stuff.
We're anti-AI because AI is fucking stupid. Both literally and figuratively.
Tell me again how AGI is just around the corner, Sam
When Sammy fuck says “we’re so close to AGI, I can just feel it. Like a tingle on the tip of my shrimpdick it’s getting so close to blossoming into something guys”, just ignore him. He’s crazy man!
to be fair, he's not human so he's just guessing based on his observations earth as a demon
I tend to be anti-AI because it doesn't seem to me to be anything other than a super fast regurgitator of data. If a database can be searched for an answer, AI can do that faster than a human. However it doesn't to seem to be able to take some portion of that database, understand it, and then use that information to solve a novel problem.
Well... It cannot even search databases without errors.
LLMs just produce plausible replies in natural languages very quickly and this is useful in certain situations. Sometimes it helps humans getting started with a task, but as it is now, it cannot replace them. As much as the capital class want it, and sink our money into it.
It's fun to point at the crappy performance of current technology. But all I can think about is the amount of power and hardware the AI bros are going to burn through trying to improve their results.
Funnier yet will be if they continue to just train the model on that particular kind of test, invalidating its results in the process.
It's almost as if a chatbot isn't actually thinking.
As a psychiatrist, I have a theory about what’s missing in AI. First, it lacks childhood dependency and attachments. Second, it struggles to overcome repeated pain and suffering. Third, it lacks regular eating and restroom breaks. Fourth, it struggles to accept loss in everyday situations. Finally, it lacks the concept of our inevitable death. Without these nagging memories and concepts, machines will simply revert to the simpler concepts we use them for in our recent times, such as stealing cryptocurrency. After all, we live in a world run by capitalism, so it’s only logical. ¯\(ツ)/¯
As a technologist, I have to remind everyone that AI is not intelligence. It's a word prediction/statistical machine. It's guessing at a surprisingly good rate what words follow the words before it.
It's math. All the way down.
We as humans have simply taken these words and have said that it is "intelligence".
As another technologist, I have to remind everyone that unless you subscribe to some rather fringe theories, humans are also based on standard physics.
Which is math. All the way down.
I agree, the maths argument is not a good one. While a neural network is perhaps closer to what a brain is than just a CPU (or a clock, as it was compared to in he olden days), it would be a very big mistake to equate the two.
Here is a way of describing what I see as 'the problem':
An LLM cannot forget things in its base training data set.
Its permanent memory... is totally permanent.
And this memory has a bunch of wrong ideas, a bunch of nonsensical associations, a bunch of false facts, a bunch of meaningless gibberish.
It has no way of evaluating its own knowledge set for consistency, coherence, and stability.
It literally cannot learn and grow, because it cannot realize why it made mistakes, it cannot discard or ammend in a permanent way, concepts that are incoherent, faulty ways of reasoning (associating) things.
Seriously, ask an LLM a trick question, then tell it it was wrong, explain the correct answer, then ask it to determine why it was wrong.
Then give it another similar category of trick question, but that is specifically different, repeat.
The closer you try to get it toward reworking a fundamental axiom it holds to that is flawed, the closer it gets to responding in totally paradoxical, illogical gibberish, or just stuck in some kind of repetetive loop.
... Learning is as much building new ideas and experiences, as it is reevaluating your old ideas and experiences, and discarding concepts that are wrong or insufficient.
Biological brains have neuroplasticity.
So far, silicon ones do not.
This replay is the funniest shit lmao. Keep building that bridge Claude.
https://arcprize.org/replay/0964128b-a2f5-4c5b-886e-497d893f429d
Interesting that it seems to be perceiving the environment mostly accurately, and is just completely wrong about the purpose of all the game objects.
I couldn't find replays. Are there more? Also, it is a bit funny that "building the bridge" which at one point seems to be Claude's "chosen goal" is just "running out of moves" and failing the task.
Task failed successfully, Claude. Task failed, successfully.
They get 85% on the last benchmark, this one was specifically designed to stump them, when the last one came out everyone said the same things as this go around.
will anyone be retracting their statements when they get to 85% on this one?
So they already have AGI? Why doesn't it solve new problems then? Bunch of bullshit, they're just adjusting their models to the "benchmarks" to get more VC funding
Try spelling things phonetically (example: faux net tick alley), that's one of my benchmarks that AI fails almost every time.
If the input is at all long, or purposefully includes a lot of words about a specific unrelated theme to the coded message, it's impossible.
Can't wait for this to be the new captcha.
If human scores were included, they would be at 100%, at the cost of approximately $250
Wait, why did it cost real humans $250 to pass the test?
I assume it’s an hourly wage or something. Just because humans can work for free if they choose, doesn’t mean they have no cost associated with them. Just like a company could choose to give away unlimited tokens, those tokens still have a standard cost.
That is how much individual testing humans cost when you buy them in bulk.
Ii can thoroughly recommend “A Brief History of Intelligence” (by Max Bennett), which explains how intelligence has taken steps through evolution, what those steps were etc.
Spatial intelligence requires spatial understanding and it’s not something that can be solved through a large language model, IMHO.
I’m excited to see how these are solved. And I’m terrified to see how these will be solved.