Time can’t exist in LLM by design: it’s just a thing that predicts next token based on previous tokens. There is no temporal relation between tokens. You can stop and resume generation at any point. How anyone expect it to “count time”? Based on what? The best you can do is add time mark to model input at some interval.

Simplifying, somewhat complex biological systems have some kind of clocks that actually chemically tick and induce some kind of signal that they can react on.

LLMs can’t do that like at all. They never will. Some other architecture that runs in cycles? Maybe. But transformer shit? Never ever.

[–] MysticKetchup@lemmy.world 23 points 1 day ago

The issue is that ChatGPT will tell you that it can do those things. Most of the hype for "AI" has been predicated on treating it like actual artificial intelligence and not the LLM parrot it truly is

[–] mrgoosmoos@lemmy.ca 8 points 1 day ago (1 children)

I don't think anybody is expecting an LLM to do it

what they are expecting is the product, chatGPT, to be a one-stop spot that can do basic tasks like that

[–] Jakeroxs@sh.itjust.works 5 points 1 day ago

Basically just rely on tool calling to a time server of some sort 🤷

[–] hydroptic@sopuli.xyz 3 points 21 hours ago* (last edited 21 hours ago)

Some other architecture that runs in cycles?

Spiking networks!

Nobody really has a good handle on which SNN architecture would be ideal for which task and they're ridiculously hard to train, but if there is ever going to be an AGI (let alone an ASI), my money is on it popping out of something like an SNN that can also simulate neuroplasticity