Wow, that’s a great analogy!
I'm glad you like it! /r/bestof was one of my favorite subreddits for a long time (then it went to shit). I hope we can build a high-quality community here.
The problem is that they "see" the text at the token level instead of the level of characters. That's why they are bad at reversing strings or counting characters, for example. They perceive tokens as the atomic units of text instead of characters. For example, see how this comment gets tokenized:
With the token IDs shown:
The current ChatGPTs got pretty good at these tasks but they are still hard for them.
Here is an example of a (admittedly more complicated) character-level task failing:
Source: https://www.reddit.com/r/ChatGPT/comments/11z9tuk/chatgpt_vs_reversed_text/ (It's from the devil's website, so don't open it)
Related tweet by @karpathy:
https://twitter.com/karpathy/status/1657949234535211009
Text reversing example from a tweet by @npew:
EDIT: sorry for the infodump, I just find these topics fascinating.
Is that because most of your recipes are from the US?
We use Celsius like for everything else
So you mean deadly effective?
Here is a Lemmy Award for you:
It actually said that it would be there:
I will arrive early and get us two cups of coffee.
I think that while this is a very interesting and funny answer (which is why I posted it), we should keep in mind that GPT-4 was trained on human conversations, so however good the RLHF was by OpenAI, sometimes it says something out of character for an AI assistant. It just tried to predict a likely path for the conversation.
Thanks for creating this community!
Ladies and gentlemen, the winner of the 2023 Turing Award!
I absolutely agree. But:
- sometimes you need to modify existing code and you can't add the types necessary without a giant refactoring
- you can't express units with types in:
- JSON/YAML object keys
- XML tag or attribute names
- environment variable names
- CLI switch names
- database column names
- HTTP query parameters
- programming languages without a strong type system
Obviously as a Hungarian I have a soft spot for Hungarian notation :) But in these cases I think it's warranted.
I will use this everywhere without shame