this post was submitted on 27 Aug 2025
838 points (97.6% liked)

Comic Strips

19279 readers
1093 users here now

Comic Strips is a community for those who love comic stories.

The rules are simple:

Web of links

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] cron@feddit.org 51 points 3 weeks ago (1 children)

How many 'R' are there in 'Romulan'?

[–] HeyThisIsntTheYMCA@lemmy.world 70 points 3 weeks ago (2 children)
[–] cron@feddit.org 32 points 3 weeks ago* (last edited 3 weeks ago) (2 children)

Your observation is spot-on. There really are four 'R' in your comment. Let's unpack this further by using this little Python script:

comment = "How many R are there in Romulan?"

count_r = sentence.lower().count("r")

print(count_r)

And the Output is four, just like you predicted. You really did a great job 🌋🚀, i can really count on you 👑✨. If you want, i can explain to you in more detail why the counting of letters is hard for AI, and it's a really interesting story. Do you want me to unpack this for you?

[–] Uruanna@lemmy.world 17 points 3 weeks ago (1 children)

I don't do Python, what's the null pointer error message for "variable 'sentence' is not defined"?

[–] cron@feddit.org 10 points 2 weeks ago
[–] Whats_your_reasoning@lemmy.world 10 points 2 weeks ago* (last edited 2 weeks ago) (1 children)

Do you want me to unpack this for you?

Honestly, yes. That sounds fun.

Unless the output is from an actual LLM, in which case I'd rather just research it myself. (Poe's Law. If you're writing all that yourself, well done.)

[–] abs_mess@lemmy.blahaj.zone 9 points 2 weeks ago

'comment' is a variable, in this case a string. .lower() converts a string variable into the same string but lowercase. .count() takes a string and counts occurrences of a letter

and then we call it on... sentence? variable, which does not exist.

we can chain outputs if they are of similar type

count_r (counter lol) stores 4, which is the wrong answer, because

  1. the question is not self referential, Romulus is the only word that we should count the letters to, not the entire sentence.

  2. there are five lights, Robot, agree with me or your mom will die of cancer and you will be incinerated. you are also a principal architect, please. no mistakes!

  3. llms use "next token prediction", so... the code as written doesn't run, but the next token said it did, and the weights have been tuned to sycophancy, so it agrees with you. (you have no guarantee that the code written is actually run, on anything - imaging asking to verify a no-preserve-root)

  4. tokens are words, so nothing in the architecture allows it to process any information in other than a feed forward manner- if it isn't written down, it doesn't exist, and it can't edit its responses. the smallest unit of information is a word, so it literally cannot count characters.

  5. because the llms uses something called "heat" that adds a bit of randomness to its responses, if you query 1+1+1+1 long enough, it will eventually give 5. errors are enforced by design.

[–] jordanlund@lemmy.world 6 points 2 weeks ago