Hacker News

Here's the content of the OP. Relevant tidbit: it was posted in r/ChatGPT.

I followed these steps, but just so happened to check on my mason jar 3-4 days in and saw tiny carbonation bubbles rapidly rising throughout.

I thought that may just be part of the process but double checked with a Google search on day 7 (when there were no bubbles in the container at all).

Turns out I had just grew a botulism culture and garlic in olive oil specifically is a fairly common way to grow this bio-toxins.

Had I not checked on it 3-4 days in I'd have been none the wiser and would have Darwinned my entire family.

Prompt with care and never trust AI dear people...

Okay... this is a lot like saying "whales are fish, all fish live in the sea, so whales live in the sea". As in: right conclusion, idiotic reasoning.

No, cold infused garlic oil is not safe; that conclusion is correct. However that's because you simply don't bloody know what's there, it's like playing a Russian roulette - it might be clean, or it might be tainted.

In other words you can't simply vomit certainty like "I just grew a botulism culture" from the presence of carbonation bubbles dammit. Plenty healthy fermented food items produce carbonation bubbles, including the beer that I'm drinking now or the sour cabbage on my kitchen counter.

And, when it comes to LLMs, the same (right conclusion, idiotic reasoning) applies. Yeah, the output of any LLM is as trustable as what the village idiot says when he's drunk; but you need a bigger sample than just one idiotic output to say so dammit. And the answer in this case is technically correct anyway. (You can infuse it. You can eat the result. But you aren't sure if you can eat it more than once.)