this post was submitted on 09 Oct 2025
282 points (99.0% liked)
Fuck AI
4469 readers
743 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I have limited experience, but ChatGPT was great for getting me over a hump when I was writing PowerShell. I was at a dev shop at the time and most of them seemed to feel the same way.
Vibe coding is a dead end, and no replacement for actually knowing the job, but an LLM can give you ideas and inspiration when you're stuck.
One example; I was trying for a Google Sheets/Calendar integration. Very thin documentation and almost no examples online. Had ChatGPT write it. Of course it didn't function, but I picked out a couple of lines that got me finished. I had spent hours banging my head when I could have cut to the chase.
So how could we study effectiveness when that depends on how it's used?
It's really good at giving you hints to steer you to the right path. Sometimes it has given me answers that are exactly what I was looking for, but didn't know existed. But I've also seen it spit out outdated answers, incomplete answers, and solutions that an experienced dev wouldn't use. It's also limited because it doesn't understand the context, where a better solution could've been available, but you wouldn't know.
Overall, I'd give it a 7/10 as a study aid. It's a great place to start, but don't rely on it.
We design studies around claimed beneficial workflows and measure.
Nobody said this is easy. It isn't. Social sciences in particular are hard to design good studies for. But without measurement (and precise definitions of what "effectiveness" means for purposes of these measurements) all claims about "productivity through the roof" are sus as all fuck.