Man, AI agents are remarkably bad at "self-awareness" like this, I've used it to configure some networking on a Raspberry Pi, and found myself reminding it frequently, "hey buddy, maybe don't lock us out of connecting to this thing over the network, I really don't want to have to wipe the thing because it's running a headless OS".

It's a perfect example of the kind of thing that "walk or drive to wash your car?" captures. I need you to realize some non-explicit context and make some basic logical inferences before you can be even remotely trusted to do anything important without very close expert supervision, a degree of supervision that almost makes it totally worthless for that kind of task because the expert could just do it instead.

[–] qjkxbmwvz@startrek.website 4 points 4 weeks ago

"...I really don't want to have to wipe the thing because it's running a headless OS"

I feel like logging in as root on a headless system and hoping you type the command(s) to restore functionality is a rite of passage.

load more comments (12 replies)