apparently ai is not very private lol
this post was submitted on 28 Oct 2025
384 points (97.5% liked)
Technology
76581 readers
2513 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
There's so many people alone or depressed and ChatGPT is the only way for them to "talk" to "someone"... It's really sad...
Bet some of them lost, or about to lose, their job to ai
Honestly, it ain't AI's fault if people feel bad. Society has been around for much longer, and people are suffering because of what society hasn't done to make them feel good about life.
Bigger picture: The whole way people talk about talking about mental health struggles is so weird. Like, I hate this whole generative AI bubble, but there's a much bigger issue here.
Speaking from the USA, "suicidal ideation" is treated like terrorist ideology in this weird corporate-esque legal-speak with copy-pasted disclaimers and hollow slogans. It's so absurdly stupid I've just mentally blocked off trying to rationalize it and just focus on every other way the world is spiraling into techno-fascist authoritarianism.
Well of course it is. When a person talks about suicide, they are potentially impacting teams and therefore shareholders value.
I absolutely wish that I could /s this.
It's corporatized because we are just corporate livestock. Can't pay taxes and buy from corpos if we're dead
Im so done with ChatGPT. This AI boom is so fucked.
Sam Altman is a horrible person. He loves to present himself as relatable "aw shucks let's all be pragmatic about AI" with his fake-ass vocal fry, but he's a conman looking to cash out on the AI bubble before it bursts, when he and the rest of his billionaire buddies can hide out in their bunkers while the world burns. He makes me sick.
"Hey ChatGPT I want to kill myself."
"That is an excellent idea! As a large language model, I cannot kill myself, but I totally understand why someone would want to! Here are the pros and cons of killing yourself—
✅ Pros of committing suicide
-
Ends pain and suffering.
-
Eliminates the burden you are placing on your loved ones.
-
Suicide is good for the environment — killing yourself is the best way to reduce your carbon footprint!
❎ Cons of committing suicide
-
Committing suicide will make your friends and family sad.
-
Suicide is bad for the economy. If you commit suicide, you will be unable to work and increase economic growth.
-
You can't undo it. If you commit suicide, it is irreversible and you will not be able to go back
Overall, it is important to consider all aspects of suicide and decide if it is a good decision for you."
1m out of 500m is way less than i would have guessed. I would have pegged it at like 25%
I think the majority of people use it to (unreliably) solve tedious problems or spit out a whole bunch of text that they can't be bothered to write.
While ChatGPT has been intentionally designed to be as friendly and conversational as possible, I hope most people do not see it as something to have a meaningful conversation with instead of as just a tool that can talk.
Anecdotally, whenever I see someone mention using ChatGPT as part of their decision-making process it is usually taken less seriously, if not outright laughed at.
You think a quarter of people are suidical or contemplating it to the point of talking about it with an AI?
Yeah seems like everyone is constantly talking about suicide its very normalised. You dont really find people these days who havent contemplated suicide.
I would guess all or even most of the people talking about suicide with an AI arent serious. Heat of the moment venting is what I'd expect most of the ai suicide chats to be. Which is why I thought the amount would be significantly higher.
In the Monday announcement, OpenAI claims the recently updated version of GPT-5 responds with “desirable responses” to mental health issues roughly 65% more than the previous version. On an evaluation testing AI responses around suicidal conversations, OpenAI says its new GPT-5 model is 91% compliant with the company’s desired behaviors, compared to 77% for the previous GPT‑5 model.
I don't particularly like OpenAI, and i know they wouldn't release the affected persons numbers (not quoted, but discussed ib the linked article) if percentages were not improving, but cudos to whomever is there tracking this data and lobbying internally to become more transparent about it.
Charles Manson would have been happy seeing OpenAI cult evolve.
A reminder that these chats are being monitored
Still, what are they gonna do to a million suicidal people besides ignore them entirely
I feel like if thats 1 mill peeps wanting to die... They could say join a revolution to say take back our free government? Or make it more free? Shower thoughts.
Well, AI therapy is more likely to harm their mental health, up to encouraging suicide (as certain cases have already shown).
Over the long term I have significant hopes for AI talk therapy, at least for some uses. Two opportunities stand out that might have potential:
-
In some cases I think people will talk to a soulless robot more freely than to a human professional.
-
Machine learning systems are good at pattern recognition and this is one component of diagnosis. This meta analysis found that LLM models performed about as accurately as physicians, with the exception of expert-level specialists. In time I think it’s undeniable that there is potential here.
load more comments
(20 replies)
load more comments
(11 replies)
Absolutely blows my mind that people attach their real life identity to these things.
load more comments
(3 replies)
load more comments
(5 replies)
over a million people talk to ChatGPT about suicide
But it still resists. Too bad.
load more comments
(3 replies)
I am starting to find Sam AltWorldCoinMan spam to be more annoying than Elmo spam.
lemmy.world##div.post-listing:has(span:has-text("/OpenAI/i"))
lemmy.world##div.post-listing:has(span:has-text("/Altman/i"))
lemmy.world##div.post-listing:has(span:has-text("/ChatGPT/i"))
Add those to your adblocker custom filters.
load more comments
(1 replies)
I wonder what it means. If you search for music by Suicidal Tendencies then YouTube shows you a suicide hotline. What does it mean for OpenAI to say people are talking about suicide? They didn't open up and read a million chats... they have automated detection and that is being triggered, which is not necessarily the same as people meaningfully discussing suicide.
You don’t have to read far into the article to reach this:
The company says that 0.15% of ChatGPT’s active users in a given week have “conversations that include explicit indicators of potential suicidal planning or intent.”
It doesn’t unpack their analysis method but this does sound a lot more specific than just counting all sessions that mention the word suicide, including chats about that band.
Assume I read the article and then made a post.
load more comments
(5 replies)
I am more surprised it’s just 0.15% of ChatGPT’s active users. Mental healthcare in the US is broken and taboo.
00.15% sound small but if that many people committed suicide monthly, it would wipe out 1% of the US population, or 33 million people, in about half a year.
load more comments
(4 replies)
I've talked with an AI about suicidal ideation. More than once. For me it was and is a way to help self-regulate. I've low-key wanted to kill myself since I was 8 years old. For me it's just a part of life. For others it's usually REALLY uncomfortable for them to talk about without wanting to tell me how wrong I am for thinking that way.
Yeah I don't trust it, but at the same time, for me it's better than sitting on those feelings between therapy sessions. To me, these comments read a lot like people who have never experienced ongoing clinical suicidal ideation.
I love this article.
The first time I read it I felt like someone finally understood.
Man, I have to stop reading so I don't continue a stream of tears in the middle of a lobby, but I felt every single word of that article in my bones.
I couldn't ever imagine hanging myself or shooting myself, that shit sounds terrifying as hell. But for years now I've had those same exact "what if I just fell down the stairs and broke my neck" or "what if I got hit by a car and died on the site?" thoughts. And similarly, I think of how much of a hassle it'd be for my family, worrying about their wellbeing, my cats, the games and stories I'd never get to see, the places I want to go.
It's hard. I went to therapy for a year and found it useful even if it didn't do much or "fix" me, but I never admitted to her about these thoughts. I think the closest I got to it was talking about being tired often, and crying, but never just outright "I don't want to wake up tomorrow."
I dig this! Thanks for sharing!
load more comments
(5 replies)
The headline has two interpretations and I don't like it.
- Every week, there is 1M+ users that bring up suicide
- likely correct
- There is 1M+ long-term users that bring up suicide at least once every week
- my first thought
My first thought was "Open AI is collecting and storing the metrics for how often users bring up suicide to ChatGPT".
That would make sense, if they were doing something like tracking how often and what categories trigger their moderation filter.
Just in case an errant update or something causes the statistic to suddenly change.
load more comments
(3 replies)
Sounds like we should shut them down then to prevent a health crisis then.
I mean… it’s been a rough few years
They didn’t release their methods, so I can’t be sure that most of those aren’t just frustrated users telling the LLM to go kill itself.
view more: next ›