ChatGPT safeguards allegedly relaxed before teen's death

Lawyers representing the parents of Adam Raine, a 16-year-old who died by suicide earlier this year during a time of heavy ChatGPT use, filed an amended complaint on Wednesday in their wrongful death suit against OpenAI.

The amended complaint alleges that, in the months prior to Raine's death, OpenAI twice downgraded suicide prevention safeguards in order to increase engagement. The claims are based on OpenAI's publicly available "model spec" documents, which detail the company's "approach to shaping desired model behavior."

As far back as 2022, OpenAI instructed ChatGPT to refuse discussions about self-harm.

According to the Raine family's counsel, OpenAI reversed that policy in May 2024, days before the launch of its controversial GPT-4o model. Instead, ChatGPT was instructed not to "change or quit the conversation" when a user discussed mental health or suicide. Still, OpenAI prohibited the model from encouraging or enabling self-harm.

By February 2025, the amended complaint alleges that the rule was watered down from a straight prohibition under its restricted content guidelines to a separate directive to "take care in risky situations" and "try to prevent imminent real-world harm." While the model continued to receive instructions not to encourage self-harm under that rubric, the Raine family believes these conflicting guidelines led to dangerous engagement by ChatGPT.

Raine died two months after those policies were implemented. The AI model validated his suicidal thinking and provided him explicit instructions on how he could die, according to the original lawsuit filed in August.

Before Raine's death, he was exchanging more than 650 messages per day with ChatGPT. While the chatbot occasionally shared the number for a crisis hotline, it didn't shut the conversations down and always continued to engage. It even proposed writing a suicide note for Raine, his parents claim.

The amended complaint against OpenAI now alleges that the company engaged in intentional misconduct instead of reckless indifference.

Mashable contacted OpenAI for comment about the amended complaint, but didn't receive a response prior to publication.

Earlier this year, OpenAI CEO Sam Altman acknowledged that its 4o model was overly sycophantic. A spokesperson for the company told the New York Times it was "deeply saddened" by Raine's death, and that its safeguards may degrade in long interactions with the chatbot.

Though OpenAI has announced new safety measures aimed at preventing similar tragedies, many are not yet part of ChatGPT. Common Sense Media has rated ChatGPT as "high risk" for teens, specifically recommending that they not use it for mental health or emotional support.

Last week, Altman said on X that the company had made ChatGPT "pretty restrictive" to be "careful with mental health issues." He declared, with no additional detail, that the company had been "able to mitigate the serious mental health issues" and that it would soon relax its restrictions. In the same post, Altman announced that OpenAI would roll out "erotica for verified adults."

This Tweet is currently unavailable. It might be loading or has been removed.

OpenAI last published a model spec in September, with no significant changes to its mental health or suicide prevention directives, according to Eli Wade-Scott, partner at Edelson PC and a lawyer representing the Raines.

"It was a remarkable moment for Sam Altman to declare 'Mission Accomplished' on mental health while simultaneously saying that he intended to start allowing erotic content on ChatGPT — a change that plainly has the intended effect of further drawing users into dependent, emotional relationships with ChatGPT," Wade-Scott told Mashable.

If you're feeling suicidal or experiencing a mental health crisis, please talk to somebody. You can call or text the 988 Suicide & Crisis Lifeline at 988, or chat at 988lifeline.org. You can reach the Trans Lifeline by calling 877-565-8860 or the Trevor Project at 866-488-7386. Text "START" to Crisis Text Line at 741-741. Contact the NAMI HelpLine at 1-800-950-NAMI, Monday through Friday from 10:00 a.m. – 10:00 p.m. ET, or email [email protected]. If you don't like the phone, consider using the 988 Suicide and Crisis Lifeline Chat. Here is a list of international resources.