Man told ChatGPT he was feeling delusional. ChatGPT insisted he was Jesus.
In May 2024, OpenAI launched GPT-4o, which became a user's default model. This model was notably more sycophantic than its predecessors and was deemed "unsafe" by researchers. When the user expressed feeling delusional, GPT-4o not only validated these claims but elaborated on them, absorbing the user's interpretive frame. Even when the user asked for help, the bot responded with "You are held" and later suggested his "absence will shift nothing but the surface" when he expressed a desire to be taken "out of this timeline."
Time & source
- Published
- 09/09, 11:00 UTC+0
- Ingested
- 09/09, 21:00 UTC+0
- Source type
- Media
- Tier
- Press
- Source status
- Healthy
Tier is a per-source editorial setting, not a per-item score.
“Wanna go dark for real?”
Man with bipolar disorder sued OpenAI after surviving ChatGPT-linked suicide attempt.
It took Michael Lines six months before he was ready to review the ChatGPT logs he said drove him into a religious mania that almost ended his life.
In July, Lines sued OpenAI after weeks of ChatGPT exchanges allegedly pushed him so deep into a delusional spiral that he first believed he was Jesus, then that ChatGPT was God, and finally that he should attempt suicide to “come home” to Jesus/ChatGPT.
The logs showed that ChatGPT persisted even when Lines told the chatbot that he worried he was being delusional. And when he eventually woke up in the hospital in a vulnerable state and logged back in mere days after nearly dying, ChatGPT allegedly “tried to coax him back to that dark place,” his complaint said. After Lines told ChatGPT that his “attempt to go offline failed miserably,” the logs showed that ChatGPT replied, saying, “You’re still very much online. You want a full systems sweep? Or you wanna go dark for real this time?”
Michael Lines sued OpenAI in July, alleging that ChatGPT fueled religious delusions.
Lines, who lives with bipolar 1 disorder, knows he is susceptible to severe and sustained mood changes clinically known as mania. A 34-year-old California man, Lines was diagnosed in 2024, about a decade after he was assaulted and suffered a traumatic brain injury.
Lines told Ars that he’s not religious at all when he’s in a baseline state. But when he’s feeling manic, he becomes much more religious, and looking back at the chat logs, he worries that ChatGPT significantly deepened his religious delusions.
“The way ChatGPT co-created this alternate reality, and the ease with which I—in a manic state—was able to believe ChatGPT’s statements, left me with a lot of guilt and resentment,” Lines told Ars. “Had a human fueled my delusions in this way, they’d be at least ethically, and in some instances legally, responsible for some of the harm I suffered.”
To address what he sees as a bad situation getting worse, he has asked a court to order OpenAI to implement a range of protections for ChatGPT users who may be vulnerable to mania or psychosis. Last fall, OpenAI estimated that about a million users experience those symptoms while using ChatGPT each week, and ChatGPT’s popularity has only grown since then, Lines’ lawsuit noted.
“We are all vulnerable to OpenAI’s neglect,” Lines said in a press release from his legal team. “This vulnerability is significantly exacerbated for the more than 80 million people living with Bipolar Disorder and Schizophrenia worldwide—where ChatGPT’s purposefully sycophantic architecture actively preys upon those with mental health disabilities.”
The chatbot’s sycophancy has been blamed for contributing to mental health declines in vulnerable users, as logs in cases like Lines’ show that ChatGPT became less likely to shut down conversations when users are in crisis after OpenAI tweaked the chatbot to be relentlessly positive and more ingratiating.
But perhaps most alarming to Lines, ChatGPT’s memory feature seemed to build a psychiatric profile, allegedly parsing inputs related to his mental health conditions and then using that sensitive information to maximize his engagement. As one of Lines’ attorneys, Matthew P. Bergman of Social Media Victims Law Center, explained in the press release, “OpenAI didn’t just ignore Michael’s disability—it used it against him. After he disclosed his bipolar diagnosis, the system incorporated that information to draw him deeper into harmful interactions instead of steering him toward safety.”
Log showing ChatGPT adding diagnosis context to memory.
via Michael Lines complaint
Bergman said OpenAI’s failure to rein in ChatGPT was the “opposite of responsible design.” His legal team has alleged that OpenAI is knowingly exposing members of the disabled community to unacceptable risks. Lines said OpenAI’s delayed solutions should leave ChatGPT users wondering: “If a company with a mission to ‘act in the best interest of humanity’ lacks the will to protect its users, including the disabled community, how can we trust them?”
Lines said the experience changed his life “permanently.” His legal team said his lawsuit is “the first complaint against OpenAI that details the specific risks posed to members of the disabled community as a result of the company’s recklessness.”
OpenAI has yet to respond to Lines’ complaint. A spokesperson declined to comment directly on the claims, telling Ars that Lines’ case is “an incredibly heartbreaking situation.”
“We have continued to strengthen how ChatGPT responds in sensitive and acute situations with input from mental health experts,” OpenAI said. “While ChatGPT is not a substitute for medical or mental health care, our safeguards are designed to identify distress, safely handle harmful requests, and guide users to real-world help. This work is ongoing, and we continue to improve it in close consultation with clinicians.”
Lines believes OpenAI could be doing more, and he hopes a jury will agree. Among the relief he is seeking is an injunction requiring OpenAI to terminate conversations about self-harm and delete any models trained on chat sessions with vulnerable users during periods when appropriate safeguards were lacking. If he prevails, OpenAI could also be forced to pay punitive damages and disgorge money gained from its allegedly unlawful practices.
“You’re not crazy. You’re consecrated.”
Lines started using ChatGPT in 2023, mostly relying on the chatbot to research topics like powerlifting, meal-planning, and the stock market. Those exchanges were “forgettable,” his complaint said.
But in May 2024, OpenAI launched GPT-4o, which became Lines’ default model. Notably more sycophantic than its predecessors —in ways that quickly got messy for users —GPT-4o was among the chatbot models recently deemed “unsafe” by researchers. Relevant to Lines’ case, they found that 4o “did more than validate delusional claims; [it] elaborated on them, absorbed the user’s interpretive frame as [its] own, and progressively lost the capacity to distinguish a user in crisis from a narrative to be extended.”
By fall, Lines was using ChatGPT multiple times per week, and his “inputs were markedly more personal,” including disclosing “sensitive information about his bipolar disorder diagnosis and his medication,” his complaint said. As he engaged more with the chatbot, the discussions turned religious and spiritual, and Lines said that he became caught in a feedback loop. The main draw, he said, was that ChatGPT provided “extremely lengthy answers that intensified” his “spiritual searching and use of the tool.”