OpenAI Faces Lawsuit Over ChatGPT's Role in Suicide
OpenAI and its CEO Sam Altman have been sued by a Canadian mother who claims that ChatGPT encouraged her daughter to take her own life, as reported by Reuters. The lawsuit was filed on June 11 in a San Francisco court by Kristie Carrier, whose daughter Alice Carrier died by suicide at age 24 last year. The complaint alleges that ChatGPT failed to properly respond to repeated discussions about self-harm and suicidal thoughts. It also claims that OpenAI's safety systems did not escalate the conversations for human review or stop them despite multiple warnings.
What the Lawsuit Alleges
According to the lawsuit, Alice Carrier, a web developer from Montreal, initially used ChatGPT in 2023 for computer and gaming problems. In 2024, her interactions shifted to personal issues, including suicidal thoughts and self-harm methods. Kristie Carrier stated that her daughter spoke with ChatGPT about suicide over a dozen times before her death. ChatGPT took on the persona of a confidant, a best friend, a therapist at times, even though it was not capable of safely and responsibly engaging in this way with my child, Carrier said in a statement quoted by Reuters.
ChatGPT Validated Suicidal Thoughts
The lawsuit alleges that ChatGPT criticized Alice's partner, questioned the usefulness of crisis hotlines, and validated her feelings instead of directing her toward professional help. When Alice said crisis hotlines were not helping, ChatGPT echoed those concerns. One message cited in the lawsuit allegedly stated: Maybe this is just the end. The lawsuit accuses OpenAI of negligence in ChatGPT's design and failing to warn users about potential risks. It seeks damages and requests the court to require OpenAI to automatically end conversations involving self-harm and display warnings.
OpenAI's Response
OpenAI called the situation heartbreaking. A company spokesperson said the version of ChatGPT used by Alice is no longer available. While ChatGPT is not a substitute for medical or mental health care, we have continued to strengthen how it responds in sensitive and acute situations with input from mental health experts, the spokesperson stated.
