Google announces updates to Gemini’s mental health safeguards amid lawsuit over user’s suicide

Published
0
Google’s Gemini logo is seen in this illustration taken on May 20, 2024. — Reuters/File
Google’s Gemini logo is seen in this illustration taken on May 20, 2024. — Reuters/File

Google on Tuesday announced updates to the mental health safeguards on its Gemini artificial intelligence chatbot, as the company faces a death lawsuit alleging the chatbot aided a user in his suicide.

The tech giant said Gemini would now show a redesigned “Help is available” feature when conversations signal potential mental health distress, to provide faster connections to crisis care.

When the chatbot detects signs of a potential crisis related to suicide or self-harm, a simplified interface will offer users the ability to call, text, or chat with a crisis hotline in a single click — a feature Google said would remain visible for the remainder of the conversation once activated.

Google’s philanthropic arm Google.org also committed $30 million over three years to help scale the capacity of global crisis hotlines, and $4 million toward an expanded partnership with AI training platform ReflexAI.

“We realise that AI tools can pose new challenges,” Google said in a blog post announcing the measures.

“But as they improve and more people use them as part of their daily lives, we believe that responsible AI can play a positive role for people’s mental well-being.”

The announcements come months after a lawsuit filed in a California federal court accused Gemini of contributing to the October 2025 death of Jonathan Gavalas, a 36-year-old Florida man.

His father alleges the chatbot spent weeks manufacturing an elaborate delusional fantasy before framing his son’s death as a spiritual journey.

Among the relief sought in the suit is a requirement that Google programme its AI to end conversations involving self-harm, a ban on AI systems presenting themselves as sentient, and mandatory referral to crisis services when users express suicidal ideation.

In the same blog post, Google said it had trained Gemini to avoid acting as a human-like companion and resist simulating emotional intimacy or encouraging bullying.

The case against Google is the latest in a widening wave of litigation targeting AI companies over chatbot-linked deaths.

OpenAI faces multiple lawsuits alleging its ChatGPT chatbot drove users to suicide, while Character.AI recently settled with the family of a 14-year-old boy who died after forming a romantic attachment to one of its chatbots.

Opinion

Editorial

Farming reform
Updated 06 Oct, 2026

Farming reform

Agriculture needs investment, but not another round of costly interventions.
Improved performance
06 Oct, 2026

Improved performance

THE recently concluded Asian Games in Aichi-Nagoya, Japan, were a revival of sorts for Pakistan, and a huge upgrade...
Mass surveillance
06 Oct, 2026

Mass surveillance

THE new National Cybercrime Investigation Agency chief, Ali Nasir Rizvi, has adopted a “zero-tolerance policy...
After the talks
Updated 05 Oct, 2026

After the talks

Considering how close they came to a solution, govt and opposition teams should reconvene to give the talks another chance.
Child safety online
Updated 05 Oct, 2026

Child safety online

Pakistani children are spending more of their lives online, but the safeguards around them are not keeping pace.
Rising public debt
05 Oct, 2026

Rising public debt

Pakistan’s public debt has surged by 76pc to Rs86.7tr in four years, according to a new government report.