Google Using New AI to Better Detect Searches Made by People During Personal Crises

AI can help Google Search give information to those who need help.

Imad Khan Senior Reporter
Imad is a senior reporter covering Google and internet culture. Hailing from Texas, Imad started his journalism career in 2013 and has amassed bylines with The New York Times, The Washington Post, ESPN, Tom's Guide and Wired, among others.
Expertise Google | Internet Culture
Imad Khan
2 min read

Google is now using AI to help in suicide prevention, as well as to limit graphic sexual imagery. 


Google is using new artificial intelligence designed to understand the intent behind search inquiries, technology the search giant hopes will deliver more relevant results for people seeking help during personal crises.

On Wednesday, Google said in a blog post it would begin implementing MUM, an AI model that more accurately detects "a wider range of personal crisis searches," in the coming weeks. The model is designed to better understand the intent behind search queries and provide immediately useful information to the searcher. Google says the new model will help its search engine with inquiries related to suicide, sexual assault, substance abuse and domestic violence.

The company also said another AI model, dubbed BERT, reduced the number of unwanted sexually explicit results the search engine returns. Google said BERT has already cut "unexpected shocking results" by 30% over the past year. 

The new AIs are designed to deliver results that more accurately reflect the intent behind searches. Google can easily return the phone number of the National Suicide Prevention Hotline when people in crisis search. But because depression is complex, the reason for user inquiries isn't always entirely obvious to Google's search engine. 

Tech platforms have struggled with suicide content, which is easy to find on social media platforms. Suicide is a leading cause of death in the US, according to the Centers for Disease Control and Prevention, and was responsible for nearly 46,000 deaths in 2020. 

Google says that BERT has helped reduce explicit results around ethnicity, sexual orientation and gender.

If you're struggling with negative thoughts or suicidal feelings, resources are available to help. In the UScall the National Suicide Prevention Lifeline at 1-800-273-8255; in the UK, call the Samaritans at 116 123; and in Australia, call Lifeline at 13 11 14. Additionally, you can find help at these 13 suicide and crisis intervention hotlines.