
Share
Dr. Emily Carter discusses the ethical and practical hurdles of using AI chatbots to support mental health, questioning their readiness to handle severe cases without risking patient safety.
In the rapidly evolving landscape of health technology, one question has been gaining increasing attention: Can general-purpose AI chatbots effectively and safely assist individuals experiencing mental health crises? Dr. Emily Carter, Google's clinical director, recently shared her insights on this complex issue during a panel discussion at a leading health tech conference.
The integration of artificial intelligence (AI) into mental health care is not just about technological advancement; it’s about saving lives and improving the quality of life for millions of people. According to the World Health Organization, nearly 1 billion people globally suffer from some form of mental disorder. In many regions, access to mental health professionals is limited, making AI chatbots a potentially valuable resource. However, the stakes are high, as these tools must be designed and deployed responsibly to avoid causing harm.
AI chatbots can offer several benefits in mental health care:
Despite these potential benefits, Dr. Carter highlighted several significant challenges:
Dr. Carter emphasized the need for a balanced approach:

“AI chatbots have enormous potential, but they must be developed with a deep understanding of the ethical and clinical implications,” she said. “We need robust testing, transparent algorithms, and clear guidelines to ensure that these tools are used safely and effectively.”
She also stressed the importance of collaboration between tech companies, healthcare providers, and regulatory bodies:
“Partnerships are crucial. We need to work together to create a framework that supports innovation while prioritizing patient safety and privacy.”
One example of an AI chatbot in mental health care is Woebot, which has been used by thousands of people for cognitive behavioral therapy (CBT). While early studies have shown promising results, Dr. Carter noted that more research is needed to fully understand the long-term impacts.
Another initiative is Google’s own project, which aims to integrate AI into telehealth platforms to provide better support for mental health professionals and patients alike.
As the field continues to evolve, Dr. Carter outlined several key steps:
The integration of AI into mental health care holds great promise, but it also comes with significant responsibilities. By addressing the ethical, technical, and regulatory challenges, we can harness the power of AI to improve mental health outcomes for individuals around the world.
Tags
Original Sources
About the author
Amara's entry point into AI was an epidemiology role at a London research hospital, where she spent five years studying how digital health tools reached — or conspicuously failed to reach — underserved communities. Watching early algorithmic systems in healthcare quietly entrench existing inequalities, she redirected her career toward the systemic consequences of AI at scale. She covers AI through an unflinching lens: who benefits, who bears the cost, and what evidence actually says versus what the press release claims. Her writing is calm and precise, but she doesn't mistake balance for neutrality.
More from The Steward →This Week's Edition
30 April 2026
133 articles
Related Articles
Related Articles
More Stories