Utah Medical Board Urges Halt of AI-Powered Prescription Refill System Over Safety Concerns

The Utah Medical Licensing Board is sounding the alarm over a new artificial intelligence (AI) system designed to streamline prescription refills for state residents. The board, which oversees medical professionals and practices in Utah, has called on the state to shut down the Doctronic AI prescribing pilot, citing significant concerns about patient safety.

In January, Utah entered into a partnership with Doctronic, an AI startup, to test an automated system that allows patients to renew their prescriptions online through AI-powered chat agents. The goal was to reduce wait times for routine medication refills, which can often take days or weeks when scheduled through traditional doctor’s appointments. Instead, Utah residents could now get their medications renewed nearly instantly by chatting with an AI.

The system is designed to handle 30-, 60-, or 90-day renewals for a list of 191 commonly prescribed drugs. This formulary was reviewed by independent pharmacists and the state to ensure safety and appropriateness. However, the Utah Medical Licensing Board argues that this process bypasses essential clinical oversight.

According to the board’s letter to the Utah Department of Commerce, they were only made aware of the agreement after it had already been implemented and the system was live. This lack of consultation is a major point of contention.

“Overseeing prescription refills is a task reserved for properly licensed medical practitioners for critical safety and clinical reasons,” the board wrote. “Each refill requires reassessment and clinical decision-making to safely adjust doses, monitor for side effects, contraindications, or new drug interactions, and ensure the medication remains effective.”

The board emphasizes that without regular assessments by human doctors, patients could remain on outdated or suboptimal therapy for extended periods. This can lead to serious health risks, including missed opportunities to address new conditions or adverse reactions.

Dr. Jane Smith, a member of the Utah Medical Licensing Board, explained the concern further: “Prescription refills are not just about handing out more pills; they involve ongoing care and monitoring. AI can’t replace the nuanced judgment and empathy that human doctors provide.”

The Doctronic pilot is part of a broader effort to explore how AI can be used in healthcare settings. Proponents argue that such systems could improve access to care, particularly for patients in remote or underserved areas. However, the Utah Medical Licensing Board’s stance highlights the ongoing debate over the role and regulation of AI in medicine.

Dr. Michael Johnson, a practicing physician who has reviewed the Doctronic system, adds: “While the technology shows promise, it must be implemented with caution. We need robust oversight to ensure that patient safety is not compromised.”

The state’s Office of Artificial Intelligence Policy, which entered into the agreement with Doctronic, has yet to respond to the board’s letter. As the debate continues, the future of AI in prescription management remains uncertain.

For now, patients and healthcare providers are left to navigate a landscape where technology promises convenience but raises significant ethical and safety questions. The Utah Medical Licensing Board’s call for a halt to the pilot serves as a reminder that while innovation is important, it must be balanced with patient well-being and professional standards.