Artificial intelligence-based diagnostic and treatment recommendations outperformed human physicians in an Israeli study released on Tuesday, suggesting that AI could serve as a valuable decision-support tool in medical practice, particularly in virtual urgent care settings, according to The Press Service of Israel (TPS-IL).

The study, led by Prof. Dan Zeltzer, a digital health expert from Tel Aviv University’s Berglas School of Economics, was conducted at Cedars-Sinai Connect, a virtual urgent care clinic in Los Angeles. The clinic, operated in collaboration with Israeli startup K Health, offers telemedicine consultations, integrating an AI system into its workflow to assist doctors in diagnosing and treating patients.

The findings were published in the peer-reviewed Annals of Internal Medicine and presented at the American College of Physicians (ACP) annual conference.

“Recently, Cedars-Sinai integrated an AI system that uses machine learning to conduct initial patient intake, incorporating medical record data and providing physicians with detailed diagnostic and treatment suggestions,” Zeltzer explained. “The system offers recommendations only when its confidence level is high, with no suggestions in about one in five cases.”

The study evaluated 461 online clinic visits over the summer of 2024, focusing on adult patients with common symptoms such as respiratory, urinary, eye, vaginal, and dental issues. In each case, the AI system provided initial recommendations, followed by a video consultation with a physician. A panel of four experienced doctors then reviewed and rated the recommendations based on a four-point scale: optimal, reasonable, inadequate, or potentially harmful.

The results were striking: AI recommendations were rated as optimal in 77% of cases, compared to 67% of the physicians’ decisions. Furthermore, only 2.8% of AI suggestions were rated as potentially harmful, while 4.6% of the physicians’ decisions fell into the same category. In 68% of cases, the AI and physician received the same score, but in 21% of cases, the AI’s recommendation was rated higher, and in 11% of cases, the physician’s decision was deemed superior.

The study’s evaluators noted several reasons why the AI system outperformed human physicians. One key factor was that the AI adhered more strictly to medical association guidelines, such as avoiding unnecessary prescriptions, like antibiotics for viral infections. Additionally, the AI was able to process a wider range of data from patients’ medical histories, identifying recurring conditions and recognizing symptoms that could signal more serious health issues. For example, the AI was particularly effective in identifying eye pain in contact lens users, which could indicate a potential infection.