A clinician performing an echocardiogram of a patient's heart

Echocardiography is an important measure of heart health. It can diagnose heart abnormalities using dozens of images and videos to measure heart size, shape, ventricle thickness and more.

In a new study in JAMA researchers from the Yale School of Medicine and The University of Texas at Austin developed an AI tool that can accurately interpret echocardiograms in a matter of minutes.

“Echocardiography is a cornerstone of cardiovascular care, but it requires a tremendous amount of clinical time from highly skilled readers to review these studies,” said Rohan Khera, assistant professor of medicine and biostatistics and director of the Cardiovascular Data Science Lab (CarDS) at Yale. “We wanted to develop a technology that can assist these very busy echocardiographers to help improve accuracy and accelerate their workflow.”

The researchers found the AI tool, PanEcho, could perform 39 diagnostic tasks based on multi-view echocardiography and accurately detect conditions, like severe aortic stenosis, systolic dysfunction, left ventricle ejection fraction, among others. This study builds on previous publications, including a 2023 publication in the European Heart Journal, that demonstrated the technology’s accuracy.

“We developed a tool that integrates information from many views of the heart to automatically identify the key measurements and abnormalities that a cardiologist would include in a complete report,” said Greg Holste, a Ph.D. student at UT’s Chandra Family Department of Electrical and Computer Engineering, who is co-advised by Khera and Texas Engineering professor Zhangyang (Atlas) Wang.

PanEcho trained on 999,727 echocardiographic videos from January 2016 to June 2022 from Yale New Haven Health System (YNHHS) patients. Researchers validated the tool using studies from 5,130 YNHHS patients and three external data cohorts from the Heart and Vascular Center of Semmelweis University in Budapest, Hungary; Stanford University Hospital; and Stanford Health Care.

“The tool can now measure and assess a wide range of heart conditions, making it much more attractive for future clinical use,” says Evangelos K. Oikonomou, a clinical fellow in cardiovascular medicine at Yale and co-first author of the study. “While it is highly accurate, it can be less interpretable than the read from a clinician. It’s still an algorithm and it requires human oversight.”

Holste was responsible for processing the echocardiogram data, designing and developing the AI model and comparing its performance on unseen cases to human experts.

“This is a perfect example of what can happen when you put engineers and clinicians in the same room, giving them time to speak each other’s languages,” Holste said. “I have worked with (Khera) and (Oikonomou) since the beginning of my Ph.D., so we have an ease that I know can be difficult to come by. This is exactly the kind of interdisciplinary science I want to continue pushing forward with the rest of my career.”

The researchers made the model available via open source, and the team wants other investigators to test it with their echocardiographic studies to make improvements.

Read the full story from Yale School of Medicine, written by Rachel Martin