In these representative reconstructed images, the column on the left represents...
In these representative reconstructed images, the column on the left represents ground truth and the column on the right shows a scanned image after AI denoising. In these examples, AI-based denoising methods reduced clinical usefulness by removing defects (top two rows, defects marked by yellow arrows) or introducing false defects (bottom two rows, defects marked by red arrows).

Image source: Washington University in St. Louis; image courtesy of Jha lab

News • Performance-based evaluation

Useful, not pretty: How AI can improve medical imaging

Medical imaging plays an essential role in diagnosis and treatment for an array of conditions. From X-rays to see a broken bone or a tooth cavity to SPECT scans for spotting heart defects, doctors use medical imaging to look inside the body, find disease and treat it appropriately. But what happens when those images aren’t clear?

Recent advances in artificial intelligence have opened the door to using AI-based methods for denoising, or cleaning up, medical images. However, before these tools can be used in clinical settings for real patient care, they need to be rigorously evaluated, said Abhinav Jha, assistant professor of biomedical engineering in the McKelvey School of Engineering and of radiology at Mallinckrodt Institute of Radiology (MIR) in the School of Medicine, both at Washington University in St. Louis. 

Rather alarmingly, while the visual-similarity-based metrics suggested that the AI-based denoising technique improved performance, it was actually having no significant impact, and in some cases, it was even degrading performance on clinical tasks

Abhinav Jha

In a study published in Medical Physics, Jha and collaborators at MIR evaluated a commonly used AI-based approach to denoise cardiac SPECT images. The team assessed the performance of the approach in two ways: How visually similar were denoised images to normal images and how well did the denoised image perform in the clinically relevant task of detecting heart defects? 

“Rather alarmingly, while the visual-similarity-based metrics suggested that the AI-based denoising technique improved performance, it was actually having no significant impact, and in some cases, it was even degrading performance on clinical tasks,” Jha said. “This emphasizes the important need for performing evaluation of AI algorithms on clinical tasks and not just relying on visual similarity as a measure of performance.”

In the study, first author Zitong Yu, a doctoral student in Jha’s lab, found that the AI denoising technique tended to smooth out cardiac SPECT images, which reduced noise as intended, but also reduced the contrast of the heart defect that doctors need to make accurate diagnoses. “This is precisely what we want to prevent from happening in actual medical practice,” Yu said.

Recommended article

The study advocates for task-based evaluation of AI-based denoising methods to assess the usefulness of AI-processed images. “Ensuring AI-based denoising works well for real clinical tasks – not just aesthetically – would mean big benefits for patients by producing high-quality images in less time or with reduced radiation doses,” said collaborator Robert J. Gropler, professor of radiology and senior vice chair and division director of radiological sciences at MIR. 

Jha and his team have been developing a new denoising technique along this direction, and their presentation on this topic received an honorable mention at the SPIE Medical Imaging meeting. Jha also led a multi-institutional, multi-agency team tasked with developing a framework for evaluating AI-based medical imaging methods. Their guidelines, Recommendations for Evaluation of AI for Nuclear Medicine (RELAINCE), were released in 2022 and informed this latest research. 


Source: Washington University in St. Louis

20.06.2023

Read all latest stories

Related articles

Photo

News • Chest X-ray evaluation

Human readers still outperform AI in lung disease identification

Reports of AI gaining the upper hand in diagnostic imaging interpretation are piling up, but there are still areas where the eye of a trained human radiologist remains superior.

Photo

News • Chest x-ray analysis

Lung cancer: High accuracy AI improves detection

Assistance from an AI algorithm with high diagnostic accuracy improved radiologist performance in detecting lung cancers on chest X-rays and increased human acceptance of AI suggestions.

Photo

News • Deep learning analysis of X-rays

AI used to triage patients with chest pain

Artificial intelligence (AI) may help improve care for patients who show up at the hospital with acute chest pain, according to a new study published in Radiology.

Related products

FDR EX-M1 AI box

Artificial Intelligence

Fujifilm · FDR EX-M1 AI box

FUJIFILM Europe GmbH
REiLI

Artificial Intelligence

Fujifilm · REiLI

FUJIFILM Europe GmbH
Advanced intelligent Clear-IQ Engine for MR

Artificial Intelligence

Canon · Advanced intelligent Clear-IQ Engine for MR

Canon Medical Systems Europe B.V.
AI-Rad Companion

Artificial Intelligence

Siemens Healthineers · AI-Rad Companion

Siemens Healthcare GmbH
Aquilion Exceed LB

Oncology CT

Canon · Aquilion Exceed LB

Canon Medical Systems Europe B.V.
Subscribe to Newsletter