AI-annotated medical image showing enhanced tumour, tumour core and edema...
AI-annotated medical image showing enhanced tumour, tumour core and edema regions

Image source: Monash University

News • Algorithmic interaction

Medical imaging AI can ask another AI for "second opinion"

Researchers at Monash University have designed a new co-training AI algorithm for medical imaging that can effectively mimic the process of seeking a second opinion.

Published recently in Nature Machine Intelligence, the research addressed the limited availability of human annotated, or labelled, medical images by using an adversarial, or competitive, learning approach against unlabelled data. This research, by Monash University faculties of Engineering and IT, will advance the field of medical image analysis for radiologists and other health experts. 

PhD candidate Himashi Peiris of the Faculty of Engineering, said the research design had set out to create a competition between the two components of a "dual-view" AI system. “One part of the AI system tries to mimic how radiologists read medical images by labelling them, while the other part of the system judges the quality of the AI-generated labelled scans by benchmarking them against the limited labelled scans provided by radiologists,” said Ms Peiris. “Traditionally radiologists and other medical experts annotate, or label, medical scans by hand highlighting specific areas of interest, such as tumours or other lesions. These labels provide guidance or supervision for training AI models. “This method relies on the subjective interpretation of individuals, is time-consuming and prone to errors and extended waiting periods for patients seeking treatments.”

This enables AI models to make more informed decisions, validate their initial assessments, and uncover more accurate diagnoses and treatment decisions

Himashi Peiris

The availability of large-scale annotated medical image datasets is often limited, as it requires significant effort, time and expertise to annotate many images manually. The algorithm developed by the Monash researchers allows multiple AI models to leverage the unique advantages of labelled and unlabelled data, and learn from each other's predictions to help improve overall accuracy. 

“Across the three publicly accessible medical datasets, utilising a 10% labelled data setting, we achieved an average improvement of 3% compared to the most recent state-of-the-art approach under identical conditions,” said Ms Peiris. “Our algorithm has produced groundbreaking results in semi-supervised learning, surpassing previous state-of-the-art methods. It demonstrates remarkable performance even with limited annotations, unlike algorithms that rely on large volumes of annotated data. This enables AI models to make more informed decisions, validate their initial assessments, and uncover more accurate diagnoses and treatment decisions.” 

The next phase of the research will focus on expanding the application to work with different types of medical images and developing a dedicated end-to-end product that radiologists can use in their practices. 

Source: Monash University


Read all latest stories

Related articles


News • Research explores DBGAN method

AI fuses CT and MRI scans for better diagnostics

New research shows how AI can be used to fuse images from clinical X-ray CT and MRI scans to allow a clearer and more clinically useful interpretation of the images.


News • Coronavirus infection

AI shortcuts could lead to misdiagnosis of Covid-19

University of Washington researchers have discovered that AI models—like humans—have a tendency to look for shortcuts. In the case of AI-assisted disease detection, these shortcuts could lead to…


News • Optoacoustic imaging method RSOM

AI tells diabetes severity from the skin

Using AI and optoacoustic imaging, researchers have developed a new method to assess microvascular changes in the skin – and thus the severity of diabetes in the patient.

Related products

Subscribe to Newsletter