Intelligent virtual assistants

Starting in the mid-1990’s, PACS technology revolutionised radiology departments. Now, some 20 years later, intelligent virtual assistant (IVA) technology is expected to do the same.

Jonathan Dreyer
Jonathan Dreyer

RSNA 2013 attendees at a business analytics scientific session received a tantalising glimpse of a product in development that marries artificial intelligence, natural language processing and speech recognition, all seamlessly interfaced to healthcare IT software.

Consumer versions of intelligent voice command technology developed by Nuance Communications (Burlington, MA) are currently used in smartphones and mobile tablets, for controlling televisions, and in some automobiles to initiate commands. In late 2014, or early 2015, Nuance plans to commercially introduce Florence, a virtual assistant for physicians named after Florence Nightingale, the world’s most influential nurse. One of its specialised applications will be for radiologists.

‘Virtual assistants will provide an intelligent layer between radiologists and the RIS or PACS they use,’ said Jonathan Dreyer, director of mobile solutions marketing for Nuance’s health care division. He explained that with the ability to actively listen, have the artificial intelligence to understand the contextual meaning of a request, and rapidly search multiple sources of data and information, virtual assistants would be able to streamline the process of information gathering that radiologists now must perform “manually” without automation using non-intuitive point-and-click software.

Florence is programmed with a conversational user interface to make interactions seem natural and human-like for its clinical users. In addition to “understanding” a verbal request for information, or command, to perform an action, Florence will be programmed to prompt for all necessary information, ask for clarification if needed, and identify/alert radiologists to obvious discrepancies.

IVA software will be designed to be interfaced with electronic health records, computerised physician order entry/clinical decision support software for ordering diagnostic imaging exams, laboratory information systems, and e-prescribing systems. IVAs will be able to access RIS/PACS as well as critical results reporting systems. At some point in their technology development, they may be able to search patient databases for critical information, such as previous cases with similar symptoms, outcomes data for patients with similar symptoms, relevant articles in peer-review journals, and electronic libraries of diagnostic images that may help a radiologist make a difficult diagnosis. IVAs are being designed to search for information within a patient’s medical record, navigate complex healthcare applications, identify missing data that is relevant to the verbal request made to it, and streamline end-to-end clinical documentation.

Jonathan Dreyer gave several examples of how the first commercial clinical virtual assistants for radiologists could be used to increase their productivity and performance. These included:

• Accessing prior reports and specific report content
• providing real-time insight on clinical guidelines
• reviewing a narrative report and determining if there are inconsistencies or information missing
• verbally navigating a PACS work list (i.e. show me all unread chest CT cases)
• streamlining transmission of critical, or unexpected, results to the ordering physician.

He also reported key findings of a survey of United States physicians that was commissioned by Nuance early in 2013. The top three roles that the respondents identified that they would like virtual assistants to do would be to provide accurate, real-time information to support patient care, alert them to missing information in patient records, and authenticate their identity by voice. The top five ways that doctors felt virtual assistants would change healthcare delivery would be by improving access to data and navigation within a patient’s electronic medical record, help navigate diagnosis and prescription options, improve communication among multiple healthcare providers, and improve follow-up communications with a patient, especially with respect to a patient discharge from a hospital.

In summary, 80% of the survey respondents felt that IVAs would drastically change healthcare by 2018 – and that’s less than five years away.
 

17.12.2013

Read all latest stories

Related articles

Photo

Enterprise imaging solution

Carestream reveals updates for Clinical Collaboration Platform at HIMSS 2019

Carestream Health will showcase its latest version of Vue Clinical Collaboration Platform at the HIMSS 2019 tradeshow (Booth #2741) being held February 11-15 in Orlando, Fla. The latest release of…

Photo

Digitalisation

National initiatives show limited success

Spain has powerful regional e-health projects, but implementing a national strategy remains a complicated task. Lack of interoperability and low resources slow down data sharing across 17 autonomous…

Photo

Transformation

The USA’s digital healthcare revolution

The digital revolution in healthcare in the United States is marching steadily forward, spurred by federal government regulations and financial incentives, by technological innovations, and by the…

Related products

Beckman Coulter – Remisol Advance

LIS, Middleware, POCT

Beckman Coulter – Remisol Advance

Beckman Coulter, Inc.
medigration – webConnect

Portal Solution

medigration – webConnect

medigration GmbH
Siemens Healthineers - CentraLink Data Management System

LIS, Middleware, POCT

Siemens Healthineers - CentraLink Data Management System

Siemens Healthineers
Agfa HealthCare – Dose

Dose Management Systems

Agfa HealthCare – Dose

Agfa HealthCare
Agfa HealthCare – DR 14e detector

DR Retrofit

Agfa HealthCare – DR 14e detector

Agfa HealthCare
Agfa HealthCare – DR 14s detector

DR Retrofit

Agfa HealthCare – DR 14s detector

Agfa HealthCare