4 N E W S & M A NAG E M E N T Transferring research into daily routine AI possibilities and probabilities Although some people foresee artificial intelligence easing medical workloads, many challenges arise before that dream can begin. Dr Felix Nensa and Dr Bram Stieltjes described such hurdles in an ‘Artificial Intelligence in Medical Imaging’ session held during a SITEM School Symposium in Bern, Switzerland. Report: Daniela Zimmermann Whilst artificial intelligence (AI) has potential, actually delivering that asset into routine medical practice remains a major challenge. Recently discussing ‘Translational AI – from bits to bedside’, radiologist Dr Felix Nensa, from Essen University Hospital in Germany, pointed to headlines that AI had helped to save lives, or that machines were suppos- edly better than radiologists. But, he noted, the tone of those headlines has been changing – indicating a peak in AI development. ‘Now,’ he said, ‘to get to a plateau of produc- tivity, we really need to be transla- tional. We need AI to do something useful for us.’ The hype around AI results from several decades of continuous expo- nential growth in computer hardware, the power of computers, and storage, which brings with it a lot of data. Is big data always big value? However, Nensa added: ‘You have to be careful not to equate big data with big value. Only if we have the ability to analyse this data does it turn into value. We are produc- ing more information but lagging behind in our ability to analyse this data. The big hope is that AI, or methods of machine learning, will help us close this gap and extract more value from our data.’ Sharing examples from radiology, he said decades of information from images had simply gone into archives and nothing further had been done with that valuable data. However, radiomics – among new C a y d a N / k c o t s r e t t u h S : e c r u o S buzzwords in radiology – is seeing information extracted from tumours, in terms of their shape and texture, with machine learning applied to the data to create predictive models or future treatment plans. A tumour’s N- or M-stage, he said, may be predicted by looking at a primary tumour. Or, for brain tumours, where there is reluctance to carry out a biopsy, machine learn- ing on PET-MRI data could be used to predict its mutational status. Yet, he still does not consider radiomics translational, because most methods need a manual tumour segmenta- tion, and there are also issues of standardisation, validation, and clini- cal acceptance. ‘Radiomics is inter- esting research-wise and we should go for it, but there is almost nothing Shaping your business success Daily clinical work means a wide variety of demands and challenges. We help you meet your needs by offering a solution tailored for your individual set-up. Ziehm Vision RFD Hybrid Edition* > Extend your capa bilities in cardiovascular surgery > Take your OR to the next level with a mobile hybrid solution > Start your hybrid procedure with zero room preparation > Reduce exposure significantly www.ziehm.com / RFDHE CMOSline represents a system configu- ration that is based on a Ziehm Imaging CMOS flat-panel detector. * Ziehm Vision RFD Hybrid Edition represents a group of optional hardware and software that creates an option package on the device named Ziehm Vision RFD. I see in five to ten years in clinical routine,’ Nensa said. At the centre for liver transplan- tation in Essen, he said a tool has been created to automatically segment the whole liver and pro- duce reports. He also outlined how machine learning can be used to predict how liver lobe will grow and predict future liver remnant in patients. A good machine learning model starts from a good question, he emphasised. ‘If you identify a clinical problem find what really needs improvement and then under- stand the problem and specify data, you can communicate that with data scientists, who can design a sys- tem. After that, it’s important to get these clinical models back to clini- cal routine early, to validate them.’ While the first try-out will probably not work that well, the process is repeated with further iteration to deliver a tool good enough to work in clinical routine. Nensa outlined the importance of medical informatics in translation and integrating tools into work- flows. ‘Medical informatics is needed to deploy AI tools into a hospital infrastructure because if it doesn’t work in the clinical routine, it’s worth nothing,’ he added. In bone analysis, for example, AI could be used to mimic a radiolo- gist’s workflow with stacked neural networks, harnessing the specialist’s knowledge of workflows into the data science for tools to work better. Is big data always big value? However, Nensa stressed that he does not think AI could or would replace radiologists or radiology. ‘Radiologists using these tools will get much more efficient much faster than those who reject them. In the end, radiologists who refuse to use these methods will be replaced – not by AI, but by other radiologists who do use these tools.’ On AI use theories recently dis- cussed at major radiology confer- ences, as well as the point about radiologists already operating at near capacity and needing new tech- nology to become more effective, he Directly after completing his final school exams, Felix Nensa freelanced as a software developer for the Research Institute for the Diagnosis and Treatment of Early Lung Cancer at the Augusta Hospital in Bochum. At that time he also took a distance learning degree course in IT (2000). His medical studies, at Ruhr University in Bochum (2001-2007), included two semesters at the University of Strasbourg in France. In 2011, Nensa became a registrar at the Institute for Diagnostic and Interventional Radiology and Neuroradiology at Essen University Hospital. He manages research projects on PET/MR, Cardio-MRI and DCEMRI. said: ‘That’s because we are getting more data every day and we cannot scale by just getting more efficient by ourselves, so we need tools to help us to scale and provide real- time diagnostic support.’ Rather than an autopilot, AI will be a co-pilot and leave radiologists to focus on vital tasks. It will not take jobs from radiologists, he confirmed, but will aid efficiency with routine tasks delegated to automation. ‘In the end,’ Nensa concluded, ‘we’ll have super-diagnostics, where all this information will come together and we, with the help of machines, will have oversight of all data, pro- viding better and more sophisticated real-time diagnostics. This is key to personalised medicine.’ Challenges to AI projects from Basel Dr Bram Stieltjes, University, outlined a range of challenges and hurdles involved in developing artificial intelligence projects in a clinical context. As Head of the university’s Research and Analysis Services Department, his presentation ‘AI in a clinical context; get ready to make your hands dirty!’, tempered expec- tations and focused on why AI in a medical context can be so difficult. He warned that a ‘huge over enthusiasm’ is circulating around medical data on what can be done in the context of AI. A key issue with machine learning is having sufficient information and items in reports, in the first place, to be able to extract meaningful information. In a significant proportion of cases, Stieltjes feels reports are incomplete. For structured reporting, he said, standard sentences must be a key element, but the aspect of ‘prob- ability’ is often overlooked, and its lack is a limitation. ‘Probability is the only way for us to know what you are thinking and the only way to use that data afterwards for a machine learning or AI project. If you do not add probability you are lost,’ he observed. Adding probability brings an extra dimension to reports and could help in future learning and thinking. ‘Recording medical think- ing like this not only helps to train algorithms but also to train doctors in a really quantitative way. ‘The whole structuring of medical data not only touches on training algorithms to replace what doctors do, but also trains doctors in a com- pletely different way.’ Bram Stieltjes MD PhD is VC of Research at the Department of Radiology of the University Hospital Basel and has recently formed a new department for research and analytical services in IT. In this role, he aims to integrate technical developments in physics and computer science into medical data science projects. His resident training is in radiology but he also had a year of training in child psychiatry and radiation oncology. He also headed a multidisciplinary group consist- ing of members from physics, medicine and informatics at the German Cancer Research Centre. There should also be a direct con- nection to the image. ‘Today, what you have with AI projects is that you are really looking for a needle in a haystack at best and sometimes, in searching for a needle, you just find hay.’ Within a healthcare setting, he said, clinical data is saved for clinical documentation without much con- sideration of research. ‘It’s relatively easy to find all the data points from one patient, but even the databases that control our clinical applica- tions are not built to find all similar patients, or all patients with the same exams.’ To create an effective machine learning application, he explained that auxiliary tools are needed that incorporate a risk element and tech- nical descriptions. Stieltjes’s team at Basel University reorganised their available data for research purposes and re-indexed technical exams in a re-think on the way they were deal- ing with data. Using the search engine for as many patients as possible who ful- filled their criteria, they could inves- tigate 12,000 MRI scans in 48 hours. ‘It’s a whole different way to work and enables interactive data inter- rogation and maybe drives the hos- pital infrastructure,’ he said. In a healthcare setting, he warned, there can be barriers to sharing data and acquiring it from other depart- ments for an AI project, and also pointed to disappointments in the length of time it takes to develop an AI project. Moving radiology – and other fields – to structured text has intrinsic limitations, he said. Obtaining good data will still not solve all the problems, especially the connection between text and image. However, in a scenario where all data created in a medical context is structured can help with modelling the data, and in making a virtual model of organs and predictions. ‘I think this highly depends on how seriously we take the data-driven organisation of medicine,’ Stieltjes said. ‘We shouldn’t organise our- selves around diseases, doctors and specialties; we should analyse what data elements are important for decision-making and how we get them.’ The focus should be more on the data stream, rather than what is necessarily most convenient for the clinician, he said. ‘If we can turn that thinking error around, I think we’ll see rapid progress. If we don’t, I think we’ll talk like this for decades.’ EUROPEAN HOSPITAL Vol 28 Issue 5/19