open hands holding small cute robot surrounded by binary code

Image source: Adobe Stock/Production Perig

News • Interaction with cancer patients

Experts raise ethics concerns posed by patient-facing AI in oncology

Ready or not, patients with cancer are increasingly likely to find themselves interacting with artificial intelligence technologies to schedule appointments, monitor their health, learn about their disease and its treatment, find support, and more.

In a new paper in JCO Oncology Practice, bioethics researchers at Dana-Farber Cancer Institute call on medical societies, government leaders, clinicians, and researchers to work together to ensure AI-driven healthcare preserves patient autonomy and respects human dignity. 

The authors note that while AI has immense potential for expanding access to cancer care and improving the ability to detect, diagnose, and treat cancer, medical professionals and technology developers need to act now to prevent the technology from depersonalizing patient care and eroding relationships between patients and caregivers. While previous papers on AI in medicine have focused on its implications for oncology clinicians and AI researchers, the new paper is one of the first to address concerns about AI embedded in technology used by patients with cancer.  "To date, there has been little formal consideration of the impact of patient interactions with AI programs that haven't been vetted by clinicians or regulatory organizations," says the paper's lead author, Amar Kelkar, MD, a Stem Cell Transplantation Physician at Dana-Farber Cancer Institute. "We wanted to explore the ethical challenges of patient-facing AI in cancer, with a particular concern for its potential implications for human dignity."

Overdependence of AI could lead to impersonal care and diminished human touch, potentially eroding patient dignity and therapeutic relationships

Amar Kelkar et al.

As oncology clinicians and researchers have begun to harness AI – to help diagnose cancer and track tumor growth, predict treatment outcomes, or find patterns of occurrence – direct interface between patients and the technology has so far been relatively limited. That is expected to change. 

The authors focus on three areas in which patients are likely to engage with AI now or in the future. 

  • Telehealth, currently a platform for patient-to-clinician conversations, may use AI to shorten wait times and collect patient data before and after appointments. 
  • Remote monitoring of patients' health may be enhanced by AI systems that analyze information reported by patients themselves or collected by wearable devices. 
  • Health coaching can employ AI – including natural language models that mimic human interactions – to provide personalized health advice, education, and psychosocial support.

For all its potential in these areas, AI also poses a variety of ethical challenges, many of which have yet to be adequately addressed, the authors write. Telehealth and remote health monitoring, for example, pose inherent risks to confidentiality when patient data are collected by AI. And as autonomous health coaching programs become more human-like, there is a danger that actual humans will have less oversight of them, eliminating the person-to-person contact that has traditionally defined cancer medicine. 

The authors cite several principles to guide the development and adoption of AI in patient-facing situations – including human dignity, patient autonomy, equity and justice, regulatory oversight, and collaboration to ensure that AI-driven health care is ethically sound and equitable. "No matter how sophisticated, AI cannot achieve the empathy, compassion, and cultural comprehension possible with human caregivers," the authors assert. "Overdependence of AI could lead to impersonal care and diminished human touch, potentially eroding patient dignity and therapeutic relationships. To ensure patient autonomy, patients need to understand the limits of AI-generated recommendations, Kelkar says. "The opacity of some patient-facing AI algorithms can make it impossible to trace the 'thought process' that lead to a treatment recommendation. It needs to be clear whether a recommendation came from the patient's physician or from an algorithmic model raking through a vast amount of data." 

Recommended article


Article • Technology overview

Artificial intelligence (AI)

With the help of artificial intelligence, computers are to simulate human thought processes. Machine learning is intended to support almost all medical specialties. But what is going on inside an AI algorithm, what are its decisions based on? Can you even entrust a medical diagnosis to a machine? Clarifying these questions remains a central aspect of AI research and development.

Justice and equity require that AI models be trained on data reflecting the racial, ethnic, socioeconomic mix of the population as a whole, as opposed to many current models, which have been trained on historical data that overrepresent majority groups, Kelkar remarks. "It is important for oncology stakeholders to work together to ensure AI technology promotes patient autonomy and dignity rather than undermining it,” says senior author Gregory Abel, MD, MPH, Director of  the Older Adult Hematologic Malignancy Program at Dana-Farber and a member of Dana-Farber’s Population Sciences Division. 

The co-authors of the paper are Andrew Hantel, MD, Corey Cutler, MD, and Marilyn Hammer, PhD, DC, RN, FAAN, and Erica Koranteng, MBChB, MBE, all of Dana-Farber. 

Source: Dana-Farber Cancer Institute


Read all latest stories

Related articles


News • Prolonging life vs. maintaining functionality

Cancer treatment goals: patients and doctors often not on the same page

Prolonging life may not be a top priority for everyone: New research finds that patients with neuroendocrine tumours and their doctors often disagree when it comes to treatment goals.


Article • AI-based personalized medical care

I³lung: EU launches lung cancer initiative

This summer, The European Commission launched I3lung, a new research initiative as a part of Horizon Europe, the EU’s research and innovation program. This research initiative aims to create a…


News • AI approach to colorectal tumors

Deep learning identifies molecular patterns of cancer

A new AI platform can analyze genomic data extremely quickly, picking out key patterns to classify different types of colorectal tumors and improve the drug discovery process.

Related products

Subscribe to Newsletter