The development of Artificial Intelligence has become part of the public consciousness more and more in recent months. Within the realm of healthcare, AI algorithms are already in use in some areas to diagnose and detect disease, predict outcomes and guide treatment. More and more research is being commissioned to look at newly developed apps harnessing AI to support speedier, more efficient practices in vast areas of medicine and AI is being used to accelerate drug discovery and identify potential new cures. The potential benefits of AI in all arenas of healthcare are manifold and its champions view the growth of AI as heralding an entirely new era for medical breakthroughs.
However, as with all seed changes throughout humanity, the dawn of AI has raised some difficult ethical questions and has magnified the disparities already apparent within healthcare. “One of the problems that’s been shown in AI in general and in particular for medicine is that these algorithms can be biased, meaning that they perform differently on different groups of people,” says Paul Yi, Director of the University of Maryland Medical Intelligent Imaging Center.
The preventable differences in disease burden, injury and access to healthcare disproportionately affecting people of colour and underserved communities has already been widely documented and studied. The problem now arising is whether the development of AI algorithms in healthcare will further widen these health disparities. The concerns about this are so grave that the WHO itself has called this month for caution when using AI for public healthcare, citing worries that the data used to train AI tools could be biased or misleading.
If the data used to train AI algorithms underrepresents a particular gender or ethnic group then the algorithm will not perform accurately, thus compounding already existent inequalities relating to socioeconomic status, ethnicity, gender or sexual orientation. “Algorithmic bias presents a clear risk of harm that… is often disproportionately distributed to marginalised populations,” says Benjamin Collins of Vanderbilt University Medical Center.
“To reduce bias in AI, developers, inventors and researchers of AI-based medical technologies need to consciously prepare for avoiding it by proactively improving the representation of certain populations in the dataset,” said Bertalan Meskó, Director of the Medical Futurist Institute in Budapest. The issue of bias in medical research is not a new one but with the advent of AI and its use within public healthcare these issues become more pronounced.
