news

Mallorca medical AI study finds trust is fragile

Responsible for this content: Frank Menze

Mallorca researchers have found a weak point in medical AI: health professionals’ trust in it is fragile. The University of the Balearic Islands in Palma, Mallorca, reported on 17 November that it has developed a way to test that trust with Son Espases University Hospital and international partners.

Archivo - Un profesional trabaja con un ordenador.
Europa Press

The method looks at AI systems that explain their predictions, known as explainable artificial intelligence (XAI). It compares whether a prediction is right with whether a person trusts the explanation. That can reveal misplaced trust in a wrong prediction — or a correct prediction that someone rejects.

The team tested the method in several studies, including medical applications using chest X-rays to help diagnose pneumonia associated with Covid-19. It found that health professionals’ trust depends on both the quality of an AI system’s explanations and the accuracy of its predictions. The researchers say the method could help make AI systems more reliable for use in healthcare.

Topics: Health

Source: Europa Press / Mallorca.com

We use cookies to provide you with the best possible experience on our website. Learn more in our Privacy Policy