Hidden flaw in AI cancer diagnosis: how one overlooked step risks patient harm
A new study reveals that the way AI systems filter out background noise in pathology scans dramatically affects cancer diagnosis accuracy—yet this critical step is almost never reported or validated. For hospitals deploying AI tools to grade prostate cancer, the choice of filtering method could mean missed diagnoses, highlighting a gap in clinical AI oversight.
Originaltitel: The impact of tissue detection on diagnostic artificial intelligence algorithms in prostate digital pathology
Abstract Tissue detection is a crucial first step in most digital pathology applications. By applying image segmentation algorithms, all tissue is delineated and background discarded from further analyses, improving both computational efficiency and analytical results. Details of the segmentation algorithm are rarely reported, and there is a lack of studies investigating the downstream effects of a poor segmentation algorithm. Disregarding tissue detection quality could jeopardize patient safety if diagnostically relevant parts of the specimen are excluded from analysis in clinical applications. This study aims to determine whether performance of downstream tasks is sensitive to the tissue detection method, and to compare the performance of a classical and an AI-based tissue detection approach. To this end, we trained an AI model for Gleason grading of prostate cancer in whole slide images (WSIs) using two different tissue detection algorithms: thresholding (classical) and UNet++ (AI). A total of 33,823 WSIs scanned on seven digital pathology scanners were used to train the segmentation AI model. The downstream Gleason grading algorithm was trained and tested using 70,524 WSIs from 13 clinical sites scanned on 13 different scanners. On the slides where tissue could be detected by both algorithms, no significant difference in overall Gleason grading performance was observed. There was a decrease from 118 (0.43%) to 24 (0.09%) fully undetected tissue samples when switching from thresholding-based tissue detection to AI-based, suggesting this AI model may be more reliable than the classical model for avoiding total failures on slides with unusual appearance. Moreover, tissue detection dependent clinically significant variations in AI grading were observed in 3.5% of malignant slides, highlighting the role of tissue detection for optimal clinical performance of diagnostic AI.