AI With Built-In Uncertainty: Classifying Kidney Cancer Subtypes From CT Scans

J Imaging Inform Med 2025 AI 5 Explanations View Original
Original Paper (PDF)

Unable to display PDF. Download it here or view on PMC.

Plain-English Explanations
Page 1
Kidney Cancer Comes in Different Types - and Identifying Them Matters

Renal cell carcinoma (RCC) is not a single disease. The three most common subtypes - clear cell RCC (ccRCC), papillary RCC (pRCC), and chromophobe RCC (chRCC) - behave differently, respond differently to treatments, and carry different prognoses. Knowing which subtype a patient has is essential for choosing the right treatment.

Currently, determining the subtype requires a biopsy or surgery followed by pathology analysis under a microscope. This involves invasive procedures, time delays, and in some cases carries procedural risks. If an AI system could reliably identify the subtype from a CT scan alone - a non-invasive imaging test patients already receive - it could change clinical decision-making significantly.

This study developed a deep learning system for RCC subtype classification from CT images, with an important innovation: the model doesn't just give an answer, it also tells you how confident it is in that answer.

TL;DR: Kidney Cancer Comes in Different Types - and Identifying Them Matters
Pages 2-3
A 3D Neural Network That Knows When It's Uncertain

The researchers built a 3D convolutional neural network (CNN) that analyzes full volumetric CT scans of kidney tumors. Unlike 2D models that look at individual slices, a 3D model captures the full spatial structure of the tumor - its depth, shape, and texture across all dimensions.

The key innovation is the use of a Dirichlet distribution to model uncertainty. Most AI classifiers produce a probability - for example, "70% likely ccRCC" - but these probabilities can be misleadingly confident. The Dirichlet-based approach instead models the uncertainty about those probabilities themselves, allowing the system to say "I'm not very sure about this prediction" when the CT features are ambiguous or unusual.

The model was trained and evaluated using cross-validation - a rigorous approach where the data is split multiple ways to ensure the model's performance is consistent and not just lucky on one particular split.

TL;DR: A 3D Neural Network That Knows When It's Uncertain
Pages 4-6
Strong Performance Across All Three Subtypes

The model achieved high classification accuracy for all three RCC subtypes. In cross-validation testing, area under the curve (AUC) scores - a standard measure of classification performance where 1.0 is perfect - were 0.868 for ccRCC, 0.846 for pRCC, and 0.839 for chRCC. These are strong results, especially considering that classifying three subtypes simultaneously is more challenging than binary classification.

Critically, the uncertainty estimates proved meaningful. When the model expressed high uncertainty about a prediction, those cases had higher error rates - meaning the model was correctly "aware" of its own limitations. Conversely, when the model was confident, it was almost always right. This inverse relationship between uncertainty grade and error rate is exactly what you want in a clinical AI tool.

This uncertainty awareness is clinically valuable: cases flagged as "uncertain" by the AI could be prioritized for additional workup (such as biopsy), while high-confidence predictions might reduce the need for invasive procedures.

TL;DR: Strong Performance Across All Three Subtypes
Pages 7-8
Helping Doctors Prioritize Biopsies and Plan Treatment

The practical vision for this technology is to use it as a decision-support tool. Before a biopsy or surgery, the AI could analyze the CT scan and provide a probable subtype classification along with a confidence rating. High-confidence predictions might support non-invasive management planning, while uncertain cases would be flagged for tissue sampling.

This approach could be particularly helpful for patients who are elderly, have other health conditions that make biopsy risky, or present with tumors in locations difficult to safely biopsy. For these patients, a reliable non-invasive classification tool could meaningfully change their care pathway.

TL;DR: Helping Doctors Prioritize Biopsies and Plan Treatment
Pages 9-11
Uncertainty-Aware AI as a New Standard for Medical Imaging

Beyond kidney cancer, this work represents an important methodological advance in medical AI. Most deployed AI systems give predictions without communicating their confidence level, which can mislead clinicians into trusting incorrect predictions. By incorporating Dirichlet distribution-based uncertainty estimation, this model sets a higher standard: AI that knows what it doesn't know.

The authors envision this approach being integrated into radiology workflows, where the AI provides both a classification and a structured measure of certainty to guide clinical decision-making. Further prospective studies in diverse patient populations will be needed before clinical deployment.

TL;DR: Uncertainty-Aware AI as a New Standard for Medical Imaging
Citation: Open Access, 2025. Available at: PMC12092889.