Deep learning algorithm-based multimodal MRI radiomics and pathomics data improve prediction of bone metastases in primary prostate cancer

J Cancer Res Clin Oncol 2024 Deep Learning 7 Explanations View Original
Original Paper (PDF)

Unable to display PDF. Download it here or view on PMC.

Plain-English Explanations
Pages 1-2
Why Predicting Bone Metastases Early Matters

Bone metastasis -- the spread of prostate cancer cells into bones -- is one of the most serious and debilitating complications of advanced prostate cancer. Patients who develop bone metastases have a median survival of only 24 months and a mortality risk 1.5 times higher than those with only lymph node metastases.

Early bone metastases are particularly difficult to detect because they often cause no symptoms. By the time a patient experiences pain or fractures, the disease has typically progressed significantly. The standard tool for detecting bone metastases is a whole-body bone scan, but there are no clear clinical criteria defining exactly when this scan should be ordered.

Current approaches rely on clinical indicators such as PSA levels, Gleason score, body mass index, and the AAPR ratio (albumin to alkaline phosphatase), but these measures have poor sensitivity and specificity when used alone. A better approach would identify at-risk patients from data already collected at the time of primary diagnosis.

This study addresses that gap by integrating three types of data -- MRI radiomics (quantitative features extracted from scan images), deep transfer learning features (learned by AI from the same scans), and pathomics (quantitative features extracted from tissue biopsy slides) -- to build a predictive model for bone metastasis risk.

TL;DR: Bone metastasis from prostate cancer dramatically reduces survival and is often asymptomatic until advanced; this study builds an AI model to predict it early from imaging and tissue data.
Pages 2-5
Three Data Sources: Radiomics, Deep Learning, and Pathomics

Radiomics is the computational analysis of medical images to extract hundreds of quantitative features that describe tumor shape, texture, and intensity patterns invisible to the naked eye. In this study, radiomics features were extracted from three MRI sequences: T2-weighted imaging (T2WI), diffusion-weighted imaging (DWI), and apparent diffusion coefficient (ADC) maps. Together, these captured 2,553 radiomics features per patient.

Deep Transfer Learning (DTL) refers to using a neural network pre-trained on a large general dataset and then applying it to extract learned image representations from a new domain. The researchers used ResNet50, a powerful convolutional neural network, to extract 3,379 high-level features from the same MRI sequences. Unlike hand-engineered radiomics, these features are automatically learned by the network without human specification.

Pathomics applies the same computational approach to histopathology slides -- tissue sections stained with hematoxylin and eosin (H&E) and scanned digitally. For each patient, tissue patches were extracted from biopsy slides and processed using ResNet50 to yield 2,048 pathomics features per patch. These features describe the microscopic architecture of the tumor, including cell arrangement, nuclear patterns, and surrounding tissue structure.

To reduce the massive number of features to a usable set, the researchers applied LASSO regression, a mathematical technique that penalizes model complexity by shrinking irrelevant features to zero. This identified 44 radiomics features, 23 DTL features, and 13 pathomics features strongly associated with bone metastasis, across the original thousands.

TL;DR: The study combines MRI-derived radiomics, AI-extracted deep learning features, and tissue biopsy pathomics, using LASSO to narrow thousands of features to the most informative subset.
Pages 3-5
Study Design and Patient Population

The retrospective study enrolled 211 patients with confirmed prostate cancer from Gansu Provincial Hospital in China, diagnosed between January 2017 and February 2023. Patients were required to have MRI scans taken within 30 days of diagnosis, available tissue sections, and complete whole-body bone scan results. Of the 211 patients, 106 had confirmed bone metastases and 105 did not.

The cohort was split randomly in an 80:20 ratio into a training group (169 patients) and a validation group (42 patients). This division ensures the model is built on one subset and tested on another it has never encountered, providing an honest measure of generalizability.

MRI segmentation -- defining the tumor boundaries for feature extraction -- was performed by two experienced specialists: a radiologist and a urologist, both blinded to bone metastasis status. When the two disagreed on a boundary, a senior expert resolved the dispute. This blind, multi-reader approach helps ensure that the features reflect true tumor characteristics rather than observer bias.

Nine different machine learning classifiers were tested for each feature type, including Logistic Regression, Support Vector Machine (SVM), Naive Bayes, XGBoost, and others. The best-performing classifier was identified for each data type, then combined in the final integrated model.

TL;DR: 211 prostate cancer patients from a single institution were split 80:20 for model training and validation, with blinded tumor segmentation by two specialists and nine classifiers tested per data type.
Pages 6-8
Model Performance: Individual and Combined

Each data type performed well independently. The best radiomics model (SVM) achieved an AUC of 0.86. The best deep transfer learning model (Logistic Regression) achieved an AUC of 0.89. The best pathomics model (Naive Bayes) achieved an AUC of 0.85.

When all three data types were combined into a single integrated model, performance improved substantially. The combined multi-omics SVM model achieved an AUC of 0.93 (95% CI: 0.854-1.000), meaning the model correctly ranked 93% of patient pairs by metastasis risk. This is meaningfully better than any single modality alone and better than clinical-variable-only models from prior studies.

Calibration curves demonstrated that predicted probabilities closely matched actual outcomes for all models, and the combined model showed the best calibration. This means that when the model predicts a 70% probability of bone metastasis, approximately 70% of such patients actually have it -- a critical property for clinical trust.

Decision curve analysis (DCA) confirmed that all models, and especially the combined nomogram, provide meaningful net clinical benefit across a wide range of decision thresholds -- indicating the models would be genuinely useful in practice, not just theoretically accurate on benchmark metrics.

TL;DR: The combined radiomics plus deep learning plus pathomics model achieved an AUC of 0.93, substantially outperforming any single data modality and demonstrating good calibration and clinical utility.
Pages 8-11
Clinical Significance and Multi-Omics Context

If validated in larger cohorts, this model could be integrated into the routine workup of newly diagnosed prostate cancer patients. By estimating bone metastasis risk at the time of primary diagnosis, clinicians could stratify patients and reserve expensive whole-body bone scans for those most likely to benefit, while sparing low-risk patients from unnecessary procedures.

For high-risk patients identified by the model, earlier initiation of bone-protecting therapies (such as bisphosphonates or RANK ligand inhibitors) and systemic cancer treatments could improve quality of life and potentially extend survival. Earlier detection enables earlier intervention.

The study fits within a broader shift in oncology toward multi-omics -- integrating genomics, transcriptomics, proteomics, radiomics, and pathomics to understand cancer more completely. Prior work in colorectal and lung cancer has demonstrated that combining imaging and tissue features outperforms any single modality, and this study extends that finding to prostate cancer bone metastasis specifically.

The construction of a nomogram combining all three feature types with clinical risk factors makes the model practically usable in clinical settings, translating complex model output into a simple visual tool where clinicians can read off a patient's predicted risk from their individual measurements.

TL;DR: The model could guide early bone scan use and protective therapy initiation at the time of primary diagnosis, fitting into a broader multi-omics approach to personalized oncology.
Pages 8-11
Why Integration Works: ResNet50 and Multi-Omics Strength

The use of ResNet50 for feature extraction is a key architectural choice. Its skip connections prevent the vanishing gradient problem that limits training of deep networks, allowing it to learn highly complex image representations from both MRI scans and tissue slides. ResNet50 has proven effective across a wide range of medical imaging tasks including breast cancer, gastric cancer, and spinal metastasis detection.

The pathomics features extracted from tissue slides capture information about the tumor microenvironment -- the arrangement of cancer cells, blood vessels, immune cells, and connective tissue that surrounds the tumor. This microenvironment is increasingly recognized as a major driver of metastatic potential, meaning pathomics features carry biological information that MRI alone cannot provide.

Combining MRI-derived and tissue-derived features leverages the complementary nature of these data types. Radiomics describes the macroscopic imaging phenotype of the tumor, while pathomics captures the cellular and tissue-level biology. Together they provide a more complete picture of the tumor's characteristics and behavior than either source alone.

The study aligns with and extends prior work by Wang et al. and Zhang et al., who showed radiomics-clinical models for bone metastasis prediction in prostate cancer reaching AUCs of 0.84-0.87. The current study's combined model AUC of 0.93 represents a meaningful improvement, attributable directly to the inclusion of DTL and pathomics features.

TL;DR: ResNet50 extracts rich features from both MRI and tissue slides, and combining these complementary data sources provides a substantially more complete view of tumor behavior than any one modality alone.
Page 11
Limitations and Path Forward

The primary limitation of the study is its single-center, retrospective design with a relatively small sample of 211 patients. Models trained on data from a single institution may not generalize equally well to other hospitals with different patient demographics, imaging protocols, or tissue processing methods.

The pathology section analysis relied on manually selected representative tumor areas rather than whole-slide images (WSIs). WSI analysis would capture more of the tumor's spatial heterogeneity and could improve pathomics feature quality. The authors plan to collect annotated whole-slide images in future work.

The researchers plan to expand to a multi-center prospective study to provide stronger evidence of generalizability and to continuously refine the model as the deep learning algorithms improve. This iterative development approach -- common in clinical AI -- is essential before deployment in real patient care.

Despite these limitations, the combined model demonstrates strong predictive performance and good clinical utility, suggesting that integrating radiomics, DTL, and pathomics represents a genuinely promising direction for early prediction of bone metastasis in prostate cancer, with the potential to meaningfully change treatment planning for high-risk patients.

TL;DR: Single-center retrospective design limits generalizability, but the strong combined AUC of 0.93 and planned multi-center validation make this a promising approach for clinical translation.
Citation: Open Access, . Available at: PMC10844393.