MRI Radiomics and Automated Machine Learning for RCC Fuhrman Grade Classification

Sci Rep 2020 AI 6 Explanations View Original
Original Paper (PDF)

Unable to display PDF. Download it here or view on PMC.

Plain-English Explanations
Pages 1-2
Fuhrman Grade and the Limits of Visual MRI Assessment

Fuhrman nuclear grading is the most widely used histopathological grading system for renal cell carcinoma, stratifying tumors from grade 1 (small uniform nuclei, favorable prognosis) through grade 4 (prominent nucleoli with extreme nuclear pleomorphism, poor prognosis). Accurate preoperative grading is clinically significant because it influences surgical approach, surveillance intensity, and eligibility for nephron-sparing surgery versus radical nephrectomy.

Standard MRI sequences including T2-weighted imaging and contrast-enhanced T1-weighted imaging provide excellent soft tissue contrast for renal mass characterization, but visual assessment of imaging features by radiologists for Fuhrman grade prediction has demonstrated limited and inconsistent diagnostic accuracy across studies. The difficulty arises because grade-associated cellular features such as nuclear size and nucleolar prominence are below the resolution of clinical MRI.

Quantitative radiomics offers the potential to extract tumor heterogeneity measures from MRI that encode microscopic architectural information indirectly reflected in macroscopic texture patterns. Combining radiomics with machine learning classification models could provide more reproducible and objective Fuhrman grade predictions than subjective radiologist assessment, but model performance must be validated across multiple independent institutions to demonstrate clinical generalizability.

TL;DR: Fuhrman grade is prognostically critical in RCC but difficult to predict preoperatively on MRI, motivating a radiomics and machine learning approach for objective classification.
Pages 2-4
Multi-Institutional Dataset and Feature Extraction Pipeline

The study assembled a multi-institutional dataset of 482 RCC lesions from five institutions: Hospital of the University of Pennsylvania (HUP), Mayo Clinic (MAY), St. Xavier Hospital (SXH), Presbyterian Homerton Hospital (PHH), and the TCIA public imaging archive. This multi-center design is critical for developing models that generalize across different MRI scanners, acquisition protocols, and institutional imaging practices.

Radiomic features were extracted from manually segmented tumor regions in two MRI sequences: T2-weighted imaging (T2WI) and contrast-enhanced T1-weighted imaging (T1C). The Pyradiomics software library was used to compute 3,087 radiomic features per lesion spanning shape, first-order statistics, gray-level co-occurrence matrix, gray-level run length matrix, gray-level size zone matrix, and wavelet-derived feature variants.

Thirteen feature selection methods were evaluated including minimum redundancy maximum relevance (mRMR), LASSO, principal component analysis, and several filter-based approaches. These selection methods were combined with 10 machine learning classifiers including support vector machine, random forest, k-nearest neighbors, naive Bayes, and Bayesian classifier. This comprehensive grid search across feature selection and classifier combinations was designed to identify the optimal pipeline for Fuhrman grade discrimination.

TL;DR: 3,087 MRI radiomic features were extracted from 482 lesions at five institutions, and 13 feature selection methods were combined with 10 classifiers in a systematic grid search.
Pages 4-6
Automated Machine Learning with TPOT

In addition to the hand-optimized radiomics pipeline, the study applied TPOT (Tree-Based Pipeline Optimization Tool), an automated machine learning (autoML) framework that uses genetic programming to search for optimal machine learning pipelines. TPOT systematically explores combinations of preprocessing steps, feature selection methods, and classifiers to identify a pipeline configuration that maximizes cross-validated classification performance without requiring manual hyperparameter tuning.

The best TPOT-identified pipeline selected a Random Forest classifier as the optimal model for Fuhrman grade classification from MRI radiomic features. Random Forest is an ensemble method that builds multiple decision trees on bootstrap samples of the training data and aggregates their predictions, providing inherent resistance to overfitting and the ability to estimate feature importance across the high-dimensional radiomic feature space.

TPOT autoML was applied to complement the hand-optimized pipeline search, providing an independent validation of feature selection and classifier choices through an algorithmic rather than manual optimization process. The use of autoML represents an increasingly important approach in radiomics research, reducing the risk of investigator bias in pipeline selection and enabling more reproducible comparisons across studies.

TL;DR: TPOT autoML independently searched the pipeline space and selected a Random Forest classifier as optimal for Fuhrman grade prediction from MRI radiomics.
Pages 5-7
Classification Performance in External Validation

External validation AUC performance was modest for both the hand-optimized and TPOT pipelines. The best hand-optimized pipeline combined Bayesian classifier with Fischer Score feature selection, achieving an external validation AUC of 0.59 with specificity of 0.86. The best TPOT pipeline using Random Forest achieved an external validation AUC of 0.60 with specificity of 0.97.

High specificity values observed for both optimal pipelines indicate that the models were conservative in predicting high Fuhrman grade, rarely misclassifying low-grade tumors as high-grade. However, the associated sensitivity values were correspondingly low, meaning many high-grade tumors were classified as low-grade. This tradeoff is partially attributable to the class imbalance in the dataset, where low-grade tumors outnumber high-grade tumors.

The external validation AUC values around 0.60 represent only marginally better performance than random prediction (AUC 0.50) and are substantially below the threshold typically considered clinically useful (AUC above 0.75). These results indicate that MRI radiomics alone, even with comprehensive feature extraction and systematic model optimization, provides insufficient discriminatory power for reliable Fuhrman grade prediction.

TL;DR: External validation AUC was 0.59 to 0.60 for both best-performing pipelines, indicating that MRI radiomics alone is insufficient for clinically reliable Fuhrman grade prediction.
Pages 7-8
Challenges in Multi-Center Radiomics Generalization

The gap between training performance and external validation AUC observed in this study is a common challenge in multicenter radiomics research. Radiomic features are sensitive to variations in MRI acquisition parameters including field strength, slice thickness, echo time, and reconstruction algorithms, which differ substantially across institutions and scanner vendors. Feature standardization and harmonization approaches such as ComBat or z-score normalization may partially mitigate these effects.

The inherently subjective nature of Fuhrman grading itself introduces label noise into the model training process, as interobserver variability among pathologists assigning grades to the same tumor has been documented in multiple studies. This grading inconsistency in the ground truth labels may limit the achievable predictive ceiling for any imaging-based prediction model, regardless of feature engineering quality.

The WHO/ISUP grading system, which replaced the traditional Fuhrman system as the recommended approach for RCC grading, may provide a more reproducible and clinically relevant target for radiomics prediction due to improved interobserver agreement. Future studies should evaluate radiomics models trained on WHO/ISUP grade categories rather than Fuhrman grades to determine whether improved label consistency translates to better model performance.

TL;DR: Scanner variability across institutions and interobserver variability in Fuhrman grading both limit achievable radiomic model performance in multi-center validation.
Page 8
Implications for MRI Radiomics in RCC Grading

This comprehensive multi-institutional study with systematic evaluation of 13 feature selection methods, 10 classifiers, and TPOT autoML establishes an important performance benchmark for MRI radiomics in RCC Fuhrman grade classification. The external validation AUC of approximately 0.60 suggests that current radiomics approaches face fundamental limitations for this specific prediction task that require addressing before clinical utility can be achieved.

Promising avenues for performance improvement include integration of radiomics features with deep learning features extracted from the same MRI images, as deep networks may capture spatially complex texture patterns not represented by hand-crafted radiomic descriptors. Multiparametric MRI incorporating diffusion-weighted imaging or dynamic contrast-enhanced perfusion sequences could also provide complementary biological information about tumor cellularity and vascularity.

The multi-institutional design of this study is a methodological strength that should be adopted as the standard for radiomics validation studies, as single-institution models have repeatedly shown performance degradation when applied to external data. The honest reporting of modest external validation performance in this work contributes important calibration information for the radiomics community regarding the realistic capabilities of current MRI-based grade prediction methods.

TL;DR: Comprehensive benchmarking reveals MRI radiomics achieves only AUC 0.60 for Fuhrman grade, indicating need for deep learning integration or multiparametric approaches to reach clinical utility.
Citation: Open Access, 2020. Available at: PMC7658976.