Deep learning-based methods for classification of microsatellite instability in endometrial cancer from HE-stained pathological images.

J Cancer Res Clin Oncol 2023 AI 6 Explanations View Original
Original Paper (PDF)

Unable to display PDF. Download it here or view on PMC.

Plain-English Explanations
Pages 1-2
MSI: A Critical Biomarker for Immunotherapy

Microsatellite instability (MSI) is a condition caused by defects in the DNA mismatch repair system - the cellular machinery that corrects errors introduced during DNA replication. When mismatch repair fails, short repetitive DNA sequences called microsatellites accumulate mutations at an elevated rate, a state called MSI-high (MSI-H). Tumors with intact repair are classified as microsatellite stable (MSS).

Endometrial cancer has the highest rate of MSI among all cancer types, with approximately 31% of cases showing MSI-H status. MSI is also the mechanism behind Lynch syndrome - an inherited disorder that dramatically elevates lifetime risks of endometrial and colorectal cancer. Current guidelines from both ESMO and the Manchester Consensus Group recommend MSI testing for all endometrial cancer patients.

The clinical importance of MSI has grown dramatically with the rise of immune checkpoint immunotherapy. MSI-H tumors express higher levels of PD-L1 on cancer cells, making them more responsive to PD-1 and PD-L1 blocking antibodies. In clinical trials, pembrolizumab and similar drugs have shown remarkable responses in patients with MSI-H endometrial cancer, making MSI status a direct guide to treatment selection.

Despite this importance, standard MSI testing methods - immunohistochemistry, polymerase chain reaction, and next-generation sequencing - are expensive, require specialized reagents and equipment, and demand significant laboratory personnel time. A faster and less costly alternative would enable routine testing across more clinical settings and potentially identify more patients who could benefit from immunotherapy.

TL;DR: MSI-H endometrial cancer responds to PD-1 immunotherapy, making MSI status a critical treatment-guiding biomarker, but conventional testing methods are costly and resource-intensive.
Pages 2-4
Three-Stage AI Classification Pipeline

The proposed system processes whole slide images through three sequential stages: data pre-processing that tiles the large slide into manageable patches, a tissue classifier that separates tumor tissue from normal and stromal tissue, and the MSI status classifier that predicts microsatellite status from tumor-containing patches only. Each stage feeds filtered output into the next.

The dataset consisted of 95 FFPE whole slide images from 95 endometrial cancer patients in the TCGA-UCEC cohort, with near-balanced classes: 47 MSI-H and 45 MSS cases. Slides were tessellated into 256 x 256 pixel tiles at 20x magnification, with an average of 16,000 tiles per slide. Tiles containing predominantly background or artifact were discarded, and only tumor epithelial tissue tiles were used for MSI classification.

The key innovation is the GRU-based Attention Module (GAM) added to a VGG16 backbone. Gated Recurrent Units (GRUs) are a type of recurrent neural network originally designed for sequential data. Here, GRU processes spatial feature maps from the convolutional layers to capture contextual relationships between different image regions, giving the model the ability to weight important areas more heavily than irrelevant background tissue.

For aggregating individual tile predictions into a single slide-level MSI classification, the study used the Bag of Words (BoW) method alongside simple mean probability averaging for comparison. BoW - originally a text processing technique - treats each slide as a document and the tile predictions as word frequencies, capturing the overall pattern of MSI-associated features across the whole slide rather than just averaging individual tile scores.

TL;DR: A VGG16 network enhanced with a GRU-based attention module classifies individual tissue tiles, and a Bag of Words aggregation method combines tile predictions into a slide-level MSI status prediction.
Pages 7-9
Model Performance and Technical Improvements

The tissue classifier - trained on a modified colorectal cancer dataset supplemented with endometrial cancer examples - achieved a validation accuracy of 99.4% in separating tumor epithelial tissue from stromal, adipose, and mucinous tissue. Pathologist review confirmed that the tissue boundaries were precisely identified, validating the quality of tumor region selection for the MSI classifier downstream.

The proposed GAM-VGG16 model significantly outperformed the baseline VGG16 for MSI classification: AUROC improved from 0.675 with the standard VGG16 to 0.799 with the attention-enhanced model. On the test set of 25 patients, the model achieved accuracy of 0.80, sensitivity of 0.857, precision of 0.80, and F1-score of 0.826 using the BoW aggregation method.

Stain normalization using the Reinhard method significantly improved performance by reducing color variability caused by differences in tissue preparation and staining protocols. Since H&E staining intensity can vary between slides prepared at different times or by different technicians, normalizing all slides to a reference color space helped the model focus on morphological features rather than staining artifacts.

Comparing aggregation methods, Bag of Words outperformed mean probability averaging on all metrics except AUROC (where they were comparable). Mean probability aggregation treats each tile equally, which can be misled by the large number of non-informative background tiles. BoW more effectively captures which tile types are specifically associated with MSI-H, giving greater weight to the most discriminative regions.

TL;DR: The attention-enhanced GAM-VGG16 achieved AUROC 0.799 and 80% accuracy for MSI classification, substantially outperforming baseline VGG16, with stain normalization and Bag of Words aggregation both contributing to improvement.
Pages 4-6
Attention Mechanisms for Histopathology

Attention mechanisms in deep learning are inspired by human visual attention - the cognitive ability to focus on the most relevant parts of an image while filtering out irrelevant details. In histopathology, this is particularly valuable because most of a tumor slide contains uninformative tissue, while the diagnostically meaningful features occupy only a small proportion of the total slide area.

The GRU-based Attention Module works by taking the feature maps produced by VGG16's convolutional layers and processing them through GRU units, which compare spatial features across different regions. The module outputs learned importance weights for each spatial location, which are then multiplied back into the feature maps to emphasize informative regions. Regions with high MSI-H probability features receive amplified representation in the final classification.

This approach captures spatial contextual information that fixed convolutional operations miss. For MSI classification, the morphological hallmark of MSI-H endometrial cancer is the presence of tumor-infiltrating lymphocytes and poorly differentiated tissue - features that are not uniformly distributed across the slide but cluster in specific areas. The attention module helps the network find and prioritize these clustered features.

Visualization through probability heatmaps makes the model's decisions interpretable to pathologists. By mapping each tile's MSI-H prediction probability back to its original location on the slide, the heatmap reveals which tissue regions drove the classification decision - with high-probability regions shown in red and low-probability in blue. This visual feedback helps clinicians understand and trust the AI's classification basis.

TL;DR: GRU-based attention weights spatially informative tumor regions more heavily during classification, while probability heatmaps make the model's decision regions visible and interpretable to pathologists.
Pages 1, 10
Clinical Value of Low-Cost MSI Screening

Deep learning MSI classification from H&E slides addresses a key clinical bottleneck: all endometrial cancer patients should be tested for MSI (per international guidelines) but current testing is expensive and complex. An AI tool that screens for MSI from already-existing diagnostic H&E slides could enable routine testing without adding laboratory costs, particularly benefiting patients at institutions without full molecular testing capabilities.

MSI testing serves two distinct clinical purposes: identifying Lynch syndrome (hereditary cancer predisposition requiring genetic counseling and surveillance of family members) and predicting immunotherapy response (pembrolizumab and other PD-1 inhibitors are specifically approved for MSI-H cancers). A cost-effective screening test could help ensure both applications are accessible to all patients.

The study notes that conventional MSI tests have their own failure rate: approximately 14% of patients fail standard testing due to insufficient DNA yield or poor DNA quality from the biopsy specimen, and false negatives occur when tumor cell purity falls below 30%. A histology-based AI test operates on different principles and could potentially supplement standard testing in ambiguous cases or serve as a first-pass screen.

The demonstrated accuracy of 80% and AUROC of 0.799 are promising but not yet sufficient for standalone clinical deployment. The authors frame this as a screening support tool rather than a replacement for confirmatory molecular testing. Larger multicenter validation studies with standardized staining protocols and more diverse patient populations are needed before clinical adoption.

TL;DR: AI-based MSI classification from H&E slides could enable affordable universal MSI testing in all endometrial cancer patients, supporting both Lynch syndrome detection and immunotherapy selection, but requires further validation.
Pages 10-11
Limitations and Path to Clinical Deployment

The primary limitation is the small dataset of 95 patients, all from TCGA. While the results are statistically compelling, deep learning models require large and diverse datasets to reliably generalize across the variation in staining protocols, scanner types, and tissue preparation methods found across different hospitals and countries.

The authors acknowledge that noisy training labels may affect classifier performance. The ground truth MSI labels used for training came from clinical molecular testing, which itself has error rates - particularly in cases with low tumor purity. A model trained on imperfect labels will inherit some of those errors, making true performance potentially higher or lower than reported metrics suggest.

Future work should combine pathological images with other data modalities. The authors note that metabolomics and genomics data can each independently predict endometrial cancer features, and integrating these with histopathology AI could provide more complete and reliable classification than any single approach. Multi-modal machine learning is an active research direction with significant potential for improving cancer diagnosis.

The approach represents a shift toward embedded molecular diagnostics - extracting genetic and molecular information from tissue structure rather than directly measuring DNA or protein. If validated in large prospective studies, this paradigm could fundamentally change how molecular subtypes are determined in cancer pathology, making precision medicine accessible in settings where molecular testing is currently impractical.

TL;DR: While dataset size and single-institution origin limit generalizability, this approach establishes a framework for cost-effective MSI screening that could eventually enable precision immunotherapy decisions at scale.
Citation: Open Access, 2023. Available at: PMC11797639.