Weakly Supervised Deep Learning to Predict Recurrence in Low-Grade Endometrial Cancer from Multiplexed Immunofluorescence Images

NPJ Digit Med 2023 AI 6 Explanations View Original
Original Paper (PDF)

Unable to display PDF. Download it here or view on PMC.

Plain-English Explanations
Pages 1-2
The Challenge of Predicting Recurrence in Low-Grade Endometrial Cancer

Most endometrial cancers are caught early and treated successfully with surgery. However, approximately 15-20% of patients experience recurrence - cancer returning after initial treatment - and recurrence is often fatal. Identifying which patients will relapse before it happens would allow clinicians to intensify treatment early for those at highest risk while sparing low-risk patients from aggressive adjuvant therapy and its side effects.

Current recurrence prediction relies on surgical staging, tumor grade, depth of invasion, and increasingly on molecular subtypes - genetic categories based on tumor mutation profiles. The main molecular subtypes (POLE-mutated, MMR-deficient, copy number high, and no specific molecular profile) have different prognoses. However, even within these categories, recurrence risk varies, and many low-grade tumors that appear molecularly favorable still recur.

This study proposed a different approach: instead of genetic markers, examine the tumor microenvironment (TME) - the complex cellular ecosystem surrounding and infiltrating the tumor, including immune cells, stromal cells, and their spatial relationships. The hypothesis was that the spatial organization of the TME, captured through imaging, contains prognostic information not captured by molecular subtyping alone.

TL;DR: 15-20% of endometrial cancer patients experience recurrence. This study explored whether deep learning analysis of tumor microenvironment spatial patterns - rather than genetics alone - could predict which low-grade patients would relapse.
Pages 2-4
Multiplexed Immunofluorescence and the NaroNet Framework

The study used multiplexed immunofluorescence (mIF) imaging - a technique that simultaneously labels multiple proteins in the same tissue section with different fluorescent colors. This enabled visualization of tumor cells, T cells (CD3, CD8), macrophages (CD68), B cells (CD20), and stromal cells all at once, mapping their spatial distribution within each tumor sample. The dataset comprised 250 patients with 489 tissue microarray (TMA) cores - small circular punches of representative tumor tissue.

Image analysis used the NaroNet framework (Neighborhood Analysis through Recursive Optimization of Neighborhoods), a weakly supervised deep learning approach. The key distinction of weakly supervised learning: rather than requiring an expert to label individual cells or tissue regions (which is extremely labor-intensive), the model receives only the patient-level outcome label (recurrence or no recurrence) and learns on its own which spatial patterns are associated with outcomes.

NaroNet learns to recognize cellular neighborhoods - recurring spatial patterns of how different cell types arrange themselves in relation to each other - and then identifies which neighborhoods are most associated with recurrence risk. This bottom-up, data-driven approach discovers relevant tissue patterns without requiring a priori hypothesis about which immune cell arrangements matter.

TL;DR: 250 patients' TMA cores were analyzed with multiplexed immunofluorescence imaging, and the NaroNet weakly supervised deep learning framework learned which tumor microenvironment spatial patterns predict recurrence.
Pages 4-6
Model Performance vs. Molecular Subtyping

NaroNet achieved an AUC of 0.90 (95% CI: 0.83-0.95) for predicting recurrence in the validation cohort - meaning the model correctly distinguished patients who would relapse from those who would not in 90% of cases. Reproducibility analysis showed 96.8% concordance between predictions from different TMA cores of the same patient, confirming that the model extracts stable biological signals rather than reflecting core-sampling artifacts.

Critically, NaroNet significantly outperformed molecular subtype models. The MMR deficiency model achieved AUC 0.79, and the POLE mutation model achieved AUC 0.78 - both substantially lower than NaroNet's 0.90. This demonstrates that TME spatial organization contains distinct and superior prognostic information compared to the tumor's genetic mutation profile alone.

The model also performed well on the specific subgroup of interest: low-grade endometrioid tumors without obvious high-risk molecular features. These are precisely the patients where current tools are least helpful, and where better prediction would have the most clinical impact. The ability to identify high-risk patients within what appears to be a low-risk molecular category is the study's most clinically significant contribution.

TL;DR: NaroNet achieved AUC 0.90 for recurrence prediction, outperforming molecular subtype models (AUC 0.78-0.79), and showed strong performance specifically in clinically ambiguous low-grade tumors.
Pages 6-8
Hot and Cold Tumors: What the TME Predicts

Interpretability analysis revealed that NaroNet had learned to distinguish two broad tumor microenvironment phenotypes with dramatically different prognostic implications. "Hot" tumors (tissue area types A2/A3) were characterized by dense immune infiltration - high numbers of CD8+ cytotoxic T cells and CD3+ T cells organized in close proximity to tumor cells. These patients had no recurrences in the study cohort.

"Cold" tumors (tissue area types A1/A4) showed immune exclusion or desert patterns - few infiltrating immune cells, dominated by stroma or tumor cells without immune accompaniment. These patients had the highest recurrence rates. This hot/cold distinction is well-established in cancer immunology as a determinant of response to treatment, but this study shows it can be quantified objectively from mIF images and used as a recurrence predictor specifically in low-grade endometrial cancer.

Beyond the simple hot/cold dichotomy, NaroNet also identified more subtle spatial neighborhood patterns - specific arrangements of macrophages relative to T cells, or T cell clusters at tumor-stroma borders - that contributed to the model's predictive performance. This spatial granularity goes beyond simply counting immune cells, capturing information about how they are organized.

TL;DR: Hot tumors (dense immune infiltration) had no recurrences while cold tumors (immune exclusion) had the highest recurrence rates, with NaroNet capturing both gross and subtle spatial neighborhood patterns contributing to prediction.
Pages 8-10
Why Spatial Context Beats Simple Cell Counts

A key insight from this study is that spatial organization matters more than raw cell counts. Two tumors might have similar numbers of CD8+ T cells, but if in one tumor they are clustered at the invasive front attacking tumor cells while in the other they are excluded to the periphery, these represent fundamentally different immunological situations with different outcomes. NaroNet captures these spatial relationships in a way that simple marker quantification cannot.

This spatial awareness also explains why NaroNet outperforms molecular subtyping. Molecular subtypes describe the tumor's genetics, but the TME represents the immune system's response to those genetics - an integrative readout of both tumor biology and host immune competence. A tumor that is molecularly favorable but fails to trigger immune recognition may behave more aggressively than a less favorable tumor that has been effectively recognized and constrained by the immune system.

The findings also have implications for immunotherapy decisions. Patients with cold TMEs - who are at highest recurrence risk - are also the most likely to benefit from immune checkpoint inhibitor therapy, which aims to convert cold tumors to hot ones by removing molecular brakes on immune activation. Thus NaroNet's recurrence prediction could simultaneously identify which patients need additional treatment and suggest what type.

TL;DR: Spatial immune cell organization outperforms simple counts and tumor genetics because it integrates both tumor biology and host immune response - and cold-tumor patients at highest recurrence risk are also most likely to benefit from immunotherapy.
Pages 11-15
Toward Routine TME-Based Prognostication

This study establishes weakly supervised deep learning on mIF images as a powerful and practical approach to TME-based prognostication in endometrial cancer. The 96.8% inter-core concordance means the approach is robust to tissue sampling variation, and the model's superior performance over established molecular biomarkers makes a compelling case for its clinical potential.

The practical barrier to widespread adoption is the requirement for multiplexed immunofluorescence imaging, which is more complex and expensive than standard single-antibody immunohistochemistry. However, mIF platforms are increasingly available at academic centers, and the cost trajectory is downward. The authors suggest that even a simplified panel of 3-4 key markers might preserve most of the model's predictive performance.

Looking ahead, integration of NaroNet-style TME analysis with molecular subtyping could create a comprehensive endometrial cancer risk classification that combines genetic tumor characteristics with immune microenvironment phenotype. Such an integrated classifier would be expected to outperform either approach alone and could guide personalized treatment allocation - identifying the small but important subgroup of low-grade endometrial cancer patients who need more than standard surgery.

TL;DR: Weakly supervised TME analysis outperforms molecular biomarkers for endometrial cancer recurrence prediction, and combining it with molecular subtyping could create a comprehensive risk classifier to guide personalized treatment.
Citation: Open Access, 2023. Available at: PMC10036616.