Discrimination of Breast Cancer with Microcalcifications on Mammography by Deep Learning

Scientific Reports 2016 Mammography AI 5 Explanations View Original
Original Paper (PDF)

Unable to display PDF. Download it here or view on PMC.

Plain-English Explanations
Pages 1-2
Why Microcalcifications Are Hard to Read

Microcalcifications are tiny calcium deposits between 0.1 and 1 mm in diameter that appear on mammograms as small bright specks. They are among the earliest visible signs of breast cancer and are especially important in detecting ductal carcinoma in situ (DCIS), which can have no palpable mass and no other visible finding on imaging.

Despite their diagnostic value, microcalcifications are notoriously difficult to interpret. Their small size, low contrast against surrounding breast tissue, and wide variability in shape and distribution make them challenging even for experienced radiologists -- and substantially harder for less experienced readers working through high volumes of screening studies.

Traditional machine learning methods such as support vector machines (SVM), k-nearest neighbor (KNN), and linear discriminant analysis (LDA) have been applied to automated microcalcification classification but are limited by the manual feature engineering they require. Identifying the right features takes substantial domain expertise, and the resulting models often fail to generalize across imaging systems and patient populations.

This study investigates whether a stacked denoising autoencoder (SAE) -- a form of deep learning that learns its own feature representations from data -- can outperform these established benchmark methods on a large clinical mammography dataset. It also tests, for the first time, whether combining microcalcification and breast mass features together improves classification accuracy beyond either feature type used alone.

TL;DR: Microcalcifications are critical but difficult to read, and this study tests whether deep learning can surpass traditional classifiers on a large clinical mammography dataset.
Pages 5-7
Dataset, Feature Extraction, and the SAE Architecture

The study used mammograms from 1,204 female patients histopathologically diagnosed with benign or malignant breast lesions at two Chinese medical institutions between 2011 and 2015. The dataset was divided into a training group of 1,000 patients and a test group of 204 patients. Lesions were confirmed by open surgical or fine needle biopsy, and patients were followed for at least two years before being classified as benign, ensuring high-quality ground truth labels.

Image segmentation was performed semi-automatically using a previously validated computerized approach to extract suspicious microcalcifications and masses from each mammogram. To avoid problems caused by image deformation, uneven illumination, and variable imaging angles, the researchers used extracted feature measurements rather than raw pixel images as model inputs.

Three analysis scenarios were compared: microcalcifications alone (15 features), breast masses alone (26 features), and a combined approach using all 41 features simultaneously. The 15 microcalcification features captured average diameter, area, density, circularity, solidity, spiculation, volume ratio, and mean gray value. The 26 mass features captured morphological, fractal, and texture properties including entropy, correlation, and energy from gray-level co-occurrence matrices.

The stacked autoencoder (SAE) deep learning model was constructed by stacking multiple autoencoders hierarchically. Each autoencoder layer learns to compress its input into a lower-dimensional hidden representation and then reconstruct the original input, with the goal of capturing the most informative latent structure. A softmax classifier was added to the top of the stacked network for final benign/malignant classification. Optimal network hyperparameters -- including hidden layer sizes of [200, 200] for single-feature scenarios and [400, 400] for the combined scenario -- were determined by 10-fold cross-validation on the training set.

TL;DR: The SAE deep learning model learned from 15 microcalcification and 26 mass features extracted from 1,204 biopsy-confirmed mammograms, tested across three increasingly comprehensive classification scenarios.
Pages 4-5
Deep Learning Outperforms Benchmarks in All Three Scenarios

In the first scenario using only microcalcification features, the SAE achieved 87.3% accuracy and an AUC of 0.87, outperforming SVM (85.8%), KNN (83.8%), and LDA (58.8%). The SAE also achieved the highest specificity (0.82), meaning it was better at correctly identifying benign lesions and avoiding unnecessary follow-up procedures.

In the second scenario using only breast mass features, all models performed substantially worse, with accuracies clustering around 61% across SVM, KNN, and SAE. The models showed very high sensitivity (nearly 100%) but extremely low specificity (around 0.26 for SAE), indicating they predicted almost every lesion as malignant. This confirms that mass features alone are insufficient for reliable breast cancer discrimination.

The third scenario -- the combinatorial approach using both microcalcification and mass features simultaneously -- produced the strongest results. The SAE achieved 89.7% accuracy and an AUC of 0.90, with specificity of 0.90. This represented a meaningful improvement over microcalcifications alone and over all benchmark methods, with SVM achieving only 85.8% accuracy on the same combined feature set.

The pattern of results across all three scenarios confirmed the study's central hypotheses: deep learning on large datasets outperforms traditional machine learning for microcalcification classification, and jointly analyzing microcalcifications and masses provides additional discriminative power beyond analyzing either alone.

TL;DR: The SAE achieved 89.7% accuracy using combined microcalcification and mass features, outperforming SVM, KNN, and LDA in all three tested scenarios.
Page 5
Why Combining Features Matters Clinically

The finding that masses alone yield only 61% accuracy -- barely above random for this dataset -- highlights an important clinical reality: breast masses are frequently ambiguous on mammography, and their features overlap substantially between benign and malignant lesions. Microcalcifications provide a more discriminative signal, and most of the system's diagnostic power comes from calcification analysis.

However, the consistent accuracy improvement from adding mass features to microcalcification features (from 87.3% to 89.7% for deep learning) demonstrates that even though masses are weak predictors on their own, they carry complementary information that reduces misclassifications when combined with calcification data. This reflects clinical practice, where radiologists integrate all visible abnormalities rather than examining features in isolation.

The study also notes that deep learning's advantage is particularly meaningful at scale. As datasets grow larger, deep learning models improve more rapidly than traditional methods because they can discover more complex, non-linear feature combinations from additional data. This learning curve advantage positions deep learning as increasingly competitive as mammography archives continue to expand.

Current limitations include a testing set of only 204 patients, which may lack sufficient statistical power for all subgroup analyses, and a feature set that may not yet comprehensively characterize all diagnostically relevant calcification properties. Expanding both the number of patients with breast masses and the feature set are identified as priority directions for improving the system.

TL;DR: Masses provide weak but complementary information to microcalcifications, and combining both feature types in a deep learning model captures the joint diagnostic reasoning of experienced radiologists.
Page 5
Practical Value and Future Directions

The study provides evidence that deep learning using a stacked autoencoder can serve as an effective computer-aided diagnosis tool for distinguishing malignant from benign breast lesions on mammography. By processing both microcalcification and mass features simultaneously, the system mimics the integrative analysis that skilled radiologists perform and achieves accuracy competitive with expert-level performance.

A key practical implication is the potential to assist less experienced radiologists who face the heaviest screening workload. A system that accurately flags suspicious microcalcification patterns could reduce missed diagnoses in high-volume settings where detailed expert review is not always feasible, particularly in health systems with radiologist shortages.

The study also demonstrates the value of large, histopathologically confirmed datasets for training deep learning models. With 1,204 biopsy-confirmed cases spanning 14 distinct pathological subtypes, the model was exposed to the full heterogeneity of real-world breast lesions rather than only idealized cases from curated research datasets.

Future directions include expanding the feature set to capture additional calcification properties, increasing the test cohort size to achieve higher statistical power, and prospectively validating the system in a clinical deployment environment. The authors also highlight the potential to extend the approach to other imaging modalities and to integrate the system into existing radiological reporting workflows.

TL;DR: A stacked autoencoder trained on biopsy-confirmed mammograms achieved near-expert accuracy in breast cancer classification, with the greatest gains coming from combining microcalcification and mass features together.
Citation: Open Access, 2016. Available at: PMC4895132.