Classification of Skin Lesions into Seven Classes Using Transfer Learning with AlexNet

J Digit Imaging 2020 AI 6 Explanations View Original
Original Paper (PDF)

Unable to display PDF. Download it here or view on PMC.

Plain-English Explanations
Pages 1-2
AlexNet Transfer Learning Achieves State-of-the-Art 7-Class Skin Lesion Classification

Task and dataset: This study classifies dermoscopy images into seven distinct skin lesion categories using the ISIC 2018 HAM10000 dataset (10,015 images): melanoma, melanocytic nevi, basal cell carcinoma, actinic keratoses, benign keratosis-like lesions, dermatofibroma, and vascular lesions.

Architecture choice: Rather than using the largest or most complex modern CNN, the authors modify AlexNet - a relatively shallow 8-layer network from 2012 - with transfer learning. The hypothesis is that careful fine-tuning of a compact architecture can outperform larger models when data is limited.

Three augmentation experiments: The study runs three experiments with progressively richer data augmentation strategies to determine how augmentation affects performance on the severe class imbalance present in HAM10000 (nevi are heavily overrepresented).

Best result: The third experiment (most aggressive augmentation) achieved 98.7% accuracy, 95.6% sensitivity, and 99.27% specificity - outperforming published ensemble methods combining VGG and GoogleNet on the same dataset.

TL;DR: A modified AlexNet with transfer learning and strategic augmentation reached 98.7% accuracy on the 7-class ISIC 2018 HAM10000 dataset, outperforming larger ensemble models.
Pages 2-3
HAM10000: Seven Classes with Severe Imbalance

HAM10000 composition: The dataset contains 10,015 dermoscopy images across 7 classes. Melanocytic nevi dominate at 6,705 images (66.9%), while classes like dermatofibroma (115 images) and vascular lesions (142 images) are extremely underrepresented.

Clinical importance of minority classes: Despite their rarity in the dataset, accurate identification of melanoma (1,113 images) and basal cell carcinoma (514 images) is clinically critical. A model that defaults to predicting nevi would achieve high accuracy but would miss most cancers.

Imbalance handling strategy: The three experiments use increasing levels of augmentation to artificially balance training data. Experiment 3 applies the most aggressive oversampling of minority classes combined with augmentation transformations, dramatically improving sensitivity for rare classes.

Train/validation/test splits: The dataset was split 70/15/15 for training, validation, and testing. Care was taken to avoid patient-level data leakage (same patient's images appearing in both training and test sets), which can inflate reported accuracy in skin lesion studies.

TL;DR: HAM10000's severe class imbalance (nevi = 67% of images) makes melanoma and other rare class recall the true measure of model performance, not overall accuracy.
Pages 3-5
Modifying AlexNet for Medical Image Classification

AlexNet architecture: AlexNet consists of 5 convolutional layers followed by 3 fully connected layers, totaling approximately 60 million parameters. For this study, the final classification layer was replaced with a 7-output softmax layer matching the HAM10000 class structure.

Transfer learning strategy: The convolutional layers were initialized with weights pre-trained on ImageNet. The first few convolutional layers (which learn basic features like edges and textures) were frozen, while deeper layers and the new classification head were fine-tuned on dermoscopy images.

Three augmentation protocols: Experiment 1 used minimal augmentation (horizontal flips only). Experiment 2 added rotation and brightness adjustments. Experiment 3 applied the full suite: horizontal/vertical flips, rotations up to 40 degrees, brightness, contrast, saturation, and hue variations, plus oversampling of minority classes.

Optimization details: Adam optimizer with a learning rate of 0.0001 was used for all experiments. Categorical cross-entropy loss was applied with class weights inversely proportional to class frequency to penalize errors on rare classes more heavily.

TL;DR: A 7-output AlexNet with frozen low-level features and fine-tuned deeper layers was trained across three augmentation experiments, with the most aggressive protocol yielding the best minority-class sensitivity.
Pages 6-7
How Augmentation Progressively Improved Performance

Experiment 1 performance: Minimal augmentation (horizontal flips only) yielded 93.2% accuracy but low sensitivity for rare classes. Melanoma recall was only 78%, meaning nearly 1 in 4 melanomas was missed.

Experiment 2 improvement: Adding rotation and brightness augmentation improved melanoma recall to 88% and overall accuracy to 96.4%. The improvement was larger for minority classes, confirming that augmentation primarily benefits underrepresented categories.

Experiment 3 (best result): Full augmentation with minority class oversampling achieved 98.7% accuracy, 95.6% sensitivity (recall), and 99.27% specificity. Melanoma recall reached 94.3%, meaning fewer than 6% of melanomas were missed - a clinically important threshold.

Comparison to prior work: The authors report that this modified AlexNet outperformed published results from a VGG16+GoogleNet ensemble (94.8% accuracy) and several other deep learning models on the same HAM10000 test split, demonstrating that model architecture complexity is less important than training strategy.

TL;DR: Progressive augmentation improved melanoma recall from 78% to 94.3%, with the final model's 98.7% accuracy outperforming VGG+GoogleNet ensembles on the same dataset.
Pages 7-8
Efficient Architecture for Real-World Dermatology AI

Compact model advantage: AlexNet's relatively small parameter count means faster inference and lower memory requirements compared to VGG, ResNet, or EfficientNet variants. This makes deployment feasible on tablets or mobile dermoscopy devices in resource-limited settings.

Importance of 7-class vs. binary: Real clinical dermoscopy requires distinguishing multiple lesion types, not just melanoma vs. benign. A 7-class system that correctly identifies basal cell carcinoma, actinic keratoses, and other actionable conditions is more clinically useful than binary classifiers.

Augmentation as clinical tool: The study demonstrates that careful augmentation - not just model architecture - is a critical design choice for real-world medical AI. This insight is particularly valuable for rare conditions where large datasets are unavailable.

TL;DR: AlexNet's compact size makes it deployable on resource-limited hardware, and the study's key lesson is that augmentation strategy matters as much as architecture choice for rare skin condition detection.
Pages 8-10
Extending AlexNet Results to Clinical Practice

External validation missing: All results are from HAM10000, a single-source dataset with known characteristics. Performance on independent clinical datasets with more diverse image quality and patient demographics has not been tested.

AlexNet age and limitations: AlexNet was a breakthrough architecture in 2012 but lacks residual connections and modern training techniques. Applying the same augmentation strategy to EfficientNet or ConvNeXt backbones would likely achieve even higher performance.

Explainability for clinical trust: The model provides class probabilities but no visualization of which lesion features drove the prediction. Integrating Grad-CAM heatmaps would allow dermatologists to verify that predictions are based on clinically relevant features.

Real-world prospective testing: Retrospective benchmark performance consistently overestimates real-world accuracy due to distribution shift. Prospective trials with live clinical images are the necessary next step before regulatory submission.

TL;DR: Future work should apply the same augmentation strategy to modern architectures, validate on independent clinical datasets, and add explainability tools before clinical deployment.
Citation: Open Access, 2020. Available at: PMC7573031.