Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024:14349:144-154.
doi: 10.1007/978-3-031-45676-3_15. Epub 2023 Oct 15.

Class-Balanced Deep Learning with Adaptive Vector Scaling Loss for Dementia Stage Detection

Affiliations

Class-Balanced Deep Learning with Adaptive Vector Scaling Loss for Dementia Stage Detection

Boning Tong et al. Mach Learn Med Imaging. 2024.

Abstract

Alzheimer's disease (AD) leads to irreversible cognitive decline, with Mild Cognitive Impairment (MCI) as its prodromal stage. Early detection of AD and related dementia is crucial for timely treatment and slowing disease progression. However, classifying cognitive normal (CN), MCI, and AD subjects using machine learning models faces class imbalance, necessitating the use of balanced accuracy as a suitable metric. To enhance model performance and balanced accuracy, we introduce a novel method called VS-Opt-Net. This approach incorporates the recently developed vector-scaling (VS) loss into a machine learning pipeline named STREAMLINE. Moreover, it employs Bayesian optimization for hyperparameter learning of both the model and loss function. VS-Opt-Net not only amplifies the contribution of minority examples in proportion to the imbalance level but also addresses the challenge of generalization in training deep networks. In our empirical study, we use MRI-based brain regional measurements as features to conduct the CN vs MCI and AD vs MCI binary classifications. We compare the balanced accuracy of our model with other machine learning models and deep neural network loss functions that also employ class-balanced strategies. Our findings demonstrate that after hyperparameter optimization, the deep neural network using the VS loss function substantially improves balanced accuracy. It also surpasses other models in performance on the AD dataset. Moreover, our feature importance analysis highlights VS-Opt-Net's ability to elucidate biomarker differences across dementia stages.

Keywords: Alzheimer’s Disease; Class-Balanced Deep Learning; Hyperparameter Optimization; Mild Cognitive Impairment; Neuroimaging.

PubMed Disclaimer

Figures

Fig. 1.
Fig. 1.
VS-Opt-Net integrates the VS loss [10] into the STREAMLINE [23] pipeline and employs Bayesian optimization to adaptively learn hyperparameters for both the model and loss function. In Step 3, the VS enlarges the margin of the minority class (m1) relative to the majority class’s margin (m2).
Fig. 2.
Fig. 2.
SHAP feature importance for DNNs with cross-entropy loss (a,c) and VS-Opt-Net (b,d). (a-b) Top regions for CN vs MCI classification. (c-d) Top regions for AD vs MCI classification. Each figure displays the top 10 features for each case.
Fig. 3.
Fig. 3.
Brain visualization of the leading 40 features for VS-Opt-Net. Colormap indicates SHAP feature importance; darker shades signify higher significance. Panels (a-d) reveal top features for CN vs MCI classification, while panels (e-h) showcase prime features for AD vs MCI classification. Notably, (a-c) and (e-g) spotlight regions of heightened importance in terms of volume, thickness, and surface area measures for both prediction categories. Panel (d) consolidates (a-c), while panel (h) amalgamates (e-g), displaying the highest importance value when a region encompasses multiple measurements.

Similar articles

Cited by

References

    1. Akiba T, Sano S, Yanase T, Ohta T, Koyama M: Optuna: A next-generation hyperparameter optimization framework. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. pp. 2623–2631 (2019)
    1. Association A, et al.: 2012 alzheimer’s disease facts and figures. Alzheimer’s & Dementia 8(2), 131–168 (2012) - PubMed
    1. Cao K, Wei C, Gaidon A, Arechiga N, Ma T: Learning imbalanced datasets with label-distribution-aware margin loss. Advances in neural information processing systems 32 (2019)
    1. De Santi S, de Leon MJ, Rusinek H, Convit A, Tarshish CY, Roche A, Tsui WH, Kandil E, Boppana M, Daisley K, et al.: Hippocampal formation glucose metabolism and volume losses in mci and ad. Neurobiology of aging 22(4), 529–539 (2001) - PubMed
    1. Du A, Schuff N, Amend D, Laakso M, Hsu Y, Jagust W, Yaffe K, Kramer J, Reed B, Norman D, et al.: Magnetic resonance imaging of the entorhinal cortex and hippocampus in mild cognitive impairment and alzheimer’s disease. Journal of Neurology, Neurosurgery & Psychiatry 71(4), 441–447 (2001) - PMC - PubMed

LinkOut - more resources