Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Aug 22:316:1098-1102.
doi: 10.3233/SHTI240602.

Improving Interpretability of Leucocyte Classification with Multimodal Network

Affiliations

Improving Interpretability of Leucocyte Classification with Multimodal Network

Manon Chossegros et al. Stud Health Technol Inform. .

Abstract

White blood cell classification plays a key role in the diagnosis of hematologic diseases. Models can perform classification either from images or based on morphological features. Image-based classification generally yields higher performance, but feature-based classification is more interpretable for clinicians. In this study, we employed a Multimodal neural network to classify white blood cells, utilizing a combination of images and morphological features. We compared this approach with image-only and feature-only training. While the highest performance was achieved with image-only training, the Multimodal model provided enhanced interpretability by the computation of SHAP values, and revealed crucial morphological features for biological characterization of the cells.

Keywords: Deep Learning; Machine Learning; Multimodal Classification; White Blood Cells.

PubMed Disclaimer

LinkOut - more resources