Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Jun 9;11(7):3673-3683.
doi: 10.1364/BOE.394772. eCollection 2020 Jul 1.

Fluorescence imaging and Raman spectroscopy applied for the accurate diagnosis of breast cancer with deep learning algorithms

Lin-Wei Shang  1 , Dan-Ying Ma  1 , Juan-Juan Fu  1 , Yan-Fei Lu  1 , Yuan Zhao  1 , Xin-Yu Xu  2 , Jian-Hua Yin  1
Affiliations

Fluorescence imaging and Raman spectroscopy applied for the accurate diagnosis of breast cancer with deep learning algorithms

Lin-Wei Shang et al. Biomed Opt Express. .

Abstract

Deep learning is usually combined with a single detection technique in the field of disease diagnosis. This study focused on simultaneously combining deep learning with multiple detection technologies, fluorescence imaging and Raman spectroscopy, for breast cancer diagnosis. A number of fluorescence images and Raman spectra were collected from breast tissue sections of 14 patients. Pseudo-color enhancement algorithm and a convolutional neural network were applied to the fluorescence image processing, so that the discriminant accuracy of test sets, 88.61%, was obtained. Two different BP-neural networks were applied to the Raman spectra that mainly comprised collagen and lipid, so that the discriminant accuracy of 95.33% and 98.67% of test sets were gotten, respectively. Then the discriminant results of fluorescence images and Raman spectra were counted and arranged into a characteristic variable matrix to predict the breast tissue samples with partial least squares (PLS) algorithm. As a result, the predictions of all samples are correct, with minor error of predictive value. This study proves that deep learning algorithms can be applied into multiple diagnostic optics/spectroscopy techniques simultaneously to improve the accuracy in disease diagnosis.

PubMed Disclaimer

Conflict of interest statement

The authors declare that there are no conflicts of interest related to this article.

Figures

Fig. 1.
Fig. 1.
The schematic diagram of excitation and collection light paths in home-made micro Raman spectrometer.
Fig. 2.
Fig. 2.
(a) The steps and results of the pseudo-color enhancement and (b) the modified parts of the GoogLeNet (contained in the dotted line).
Fig. 3.
Fig. 3.
(a) Discriminant accuracy curves of the training sets (blue curve) and validation sets (black scatter) in training process. (b) loss function curves of the training sets (red curve) and validation sets (black scatter) in training process. (c) The receiver operating characteristic curve of the test sets.
Fig. 4.
Fig. 4.
Visible light photo of breast tissue section (150-µm thickness) under (a) 5x and (b) 20x objective lens. The positions marked as A and B in (b) represent the extracellular matrix and the globose structures in the section, respectively. (c) Average spectra of collagen and lipid collected from the ECM and the globose structures, respectively. (d) Schematic diagrams of the structure of BP-neural networks for collagen and (e) lipid.
Fig. 5.
Fig. 5.
Mean squared error curves of (a) collagen and (b) lipid. The two curves in either graph correspond to training sets (blue curve) and validation sets (red curve), respectively. Receiver operating characteristic curve of (c) collagen and (d) lipid.
Fig. 6.
Fig. 6.
Predictive value of the breast samples with the PLS model. The dashed line represents the threshold of 1.5.
See this image and copyright information in PMC

References

    1. Rosen E. L., Eubank W. B., Mankoff D. A., “FDG PET, PET/CT, and Breast Cancer Imaging,” RadioGraphics 27(suppl_1), S215–S229 (2007). 10.1148/rg.27si075517 - DOI - PubMed
    1. Turnbull L., Brown S., Harvey I., Olivier C., Drew P., Napp V., Hanby A., Brown J., “Comparative effectiveness of MRI in breast cancer (COMICE) trial: a randomised controlled trial,” The Lancet 375(9714), 563–571 (2010). 10.1016/S0140-6736(09)62070-5 - DOI - PubMed
    1. Kovama Y., Yoshizawa M., Manba N., Hasegawa M., Hatakeyama K., “The frozen section is superior to imprint cytology for intraoperative diagnosis of sentinel node biopsy for breast cancer,” Eur. J. Cancer Suppl. 6(7), 151 (2008). 10.1016/S1359-6349(08)70664-5 - DOI
    1. Elston C. W., “Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up,” Histopathology 19(5), 403–410 (1991). 10.1111/j.1365-2559.1991.tb00229.x - DOI - PubMed
    1. Kurosumi M., “Recent trends in pathological diagnosis of breast cancer,” J. Nihon rinsho. 64(3), 451–460 (2006). - PubMed

LinkOut - more resources