Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Aug;130(2):235-243.
doi: 10.1111/bju.15518. Epub 2021 Jul 5.

Urine cell image recognition using a deep-learning model for an automated slide evaluation system

Masatomo Kaneko  1 , Keisuke Tsuji  1 , Keiichi Masuda  2 , Kengo Ueno  2 , Kohei Henmi  2 , Shota Nakagawa  3 , Ryo Fujita  3 , Kensho Suzuki  3 , Yuichi Inoue  3 , Satoshi Teramukai  4 , Eiichi Konishi  5 , Tetsuro Takamatsu  6 , Osamu Ukimura  1
Affiliations

Urine cell image recognition using a deep-learning model for an automated slide evaluation system

Masatomo Kaneko et al. BJU Int. 2022 Aug.

Abstract

Objectives: To develop a classification system for urine cytology with artificial intelligence (AI) using a convolutional neural network algorithm that classifies urine cell images as negative (benign) or positive (atypical or malignant).

Patients and methods: We collected 195 urine cytology slides from consecutive patients with a histologically confirmed diagnosis of urothelial cancer (between January 2016 and December 2017). Two certified cytotechnologists independently evaluated and labelled each slide; 4637 cell images with concordant diagnoses were selected, including 3128 benign cells (negative), 398 atypical cells, and 1111 cells that were malignant or suspicious for malignancy (positive). This pathologically confirmed labelled dataset was used to represent the ground truth for AI training/validation/testing. Customized CutMix (CircleCut) and Refined Data Augmentation were used for image processing. The model architecture included EfficientNet B6 and Arcface. We used 80% of the data for training and validation (4:1 ratio) and 20% for testing. Model performance was evaluated with fivefold cross-validation. A receiver-operating characteristic (ROC) analysis was used to evaluate the binary classification model. Bayesian posterior probabilities for the AI performance measure (Y) and cytotechnologist performance measure (X) were compared.

Results: The area under the ROC curve was 0.99 (95% confidence interval [CI] 0.98-0.99), the highest accuracy was 95% (95% CI 94-97), sensitivity was 97% (95% CI 95-99), and specificity was 95% (95% CI 93-97). The accuracy of AI surpassed the highest level of cytotechnologists for the binary classification [Pr(Y > X) = 0.95]. AI achieved >90% accuracy for all cell subtypes. In the subgroup analysis based on the clinicopathological characteristics of patients who provided the test cells, the accuracy of AI ranged between 89% and 97%.

Conclusion: Our novel AI classification system for urine cytology successfully classified all cell subtypes with an accuracy of higher than 90%, and achieved diagnostic accuracy of malignancy superior to the highest level achieved by cytotechnologists.

Keywords: artificial intelligence; computer-assisted image recognition; deep learning; urine cytology; urothelial carcinoma.

PubMed Disclaimer

References

    1. Babjuk M, Burger M, Comperat E, Gontero P, Mostafid A. European association of urology-guidelines-non-muscle-invasive-bladder-cancer-TaT1-CIS-2018. http://uroweb.org/wp-content/uploads/EAU-Guidelines-Non-muscle-invasive-.... Accessed March 25, 2021
    1. Flaig TW, Spiess PE, Agarwal N et al. Bladder cancer, version 3.2020, NCCN clinical practice guidelines in oncology. J Natl Compr Cancer Netw 2020; 18: 329-54
    1. Yafi FA, Brimo F, Steinberg J, Aprikian AG, Tanguay S, Kassouf W. Prospective analysis of sensitivity and specificity of urinary cytology and other urinary biomarkers for bladder cancer. Urol Oncol 2015; 33: e25-31
    1. Blick CGT, Nazir SA, Mallett S et al. Evaluation of diagnostic strategies for bladder cancer using computed tomography (CT) urography, flexible cystoscopy and voided urine cytology: Results for 778 patients from a hospital haematuria clinic. BJU Int 2012; 110: 84-94
    1. Raitanen MP, Aine R, Rintala E et al. Differences between local and review urinary cytology in diagnosis of bladder cancer. an interobserver multicenter analysis. Eur Urol 2002; 41: 284-9

LinkOut - more resources