Primary bone tumor detection and classification in full-field bone radiographs via YOLO deep learning model

Abstract

Objectives: Automatic bone lesions detection and classifications present a critical challenge and are essential to support radiologists in making an accurate diagnosis of bone lesions. In this paper, we aimed to develop a novel deep learning model called You Only Look Once (YOLO) to handle detecting and classifying bone lesions on full-field radiographs with limited manual intervention.

Methods: In this retrospective study, we used 1085 bone tumor radiographs and 345 normal bone radiographs from two centers between January 2009 and December 2020 to train and test our YOLO deep learning (DL) model. The trained model detected bone lesions and then classified these radiographs into normal, benign, intermediate, or malignant types. The intersection over union (IoU) was used to assess the model's performance in the detection task. Confusion matrices and Cohen's kappa scores were used for evaluating classification performance. Two radiologists compared diagnostic performance with the trained model using the external validation set.

Results: In the detection task, the model achieved accuracies of 86.36% and 85.37% in the internal and external validation sets, respectively. In the DL model, radiologist 1 and radiologist 2 achieved Cohen's kappa scores of 0.8187, 0.7927, and 0.9077 for four-way classification in the external validation set, respectively. The YOLO DL model illustrated a significantly higher accuracy for intermediate bone tumor classification than radiologist 1 (95.73% vs 88.08%, p = 0.004).

Conclusions: The developed YOLO DL model could be used to assist radiologists at all stages of bone lesion detection and classification in full-field bone radiographs.

Key points: • YOLO DL model can automatically detect bone neoplasms from full-field radiographs in one shot and then simultaneously classify radiographs into normal, benign, intermediate, or malignant. • The dataset used in this retrospective study includes normal bone radiographs. • YOLO can detect even some challenging cases with small volumes.

Keywords: Bone neoplasms; Deep learning; Radiologists; Retrospective studies.