. 2022 Apr 6:9:832108.

doi: 10.3389/fmed.2022.832108. eCollection 2022.

A Machine Learning-Based Predictive Model for Predicting Lymph Node Metastasis in Patients With Ewing's Sarcoma

Wenle Li^{1

2}, Qian Zhou³, Wencai Liu⁴, Chan Xu^{3

5}, Zhi-Ri Tang⁶, Shengtao Dong⁷, Haosheng Wang⁸, Wanying Li², Kai Zhang^{1

2}, Rong Li⁹, Wenshi Zhang⁹, Zhaohui Hu¹⁰, Su Shibin¹¹, Qiang Liu², Sirui Kuang¹², Chengliang Yin¹²

Affiliations

¹ Department of Orthopedics, Xianyang Central Hospital, Xianyang, China.
² Clinical Medical Research Center, Xianyang Central Hospital, Xianyang, China.
³ Department of Respiratory and Critical Care Medicine, The First People's Hospital of Chongqing Liang Jiang New Area, Chongqing, China.
⁴ Department of Orthopaedic Surgery, The First Affiliated Hospital of Nanchang University, Nanchang, China.
⁵ Department of Dermatology, Xianyang Central Hospital, Xianyang, China.
⁶ School of Physics and Technology, Wuhan University, Wuhan, China.
⁷ Department of Spine Surgery, Second Affiliated Hospital of Dalian Medical University, Dalian, China.
⁸ Department of Orthopaedics, The Second Hospital of Jilin University, Changchun, China.
⁹ The First Clinical Medical College, Shaanxi University of Traditional Chinese Medicine, Xianyang, China.
¹⁰ Department of Spinal Surgery, Liuzhou People's Hospital, Liuzhou, China.
¹¹ Department of Business Management, Xiamen Bank, Xiamen, China.
¹² Faculty of Medicine, Macau University of Science and Technology, Macau, China.

PMID: 35463005
PMCID: PMC9020377
DOI: 10.3389/fmed.2022.832108

A Machine Learning-Based Predictive Model for Predicting Lymph Node Metastasis in Patients With Ewing's Sarcoma

Wenle Li et al. Front Med (Lausanne). 2022.

. 2022 Apr 6:9:832108.

doi: 10.3389/fmed.2022.832108. eCollection 2022.

Authors

Affiliations

¹ Department of Orthopedics, Xianyang Central Hospital, Xianyang, China.
² Clinical Medical Research Center, Xianyang Central Hospital, Xianyang, China.
³ Department of Respiratory and Critical Care Medicine, The First People's Hospital of Chongqing Liang Jiang New Area, Chongqing, China.
⁴ Department of Orthopaedic Surgery, The First Affiliated Hospital of Nanchang University, Nanchang, China.
⁵ Department of Dermatology, Xianyang Central Hospital, Xianyang, China.
⁶ School of Physics and Technology, Wuhan University, Wuhan, China.
⁷ Department of Spine Surgery, Second Affiliated Hospital of Dalian Medical University, Dalian, China.
⁸ Department of Orthopaedics, The Second Hospital of Jilin University, Changchun, China.
⁹ The First Clinical Medical College, Shaanxi University of Traditional Chinese Medicine, Xianyang, China.
¹⁰ Department of Spinal Surgery, Liuzhou People's Hospital, Liuzhou, China.
¹¹ Department of Business Management, Xiamen Bank, Xiamen, China.
¹² Faculty of Medicine, Macau University of Science and Technology, Macau, China.

PMID: 35463005
PMCID: PMC9020377
DOI: 10.3389/fmed.2022.832108

Abstract

Objective: In order to provide reference for clinicians and bring convenience to clinical work, we seeked to develop and validate a risk prediction model for lymph node metastasis (LNM) of Ewing's sarcoma (ES) based on machine learning (ML) algorithms.

Methods: Clinicopathological data of 923 ES patients from the Surveillance, Epidemiology, and End Results (SEER) database and 51 ES patients from multi-center external validation set were retrospectively collected. We applied ML algorithms to establish a risk prediction model. Model performance was checked using 10-fold cross-validation in the training set and receiver operating characteristic (ROC) curve analysis in external validation set. After determining the best model, a web-based calculator was made to promote the clinical application.

Results: LNM was confirmed or unable to evaluate in 13.86% (135 out of 974) ES patients. In multivariate logistic regression, race, T stage, M stage and lung metastases were independent predictors for LNM in ES. Six prediction models were established using random forest (RF), naive Bayes classifier (NBC), decision tree (DT), xgboost (XGB), gradient boosting machine (GBM), logistic regression (LR). In 10-fold cross-validation, the average area under curve (AUC) ranked from 0.705 to 0.764. In ROC curve analysis, AUC ranged from 0.612 to 0.727. The performance of the RF model ranked best. Accordingly, a web-based calculator was developed (https://share.streamlit.io/liuwencai2/es_lnm/main/es_lnm.py).

Conclusion: With the help of clinicopathological data, clinicians can better identify LNM in ES patients. Risk prediction models established in this study performed well, especially the RF model.

Keywords: Ewing sarcoma; SEER; lymph node metastasis; machine learning; multi-center; web calculator.

PubMed Disclaimer

Conflict of interest statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Figures

**FIGURE 1**
Ten-fold cross-validation of 6 ML algorithms for predicting LNM in patients with ES in the training set.

**FIGURE 2**
ROC curve analysis of 6 ML algorithms for predicting LNM in patients with ES in the validation set.

**FIGURE 3**
Relative importance ranking of each input variable for predicting models. **(A)** Random forest (RF). **(B)** Naive Bayes classifier (NBC). **(C)** Decision tree (DT). **(D)** Xgboost (XGB). **(E)** Gradient boosting machine (GBM). **(F)** Logistic regression (LR).

**FIGURE 4**
An example of the online calculator for predicting LNM in ES.

See this image and copyright information in PMC

Cited by

A machine learning-based model for predicting the risk of early-stage inguinal lymph node metastases in patients with squamous cell carcinoma of the penis.
Ding L, Zhang C, Wang K, Zhang Y, Wu C, Xia W, Li S, Li W, Wang J. Ding L, et al. Front Surg. 2023 Mar 17;10:1095545. doi: 10.3389/fsurg.2023.1095545. eCollection 2023. Front Surg. 2023. PMID: 37009612 Free PMC article.
Prediction model for hepatocellular carcinoma recurrence after hepatectomy: Machine learning-based development and interpretation study.
Liu R, Wu S, Yu HY, Zeng K, Liang Z, Li S, Hu Y, Yang Y, Ye L. Liu R, et al. Heliyon. 2023 Nov 19;9(11):e22458. doi: 10.1016/j.heliyon.2023.e22458. eCollection 2023 Nov. Heliyon. 2023. PMID: 38034691 Free PMC article.
Comparison of the effectiveness of different machine learning algorithms in predicting new fractures after PKP for osteoporotic vertebral compression fractures.
Ma Y, Lu Q, Yuan F, Chen H. Ma Y, et al. J Orthop Surg Res. 2023 Jan 23;18(1):62. doi: 10.1186/s13018-023-03551-9. J Orthop Surg Res. 2023. PMID: 36683045 Free PMC article.
A Machine Learning Algorithm for Predicting the Risk of Developing to M1b Stage of Patients With Germ Cell Testicular Cancer.
Ding L, Wang K, Zhang C, Zhang Y, Wang K, Li W, Wang J. Ding L, et al. Front Public Health. 2022 Jun 29;10:916513. doi: 10.3389/fpubh.2022.916513. eCollection 2022. Front Public Health. 2022. PMID: 35844840 Free PMC article.
Application of machine learning algorithm in prediction of lymph node metastasis in patients with intermediate and high-risk prostate cancer.
Wang X, Zhang X, Li H, Zhang M, Liu Y, Li X. Wang X, et al. J Cancer Res Clin Oncol. 2023 Sep;149(11):8759-8768. doi: 10.1007/s00432-023-04816-w. Epub 2023 May 2. J Cancer Res Clin Oncol. 2023. PMID: 37127828 Free PMC article.

See all "Cited by" articles

References

1. Applebaum MA, Goldsby R, Neuhaus J, DuBois SG. Clinical features and outcomes in patients with Ewing sarcoma and regional lymph node involvement. Pediatr Blood Cancer. (2012) 59:617–20. - PMC - PubMed
1. Li G, Zhang P, Zhang W, Lei Z, He J, Meng J, et al. Identification of key genes and pathways in Ewing’s sarcoma patients associated with metastasis and poor prognosis. Onco Targets Ther. (2019) 12:4153–65. - PMC - PubMed
1. Wang Y, Mai H, Yuan Y, Chen H, Wu S, Hu X, et al. EWS-FLI1-targeting peptide identifies Ewing sarcoma tumor boundaries and lymph node metastasis via near-infrared imaging. Mol Oncol. (2021) 15:3706–20. - PMC - PubMed
1. Kondo T. Current status and perspectives of patient-derived models for Ewing’s sarcoma. Cancers. (2020) 12:2520. - PMC - PubMed
1. Dong Y, Wu W, Kang H, Xiong W, Ye D, Fang Z, et al. Risk factors of regional lymph node (RLN) metastasis among patients with bone sarcoma and survival of patients with RLN-positive bone sarcoma. Ann Transl Med. (2021) 9:48. - PMC - PubMed

LinkOut - more resources

Full Text Sources

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

A Machine Learning-Based Predictive Model for Predicting Lymph Node Metastasis in Patients With Ewing's Sarcoma

Affiliations

A Machine Learning-Based Predictive Model for Predicting Lymph Node Metastasis in Patients With Ewing's Sarcoma

Authors

Affiliations

Abstract

Conflict of interest statement

Figures

Similar articles

Cited by

References

LinkOut - more resources

Full Text Sources

Abstract

Conflict of interest statement

Figures

Similar articles

Cited by

References

Related information

LinkOut - more resources

Full Text Sources