Human-multimodal deep learning collaboration in 'precise' diagnosis of lupus erythematosus subtypes and similar skin diseases

Qianwen Li¹, Zhi Yang², Kaili Chen¹, Ming Zhao¹, Hai Long¹, Yueming Deng¹, Haoran Hu¹, Chen Jia¹, Meiyu Wu¹, Zhidan Zhao¹, Huan Zhu¹, Suqing Zhou¹, Mingming Zhao¹, Pengpeng Cao¹, Shengnan Zhou¹, Yang Song¹, Guishao Tang¹, Juan Liu¹, Jiao Jiang¹, Wei Liao³, Wenhui Zhou¹, Bingyi Yang¹, Feng Xiong¹, Suhan Zhang¹, Xiaofei Gao³, Yiqun Jiang⁴, Wei Zhang⁴, Bo Zhang⁴, Yan-Ling He⁵, Liwei Ran⁵, Chunlei Zhang⁶, Wenting Wu⁶, Quzong Suolang⁷, Hanhuan Luo⁷, Xiaojing Kang⁸, Caoying Wu⁸, Hongzhong Jin⁹, Lei Chen⁹, Qing Guo¹⁰, Guangji Gui¹⁰, Shanshan Li¹¹, Henan Si¹¹, Shuping Guo¹², Hong-Ye Liu¹², Xiguang Liu¹³, Guo-Zhang Ma¹³, Danqi Deng¹⁴, Limei Yuan¹⁴, Jianyun Lu¹⁵, Jinrong Zeng¹⁵, Xian Jiang¹⁶, Xiaoyan Lyu¹⁶, Liuqing Chen¹⁷, Bin Hu¹⁷, Juan Tao¹⁸, Yuhao Liu¹⁸, Gang Wang¹⁹, Guannan Zhu¹⁹, Zhirong Yao²⁰, Qianyue Xu²⁰, Bin Yang²¹, Yu Wang²¹, Yan Ding²², Xianxu Yang²², Hu Kai², Haijing Wu¹, Qianjin Lu^{1

4

23

24}

Affiliations

¹ Department of Dermatology, Hunan Key Laboratory of Medical Epigenomics, The Second Xiangya Hospital of Central South University, Changsha, China.
² Key Laboratory of Intelligent Computing and Information Processing of Ministry of Education, Xiangtan University, Xiangtan, China.
³ Department of Dermatology, Hunan Children's Hospital, Changsha, China.
⁴ Institute of Dermatology, Chinese Academy of Medical Sciences and Peking Union Medical College, Nanjing, China.
⁵ Department of Dermatology, Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China.
⁶ Department of Dermatology, Peking University Third Hospital, Beijing, China.
⁷ Department of Dermatology, People's Hospital of Tibet Autonomous Region, Lhasa, China.
⁸ Department of Dermatology, People's Hospital of Xinjiang Uygur Autonomous Region, Urumqi, China.
⁹ Department of Dermatology, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China.
¹⁰ Department of Dermatology, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China.
¹¹ Department of Dermatology, The First Bethune Hospital of Jilin University, Changchun, China.
¹² Department of Dermatology, The First Hospital of Shanxi Medical University, Taiyuan, China.
¹³ Department of Dermatology, The Hei Long Jiang Provincial Hospital, Harbin, China.
¹⁴ Department of Dermatology, The Second Affiliated Hospital of Kunming Medical University, Kunming, China.
¹⁵ Department of Dermatology, The Third Xiangya Hospital, Central South University, Changsha, China.
¹⁶ Department of Dermatology, West China Hospital, Sichuan University, Chengdu, China.
¹⁷ Department of Dermatology, Wuhan No. 1 Hospital, Wuhan, China.
¹⁸ Department of Dermatology, Wuhan Union Hospital of China, Wuhan, China.
¹⁹ Department of Dermatology, Xijing Hospital, Xi'an, China.
²⁰ Department of Dermatology, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China.
²¹ Dermatology Hospital of Southern Medical University, Guangzhou, China.
²² Hainan Provincial Hospital of Skin Disease, Haikou, China.
²³ Key Laboratory of Basic and Translational Research on Immune-Mediated Skin Diseases, Chinese Academy of Medical Sciences, Nanjing, China.
²⁴ Jiangsu Key Laboratory of Molecular Biology for Skin Diseases and STIs, Nanjing, China.

PMID: 38619440
DOI: 10.1111/jdv.20031

Multicenter Study

Human-multimodal deep learning collaboration in 'precise' diagnosis of lupus erythematosus subtypes and similar skin diseases

Qianwen Li et al. J Eur Acad Dermatol Venereol. 2024 Dec.

. 2024 Dec;38(12):2268-2279.

doi: 10.1111/jdv.20031. Epub 2024 Apr 15.

Authors

Affiliations

¹ Department of Dermatology, Hunan Key Laboratory of Medical Epigenomics, The Second Xiangya Hospital of Central South University, Changsha, China.
² Key Laboratory of Intelligent Computing and Information Processing of Ministry of Education, Xiangtan University, Xiangtan, China.
³ Department of Dermatology, Hunan Children's Hospital, Changsha, China.
⁴ Institute of Dermatology, Chinese Academy of Medical Sciences and Peking Union Medical College, Nanjing, China.
⁵ Department of Dermatology, Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China.
⁶ Department of Dermatology, Peking University Third Hospital, Beijing, China.
⁷ Department of Dermatology, People's Hospital of Tibet Autonomous Region, Lhasa, China.
⁸ Department of Dermatology, People's Hospital of Xinjiang Uygur Autonomous Region, Urumqi, China.
⁹ Department of Dermatology, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China.
¹⁰ Department of Dermatology, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China.
¹¹ Department of Dermatology, The First Bethune Hospital of Jilin University, Changchun, China.
¹² Department of Dermatology, The First Hospital of Shanxi Medical University, Taiyuan, China.
¹³ Department of Dermatology, The Hei Long Jiang Provincial Hospital, Harbin, China.
¹⁴ Department of Dermatology, The Second Affiliated Hospital of Kunming Medical University, Kunming, China.
¹⁵ Department of Dermatology, The Third Xiangya Hospital, Central South University, Changsha, China.
¹⁶ Department of Dermatology, West China Hospital, Sichuan University, Chengdu, China.
¹⁷ Department of Dermatology, Wuhan No. 1 Hospital, Wuhan, China.
¹⁸ Department of Dermatology, Wuhan Union Hospital of China, Wuhan, China.
¹⁹ Department of Dermatology, Xijing Hospital, Xi'an, China.
²⁰ Department of Dermatology, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China.
²¹ Dermatology Hospital of Southern Medical University, Guangzhou, China.
²² Hainan Provincial Hospital of Skin Disease, Haikou, China.
²³ Key Laboratory of Basic and Translational Research on Immune-Mediated Skin Diseases, Chinese Academy of Medical Sciences, Nanjing, China.
²⁴ Jiangsu Key Laboratory of Molecular Biology for Skin Diseases and STIs, Nanjing, China.

PMID: 38619440
DOI: 10.1111/jdv.20031

Abstract

Background: Lupus erythematosus (LE) is a spectrum of autoimmune diseases. Due to the complexity of cutaneous LE (CLE), clinical skin image-based artificial intelligence is still experiencing difficulties in distinguishing subtypes of LE.

Objectives: We aim to develop a multimodal deep learning system (MMDLS) for human-AI collaboration in diagnosis of LE subtypes.

Methods: This is a multi-centre study based on 25 institutions across China to assist in diagnosis of LE subtypes, other eight similar skin diseases and healthy subjects. In total, 446 cases with 800 clinical skin images, 3786 multicolor-immunohistochemistry (multi-IHC) images and clinical data were collected, and EfficientNet-B3 and ResNet-18 were utilized in this study.

Results: In the multi-classification task, the overall performance of MMDLS on 13 skin conditions is much higher than single or dual modals (Sen = 0.8288, Spe = 0.9852, Pre = 0.8518, AUC = 0.9844). Further, the MMDLS-based diagnostic-support help improves the accuracy of dermatologists from 66.88% ± 6.94% to 81.25% ± 4.23% (p = 0.0004).

Conclusions: These results highlight the benefit of human-MMDLS collaborated framework in telemedicine by assisting dermatologists and rheumatologists in the differential diagnosis of LE subtypes and similar skin diseases.

PubMed Disclaimer

References

REFERENCES

1. Barber MRW, Drenkard C, Falasinnu T, Hoi A, Mak A, Kow NY, et al. Global epidemiology of systemic lupus erythematosus. Nat Rev Rheumatol. 2021;17(9):515–532.
1. Li M, Zhang W, Leng X, Li Z, Ye Z, Li C, et al. Chinese SLE treatment and research group (CSTAR) registry: I. Major clinical characteristics of Chinese patients with systemic lupus erythematosus. Lupus. 2013;22(11):1192–1199.
1. Li Q, Wu H, Liao W, Zhao M, Chan V, Li L, et al. A comprehensive review of immune‐mediated dermatopathology in systemic lupus erythematosus. J Autoimmun. 2018;93:1–15.
1. Lu Q, Long H, Chow S, Hidayat S, Danarti R, Listiawan Y, et al. Guideline for the diagnosis, treatment and long‐term management of cutaneous lupus erythematosus. J Autoimmun. 2021;123:102707.
1. Jia Qiannan JH, Yuehua L, Ma Donglai Q, Tao ZY, Tao W, Kai F, et al. Analysis of clinical and pathological diagnoses of 29 987 skin biopsy samples in Peking union medical college hospital. Chin J Dermatol. 2020;53(2):117–120.

Publication types

Actions

MeSH terms

Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions

Grants and funding

LinkOut - more resources

Full Text Sources
- Ovid Technologies, Inc.
- Wiley

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

Human-multimodal deep learning collaboration in 'precise' diagnosis of lupus erythematosus subtypes and similar skin diseases

Affiliations

Human-multimodal deep learning collaboration in 'precise' diagnosis of lupus erythematosus subtypes and similar skin diseases

Authors

Affiliations

Abstract

References

REFERENCES

Publication types

MeSH terms

Grants and funding

LinkOut - more resources

Full Text Sources