Validation of data quality in a nationwide gastroenterological surgical database: The National Clinical Database site-visit and remote audits, 2016-2018
- PMID: 34095719
- PMCID: PMC8164453
- DOI: 10.1002/ags3.12419
Validation of data quality in a nationwide gastroenterological surgical database: The National Clinical Database site-visit and remote audits, 2016-2018
Abstract
Background and aim: In 2015, the Japanese Society of Gastroenterological Surgery (JSGS) initiated data verification in the gastroenterological section of the National Clinical Database (NCD) and reported high accuracy of data entry. Remote audits were introduced for data validation on a trial basis in 2016 and formally accepted into use in 2017-2018. The aim of this study was to audit the data quality of the NCD gastroenterological section for 2016-2018 and to confirm the high accuracy of data in remote audits.
Methods: Each year, 45-46 hospitals were selected for audit. Twenty cases were randomly selected in each hospital, and the accuracy of patient demographic and surgical outcome data (46 items) was compared with the corresponding medical records obtained by visiting the hospital (site-visit audit) or by mailing data from the hospital to the JSGS office (remote audit).
Results: A total of 136 hospitals were included, of which 88 (64.7%) had a remote audit, and 124 936 items were evaluated with an overall data accuracy of 98.1%. There was no significant difference in terms of data accuracy between site-visit audit and remote audit. Accuracy, sensitivity, and specificity of mortality were 99.7%, 89.7%, 100% for site-visit audits and 99.8%, 97.3%, 100% for remote audits, respectively. Mean time spent on data verification per case of remote audits was shorter than that of site-visit audits (10.0 minutes vs 13.7 minutes, P < 0.001).
Conclusion: The audits showed that NCD data are reliable and characterized by high accuracy. Remote audits may substitute site-visit audits.
Keywords: National Clinical Database; audit; gastroenterological surgery.
© 2020 The Authors. Annals of Gastroenterological Surgery published by John Wiley & Sons Australia, Ltd on behalf of The Japanese Society of Gastroenterological Surgery.
Conflict of interest statement
Conflicts of Interest: AT and HM are affiliated with the Department of Healthcare Quality Assessment at The University of Tokyo. The department is a social collaboration department supported by the National Clinical Database, Johnson & Johnson KK, and Nipro Corporation. The other authors declare no conflicts of interest for this article.
References
-
- Kanaji S, Takahashi A, Miyata H, Marubashi S, Kakeji Y, Konno H, et al. Initial verification of data from a clinical database of gastroenterological surgery in Japan. Surg Today. 2019;49:328–33. - PubMed
LinkOut - more resources
Full Text Sources
