Quality of data in the Manchester orthopaedic database

Abstract

Objective: To determine the completeness and accuracy of data in a computerised clinical information system (Manchester orthopaedic database) in comparison with the data available through the Hospital Activity Analysis.

Design: Retrospective review of case notes, computer data, and Hospital Activity Analysis data.

Setting: Orthopaedic unit in a district general hospital in Manchester.

Subjects: 200 random patient records distributed through the period of use of the computer system (1 October 1988 to 31 March 1990) and 121 records for random admissions between 1 April 1989 and 31 March 1990, 71 of which were included in the previous sample.

Main outcome measures: Conformity of the computer record key words and Hospital Activity Analysis codes to an ideal key word record and ideal code record drawn up by one investigator from the clinical notes; overall quality (completeness times accuracy).

Results: Overall completeness of the data in the orthopaedic database was 62% and the accuracy was 96%. Completeness improved after feedback to doctors on the use of key words in regular audit meetings. Completeness was higher in inpatient than outpatient records (69.9% v 53.7%, p less than 0.001) and when a new key word was required compared with missing and incorrect key words (both p less than 0.001). Completeness was lower when the key word was required of a senior registrar (p less than 0.05). Accuracy was not significantly different. The completeness of Hospital Activity Analysis data was 90.5% and accuracy 69.5%. Thus the overall data quality was similar in both systems.

Conclusions: Even in a system designed for simple and efficient data capture, compliance by users was poor. Accuracy was high, suggesting that users understood the principles of data entry. Completeness of data capture can be improved by providing feedback to users on use of the system and performance. Improvements in future versions of the software should improve performance.