Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Multicenter Study
. 2012 Jul-Aug;19(4):604-9.
doi: 10.1136/amiajnl-2011-000557. Epub 2012 Jan 16.

Validity of electronic health record-derived quality measurement for performance monitoring

Amanda Parsons  1 , Colleen McCullough, Jason Wang, Sarah Shih
Affiliations
Multicenter Study

Validity of electronic health record-derived quality measurement for performance monitoring

Amanda Parsons et al. J Am Med Inform Assoc. 2012 Jul-Aug.

Abstract

Background: Since 2007, New York City's primary care information project has assisted over 3000 providers to adopt and use a prevention-oriented electronic health record (EHR). Participating practices were taught to re-adjust their workflows to use the EHR built-in population health monitoring tools, including automated quality measures, patient registries and a clinical decision support system. Practices received a comprehensive suite of technical assistance, which included quality improvement, EHR customization and configuration, privacy and security training, and revenue cycle optimization. These services were aimed at helping providers understand how to use their EHR to track and improve the quality of care delivered to patients.

Materials and methods: Retrospective electronic chart reviews of 4081 patient records across 57 practices were analyzed to determine the validity of EHR-derived quality measures and documented preventive services.

Results: Results from this study show that workflow and documentation habits have a profound impact on EHR-derived quality measures. Compared with the manual review of electronic charts, EHR-derived measures can undercount practice performance, with a disproportionately negative impact on the number of patients captured as receiving a clinical preventive service or meeting a recommended treatment goal.

Conclusion: This study provides a cautionary note in using EHR-derived measurement for public reporting of provider performance or use for payment.

PubMed Disclaimer

Conflict of interest statement

Competing interests: None.

Figures

Figure 1
Figure 1
Distribution of documentation and data elements recognized for quality measurement across 57 practices. EHR, electronic health record; IVD, ischemic cardiovascular disease; LDL, low-density lipoprotein.
See this image and copyright information in PMC

References

    1. Blumenthal D. Promoting use of health IT: why be a meaningful user? Md Med 2010;11:18–19 - PubMed
    1. CMS Office of Public Affairs. Fact Sheet Details for Medicare and Medicaid Health Information Technology: Title IV of the American Recovery and Reinvestment Act. 2009. http://www.cms.hhs.gov/apps/media/press/factsheet.asp?Counter=3466&intNu... (accessed 18 Aug 2011).
    1. Frieden TR, Mostashari F. Health care as if health mattered. JAMA 2008;299:950–2 - PubMed
    1. Jollis JG, Ancukiewicz M, DeLong ER, et al. Discordance of databases designed for claims payment versus clinical information systems. Implications for outcomes research. Ann Intern Med 1993;119:844–50 - PubMed
    1. Tang PC, Ralston M, Arrigotti MF, et al. Comparison of methodologies for calculating quality measures based on administrative data versus clinical data from an electronic health record system: implications for performance measures. J Am Med Inform Assoc 2007;14:10–15 - PMC - PubMed

Publication types