Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2015 Mar;22(2):409-16.
doi: 10.1136/amiajnl-2014-002865. Epub 2014 Oct 17.

Completeness, accuracy, and computability of National Quality Forum-specified eMeasures

Andy Amster  1 , Joseph Jentzsch  1 , Ham Pasupuleti  2 , K G Subramanian  2
Affiliations

Completeness, accuracy, and computability of National Quality Forum-specified eMeasures

Andy Amster et al. J Am Med Inform Assoc. 2015 Mar.

Abstract

Objective: To analyze the completeness, computability, and accuracy of specifications for five National Quality Forum-specified (NQF) eMeasures spanning ambulatory, post-discharge, and emergency care within a comprehensive, integrated electronic health record (EHR) environment.

Materials and methods: To evaluate completeness, we assessed eMeasure logic, data elements, and value sets. To evaluate computability, we assessed the translation of eMeasure algorithms to programmable logic constructs and the availability of EHR data elements to implement specified data criteria, using a de-identified clinical data set from Kaiser Permanente Northwest. To assess accuracy, we compared eMeasure results with those obtained independently by existing audited chart abstraction methods used for external and internal reporting.

Results: One measure specification was incomplete; missing applicable LOINC codes rendered it non-computable. For three of four computable measures, data availability issues occurred; the literal specification guidance for a data element differed from the physical implementation of the data element in the EHR. In two cases, cross-referencing specified data elements to EHR equivalents allowed variably accurate measure computation. Substantial data availability issues occurred for one of the four computable measures, producing highly inaccurate results.

Discussion: Existing clinical workflows, documentation, and coding in the EHR were significant barriers to implementing eMeasures as specified. Implementation requires redesigning business or clinical practices and, for one measure, systemic EHR modifications, including clinical text search capabilities.

Conclusions: Five NQF eMeasures fell short of being machine-consumable specifications. Both clinical domain and technological expertise are required to implement manually intensive steps from data mapping to text mining to EHR-specific eMeasure implementation.

Keywords: Electronic Health Record; Healthcare Quality Indicators/Methods; Meaningful Use; Process Assessment (Health Care).

PubMed Disclaimer

Conflict of interest statement

None.

References

    1. Stark P. Congressional intent for the HITECH Act. Am J Manag Care. 2010;16:SP24–SP28. - PubMed
    1. Blumenthal D. Launching HITECH. N Engl J Med. 2010;362:382–385. - PubMed
    1. Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med. 2010;363:501–504. - PubMed
    1. Anderson KM, Marsh CA, Flemming AC, et al. . Quality measurement enabled by health IT: overview, possibilities, and challenges. Rockville, MD: Agency for Healthcare Research and Quality, 2012.
    1. Centers for Medicare & Medicaid Services. Clinical Quality Measures (CQMs). Baltimore, MD: CMS, 2013. Accessed September 13, 2013.