Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comment
. 2023 Jul-Aug;35(4):351-363.
doi: 10.1080/08995605.2022.2063614. Epub 2022 May 31.

Administrative records-based criterion measures

Martin C Yu  1 , Matthew C Reeder  1 , David Dorsey  1 , Matthew T Allen  1
Affiliations
Comment

Administrative records-based criterion measures

Martin C Yu et al. Mil Psychol. 2023 Jul-Aug.

Abstract

This paper covers considerations in using criterion measures based on administrative data. We begin with a conceptual framework for understanding and evaluating administrative criterion measures as "objective" rather than (ratings-based) assessments of job performance. We then describe the associated advantages (e.g., availability) and disadvantages (e.g., contamination) of using administrative data for criterion-related validation purposes. Best practices in the use of administrative data for validation purposes, including procedures for (a) handling missing data, (b) performing data checks, and (c) reporting detailed decision rules so future researchers can replicate the analyses are also described. Finally, we discuss "modern data management" approaches for improving administrative data for supporting organizational decision-making.

Keywords: Administrative records; archival data; criterion measurement; modern data management; outcome measures.

PubMed Disclaimer

Conflict of interest statement

No potential conflict of interest was reported by the author(s).

Comment on

References

    1. Allen, M. T., Russell, T., Ford, L., Carretta, T., Lee, A., & Kirkendall, C. (2022). Identification and evaluation of criterion measurement methods. Military Psychology, 35(4), 308–320. 10.1080/08995605.2022.2050165 - DOI - PMC - PubMed
    1. Austin, J. T., & Villanova, P. (1992). The criterion problem: 1917–1992. Journal of Applied Psychology, 77(6), 836–874. 10.1037/0021-9010.77.6.836 - DOI
    1. Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44(1), 1–26. 10.1111/j.1744-6570.1991.tb00688.x - DOI
    1. Bass, A. R., & Turner, J. N. (1973). Ethnic group differences in relationships among criteria of job performance. Journal of Applied Psychology, 57(2), 101–109. 10.1037/h0037125 - DOI
    1. Bommer, W. H., Johnson, J. L., Rich, G. A., Podsakoff, P. M., & Mackenzie, S. B. (1995). On the interchangeability of objective and subjective measures of employee performance: A meta-analysis. Personnel Psychology, 48(3), 587–605. 10.1111/j.1744-6570.1995.tb01772.x - DOI

LinkOut - more resources