Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Nov 10;21(1):553.
doi: 10.1186/s12888-021-03562-y.

Reliability of the performance-based measure of executive functions in people with schizophrenia

En-Chi Chiu  1   2 , Ya-Chen Lee  3 , Shu-Chun Lee #  2   4   5 , I-Ping Hsueh #  6   7
Affiliations

Reliability of the performance-based measure of executive functions in people with schizophrenia

En-Chi Chiu et al. BMC Psychiatry. .

Abstract

Background: The Performance-based measure of Executive Functions (PEF) with four domains is designed to assess executive functions in people with schizophrenia. The purpose of this study was to examine the test-retest reliability of the PEF administered by the same rater (intra-rater agreement) and by different raters (inter-rater agreement) in people with schizophrenia and to estimate the values of minimal detectable change (MDC) and MDC%.

Methods: Two convenience samples (each sample, n = 60) with schizophrenia were conducted two assessments (two weeks apart). The intraclass correlation coefficient (ICC) was analyzed to examine intra-rater and inter-rater agreements of the test-retest reliability of the PEF. The MDC was calculated through standard error of measurement.

Results: For the intra-rater agreement study, the ICC values of the four domains were 0.88-0.92. The MDC (MDC%) of the four domains (volition, planning, purposive action, and perfromance effective) were 13.0 (13.0%), 12.2 (16.4%), 16.2 (16.2%), and 16.3 (18.8%), respectively. For the inter-rater agreement study, the ICC values of the four domains were 0.82-0.89. The MDC (MDC%) were 15.8 (15.8%), 17.4 (20.0%), 20.9 (20.9%), and 18.6 (18.6%) for the volition, planning, purposive action, and performance effective domains, respectively.

Conclusions: The PEF has good test-retest reliability, including intra-rater and inter-rater agreements, for people with schizophrenia. Clinicians and researchers can use the MDC values to verify whether an individual with schizophrenia shows any real change (improvement or deterioration) between repeated PEF assessments by the same or different raters.

Keywords: Executive functions; Occupational therapy; Psychometric evaluation; Reliability; Schizophrenia.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Bland-Altman plots. The bold line defines the mean difference and the two dotted line define the 95% limits of agreement
See this image and copyright information in PMC

References

    1. García-Madruga JA, Gómez-Veiga I, Vila JÓ. Executive functions and the improvement of thinking abilities: the intervention in reading comprehension. Front Psychol. 2016;7:58. doi: 10.3389/fpsyg.2016.00058. - DOI - PMC - PubMed
    1. Hendry A, Jones EJH, Charman T. Executive function in the first three years of life: precursors, predictors and patterns. Dev Rev. 2016;42:1–33. doi: 10.1016/j.dr.2016.06.005. - DOI
    1. Teigset CM, Mohn C, Rund BR. Perinatal complications and executive dysfunction in early-onset schizophrenia. BMC Psychiatry. 2020;20(1):103. doi: 10.1186/s12888-020-02517-z. - DOI - PMC - PubMed
    1. Okasha TA, Hussein H, Shorub E, Nagi H, Moustafa AA, El-Serafi D. Cognitive dysfunction among inpatients and outpatients with schizophrenia: relationship to positive and negative symptoms. Middle East Curr Psychiatry. 2020;27(1):58. doi: 10.1186/s43045-020-00062-9. - DOI
    1. Kelly C, Sharkey V, Morrison G, Allardyce J, McCreadie RG. Nithsdale schizophrenia surveys. 20. Cognitive function in a catchment-area-based population of patients with schizophrenia. Br J Psychiatry. 2000;177(4):348–353. doi: 10.1192/bjp.177.4.348. - DOI - PubMed

Publication types