Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Jun;41(2):248-254.
doi: 10.1002/npr2.12172. Epub 2021 Mar 18.

Assessing stable validity and reliability of the Japanese version of the individualized supported employment fidelity scale: A replication

Sosei Yamaguchi  1 , Sayaka Sato  1 , Yasutaka Ojio  1 , Takuma Shiozawa  1 , Asami Matsunaga  1 , Ayano Taneda  2 , Utako Sawada  3 , Koji Yoshida  4 , Chiyo Fujii  1
Affiliations

Assessing stable validity and reliability of the Japanese version of the individualized supported employment fidelity scale: A replication

Sosei Yamaguchi et al. Neuropsychopharmacol Rep. 2021 Jun.

Abstract

Background: The Japanese version of the individualized Supported Employment Fidelity scale (JiSEF) was developed by modifying the 25-item Individual Placement and Support Fidelity Scale (IPS-25). While a preliminary study partly confirmed the concurrent validity with vocational outcomes, this replication study aimed to examine the stability of the concurrent validity and the inter-rater reliability of the JiSEF and to test its convergent validity with IPS-25.

Methods: Fidelity assessments were conducted in 2016 (n = 17), 2017 (n = 13), and 2018 (n = 18) to examine the employment rate and the fidelity scores at the agency level. We also evaluated the fidelity scores for the IPS-25 in 2018. We examined the associations between the fidelity scale scores and vocational outcomes for the concurrent validity and between the fidelity scales for convergent validity. The inter-rater reliability was examined in the 2016 and 2017 assessments.

Results: High intraclass correlation coefficients (0.93 in 2016 and 0.92 in 2017) were obtained for the inter-rater reliability. The JiSEF score in each year was associated with the agency employment rate (r = 0.710, P = 0.001 in 2016; r = 0.722, P = 0.005 in 2017; and r = 0.665, P = 0.003 in 2018). A supplementary longitudinal data analysis also confirmed the association between the JiSEF score and the employment outcomes. Additionally, the JiSEF was significantly correlated with the IPS-25 (r = 0.760, P < 0.001).

Conclusions: This study stably replicated good inter-rater reliability and concurrent validity of the JiSEF. Additionally, the convergent validity was confirmed. Further studies with large samples are needed to confirm these findings.

Keywords: fidelity; mental illness; supported employment; validity; vocational outcome.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Figures

FIGURE 1
FIGURE 1
Pearson's correlation coefficient analysis for concurrent validity. (A) Correlation between JiSEF score and employment rate at the agency level; (B) correlation between JiSEF score and 3‐month employment rate at the agency level. Employment rate, Average agency employment rate; 3‐months employment rate, Average agency employment rate: 3‐months or longer; JiSEF, Japanese version of individualized Supported Employment Fidelity scale
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Modini M, Tan L, Brinchmann B, Wang M‐J, Killackey E, Glozier N, et al. Supported employment for people with severe mental illness: systematic review and meta‐analysis of the international evidence. Br J Psychiatry. 2016;209:14–22. - PubMed
    1. Suijkerbuijk YB, Schaafsma FG, van Mechelen JC, Ojajärvi A, Corbière M, Anema JR. Interventions for obtaining and maintaining employment in adults with severe mental illness, a network meta‐analysis. Cochrane Database Syst Rev. 2017;9:CD011867. - PMC - PubMed
    1. Metcalfe JD, Drake RE, Bond GR. Economic, labor, and regulatory moderators of the effect of individual placement and support among people with severe mental illness: a systematic review and meta‐analysis. Schizophr Bull. 2018;44:22–31. - PMC - PubMed
    1. Brinchmann B, Widding‐Havneraas T, Modini M, Rinaldi M, Moe CF, McDaid D, et al. A meta‐regression of the impact of policy on the efficacy of individual placement and support. Acta Psychiatr Scand. 2020;141:206–20. - PubMed
    1. Frederick DE, VanderWeele TJ. Supported employment: meta‐analysis and review of randomized controlled trials of individual placement and support. PLoS One. 2019;14:e0212208. - PMC - PubMed

Publication types