Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Mar 1;75(3):228-236.
doi: 10.1176/appi.ps.20230023. Epub 2023 Aug 30.

A Mixed-Methods Implementation Evaluation of Virtual Reality Job Interview Training in IPS Supported Employment

Shannon Blajeski  1 , Matthew J Smith  1 , Meghan Harrington  1 , Jeffery Johnson  1 , Brittany Ross  1 , Addie Weaver  1 , Lisa A Razzano  1 , Nicole Pashka  1 , Adrienne Brown  1 , John Prestipino  1 , Karley Nelson  1 , Tovah Lieberman  1 , Neil Jordan  1 , Eugene A Oulvey  1 , Kim T Mueser  1 , Susan R McGurk  1 , Morris D Bell  1 , Justin D Smith  1
Affiliations

A Mixed-Methods Implementation Evaluation of Virtual Reality Job Interview Training in IPS Supported Employment

Shannon Blajeski et al. Psychiatr Serv. .

Abstract

Objective: Employment rates among individuals with serious mental illness may be improved by engagement in the individual placement and support (IPS) model of supported employment. Results from a recent randomized controlled trial (RCT) indicate that virtual reality job interview training (VR-JIT) improves employment rates among individuals with serious mental illness who have been actively engaged in IPS for at least 90 days. This study reports on an initial implementation evaluation of VR-JIT during the RCT in a community mental health agency.

Methods: A sequential, complementary mixed-methods design included use of qualitative data to improve understanding of quantitative findings. Thirteen IPS staff trained to lead VR-JIT implementation completed VR-JIT acceptability, appropriateness, and feasibility surveys. Participants randomly assigned to IPS with VR-JIT completed acceptability (N=42) and usability (N=28) surveys after implementation. The authors also conducted five focus groups with IPS staff (N=11) and VR-JIT recipients (N=13) and semistructured interviews with IPS staff (N=9) and VR-JIT recipients (N=4), followed by an integrated analysis process.

Results: Quantitative results suggest that IPS staff found VR-JIT to be highly acceptable, appropriate for integration with IPS, and feasible for delivery. VR-JIT was highly acceptable to recipients. Qualitative results add important context to the quantitative findings, including benefits of VR-JIT for IPS staff as well as adaptations for delivering technology-based interventions to individuals with serious mental illness.

Conclusions: These qualitative and quantitative findings are consistent with each other and were influenced by VR-JIT's adaptability and perceived benefits. Tailoring VR-JIT instruction and delivery to individuals with serious mental illness may help optimize VR-JIT implementation within IPS.

Keywords: Bipolar disorder; Community mental health services; Psychiatric rehabilitation; Schizophrenia; Virtual job interview training.

PubMed Disclaimer

Conflict of interest statement

The data reported in this manuscript were collected as part of a trial evaluating the original version of virtual reality job interview training.Dr. M. J. Smith reports receiving royalty payments from SIMmersion L.L.C. for a youth-focused version of the virtual job interview intervention and receiving speaker honoraria for invited presentations from Hartford Healthcare, Ohio State University, Rush University, Virginia Commonwealth University, Boston University, University of Utah, and The Help Group. The other authors report no financial relationships with commercial interests.

Figures

Figure 1.
Figure 1.
Joint display of IPS staff quantitative and qualitative data
Figure 2.
Figure 2.
Joint display of VR-JIT recipient quantitative and qualitative data
See this image and copyright information in PMC

References

    1. Drake RE, Bond GR, & Becker DR (2012). IPS Supported Employment: An Evidence-Based Approach. New York: Oxford University Press.
    1. Alpine DD, & Alang SM (2021). Employment and economic outcomes of persons with mental illness and disability: The impact of the Great Recession in the United States. Psychiatr Rehabil J, 44(2), 132–141. - PubMed
    1. Healthy People 2030. Rockville, MD, United States Department of Health and Human Services, Office of Disease Prevention and Health Promotion, 2020. https://health.gov/healthypeople/objectives-and-data/social-determinants...
    1. Frederick DE & VanderWeele TJ (2019) Supported employment: Meta-analysis and review of randomized controlled trials of individual placement and support. PloS one 4(2), e0212208. 10.1371/journal.pone.0212208 - DOI - PMC - PubMed
    1. Bond GR, Drake RE, & Becker DR (2020). An update on individual placement and support. World Psychiatry, 19(3), 390. 10.1002/wps.20784 - DOI - PMC - PubMed

LinkOut - more resources