Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Nov 18;19(22):15272.
doi: 10.3390/ijerph192215272.

Critical Analysis of the Evaluation Methods of Extended Reality (XR) Experiences for Construction Safety

Daniel Salinas  1 , Felipe Muñoz-La Rivera  1   2   3 , Javier Mora-Serrano  2   3
Affiliations

Critical Analysis of the Evaluation Methods of Extended Reality (XR) Experiences for Construction Safety

Daniel Salinas et al. Int J Environ Res Public Health. .

Abstract

The construction industry has high accident rates. The sector is exploring various tools to improve safety management, training, and awareness to achieve zero accidents. This work focuses on extended reality (XR), which encompasses virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies. Several authors have developed training experiences for construction safety in XR environments with positive conclusions about their effectiveness. However, there is no standardization regarding the evaluation methods used in the sector, and many experiences do not use any method. This lack is critical, as whenever the aim is to evaluate the degree of awareness of security issues, the implementation of evaluation systems is indispensable to make known the methods used in the literature to evaluate the effectiveness of the experiences and represent support for future research. This research identifies developments in XR experiences and analyzes the validation methods through a systematic review using the PRISMA methodology. It identifies two evaluation methods, objective and subjective, which are each broken down into four categories. The results show the types of evaluation, safety-related purposes, and safety application objectives used by the database classification.

Keywords: augmented reality; construction safety; extended reality; mixed reality; prevention of occupational hazards; virtual reality.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflicts of interest.

Figures

Figure 1
Figure 1
PRISMA workflow for systematic review.
Figure 2
Figure 2
Number of articles by year of publication.
Figure 3
Figure 3
Distribution of published articles by country.
Figure 4
Figure 4
Number of articles in relation to the technology used by year of publication.
Figure 5
Figure 5
Number of studies that use or do not use some method to measure the effectiveness of XR experiences according to the technologies used.
Figure 6
Figure 6
Types of evaluation belonging to the target objective method and number of corresponding XR tools.
Figure 7
Figure 7
Types of evaluation belonging to the subjective method and number of corresponding XR tools.
Figure 8
Figure 8
Number of items for each safety-related purpose by type of objective method assessment.
Figure 9
Figure 9
Number of items for each safety-related purpose by type of subjective method evaluation.
Figure 10
Figure 10
Number of items of each safety application objective for each purpose related to the types of evaluation of the target method.
Figure 11
Figure 11
Number of items of each security application objective for each purpose related to the types of evaluation of the subjective method: User interview and questionnaire; User field workload; Expert analysis; and Sensory user and emotions.
Figure 12
Figure 12
Number of items by type of evaluation of the objective method and number evaluating within and outside the experience.
Figure 13
Figure 13
Number of items by type of evaluation of the subjective method and number evaluating within and outside the experience.
Figure 14
Figure 14
Types of evaluation. (a) Objective methods; (b) Subjective methods.
See this image and copyright information in PMC

References

    1. Martínez Guirao J.E. Riesgos Laborales en la Construcción. Un Análisis Sociocultural. Universitas. 2016;23:65–86. doi: 10.17163/uni.n23.2015.03. - DOI
    1. IEEE Power Engineering Society. Insulated Conductors Committee. Institute of Electrical and Electronics Engineers. IEEE Standards Board . IEEE Guide for the Properties of Identifiable Jackets for Underground Power Cables and Ducts. Institute of Electrical and Electronics Engineers; New York, NY, USA: 2000.
    1. Mohana Priya M.M., Kothai P.S., Kohilambal E. Study on Safety Practices and Their Performance in the Construction Industries. Int. J. Mod. Trends Eng. Res. 2016;3:284–293.
    1. Haupt T.C., Akinlolu M., Raliile M.T. Emerging Technologies in Construction Safety and Health Management; Proceedings of the International Conference on Innovation, Technology, Enterprise and Entrepreneurship; Anwaj Island, Bahrain. 3 February 2020.
    1. Schulte P.A., Rinehart R., Okun A., Geraci C.L., Heidel D.S. National Prevention through Design (PtD) Initiative. J. Saf. Res. 2008;39:115–121. doi: 10.1016/j.jsr.2008.02.021. - DOI - PubMed

Publication types