Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient
- PMID: 28794664
- PMCID: PMC5536229
- DOI: 10.2147/AMEP.S138380
Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient
Abstract
Background: Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient.
Methods: We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t-test, and comparisons between Groups A and B were analyzed with an independent t-test.
Results: Compared to the preseminar result, Group A's postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program.
Conclusion: Improved pre-post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence.
Keywords: clinical competence; empathy; health communication; informatics; verbal behavior.
Conflict of interest statement
Disclosure FWK serves as president and MDF has stock options in Medical Cyberworlds, Inc, the entity receiving Small Business Innovation Research I grant funds for this project. The University of Michigan Conflict of Interest Office considered the potential for conflict of interest and concluded that no formal management plan was required. The authors report no other conflicts of interest in this work.
Similar articles
-
Breaking bad news to patients with cancer: A randomized control trial of a brief communication skills training module incorporating the stories and preferences of actual patients.Patient Educ Couns. 2017 Apr;100(4):655-666. doi: 10.1016/j.pec.2016.11.008. Epub 2016 Nov 13. Patient Educ Couns. 2017. PMID: 27876220 Free PMC article. Clinical Trial.
-
Effect of a simulation-based workshop on breaking bad news for anesthesiology residents: an intervention study.BMC Anesthesiol. 2017 Jun 14;17(1):77. doi: 10.1186/s12871-017-0374-7. BMC Anesthesiol. 2017. PMID: 28615002 Free PMC article.
-
The effect of guided group reflection on the ability and convenience of breaking bad news in pre-hospital emergency staff.BMC Health Serv Res. 2024 Oct 4;24(1):1175. doi: 10.1186/s12913-024-11604-w. BMC Health Serv Res. 2024. PMID: 39363286 Free PMC article.
-
Breaking bad news: A communication competency for ophthalmology training programs.Surv Ophthalmol. 2016 Nov-Dec;61(6):791-798. doi: 10.1016/j.survophthal.2016.04.005. Epub 2016 Apr 29. Surv Ophthalmol. 2016. PMID: 27134009 Free PMC article. Review.
-
Assessment of Surgery Residents' Interpersonal Communication Skills: Validation Evidence for the Communication Assessment Tool in a Simulation Environment.J Surg Educ. 2016 Nov-Dec;73(6):e19-e27. doi: 10.1016/j.jsurg.2016.04.016. Epub 2016 May 20. J Surg Educ. 2016. PMID: 27216300 Review.
Cited by
-
Artificial intelligence technologies and compassion in healthcare: A systematic scoping review.Front Psychol. 2023 Jan 17;13:971044. doi: 10.3389/fpsyg.2022.971044. eCollection 2022. Front Psychol. 2023. PMID: 36733854 Free PMC article.
-
Metaverse-based simulation: a scoping review of charting medical education over the last two decades in the lens of the 'marvelous medical education machine'.Ann Med. 2024 Dec;56(1):2424450. doi: 10.1080/07853890.2024.2424450. Epub 2024 Nov 13. Ann Med. 2024. PMID: 39535116 Free PMC article.
-
Response to "Emerging Roles of Virtual Patients in the Age of AI".AMA J Ethics. 2019 Oct 1;21(10):E920-925. doi: 10.1001/amajethics.2019.920. AMA J Ethics. 2019. PMID: 31651393 Free PMC article. No abstract available.
-
Basics of statistics for primary care research.Fam Med Community Health. 2019 May;7(2):e000067. doi: 10.1136/fmch-2018-000067. Epub 2019 Mar 28. Fam Med Community Health. 2019. PMID: 31218217 Free PMC article.
References
-
- Ong LM, De Haes JC, Hoos AM, Lammes FB. Doctor-patient communication: a review of the literature. Soc Sci Med. 1995;40(7):903–918. - PubMed
-
- Williams M, Hevelone N, Alban RF, et al. Measuring communication in the surgical ICU: better communication equals better care. J Am Coll Surg. 2010;210(1):17–22. - PubMed
-
- Sutcliffe KM, Lewton E, Rosenthal MM. Communication failures: an insidious contributor to medical mishaps. Acad Med. 2004;79(2):186–194. - PubMed
-
- Hulsman RL, Visser A. Seven challenges in communication training: learning from research. Patient Educ Couns. 2013;90(2):145–146. - PubMed
Publication types
LinkOut - more resources
Full Text Sources
Other Literature Sources
Research Materials