Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Apr;16(2):221-226.
doi: 10.4300/JGME-D-23-00378.1. Epub 2024 Apr 15.

Mobile Application to Improve Just-in-Time 2-Way Formative Feedback in Graduate Medical Education

Jane Rowat  1 , Girish Mhatre  2 , Manish Suneja  3
Affiliations

Mobile Application to Improve Just-in-Time 2-Way Formative Feedback in Graduate Medical Education

Jane Rowat et al. J Grad Med Educ. 2024 Apr.

Abstract

Background An easy-to-use application to facilitate direct observation and allow for 2-way feedback between residents and faculty is needed. Objective To develop a mobile-based application (app) with the goals of (1) providing just-in-time feedback to residents; (2) improving timeliness of feedback by faculty; and (3) allowing residents to comment on the value of faculty feedback. Methods Fifty-one of 69 (74%) internal medicine (IM) residents and 20 of 25 (80%) IM core faculty participated in the study from July 1, 2020, to December 31, 2021. An iOS app was designed by authors with expertise in medical education and application development to capture entrustable professional activities (EPAs)-based feedback (eg, informed consent) based on direct observation of residents' skills in the workplace. App utilization and narrative feedback characteristics of faculty comments were examined by exporting the data from the database server. The end user satisfaction was examined using a survey instrument. Results Eighty-seven percent of assessments (117 of 134) initiated were fully completed by residents and faculty. Faculty narrative comments were noted in 97% (114 of 117) of completed assessments and 64% (75 of 117) of residents' feedback to the faculty contained narrative comments. Eighty-three percent (97 of 117) of comments were behaviorally specific and 71% (83 of 117) contained an actionable item. Eighty-six percent (18 of 21) of residents and 90% (9 of 10) of core faculty stated that this application promoted an educational interaction between them. Conclusions This app facilitates the efficient completion of EPA-based formative assessments and captures bidirectional feedback in the workplace setting.

PubMed Disclaimer

Figures

Figure
Figure
Illustration of Bidirectional Feedback Cycle Used in the Mobile Application
See this image and copyright information in PMC

References

    1. Holmboe ES. Faculty and the observation of trainees’ clinical skills: problems and opportunities. Acad Med. 2004;79(1):16–22. doi: 10.1097/00001888-200401000-00006. - DOI - PubMed
    1. Hasley PB,, Arnold RM. Summative evaluation on the hospital wards. What do faculty say to learners? Adv Health Sci Educ Theory Pract. 2009;14(3):431–439. doi: 10.1007/s10459-008-9127-1. - DOI - PubMed
    1. Cantillon P,, Sargeant J. Giving feedback in clinical settings. BMJ. 2008;337:a1961. doi: 10.1136/bmj.a1961. - DOI - PubMed
    1. Van Hell EA,, Kuks JB,, Raat AN,, Van Lohuizen MT,, Cohen-Schotanus J. Instructiveness of feedback during clerkships: influence of supervisor, observation and student initiative. Med Teach. 2009;31(1):45–50. doi: 10.1080/01421590802144294. doi: - DOI - PubMed
    1. Cooney CM,, Redett RJ, 3rd,, Dorafshar AH,, Zarrabi B,, Lifchez SD. Integrating the NAS Milestones and handheld technology to improve residency training and assessment. J Surg Educ. 2014;71(1):39–42. doi: 10.1016/j.jsurg.2013.09.019. - DOI - PubMed

LinkOut - more resources