Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comparative Study
. 2021 May;30(5):1042-1052.
doi: 10.1016/j.jse.2020.08.016. Epub 2020 Aug 29.

Comparison of the accuracy of telehealth examination versus clinical examination in the detection of shoulder pathology

Kendall E Bradley  1 , Chad Cook  2 , Emily K Reinke  3 , Emily N Vinson  4 , Richard C Mather 3rd  3 , Jonathan Riboh  3 , Tally Lassiter  3 , Jocelyn R Wittstein  3
Affiliations
Comparative Study

Comparison of the accuracy of telehealth examination versus clinical examination in the detection of shoulder pathology

Kendall E Bradley et al. J Shoulder Elbow Surg. 2021 May.

Abstract

Hypothesis/background: In 2017, the American Orthopaedic Association advocated for the increased use of telehealth as an assessment and treatment platform, and demand has significantly increased during the coronavirus disease 2019 pandemic. Diagnostic effectiveness (also called overall diagnostic accuracy) and reliability of a telehealth clinical examination vs. a traditional shoulder clinical examination (SCE) has not been established. Our objective is to compare the diagnostic effectiveness of a telehealth shoulder examination against an SCE for rotator cuff tear (RCT), using magnetic resonance imaging (MRI) as a reference standard; secondary objectives included assessing agreement between test platforms and validity of individualized tests. We hypothesize that tests provided in a telehealth platform would not have inferior diagnostic effectiveness to an SCE.

Methods: The study is a case-based, case-control design. Two clinicians selected movement, strength, and special tests for the SCE that are associated with the diagnosis of RCT and identified similar tests to replicate for a simulated telehealth-based examination (STE). Consecutive patients with no prior shoulder surgery or advanced imaging underwent both the SCE and STE in the same visit using 2 separate assessors. We randomized the order of the SCE or STE. A blinded reader assessed an MRI, to be used as a reference standard. We calculated diagnostic effectiveness, which provides values from 0% to 100% as well as agreement statistics (Kappa) between tests by an assessment platform, and sensitivity, specificity, and likelihood ratios for individual tests in both SCE and STE. We compared the diagnostic effectiveness (overall) of the SCE and STE with a Mann-Whitney U test.

Results: We included 62 consecutive patients with shoulder pain, aged 40 or older; 50 (81%) received an MRI as a reference standard. The diagnostic effectiveness of stand-alone tests was poor regardless of the group, with the exception of a few tests with high specificity. None had greater than 70% accuracy. There was no significant difference between the overall diagnostic effectiveness of the STE and SCE (P = .98). Overall agreement between the STE tests and the SCE tests ranged from poor to moderate (Kappa, 0.07-0.87).

Conclusion: This study identified initial feasibility and noninferiority of the physician-guided, patient-performed STE when compared with an SCE in the detection of RCTs. Although these results are promising, larger studies are needed for further validation of an STE assessment platform.

Keywords: Shoulder; clinical assessment; diagnostic accuracy; imaging; magnetic resonance; rotator cuff tear; telehealth.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Patient enrollment flowchart.
Figure 2
Figure 2
Location of rotator cuff tear on MRI as read by the radiologist. SS, supraspinatus; IS, infraspinatus; SSc, subscapularis.
See this image and copyright information in PMC

References

    1. Baratloo A., Hosseini M., Negida A., El Ashal G. Part 1: simple definition and calculation of accuracy, sensitivity and specificity. Emerg (Tehran) 2015;3:48–49. - PMC - PubMed
    1. Blank E., Lappan C., Belmont P.J., Jr., Shaun Machen M., Ficke J., Pope R. Early analysis of the United States Army's telemedicine orthopaedic consultation program. J Surg Orthop Adv. 2011;20:50. - PubMed
    1. Bossuyt P.M., Reitsma J.B., Bruns D.E., Gatsonis C.A., Glasziou P.P., Irwig L. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. Clin Chem. 2015;61:1446–1452. doi: 10.1373/clinchem.2015.246280. - DOI - PubMed
    1. Brockmeyer M., Schmitt C., Haupert A., Kohn D., Lorbach O. Limited diagnostic accuracy of magnetic resonance imaging and clinical tests for detecting partial-thickness tears of the rotator cuff. Arch Orthop Trauma Surg. 2017;137:1719–1724. doi: 10.1007/s00402-017-2799-3. - DOI - PubMed
    1. Buvik A., Bugge E., Knutsen G., Småbrekke A., Wilsgaard T. Quality of care for remote orthopaedic consultations using telemedicine: a randomised controlled trial. BMC Health Serv Res. 2016;16:483. doi: 10.1186/s12913-016-1717-7. - DOI - PMC - PubMed

Publication types