Real-Time Tele-Mentored Low Cost "Point-of-Care US" in the Hands of Paediatricians in the Emergency Department: Diagnostic Accuracy Compared to Expert Radiologists

Abstract

Background: The use of point-of-care ultrasonography (POC US) in paediatrics is increasing. This study investigated the diagnostic accuracy of POC US in children accessing the emergency department (ED) when performed by paediatricians under the remote guidance of radiologists (TELE POC).

Methods: Children aged 0 to 18 years accessing the ED of a third level research hospital with eight possible clinical scenarios and without emergency/severity signs at the triage underwent three subsequent US tests: by a paediatrician guided remotely by a radiologist (TELE POC); by the same radiologist (UNBLIND RAD); by an independent blinded radiologist (BLIND RAD). Tele-radiology was implemented using low cost "commercial off-the-shelf" (COTS) equipment and open-source software. Data were prospectively collected on predefined templates.

Results: Fifty-two children were enrolled, for a total of 170 ultrasound findings. Sensitivity, specificity, positive and negative predictive values of TELE POC were: 93.8, 99.7, 96.8, 99.4 when compared to UNBLIND RAD and 88.2, 99.7, 96.8, 98.7 when compared to BLIND RAD. The inter-observers agreement between the paediatricians and either the unblind or blind radiologist was excellent (k = 0.93). The mean duration of TELE POC was 6.3 minutes (95% CI 4.1 to 8.5). Technical difficulties occurred in two (3.8%) cases. Quality of the transmission was rated as fair, good, very good and excellent in 7.7%, 15.4%, 42.3% and 34.6% of cases respectively, while in no case was it rated as poor.

Conclusions: POC US performed by paediatricians in ED guided via tele-radiology by an expert radiologist (TELE POC) produced reliable and timely diagnoses. Findings of this study, especially for the rarer conditions under evaluation, need further confirmation. Future research should investigate the overall benefits and the cost savings of using tele-ultrasound to perform US "at children's bedsides", under remote guidance of expert radiologists.

Fig 1. Components of the TELE-POC.

Fig 2. Images of the TELE-POC performed by the paediatrician in the emergency department (bottom right] as appears on the radiologist’s computer.

Fig 3. Detail of the images transmitted via tele-ultrasound, as appear on the radiologist’s screen, also showing the buttons for remote control of the webcam, zooming functions and volume.

Fig 4. START Study flow diagram.

Fig 5. Quality of transmission via tele-POC.