Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 Sep 21;5(9):e140.
doi: 10.2196/mhealth.8534.

Social Communication Coaching Smartglasses: Well Tolerated in a Diverse Sample of Children and Adults With Autism

Neha U Keshav  1 , Joseph P Salisbury  1 , Arshya Vahabzadeh  1   2 , Ned T Sahin  1   3
Affiliations

Social Communication Coaching Smartglasses: Well Tolerated in a Diverse Sample of Children and Adults With Autism

Neha U Keshav et al. JMIR Mhealth Uhealth. .

Abstract

Background: Augmented reality (AR) smartglasses are an emerging technology that is under investigation as a social communication aid for children and adults with autism spectrum disorder (ASD) and as a research tool to aid with digital phenotyping. Tolerability of this wearable technology in people with ASD is an important area for research, especially as these individuals may experience sensory, cognitive, and attentional challenges.

Objective: The aim of this study was to assess the tolerability and usability of a novel smartglasses system that has been designed as a social communication aid for children and adults with autism (the Brain Power Autism System [BPAS]). BPAS runs on Google Glass Explorer Edition and other smartglasses, uses both AR and affective artificial intelligence, and helps users learn key social and emotional skills.

Methods: A total of 21 children and adults with ASD across a spectrum of severity used BPAS for a coaching session. The user's tolerability to the smartglasses, user being able to wear the smartglasses for 1 minute (initial tolerability threshold), and user being able to wear the smartglasses for the entire duration of the coaching session (whole session tolerability threshold) were determined through caregiver report.

Results: Of 21 users, 19 (91%) demonstrated tolerability on all 3 measures. Caregivers reported 21 out of 21 users (100%) as tolerating the experience, while study staff found only 19 out of 21 users managed to demonstrate initial tolerability (91%). Of the 19 users who demonstrated initial tolerability, all 19 (100%) were able to use the smartglasses for the entire session (whole session tolerability threshold). Caregivers reported that 19 out of 21 users (91%) successfully used BPAS, and users surpassed caregiver expectations in 15 of 21 cases (71%). Users who could communicate reported BPAS as being comfortable (94%).

Conclusions: This preliminary report suggests that BPAS is well tolerated and usable to a diverse age- and severity-range of people with ASD. This is encouraging as these devices are being developed as assistive technologies for people with ASD. Further research should focus on improving smartglasses design and exploring their efficacy in helping with social communication in children and adults with ASD.

Keywords: augmented reality; autism; autism spectrum disorder; digital health; education; medtech; smartglasses; tech; technology.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: This report was supported by Brain Power, a neurotechnology company developing a range of artificially intelligent wearable technologies. Brain Power has engineering and technical partnerships with major technology companies and also receives funding support from federal and congressional sources.

Figures

Figure 1
Figure 1
Three users with autism wearing the Brain Power Autism System and using its socioemotional coaching apps. Pictures used with user/caregiver permission.
Figure 2
Figure 2
Caregiver assisting user in wearing Brain Power Autism System smartglasses during testing (A, B). User demonstrated tolerability on all 3 measures and was witnessed to spontaneously hug his caregiver during use of social communication app use (C, D). Pictures used with user/caregiver permission.
Figure 3
Figure 3
Summary of Brain Power Autism System tolerability and experience.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Elder S, Vakaloudis A. A technical evaluation of devices for smart glasses applications. Internet Technologies and Applications (ITA); 2015; Wrexham. 2015.
    1. Elder S, Vakaloudis A. Towards uniformity for smart glasses devices: an assessment of function as the driver for standardisation. Technology and Society (ISTAS), 2015 IEEE International Symposium; 2015; Dublin. 2015.
    1. Grynszpan O, Weiss P, Perez-Diaz F, Gal E. Innovative technology-based interventions for autism spectrum disorders: a meta-analysis. Autism. 2013 Oct 03;18(4):346–361. doi: 10.1177/1362361313476767. - DOI - PubMed
    1. Newbutt N, Sung C, Kuo H, Leahy M. Recent Advances in Technologies for Inclusive Well-Being. New York: Springer; 2017. The acceptance, challenges, and future applications of wearable technology and virtual reality to support people with autism spectrum disorders; pp. 221–241.
    1. Chen C, Lee I, Lin L. Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Comput Hum Behav. 2016 Feb;55:477–485. doi: 10.1016/j.chb.2015.09.033. - DOI