Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017:2017:4306416.
doi: 10.1155/2017/4306416. Epub 2017 Nov 2.

A Cross-Lingual Mobile Medical Communication System Prototype for Foreigners and Subjects with Speech, Hearing, and Mental Disabilities Based on Pictograms

Krzysztof Wołk  1 , Agnieszka Wołk  1 , Wojciech Glinkowski  2
Affiliations

A Cross-Lingual Mobile Medical Communication System Prototype for Foreigners and Subjects with Speech, Hearing, and Mental Disabilities Based on Pictograms

Krzysztof Wołk et al. Comput Math Methods Med. 2017.

Abstract

People with speech, hearing, or mental impairment require special communication assistance, especially for medical purposes. Automatic solutions for speech recognition and voice synthesis from text are poor fits for communication in the medical domain because they are dependent on error-prone statistical models. Systems dependent on manual text input are insufficient. Recently introduced systems for automatic sign language recognition are dependent on statistical models as well as on image and gesture quality. Such systems remain in early development and are based mostly on minimal hand gestures unsuitable for medical purposes. Furthermore, solutions that rely on the Internet cannot be used after disasters that require humanitarian aid. We propose a high-speed, intuitive, Internet-free, voice-free, and text-free tool suited for emergency medical communication. Our solution is a pictogram-based application that provides easy communication for individuals who have speech or hearing impairment or mental health issues that impair communication, as well as foreigners who do not speak the local language. It provides support and clarification in communication by using intuitive icons and interactive symbols that are easy to use on a mobile device. Such pictogram-based communication can be quite effective and ultimately make people's lives happier, easier, and safer.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Statistics of English language knowledge.
Figure 2
Figure 2
Basic smart watch application parts.
Figure 3
Figure 3
Navigation and additional functions.
Figure 4
Figure 4
Diet symbol for hunger.
Figure 5
Figure 5
Aid to communicate pain.
Figure 6
Figure 6
Aid to communicate mood or emotion.
Figure 7
Figure 7
Age groups statistics.
Figure 8
Figure 8
Gender by age.
Figure 9
Figure 9
Disability by gender.
Figure 10
Figure 10
Disability breakdown.
Figure 11
Figure 11
Mental health.
Figure 12
Figure 12
Visual impairment.
See this image and copyright information in PMC

References

    1. Wac K. Smartphone as a personal, pervasive health informatics services platform: literature review. arXiv:1310.7965. - PubMed
    1. Schwanke T. D., Smith R. O. Assistive technology outcomes in work settings. Work. 2005;24(2):195–204. - PubMed
    1. Susick M. Application of smartphone technology in the management and treatment of mental illnesses [Doctoral dissertation] University of Pittsburgh; 2011.
    1. Luxton D. D., McCann R. A., Bush N. E., Mishkind M. C., Reger G. M. mHealth for mental health: integrating smartphone technology in behavioral healthcare. Professional Psychology: Research and Practice. 2011;42(6):505–512. doi: 10.1037/a0024485. - DOI
    1. Kazdin A. E., Blase S. L. Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspectives on Psychological Science. 2011;6(1):21–37. doi: 10.1177/1745691610393527. - DOI - PubMed

MeSH terms

LinkOut - more resources