Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2021 Aug 30;21(17):5843.
doi: 10.3390/s21175843.

Artificial Intelligence Technologies for Sign Language

Ilias Papastratis  1 , Christos Chatzikonstantinou  1 , Dimitrios Konstantinidis  1 , Kosmas Dimitropoulos  1 , Petros Daras  1
Affiliations
Review

Artificial Intelligence Technologies for Sign Language

Ilias Papastratis et al. Sensors (Basel). .

Abstract

AI technologies can play an important role in breaking down the communication barriers of deaf or hearing-impaired people with other communities, contributing significantly to their social inclusion. Recent advances in both sensing technologies and AI algorithms have paved the way for the development of various applications aiming at fulfilling the needs of deaf and hearing-impaired communities. To this end, this survey aims to provide a comprehensive review of state-of-the-art methods in sign language capturing, recognition, translation and representation, pinpointing their advantages and limitations. In addition, the survey presents a number of applications, while it discusses the main challenges in the field of sign language technologies. Future research direction are also proposed in order to assist prospective researchers towards further advancing the field.

Keywords: applications; sign language capturing; sign language recognition; sign language representation.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Figures

Figure 1
Figure 1
Sign language technologies.
Figure 2
Figure 2
Flowchart of the systematic literature search process.
Figure 3
Figure 3
Radar charts showcasing the findings of this survey regarding (a) the literature methods for CSLR, ISLR and SLP and (b) the characteristics of each AI sign language technology.
See this image and copyright information in PMC

References

    1. Kendon A. Gesture: Visible Action as Utterance. Cambridge University Press; Cambridge, UK: 2004.
    1. Stefanidis K., Konstantinidis D., Kalvourtzis A., Dimitropoulos K., Daras P. Recent Advances in 3D Imaging, Modeling, and Reconstruction. IGI Global; Hershey, PA, USA: 2020. 3D technologies and applications in sign language; pp. 50–78.
    1. Kudrinko K., Flavin E., Zhu X., Li Q. Wearable Sensor-Based Sign Language Recognition: A Comprehensive Review. IEEE Rev. Biomed. Eng. 2020;14:82–97. doi: 10.1109/RBME.2020.3019769. - DOI - PubMed
    1. Nimisha K., Jacob A. A brief review of the recent trends in sign language recognition; Proceedings of the IEEE 2020 International Conference on Communication and Signal Processing (ICCSP); Virtual. 16–18 March 2021; pp. 186–190.
    1. Safeel M., Sukumar T., Shashank K., Arman M., Shashidhar R., Puneeth S. Sign Language Recognition Techniques—A Review; Proceedings of the 2020 IEEE International Conference for Innovation in Technology (INOCON); Bangalore, India. 19–21 November 2021; pp. 1–9.

LinkOut - more resources