Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Nov 11:51:109797.
doi: 10.1016/j.dib.2023.109797. eCollection 2023 Dec.

KU-BdSL: An open dataset for Bengali sign language recognition

Abdullah Al Jaid Jim  1 , Ibrahim Rafi  1 , Md Zahid Akon  2 , Uzzal Biswas  1 , Abdullah-Al Nahid  1
Affiliations

KU-BdSL: An open dataset for Bengali sign language recognition

Abdullah Al Jaid Jim et al. Data Brief. .

Abstract

Sign language is a form of communication medium for speech and hearing disabled people. It has various forms with different troublesome patterns, which are difficult for the general mass to comprehend. Bengali sign language (BdSL) is one of the difficult sign languages due to its immense number of alphabet, words, and expression techniques. Machine translation can ease the difficulty for disabled people to communicate with generals. From the machine learning (ML) domain, computer vision can be the solution for them, and every ML solution requires a optimized model and a proper dataset. Therefore, in this research work, we have created a BdSL dataset and named `KU-BdSL', which consists of 30 classes describing 38 consonants ('banjonborno') of the Bengali alphabet. The dataset includes 1500 images of hand signs in total, each representing Bengali consonant(s). Thirty-nine participants (30 males and 9 females) of different ages (21-38 years) participated in the creation of this dataset. We adopted smartphones to capture the images due to the availability of their high-definition cameras. We believe that this dataset can be beneficial to the deaf and dumb (D&D) community. Identification of Bengali consonants of BdSL from images or videos is feasible using the dataset. It can also be employed for a human-machine interface for disabled people. In the future, we will work on the vowels and word level of BdSL.

Keywords: Bengali sign language; Computer vision; Deep learning; Machine learning; Sign language recognition.

PubMed Disclaimer

Figures

Fig. 1:
Fig. 1
Different hand gestures for ‘Chandra bindu’.
Fig. 2:
Fig. 2
Creation of USLD variant.
See this image and copyright information in PMC

References

    1. Tathe S.V., Narote S.P. Face detection using color models. World J. Sci. Technol. 2012;2(4):182–185.
    1. Pavel D.S.H., Mustafiz T., Sarkar A.I., Rokonuzzaman M. ICCIT. 2003. Geometrical model based hand gesture recognition for interpreting Bengali sign language using computer vision.
    1. Sarkar B., Datta K., Datta C.D., Sarkar D., Dutta S.J., Roy I.D.…Paul A. 2009 Annual IEEE India Conference. IEEE; 2009. A translator for Bangla text to sign language; pp. 1–4.
    1. Rahim F.M., Mursalin T.E., Sultana N. Intelligent sign language verification system–using image processing, clustering and neural network concepts. Int. J. Eng. Comput. Sci. Math. 2010;1(1):43–56.
    1. Uddin M.A., Chowdhury S.A. 2016 International Conference on Innovations in Science, Engineering and Technology (ICISET) IEEE; 2016. Hand sign language recognition for Bangla alphabet using support vector machine; pp. 1–4.

LinkOut - more resources