Kenyan sign language word-based pose dataset

Abstract

In an era where technology fosters inclusion, sign language remains underrepresented in linguistic datasets, especially for low-resource languages such as Kenyan Sign Language (KSL). This paper presents a novel dataset created using MediaPipe's pose estimation technology, designed to address the scarcity of resources for KSL. The dataset includes 20,000 video recordings of KSL gestures, converted into anonymized stickman representations alongside detailed 3D pose coordinates stored in .npy files. The data collection process focused on preserving participant privacy while ensuring the integrity of gesture data. By utilizing pose estimation, the dataset captures manual and non-manual features of KSL while maintaining the anonymity of signers. Stickman representations abstract human features, mitigating ethical concerns associated with traditional video datasets and aligning with privacy-preserving practices. The dataset spans a diverse range of themes relevant to KSL, including daily interactions, cultural expressions, and educational contexts, providing comprehensive coverage of the KSL lexicon. This dataset is designed for reuse across multiple domains. Researchers can leverage it to train machine learning models for sign language recognition, while educators can utilize it to develop interactive language learning tools. Additionally, it supports the development of virtual sign language interpreters and 3D avatars for accessibility applications. By enabling seamless integration into machine learning frameworks, the dataset facilitates advancements in KSL-related technologies and contributes to bridging communication gaps within the Deaf community.

Keywords: Kenyan sign language; Low resource languages; Pose estimation; Stickman representation.

Fig. 1

Reading NPY File with landmarks using python.

Fig. 2

Age distribution of respondents by gender.

Fig. 3

School distribution by gender.

Fig. 4

School distribution by experience.

Fig. 5

Video segmentation using ELAN tool.

Fig. 6

Segmentation process based on the tiers.

Fig. 7

Pose estimation.

Fig. 8

Stickman generation.

Fig. 9

Pose estimation and stickman generation process.