ANCHOLIK-NER: A benchmark dataset for Bangla regional named entity recognition
- PMID: 41739882
- PMCID: PMC12935308
- DOI: 10.1371/journal.pone.0342786
ANCHOLIK-NER: A benchmark dataset for Bangla regional named entity recognition
Abstract
Named Entity Recognition (NER) in regional dialects is a critical yet underexplored area in Natural Language Processing (NLP), especially for low-resource languages like Bangla. While NER systems for Standard Bangla have made progress, no existing resources or models specifically address the challenge of regional dialects such as Barishal, Chittagong, Mymensingh, Noakhali, and Sylhet, which exhibit unique linguistic features that existing models fail to handle effectively. To fill this gap, we introduce ANCHOLIK-NER, the first benchmark dataset for NER in Bangla regional dialects, comprising 17,405 sentences and 101,817 words annotated with 10 entity tags across 5 regions. The dataset was sourced from publicly available resources and supplemented with manual translations, ensuring alignment of named entities across dialects. We evaluate three transformer-based models-Bangla BERT, Bangla Bert Base, and BERT Base Multilingual Cased-on this dataset. Bangla BERT achieved the highest performance overall, with F1-scores of 82.27% (Mymensingh), 81.48% (Barishal), 78.75% (Sylhet), 78.50% (Noakhali), and 75.31% (Chittagong). These results highlight strong recognition capability in Mymensingh and Barishal, while dialectal variation in Chittagong remains challenging. As no prior NER resources exist for Bangla regional dialects, this work provides a foundational dataset and baseline benchmarks to facilitate future research. Future work will focus on dialect-aware model adaptation and expanding coverage to additional regions.
Copyright: © 2026 Paul et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Conflict of interest statement
The authors have declared that no competing interests exist.
Figures
References
-
- Grishman R, Sundheim BM. Message understanding conference-6: a brief history. In: COLING 1996 volume 1: The 16th international conference on computational linguistics. 1996.
-
- Chinchor N, Robinson P. Appendix E: MUC-7 named entity task definition (version 3.5). In: Seventh Message Understanding Conference (MUC-7): Proceedings of a Conference Held in Fairfax, Virginia, April 29-May 1, 1998. 1998.
-
- Le Meur C, Galliano S, Geoffrois E. Conventions d’annotations en entités nommées-ester. 2004.
-
- Nadeau D, Sekine S. A survey of named entity recognition and classification. LI. 2007;30(1):3–26. doi: 10.1075/li.30.1.03nad - DOI
-
- Mikheev A. A knowledge-free method for capitalized word disambiguation. In: Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics. 1999. p. 159–66. 10.3115/1034678.1034710 - DOI
LinkOut - more resources
Full Text Sources
Research Materials
Miscellaneous
