Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Oct 12;7(1):21.
doi: 10.1007/s13755-019-0084-2. eCollection 2019 Dec.

Neural attention with character embeddings for hay fever detection from twitter

Jiahua Du  1 , Sandra Michalska  1 , Sudha Subramani  1 , Hua Wang  1 , Yanchun Zhang  1
Affiliations

Neural attention with character embeddings for hay fever detection from twitter

Jiahua Du et al. Health Inf Sci Syst. .

Abstract

The paper aims to leverage the highly unstructured user-generated content in the context of pollen allergy surveillance using neural networks with character embeddings and the attention mechanism. Currently, there is no accurate representation of hay fever prevalence, particularly in real-time scenarios. Social media serves as an alternative to extract knowledge about the condition, which is valuable for allergy sufferers, general practitioners, and policy makers. Despite tremendous potential offered, conventional natural language processing methods prove limited when exposed to the challenging nature of user-generated content. As a result, the detection of actual hay fever instances among the number of false positives, as well as the correct identification of non-technical expressions as pollen allergy symptoms poses a major problem. We propose a deep architecture enhanced with character embeddings and neural attention to improve the performance of hay fever-related content classification from Twitter data. Improvement in prediction is achieved due to the character-level semantics introduced, which effectively addresses the out-of-vocabulary problem in our dataset where the rate is approximately 9%. Overall, the study is a step forward towards improved real-time pollen allergy surveillance from social media with state-of-art technology.

Keywords: Deep learning; Hay fever; Pollen allergy; Twitter.

PubMed Disclaimer

Figures

Fig. 1
Fig. 1
Prevalence of allergic rhinitis sufferers in Australia [1]
See this image and copyright information in PMC

References

    1. Australian Institute of Health and Welfare (AIHW). Allergic rhinitis (‘hay fever’). https://www.aihw.gov.au/reports/chronic-respiratory-conditions/allergic-... (2016). Accessed 30 Jan 2019.
    1. Byrd K, Mansurov A, Baysal O. Mining twitter data for influenza detection and surveillance. In: Proceedings of the international workshop on software engineering in healthcare systems. New York: ACM; 2016. p. 43–9.
    1. Carletta J. Assessing agreement on classification tasks: the kappa statistic. Comput linguist. 1996;22(2):249–254.
    1. Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P. Natural language processing (almost) from scratch. J Mach Learn Res. 2011;12(Aug):2493–2537.
    1. Coppersmith G, Dredze M, Harman C. Quantifying mental health signals in twitter. In: Proceedings of the workshop on computational linguistics and clinical psychology: From linguistic signal to clinical reality, 2014, p. 51–60.