Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Aug 21:264:1558-1559.
doi: 10.3233/SHTI190533.

Do You Need Embeddings Trained on a Massive Specialized Corpus for Your Clinical Natural Language Processing Task?

Antoine Neuraz  1   2   3 , Vincent Looten  2   4 , Bastien Rance  2   4 , Nicolas Daniel  4 , Nicolas Garcelon  1   5 , Leonardo Campillos Llanos  3 , Anita Burgun  1   2   4 , Sophie Rosset  3
Affiliations

Do You Need Embeddings Trained on a Massive Specialized Corpus for Your Clinical Natural Language Processing Task?

Antoine Neuraz et al. Stud Health Technol Inform. .

Abstract

We explore the impact of data source on word representations for different NLP tasks in the clinical domain in French (natural language understanding and text classification). We compared word embeddings (Fasttext) and language models (ELMo), learned either on the general domain (Wikipedia) or on specialized data (electronic health records, EHR). The best results were obtained with ELMo representations learned on EHR data for one of the two tasks(+7% and +8% of gain in F1-score).

Keywords: Natural language processing; electronic health records.

PubMed Disclaimer

LinkOut - more resources