A tree-based corpus annotated with Cyber-Syndrome, symptoms, and acupoints

Abstract

Prolonged and over-excessive interaction with cyberspace poses a threat to people's health and leads to the occurrence of Cyber-Syndrome, which covers not only physiological but also psychological disorders. This paper aims to create a tree-shaped gold-standard corpus that annotates the Cyber-Syndrome, clinical manifestations, and acupoints that can alleviate their symptoms or signs, designating this corpus as CS-A. In the CS-A corpus, this paper defines six entities and relations subject to annotation. There are 448 texts to annotate in total manually. After three rounds of updating the annotation guidelines, the inter-annotator agreement (IAA) improved significantly, resulting in a higher IAA score of 86.05%. The purpose of constructing CS-A corpus is to increase the popularity of Cyber-Syndrome and draw attention to its subtle impact on people's health. Meanwhile, annotated corpus promotes the development of natural language processing technology. Some model experiments can be implemented based on this corpus, such as optimizing and improving models for discontinuous entity recognition, nested entity recognition, etc. The CS-A corpus has been uploaded to figshare.

Fig. 1

Examples of entity annotation: (a) overlapping entities; (b) discontinuous entities; (c) nested entities; (d) adjectives.

Fig. 2

Examples of relationship annotation. (a) The first case of the relationship annotation of causes and Is_synon in the same sentence. (b) The second case of the relationship annotation of causes and Is_synon in the same sentence. (c) An example of annotation when Disease/Cyber-Syndrome entities and their abbreviations in different sentences. (d) An example of annotation when Disease/Cyber-Syndrome entities and their anaphors in different sentences.

Fig. 3

Statics on the ultimate number of entities and relationships annotated: (a) Number of entities (b) Number of relations.

Fig. 4

Examples of supplementary rules after inconsistency annotation analysis. (a) An example of supplementary rules for disease annotation. (b) An example of annotation rules when symptoms/signs and their technical terms are present at the same time. (c) An example of syndromes/signs rules for (Syndrome_1 ∪ Syndrome_2 ∪... ∪ Syndrome_N) ∪ (body part 1 ∪ body part 2 ∪...∪ body part M). (d) An example of syndromes/signs rules for (Syndrome_1 ∪ Syndrome_2 ∪... ∪ Syndrome_N) ∪ body part. (e) An example of syndromes/signs rules for Syndrome ∪ (body part 1 ∪ body part 2 ∪...∪ body part M).

Fig. 5

Comparison of annotation agreement scores for each entity and relation. (a) Three-round entity annotation agreement scores. (b) Three-round relation annotation agreement scores.

Fig. 6

Example of CS-A corpus - Take the Cyber-Syndrome represented by D001251 as an example, the four acupoints of tianyou, sizhukong, luoque, and yangbai can relieve its symptoms.