Should We Stop Using Lexical Diversity Measures in Children's Language Sample Analysis?

Abstract

Purpose: Prior work has identified weaknesses in commonly used indices of lexical diversity in spoken language samples, such as type-token ratio (TTR) due to sample size and elicitation variation, we explored whether TTR and other diversity measures, such as number of different words/100 (NDW), vocabulary diversity (VocD), and the moving average TTR would be more sensitive to child age and clinical status (typically developing [TD] or developmental language disorder [DLD]) if samples were obtained from standardized prompts.

Method: We utilized archival data from the norming samples of the Test of Narrative Language and the Edmonton Narrative Norms Instrument. We examined lexical diversity and other linguistic properties of the samples, from a total of 1,048 children, ages 4-11 years; 798 of these were considered TD, whereas 250 were categorized as having a language learning disorder.

Results: TTR was the least sensitive to child age or diagnostic group, with good potential to misidentify children with DLD as TD and TD children as having DLD. Growth slopes of NDW were shallow and not very sensitive to diagnostic grouping. The strongest performing measure was VocD. Mean length of utterance, TNW, and verbs/utterance did show both good growth trajectories and ability to distinguish between clinical and typical samples.

Conclusions: This study, the largest and best controlled to date, re-affirms that TTR should not be used in clinical decision making with children. A second popular measure, NDW, is not measurably stronger in terms of its psychometric properties. Because the most sensitive measure of lexical diversity, VocD, is unlikely to gain popularity because of reliance on computer-assisted analysis, we suggest alternatives for the appraisal of children's expressive vocabulary skill.

Figure 1.

Regression findings, samples from the Test of Narrative Language (TNL). Growth trajectory of each measure from Gillam TNL corpus across age and for each group (typically developing children [TD] and children with developmental language disorder [DLD]). TTR = type–token ratio; NDW_100 = number of different words/100; VocD = vocabulary diversity.

Figure 2.

Regression findings, samples from the Edmonton Narrative Norms Inventory (ENNI). Growth trajectory of each measure from ENNI corpus across age and for each group (typically developing children [TD] and children with developmental language disorder [DLD]). TTR = type–token ratio; NDW_100 = number of different words/100; VocD = vocabulary diversity.