Content analysis: a comparison of manual and computerized systems

Abstract

Computerized content analysis is a technique for classifying texts. In personality research it has been used to make inferences about psychological states and traits of the speaker or writer. Whereas computerized techniques have been increasing in both sophistication and ease of use, questions remain regarding their validity compared to hand-scored scales. In this study, we compare a relatively simple computerized technique; a more sophisticated, context-sensitive computerized approach; and a context-sensitive, human-scored system. Seventy-one subjects, representing four diagnostic groups, provided free-speech samples which were scored according to all three methods. Data from each method were then submitted to discriminant and classification analyses. In comparing the classification performance of the three methods, we found that both computerized methods were more accurate than the human-scored method. The time and cost benefits of computerized systems are discussed.