Cognitive complexity of evaluator competencies

Abstract

A critical aspect of evaluator education and professional learning is to educate evaluators who know the major evaluation models and learn how to manage relationships and solve complex problems when conducting, critiquing, developing and interpreting evaluations. The American and Australian Evaluation Associations have specified desired evaluator competencies, although developing a core curriculum for evaluation still seems elusive. It is suggested that these various competencies can be considered in terms of their levels of cognitive complexity. A model of cognitive complexity is utilised to explore the tasks and thinking of evaluators, leading to an important distinction between 'knowing that' and 'knowing how' in relation to evaluation tasks. As an illustration of this posited relationship, the Australian 'Evaluators Professional Learning Competencies' were coded according to their cognitive complexity. Two-thirds of these competencies were classed as 'knowing that' or surface thinking, and one third were classified as 'knowing how' or deeper thinking. A taxonomy is offered as a method to understand models of learning necessary for evaluator education and training, as well as for further development of professional evaluator competencies.

Keywords: Cognitive complexity; Course development; Evaluation education; Evaluation thinking; Evaluator competencies.