Academic judgments under uncertainty: A study of collective anchoring effects in Swedish Research Council panel groups
2017 (English)In: Social Studies of Science, ISSN 0306-3127, E-ISSN 1460-3659, Vol. 47, no 1, 95-116 p.Article in journal (Refereed) Published
This article focuses on anchoring effects in the process of peer reviewing research proposals. Anchoring effects are commonly seen as the result of flaws in human judgment, as cognitive biases that stem from specific heuristics that guide people when they involve their intuition in solving a problem. Here, the cognitive biases will be analyzed from a sociological point of view, as interactional and aggregated phenomena. The article is based on direct observations of ten panel groups evaluating research proposals in the natural and engineering sciences for the Swedish Research Council. The analysis suggests that collective anchoring effects emerge as a result of the combination of the evaluation techniques that are being used (grading scales and average ranking) and the efforts of the evaluators to reach consensus in the face of disagreements and uncertainty in the group. What many commentators and evaluators have interpreted as an element of chance in the peer review process may also be understood as partly a result of the dynamic aspects of collective anchoring effects.
Place, publisher, year, edition, pages
2017. Vol. 47, no 1, 95-116 p.
academic judgment, anchoring effects, double heuristics, evaluation, peer review, uncertainty
Research subject Sociology
IdentifiersURN: urn:nbn:se:su:diva-135872DOI: 10.1177/0306312716659789OAI: oai:DiVA.org:su-135872DiVA: diva2:1049647