Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

When experts disagree: Response aggregation and Its consequences in expert surveys

Lindstadt, Rene, Proksch, Sven-Oliver and Slapin, Jonathan B. 2020. When experts disagree: Response aggregation and Its consequences in expert surveys. Political Science Research and Methods 8 (3) , pp. 580-588. 10.1017/psrm.2018.52

PDF - Accepted Post-Print Version
Download (214kB) | Preview


Political scientists use expert surveys to assess latent features of political actors. Experts, though, are unlikely to be equally informed and assess all actors equally well. The literature acknowledges variance in measurement quality, but pays little attention to the implications of uncertainty for aggregating responses. We discuss the nature of the measurement problem in expert surveys. We then propose methods to assess the ability of experts to judge where actors stand and to aggregate expert responses. We examine the effects of aggregation for a prominent survey in the literature on party politics and EU integration. Using a Monte Carlo simulation, we demonstrate that it is better to aggregate expert responses using the median or modal response, rather than the mean.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Department of Politics and International Relations (POLIR)
Publisher: Cambridge University Press (CUP)
ISSN: 2049-8470
Related URLs:
Date of First Compliant Deposit: 25 January 2019
Date of Acceptance: 25 September 2018
Last Modified: 27 Nov 2020 09:06

Citation Data

Cited 4 times in Google Scholar. View in Google Scholar

Cited 3 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item Edit Item


Downloads per month over past year

View more statistics