Title: Rickety numbers: Volatility of university rankings and policy implications
Authors: SAISANA MichaelaD'HOMBRES BeatriceSALTELLI Andrea
Citation: RESEARCH POLICY vol. 40 no. 1 p. 165-177
Publication Year: 2011
JRC N°: JRC48717
ISSN: 0048-7333
URI: http://publications.jrc.ec.europa.eu/repository/handle/JRC48717
DOI: 10.1016/j.respol.2010.09.003
Type: Articles in periodicals and books
Abstract: The most popular world university rankings are routinely taken at face value by media and social actors. While these rankings are politically influential, they are sensitive to both the conceptual framework (the set of indicators) and the modelling choices made in their construction (e.g., weighting or type of aggregation). A robustness analysis, based on a multi-modelling approach, aims to test the validity of the inference about the rankings produced in the Academic Ranking of World Universities (ARWU) of Shanghai Jiao Tong University and those produced by the UK¿s Times Higher Education Supplement (THES). Conclusions are drawn on the reliability of individual university ranks and on relative country or macro regional performance (e.g., Europe versus USA versus China) in terms of the number of top performing institutions. We find that while university and country level statistical inferences are unsound, the inference on macro regions is more robust. The paper also aims to propose an alternative ranking which is more dependant on the framework than on the methodological choices.
JRC Directorate:Space, Security and Migration

Files in This Item:
There are no files associated with this item.

Items in repository are protected by copyright, with all rights reserved, unless otherwise indicated.