Title: Insights into survey errors of large scale educational achievement surveys
Publisher: Publications Office of the European Union
Publication Year: 2018
JRC N°: JRC111734
ISBN: 978-92-79-85795-9
ISSN: 2467-2203
Other Identifiers: OP KJ-AE-18-005-EN-N
URI: http://publications.jrc.ec.europa.eu/repository/handle/JRC111734
DOI: 10.2760/219007
Type: EUR - Scientific and Technical Research Reports
Abstract: While educational achievement surveys revolutionised research on education cross-nationally, the surveys have been repeatedly subject of heated debate since first results were published. This paper reviews existing research examining the design and methodology of educational achievement surveys. Results are reported by allocating them to the specific survey error component of achievement estimates they address. Different error components from the design, collection, processing and analysis of survey data constitute the total survey error, which is an error difficult to quantify but important for assessing the overall accuracy of the surveys’ achievement estimates. The review shows that there are many reasons to assume that the total survey error associated with countries’ educational achievement estimates is likely to be inflated by other errors besides the standard error reported by survey organisers. Given the policy relevance of the surveys’ estimates, policy makers and the research community would greatly benefit from survey organisers providing more transparency on the different potential errors of educational achievement estimates. Without this information the debate about the fitness of educational achievement data for policy making is unlikely to dissolve.
JRC Directorate:Joint Research Centre Corporate Activities

Files in This Item:
File Description SizeFormat 
jrc111734_jrc_wpef_insights_into_survey_errors_final_september_2018.pdf489.64 kBAdobe PDFView/Open

Items in repository are protected by copyright, with all rights reserved, unless otherwise indicated.