The World Conference on Stock Assessment Methods (July 2013) included a workshop on testing assessment methods through simula- tions. The exercise was made up of two steps applied to datasets from 14 representative fish stocks from around the world. Step 1 involved applyingstockassessmentstodatasetswithvaryingdegreesofeffortdedicatedtooptimizingfit.Step2wasappliedtoasubsetofthestocks and involved characteristics of given model fits being used to generate pseudo-data with error. These pseudo-data were then provided to assessment modellers and fits to the pseudo-data provided consistency checks within (self-tests) and among (cross-tests) assessment models. Although trends in biomass were often similar across models, the scaling of absolute biomass was not consistent across models. Similar types of models tended to perform similarly (e.g. age based or production models). Self-testing and cross-testing of models are a useful diagnostic approach, and suggested that estimates in the most recent years of time-series were the least robust. Results from the simulation exercise provide a basis for guidance on future large-scale simulation experiments and demonstrate the need for strategic investments in the evaluation and development of stock assessment methods.

DEROBA J.J.;  BUTTERWORTH D.S.;  METHOT R.D.;  DE OLIVEIRA José;  FERNANDEZ C.;  NIELSEN Anders;  CADRIN S.X.;  DICKEY-COLLAS M.;  LEGAULT Chris;  IANELLI J.;  VALERO J.;  NEEDLE C.;  O’MALLEY J.M.;  CHANG Y-J;  THOMPSON J.J.;  CANALES C.;  SWAIN D.P.;  MILLER D.;  HINTZEN Niels T.;  BERTIGNAC M.;  IBAIBARRIAGA L.;  SILVA A.;  MURTA Alberto;  KELL Laurence T.;  DE MOOR C.L.;  PARMA A.M.;  DICHMONT C.M.;  RESTREPO V.R.;  YE Y.;  GAMITO JARDIM José Ernesto;  SPENCER P.;  HANSELMAN D.H.;  BLAYLOCK J.;  MOOD M.;  HULSON P.J.F; 

2015-01-21

OXFORD UNIV PRESS

JRC87099

1054-3139,   

http://icesjms.oxfordjournals.org/content/72/1/19.full.pdf,    html,    https://publications.jrc.ec.europa.eu/repository/handle/JRC87099,   

10.1093/icesjms/fst237,