Simulation testing the robustness of stock assessment models to error: some results from the ICES strategic initiative on stock assessment methods
The World Conference on Stock Assessment Methods (July 2013) included a workshop on testing assessment methods through simula-
tions. The exercise was made up of two steps applied to datasets from 14 representative fish stocks from around the world. Step 1 involved
applyingstockassessmentstodatasetswithvaryingdegreesofeffortdedicatedtooptimizingfit.Step2wasappliedtoasubsetofthestocks
and involved characteristics of given model fits being used to generate pseudo-data with error. These pseudo-data were then provided to
assessment modellers and fits to the pseudo-data provided consistency checks within (self-tests) and among (cross-tests) assessment
models. Although trends in biomass were often similar across models, the scaling of absolute biomass was not consistent across
models. Similar types of models tended to perform similarly (e.g. age based or production models). Self-testing and cross-testing
of models are a useful diagnostic approach, and suggested that estimates in the most recent years of time-series were the least robust.
Results from the simulation exercise provide a basis for guidance on future large-scale simulation experiments and demonstrate the
need for strategic investments in the evaluation and development of stock assessment methods.
DEROBA J.J.;
BUTTERWORTH D.S.;
METHOT R.D.;
DE OLIVEIRA José;
FERNANDEZ C.;
NIELSEN Anders;
CADRIN S.X.;
DICKEY-COLLAS M.;
LEGAULT Chris;
IANELLI J.;
VALERO J.;
NEEDLE C.;
O’MALLEY J.M.;
CHANG Y-J;
THOMPSON J.J.;
CANALES C.;
SWAIN D.P.;
MILLER D.;
HINTZEN Niels T.;
BERTIGNAC M.;
IBAIBARRIAGA L.;
SILVA A.;
MURTA Alberto;
KELL Laurence T.;
DE MOOR C.L.;
PARMA A.M.;
DICHMONT C.M.;
RESTREPO V.R.;
YE Y.;
GAMITO JARDIM José Ernesto;
SPENCER P.;
HANSELMAN D.H.;
BLAYLOCK J.;
MOOD M.;
HULSON P.J.F;
2015-01-21
OXFORD UNIV PRESS
JRC87099
1054-3139,
http://icesjms.oxfordjournals.org/content/72/1/19.full.pdf,
html,
https://publications.jrc.ec.europa.eu/repository/handle/JRC87099,
10.1093/icesjms/fst237,
Additional supporting files
| File name | Description | File type | |
|---|
