The RAMI On-line Model Checker (ROMC)

Abstract

The RAMI On-line Model Checker (ROMC) is a web-based tool (http://romc.jrc.it/)** allowing for the automated evaluation of canopy radiation transfer (RT) models. This is achieved by comparing simulation results submitted by registered ROMC users to a reference dataset established from credible 3-D Monte Carlo models during the third phase of the RAdiation transfer Model Intercomparison (RAMI) exercise. Access to the ROMC is free and allows users to assess their model performance either in “debug mode” (if users want to evaluate the impact of changes in their model’s software code/parameter input with respect to some user-selected test cases identical to those in RAMI), or, in “validate mode” (if users want to evaluate the performance of their model against a random selection of test cases not included within RAMI). Upon successful submission, registered ROMC users will be presented with various results statistics and graphical displays that document the performance of their model with respect to the reference dataset. In addition to providing an indication of the overall skill of a model to correctly match the reference data, the ROMC also allows for interactive comparison/evaluation of the differences existing between various versions of the same model. Furthermore, ROMC users can download encapsulated postscript versions of these graphical results files, and – in debug mode only – may also receive ASCII files containing the ROMC reference data. ROMC graphs come with a reference number and may be used in presentations and – in validate mode – also in refereed scientific publications to underline the quality of a given model. As such the ROMC is a good example, on how a concerted, voluntary community effort (i.e., RAMI) has led to tangible results that benefit both model developers and their customers.