Sensitivity and Robustness Analyses in Social Multi-Criteria Evaluation of Public Policies

In policy arenas, the major virtue of multiple criteria decision analysis (MCDA) is the possibility of dealing with a plurality of multidimensional features both at technical and social levels. However, in this process there is always the danger of oversimplifying complex issues by creating false certainties. MCDA outputs may seem a precise result, while they are not, frequently. In this article, we propose the following improvements of the state of the art, in particular with reference to social multi-criteria evaluation (SMCE), which has been explicitly developed for public policies: • From an empirical point of view, a new approach, based on frequency matrices, to make output uncertainty transparent and easy to communicate; this helps improving the policy learning process, too. • Algorithmically, our approach allows to perform exhaustive sensitivity and robustness analyses in the context of the Kemeny median ranking aggregation rule by solving its computational time issue. • From the theoretical point of view, local and global sensitivity analyses are considered as complementary, while habitually they are considered as separate analyses; this is particularly relevant for criterion weights, which are one of the most sensitive input parameters in real-world MCDA applications. • Finally, we present an illustrative example, where we summarise the whole approach and put emphasis on the role of sensitivity analysis as a tool for better understanding the overall decision model and explore its informative content.

AZZINI Ivano;  MUNDA Giuseppe; 

2025-02-21

JOHN WILEY AND SONS LTD

JRC138872

1099-1360 (online),   

https://publications.jrc.ec.europa.eu/repository/handle/JRC138872,   

10.1002/mcda.70006 (online),