General intelligence disentangled via a generality metric for natural and artificial intelligence

Success in all sorts of situations is the most classical interpretation of general intelligence. Under limited resources, however, the capability of an agent must necessarily be limited too, and generality needs to be understood as comprehensive performance up to a level of difficulty. The degree of generality then refers to the way an agent’s capability is distributed as a function of task difficulty. This dissects the notion of general intelligence into two non-populational measures, generality and capability, which we apply to individuals and groups of humans, other animals and AI systems, on several cognitive and perceptual tests. Our results indicate that generality and capability can decouple at the individual level: very specialised agents can show high capability and vice versa. The metrics also decouple at the population level, and we rarely see diminishing returns in generality for those groups of high capability. We relate the individual measure of generality to traditional notions of general intelligence and cognitive efficiency in humans, collectives, non-human animals and machines. The choice of the difficulty function now plays a prominent role in this new conception of generality, which brings a quantitative tool for shedding light on long-standing questions about the evolution of general intelligence and the evaluation of progress in Artificial General Intelligence.

HERNÁNDEZ-ORALLO José;  LOE Bao Sheng;  CHEKE Lucy;  MARTINEZ PLUMED Fernando;  Ó HÉIGEARTAIGH Seán; 

2021-12-01

NATURE PUBLISHING GROUP

JRC124268

2045-2322 (online),   

https://www.nature.com/articles/s41598-021-01997-7,    https://publications.jrc.ec.europa.eu/repository/handle/JRC124268,   

10.1038/s41598-021-01997-7 (online),