Multimodal data for behavioural authentication in Internet of Things environments

Identifying humans based on their behavioural patterns represents an attractive basis for access control, as such patterns appear naturally, do not require focused effort from the user side, and do not impose additional burden of memorising passwords. One means of capturing behavioural patterns is through passive sensors laid out in a target environment. Thanks to the proliferation of the Internet of Things (IoT), sensing devices are already embedded in our everyday surroundings and representing a rich source of multimodal data. Nevertheless, collecting such data for authentication research purposes is challenging, as it entails management and synchronisation of a range of sensing devices, design of diverse tasks that would evoke different behaviour patterns, storage and pre-processing of data arriving from multiple sources, and the execution of long-lasting user activities. Consequently, to the best of our knowledge, no publicly available datasets suitable for behaviour-based authentication research exist. In this brief article we describe the first multimodal dataset for behavioural authentication research collected in a sensor-enabled IoT setting. The dataset comprises of high-frequency accelerometer, gyroscope, and force sensor data collected from an office-like environment. In addition, the dataset contains 3D point clouds collected with a wireless radar and electroencephalogram (EEG) readings from a wireless EEG cap worn by the study participants. Within the environment, 54 volunteers have conducted 6 different tasks that were constructed to elicit different behaviours and different cognitive load levels, resulting in a total of 16 hours of multimodal data. The richness of the dataset comprising 5 different sensing modalities, a variability of tasks including keyboard typing, hand gesturing, walking, and other activities, opens a range of opportunities for research in behaviour-based authentication, but also the understanding of the role of different tasks and cognitive load levels on human behaviour.

KRASOVEC Andraz;  BALDINI Gianmarco;  PEJOVIC Veljko; 

2025-04-08

ELSEVIER BV

JRC137672

2352-3409 (online),   

https://www.sciencedirect.com/science/article/pii/S2352340924006644,    https://publications.jrc.ec.europa.eu/repository/handle/JRC137672,   

10.1016/j.dib.2024.110697 (online),