Sensor Pattern Noise and Image Similarity for Picture-to-Identity Linking

Picture sharing through social networks has become a prominent phenomenon, producing a large amount of data that law enforcers may be entitled to use, under the proper legal framework, as a source of information for investigating a crime. In this work, we exploit digital camera 'fingerprinting' based on noise residuals (Sensor Pattern Noise or SPN) to achieve a novel forensic task, named Picture-to-Identity linking. It consists of finding social network accounts that possibly belong to the author of a certain photo (e.g, showing illegal content such as child abuse). The rationale is that the author of the offending photo has likely used the same camera for taking other (legal) pictures, and posted them in a social network account. We extend a previous work on the topic by coupling SPN with visual image similarity, a useful cue when pictures have been taken in the same environment (e.g., a room). We also improve the framework by allowing for multiple-image queries, and thoroughly evaluate the performance on two corpora of images from social network accounts, including the impact of image modifications. Reported results show a robust improvement with respect to the previous work, and prove the usefulness of Picture-to-Identity as an aid for digital forensic investigations.

SATTA Riccardo;  CIARDULLI Andrea; 

2016-01-20

INST ENGINEERING TECHNOLOGY-IET

JRC94629

1751-9632,   

http://digital-library.theiet.org/content/journals/10.1049/iet-cvi.2014.0320,    https://publications.jrc.ec.europa.eu/repository/handle/JRC94629,   

10.1049/iet-cvi.2014.0320,