User Profiling and Context Understanding for Adaptive and Personalised Museum Experiences

  • Claudio Baecchi MICC - University of Firenze
  • Andrea Ferracani MICC - University of Firenze
  • Alberto Del Bimbo MICC - University of Firenze

Abstract [eng]

In this article we present an integrated multimedia system for passive and active profiling of visitors in the Donatello room of the Bargello Museum in Florence. The system is composed by two Computer Vision powered modules: 1) the first, MNEMOSYNE, based on passive observation of visitors through cameras, builds a list of the artworks of interest for each visitor. These preferred artworks are then used to deliver personalised content and targeted recommendation of other items of interest on an interactive table exploiting user re-identification; 2) the latter, SeeForMe, is a wearable embedded system featuring an application which augments the functions of the well-known museum audio guides. The embedded system provides real-time artwork recognition on data obtained through a micro-camera exploiting a Convolutional Neural Network; furthermore it is smart, understanding the context and user behaviours such as walking, talking or being distracted and reacting consequently.

Published
2019-12-25
How to Cite
BAECCHI, Claudio; FERRACANI, Andrea; DEL BIMBO, Alberto. User Profiling and Context Understanding for Adaptive and Personalised Museum Experiences. DigitCult - Scientific Journal on Digital Cultures, [S.l.], v. 4, n. 2, p. 15-28, dec. 2019. ISSN 2531-5994. Available at: <https://digitcult.lim.di.unimi.it/index.php/dc/article/view/130>. Date accessed: 27 oct. 2021. doi: https://doi.org/10.4399/97888255301482.