Publication

Activities of daily living monitoring via a wearable camera: toward real-world applications

Journal Article (2020)

Journal

IEEE Access

Pages

77344-77363

Volume

8

Doc link

https://doi.org/10.1109/ACCESS.2020.2990333

File

Download the digital copy of the doc pdf document

Authors

Abstract

Activity recognition from wearable photo-cameras is crucial for lifestyle characterization and health monitoring. However, to enable its wide-spreading use in real-world applications, a high level of generalization needs to be ensured on unseen users. Currently, state-of-the-art methods have been tested only on relatively small datasets consisting of data collected by a few users that are partially seen during training. In this paper, we built a new egocentric dataset acquired by 15 people through a wearable photo-camera and used it to test the generalization capabilities of several state-of-the-art methods for egocentric activity recognition on unseen users and daily image sequences. In addition, we propose several variants to state-of-the-art deep learning architectures, and we show that it is possible to achieve 79.87% accuracy on users unseen during training. Furthermore, to show that the proposed dataset and approach can be useful in real-world applications, where data can be acquired by different wearable cameras and labeled data are scarcely available, we employed a domain adaptation strategy on two egocentric activity recognition benchmark datasets. These experiments show that the model learned with our dataset, can easily be transferred to other domains with a very small amount of labeled data. Taken together, those results show that activity recognition from wearable photo-cameras is mature enough to be tested in real-world applications.

Categories

pattern recognition.

Author keywords

wearable cameras, activity recognition, domain adaptation

Scientific reference

A. Cartas, P. Radeva and M. Dimiccoli. Activities of daily living monitoring via a wearable camera: toward real-world applications. IEEE Access, 8: 77344-77363, 2020.