Publication

Interpretation of complex situations in a semantic-based surveillance framework

Journal Article (2008)

Journal

Signal Processing: Image Communication

Pages

554-569

Volume

23

Number

7

Doc link

http://dx.doi.org/10.1016/j.image.2008.04.015

File

Download the digital copy of the doc pdf document

Authors

Projects associated

Abstract

The integration of cognitive capabilities in computer vision systems requires both to enable high semantic expressiveness and to deal with high computational costs as large amounts of data are involved in the analysis. This contribution describes a cognitive vision system conceived to automatically provide high-level interpretations of complex real-time situations in outdoor and indoor scenarios, and to eventually maintain communication with casual end users in multiple languages. The main contributions are: (i) the design of an integrative multilevel architecture for cognitive surveillance purposes; (ii) the proposal of a coherent taxonomy of knowledge to guide the process of interpretation, which leads to the conception of a situation-based ontology; (iii) the use of situational analysis for content detection and a progressive interpretation of semantically rich scenes, by managing incomplete or uncertain knowledge, and (iv) the use of such an ontological background to enable multilingual capabilities and advanced end-user interfaces. Experimental results are provided to show the feasibility of the proposed approach.

Categories

computer vision.

Author keywords

cognitive vision system, situation analysis, applied ontologies

Scientific reference

C. Fernández, P. Baiget, F. Xavier Roca and J. Gonzàlez. Interpretation of complex situations in a semantic-based surveillance framework. Signal Processing: Image Communication, 23(7): 554-569, 2008.