Proceedings

Automatic Video Interpretation: A Novel Algorithm for Temporal Scenario Recognition

Download BibTeX Cite

Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence. Pages 1295-1301.

© 2003 International Joint Conferences on Artificial Intelligence

Abstract

This paper presents a new scenario recognition algorithm for Video Interpretation. We represent a scenario model by specifying the characters involved in the scenario, the sub-scenarios composing the scenario and the constraints combining the sub-scenarios. Various types of constraints can be used including spatio-temporal and logical constraints. In this paper, we focus on the performance of the recognition algorithm. Our goal is to propose an efficient algorithm for processing temporal constraints and c?mbining several actors defined within the scenano. By efficient we mean that the recognition process is linear in function of the number of sub-scenarios and in most of the cases in function of the number of characters. To validate this algorithm in term of correctness, robustness and processing time in function of scenario and scene properties (e. g. number of persons in the scene), we have tested the algorithm on several videos of a bank branch and of an office, in on-line and off-line mode and on simulated data. We conclude by comparing our algorithm with the state of the a_rt and showing how the definition of scenano models can influence the results of the real-time scenario recognition.

  1. [Chleq and Thonnat, 1996] Nicolas Chleq and Monique Thonnat. Real-time image sequence interpretation for video- surveillance applications. International conference on Im- age Processing (ICIP'96). Proceeding IEEE ICIP'96. Vol 2. pp 801-804. Switzerland. 09/ 1996.
  2. [Ghallab, 1996] Malik Ghallab. On Chronicles : Represen- tation, On-line Recognition and Learning. 5th International Conference on Principles of Knowledge Representation and Reasoning (KR '96), USA, 1111996.
  3. [Gerber et al., 2002] R. Gerber, H. Nagel and H. Schreiber. Deriving Textual Descriptions of Road Traffic Queues from Video Sequences. The 15-th European Conference on Artifi- cial Intelligence (ECAI'2002), Lyon, France, 21-26/07/2002.
  4. [Hongeng et al., 2000] S. Hongeng, F. Bremond and R. Ne- vatia. Representation and Optimal Recognition of Human Activities. In IEEE Proceedings of Computer Vision and Pattern Recognition, USA, 2000.
  5. [Howell and Buxton, 2002] A.J. Howell and H. Buxton . Active vision techniques for visually mediated interaction . Image and Vision Computing, 2002.
  6. [Oliver and Pentland, 2000] Nuria Oliver and Alex Pen- tland. Graphical Models for Driver Behavior Recognition in a SmartCar. Proceedings of IEEE Inti. Conference on Intel- ligent Vehicles 2000 Detroit. Michigan, 10/2000.
  7. [Pinhanez and Bobick, 1997] Claudio Pinhanez and Aaron Bobick. Human Action Detection Using PNF Propaga tion of Temporal Constraints. M.T.T Media Laboratory Percep- tual Section Report No. 423, 04/1997 .
  8. [Rota and Thonnat, 2000] Nathanael Rota and Monique Thonnat. Activity Reco!ft.nition from Video Sequences using Declarative Models. 14 European Conference on Artificial Intelligence (ECAI 2000), Berlin, W. Horn (ed.) lOS Press, Amsterdam, 20-25/08/2000.
  9. [Vu et al, 2002] Van-Thinh Vu, Fran.yois Bremond and Monique Thonnat. Temporal Constraints for Video Inter- pretation . The 15-th European Conference on Artificial In- telligence (ECAI'2002), Lyon, France, 21-26/07/2002 .

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards