Proceedings

Towards Active Event Recognition

Download BibTeX Cite

Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. Pages 2495-2500.

© 2013 International Joint Conferences on Artificial Intelligence

Abstract

Directing robot attention to recognise activities and to anticipate events like goal-directed actions is a crucial skill for human-robot interaction. Unfortunately, issues like intrinsic time constraints, the spatially distributed nature of the entailed information sources, and the existence of a multitude of unobservable states affecting the system, like latent intentions, have long rendered achievement of such skills a rather elusive goal. The problem tests the limits of current attention control systems. It requires an integrated solution for tracking, exploration and recognition, which traditionally have been seen as separate problems in active vision.We propose a probabilistic generative framework based on a mixture of Kalman filters and information gain maximisation that uses predictions in both recognition and attention-control. This framework can efficiently use the observations of one element in a dynamic environment to provide information on other elements, and consequently enables guided exploration.Interestingly, the sensors-control policy, directly derived from first principles, represents the intuitive trade-off between finding the most discriminative clues and maintaining overall awareness.Experiments on a simulated humanoid robot observing a human executing goal-oriented actions demonstrated improvement on recognition time and precision over baseline systems.

  1. [Aloimonos et al., 1988] J. Aloimonos, I. Weiss, and A. Bandy- opadhyay. Active vision. International Journal of Computer Vision, 1(4):333-356, january 1988.
  2. [Andreopoulos and Tsotsos, 2013] A. Andreopoulos and J. K. Tsotsos. A computational learning theory of active object recog- nition under uncertainty. Int. J. Comp. Vis., 101(1):95-142, 2013.
  3. [Bajcsy, 1988] R. Bajcsy. Active perception. Proceedings of the IEEE, Special issue on Computer Vision, 76(8):966-1005, 1988.
  4. [Baker et al., 2009] C. L Baker, R. Saxe, and J. B Tenenbaum. Ac- tion understanding as inverse planning. Cognition, 2009.
  5. [Balkenius and Johansson, 2007] C. Balkenius and B. Johansson. Anticipatory models in gaze control: a developmental model. Cognitive processing, 8(3):167-174, 2007.
  6. [Ballard, 1991] D.H. Ballard. Animate vision. Artificial Intelli- gence, 48:57-86, 1991.
  7. [Beer, 1995] R. D. Beer. A dynamical systems perspective on agent-environment interaction. Artificial Intelligence, 72:173- 215, 1995.
  8. [Bruce and Gordon, 2004] A. Bruce and G. Gordon. Better motion prediction for people-tracking. In Proc. of the 2004 IEEE Inter- national Conference on Robotics and Automation, New Orleans, LA, USA, May 2004.
  9. [de Croon and Postma, 2007] G. de Croon and E.O. Postma. Sensory-motor coordination in object detection. In Proceedings of the IEEE Symposium on Artificial Life, ALIFE'07, pages 147- 154, 2007.
  10. [Demiris and Khadhouri, 2008] Y. Demiris and B. Khadhouri. Content-based control of goal-directed attention during human action perception. Interaction Studies, 9(2):353-376, 2008.
  11. [Demiris, 2007] Y. Demiris. Prediction of intent in robotics and multi-agent systems. Cognitive Processing, 8(3):151-158, 2007.
  12. [Denzler and Brown, 2002] J. Denzler and C.M. Brown. Informa- tion Theoretic Sensor Data Selection for Active Object Recogni- tion and State Estimation. Transactions in Pattern Analysis and Machine Intelligence, 24(2):145-157, 2002.
  13. [Dindo et al., 2011] H. Dindo, D. Zambuto, and G. Pezzulo. Motor simulation via coupled internal models using sequential monte carlo. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, Barcelona, Spain, July 2011. IJCAI
  14. [Findlay and Gilchrist, 2003] J.M. Findlay and I.D. Gilchrist. Ac- tive vision: The psychology of looking and seeing. Oxford Uni- versity Press, 2003.
  15. [Flanagan and Johansson, 2003] J Randall Flanagan and Roland S Johansson. Action plans used in action observation. Nature, 424(6950):769-771, 2003.
  16. [Gori et al., 2012] I. Gori, U. Pattacini, F. Nori, G. Metta, and G. Sandini. Dforc: a real-time method for reaching, tracking and obstacle avoidance in humanoid robots. In IEEE-RAS Inter- national Conference on Humanoid Robots (HUMANOIDS2012),, Osaka, Japan, November 29 -December 1. 2012.
  17. [Gould et al., 2007] S. Gould, J. Arfvidsson, A. Kaehler, B. Sapp, M. Messner, G. Bradski, P. Baumstarck, S. Chung, and A. Y. Ng. Peripheral-foveal vision for real-time object recognition and tracking in video. In IJCAI07, Proceedings of, 2007. IJCAI
  18. [Navalpakkam and Itti, 2006] V. Navalpakkam and L. Itti. An in- tegrated model of top-down and bottom-up attention for optimal object detection. In Proceedings of the 2006 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2006.
  19. [Nolfi and Floreano, 2000] S. Nolfi and D. Floreano. Evolutionary Robotics: The Biology,Intelligence,and Technology. MIT Press, Cambridge, MA, USA, 2000.
  20. [Ognibene et al., 2010] D. Ognibene, G. Pezzulo, and G. Baldas- sarre. How can bottom-up information shape learning of top- down attention control skills? In Proceedings of 9th International Conference on Development and Learning, 2010.
  21. [Ognibene et al., 2012] D. Ognibene, E. Chinellato, M. Sarabia, and Y. Demiris. Towards contextual action recognition and target localization with active allocation of attention. In Proc. of First Int. Conf.on Living Machines, pages 192-203, 2012.
  22. [Ope, 2010] OpenNI organization. OpenNI User Guide, November 2010. Last viewed 19-01-2011 11:32.
  23. [Paletta et al., 2005] L. Paletta, G. Fritz, and C. Seifert. Cascaded sequential attention for object recognition with informative lo- cal descriptors and q-learning of grouping strategies. In Proc.of Computer Vision and Pattern Recognition (CVPR), 2005.
  24. [Pattacini, 2010] U. Pattacini. Modular Cartesian Controllers for Humanoid Robots: Design and Implementation on the iCub. PhD thesis, RBCS, Istituto Italiano di Tecnologia, Genoa., 2010.
  25. [Pezzulo and Ognibene, 2012] G Pezzulo and D Ognibene. Proac- tive action preparation: Seeing action preparation as a continuous and proactive process. Motor control, 16(3):386-424., 2012.
  26. [Pezzulo, 2008] G. Pezzulo. Coordinating with the future: the anticipatory nature of representation. Minds and Machines, 18(2):179-225, 2008.
  27. [Pri, 2010] PrimeSense Inc. Prime Sensor NITE 1.3 Algorithms notes, 2010. Last viewed 19-01-2011 15:34.
  28. [Ramirez and Geffner, 2011] M. Ramirez and H. Geffner. Goal recognition over pomdps: Inferring the intention of a pomdp agent. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, Barcelona, Spain, 2011. IJCAI
  29. [Rothkopf et al., 2007] C. A. Rothkopf, D. H. Ballard, and M. M. Hayhoe. Task and context determine where you look. Journal of Vision, 7(14):1610-1620, 2007.
  30. [Sommerlade and Reid, 2008] R. Sommerlade and I Reid. Infor- mation theoretic active scene exploration. In Proceedings of 2008 IEEE Computer Society Conference on Computer Vision and Pat- tern Recognition, Anchorage, Alaska, USA, June 2008.
  31. [Sprague et al., 2007] N. Sprague, D. Ballard, and A. Robinson. Modeling embodied visual behaviors. ACM Trans. Appl. Per- cept., 4(2):11, 2007.
  32. [Sridharan et al., 2010] M. Sridharan, J. Wyatt, and R. Dearden. Planning to see: A hierarchical approach to planning vi- sual actions on a robot using pomdps. Artificial Intelligence, 174(11):704-725, 2010.
  33. [Suzuki and Floreano, 2008] M. Suzuki and D. Floreano. Enactive robot vision. Adaptive Behavior, 16(2-3):122-128, 2008.
  34. [Tatler et al., 2011] B. W. Tatler, M. M. Hayhoe, M. F. Land, and D. Ballard. Eye guidance in natural vision: Reinterpreting salience. Journal of Vision, 11(5):1-23, 2011.
  35. [Vijayanarasimhan and Kapoor, 2010] S. Vijayanarasimhan and A. Kapoor. Visual recognition and detection under bounded com- putational resources. In Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR), pages 1006-1013, June 2010.
  36. [Vogel and de Freitas, 2008] J. Vogel and N. de Freitas. Target- directed attention: Sequential decision-making for gaze plan- ning. In The International Conference of Robotics and Automa- tion (ICRA), pages 2372-2379, 2008.
  37. [Walther et al., 2005] D. Walther, U. Rutishauser, C. Koch, and P. Perona. Selective visual attention enables learning and recog- nition of multiple objects in cluttered scenes. Computer Vision and Image Understanding, 100(1-2):41-63, October 2005.
  38. [Zilberstein and Russell, 1996] S. Zilberstein and S. Russell. Op- timal composition of real-time systems. Artificial Intelligence, 82(1-2):181-213, 1996.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards