Proceedings

On the Testability of BDI Agent Systems (Extended Abstract)

Download BibTeX Cite

Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence. Journal Track. Pages 4217-4220.

© 2015 International Joint Conferences on Artificial Intelligence

Abstract

Before deploying a software system we need to assure ourselves (and stakeholders) that the system will behave correctly. This assurance is usually done by testing the system. However, it is intuitively obvious that adaptive systems, including agent-based systems, can exhibit complex behaviour, and are thus harder to test. In this paper we examine this obvious intuition in the case of Belief-Desire-Intention (BDI) agents, by analysing the number of paths through BDI goal-plan trees. Our analysis confirms quantitatively that BDI agents are hard to test, sheds light on the role of different parameters, and highlights the enormous difference made by failure handling.

  1. [Benfield et al., 2006] S. S. Benfield, J. Hendrickson, and D. Galanti. Making a strong business case for multiagent technology. In P. Stone and G. Weiss, editors, Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), pages 10-15. ACM Press, 2006.
  2. [Bratman et al., 1988] M. E. Bratman, D. J. Israel, and M. E. Pollack. Plans and resource-bounded practical reasoning. Computational Intelligence, 4:349-355, 1988.
  3. Bratman, 1987
  4. M. E. Bratman. Intentions, Plans, and Practical Reason. Harvard University Press, Cambridge, MA, 1987.
  5. [Burmeister et al., 2008] B. Burmeister, M. Arnold, F. Co- paciu, and G. Rimassa. BDI-agents for agile goal-oriented business processes. In Proceedings of the Seventh Interna- tional Conference on Autonomous Agents and Multiagent Systems (AAMAS) [Industry Track], pages 37-44.
  6. [Busetta et al., 1999] P. Busetta, R. Rönnquist, A. Hodgson, and A. Lucas. JACK Intelligent Agents -Components for Intelligent Agents in Java. AgentLink News (2), 1999.
  7. [Dastani et al., 2010] M. Dastani, K. V. Hindriks, and J- J. Ch. Meyer, editors. Specification and Verification of Multi-agent systems. Springer, Berlin/Heidelberg, 2010.
  8. [de Silva and Padgham, 2004] L. P. de Silva and L. Padgham. A comparison of BDI based real-time reasoning and HTN based planning. In G.I. Webb and X. Yu, editors, AI 2004: Advances in Artificial Intel- ligence, volume 3339 of Lecture Notes in Computer Science, pages 1167-1173. Springer, Berlin/Heidelberg, 2004.
  9. [Ekinci et al., 2009] E. E. Ekinci, A. M. Tiryaki, Ö. C ¸etin, and O. Dikenelli. Goal-oriented agent testing revisited. In M. Luck and J. J. Gomez-Sanz, editors, Agent-Oriented Software Engineering IX, volume 5386 of Lecture Notes in Computer Science, pages 173-186, Berlin/Heidelberg, 2009. Springer.
  10. [Erol et al., 1994] K. Erol, J. A. Hendler, and D. S. Nau. HTN planning: Complexity and expressivity. In Proceed- ings of the 12th National Conference on Artificial Intelli- gence (AAAI), pages 1123-1128. AAAI Press, 1994.
  11. [Erol et al., 1996] K. Erol, J. A. Hendler, and D. S. Nau. Complexity results for HTN planning. Annals of Math- ematics and Artificial Intelligence, 18(1):69-93, 1996.
  12. [Gomez-Sanz et al., 2009] J. J. Gomez-Sanz, J. Botía, E. Serrano, and J. Pavón. Testing and debugging of MAS interactions with INGENIAS. In M. Luck and J. J. Gomez- Sanz, editors, Agent-Oriented Software Engineering IX, volume 5386 of Lecture Notes in Computer Science, pages 199-212, Berlin/Heidelberg, 2009. Springer.
  13. [Mathur, 2008] A. P. Mathur. Foundations of Software Test- ing. Pearson, 2008. ISBN 978-81-317-1660-1.
  14. [Müller and Fischer, 2014] J. Müller and K. Fischer. Ap- plication impact of multi-agent systems and technologies: A survey. In O. Shehory and A. Sturm, editors, Agent- Oriented Software Engineering, pages 27-53. Springer Berlin Heidelberg, 2014.
  15. [Munroe et al., 2006] S. Munroe, T. Miller, R.A. Belecheanu, M. Pechoucek, P. McBurney, and M. Luck. Crossing the agent technology chasm: Experiences and challenges in commercial applications of agents. Knowledge Engineering Review, 21(4):345-392, 2006.
  16. [Nguyen et al., 2009] C. D. Nguyen, A. Perini, and P. Tonella. Experimental evaluation of ontology-based test generation for multi-agent systems. In M. Luck and J. J. Gomez-Sanz, editors, Agent-Oriented Software Engineering IX, volume 5386 of Lecture Notes in Com- puter Science, pages 187-198, Berlin/Heidelberg, 2009. Springer.
  17. [Padgham and Winikoff, 2004] L. Padgham and M. Winikoff. Developing Intelligent Agent Systems: A Practical Guide. John Wiley and Sons, 2004. ISBN 0-470-86120-7.
  18. [Padgham et al., 2013] L. Padgham, Z. Zhang, J. Thangara- jah, and T. Miller. Model-based test oracle generation for automated unit testing of agent systems. IEEE Transac- tions on Software Engineering, 39:1230-1244, 2013.
  19. [Rao and Georgeff, 1991] A. S. Rao and M. P. Georgeff. Modeling rational agents within a BDI-architecture. In J. Allen, R. Fikes, and E. Sandewall, editors, Principles of Knowledge Representation and Reasoning, Proceedings of the Second International Conference, pages 473-484.
  20. Morgan Kaufmann, 1991.
  21. [Sardina and Padgham, 2011] S. Sardina and L. Padgham. A BDI agent programming language with failure handling, declarative goals, and planning. Autonomous Agents and Multi-Agent Systems, 23:18-70, 2011.
  22. [Winikoff and Cranefield, 2014] M. Winikoff and S. Crane- field. On the testability of BDI agent systems. Journal of Artificial Intelligence Research (JAIR), 51:71-131, 2014.
  23. [Wooldridge, 2002] M. Wooldridge. An Introduction to Mul- tiAgent Systems. John Wiley & Sons, Chichester, England, 2002. ISBN 0 47149691X.
  24. [Zhang et al., 2009] Z. Zhang, J. Thangarajah, and L. Padgham. Model based testing for agent systems. In J. Filipe, B. Shishkov, M. Helfert, and L. Maciaszek, editors, Software and Data Technologies, volume 22 of Communications in Computer and Information Science, pages 399-413, Berlin/Heidelberg, 2009. Springer.
  25. [Zhu et al., 1997] H. Zhu, P. A. V. Hall, and J. H. R. May. Software unit test coverage and adequacy. ACM Comput. Surv., 29(4):366-427, December 1997.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards