{"type":"ScholarlyArticle","title":"A Goal Reasoning Agent for Controlling UAVs in Beyond-Visual-Range Air Combat","authors":[{"name":"Michael W. Floyd","slug":"michael-w-floyd","given":"Michael W.","family":"Floyd","affiliation":"Knexus Research Corporation ; Springfield , Virginia ; USA"},{"name":"Justin Karneeb","slug":"justin-karneeb","given":"Justin","family":"Karneeb","affiliation":"Knexus Research Corporation ; Springfield , Virginia ; USA"},{"name":"Philip Moore","slug":"philip-moore","given":"Philip","family":"Moore","affiliation":"Knexus Research Corporation ; Springfield , Virginia ; USA"},{"name":"David W. Aha","slug":"david-w-aha","given":"David W.","family":"Aha","affiliation":"Navy Center for Applied Research in AI ; Naval Research Laboratory ; Washington , DC ; USA"}],"abstract":"We describe the Tactical Battle Manager (TBM), an intelligent agent that uses several integrated artificial intelligence techniques to control an autonomous unmanned aerial vehicle in simulated beyond-visual-range (BVR) air combat scenarios. The TBM incorporates goal reasoning, automated planning, opponent behavior recognition, state prediction, and discrepancy detection to operate in a real-time, dynamic, uncertain, and adversarial environment. We describe evidence from our empirical study that the TBM significantly outperforms an expert-scripted agent in BVR scenarios. We also report the results of an ablation study which indicates that all components of our agent architecture are needed to maximize mission performance.","doi":"10.24963/ijcai.2017/657","url":"https://ijcai.org/proceedings/2017/657","pdf":"https://ijcai.org/proceedings/2017/0657.pdf","markdown":"https://ijcai.org/proceedings/2017/657.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/657","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"AI and autonomy track","track":"AI and autonomy track","number":657,"pages":{"first":4714,"last":4721},"keywords":["Technical: Techniques","Technical: Models"],"videos":[],"references":[{"position":1,"raw":"[Aha et al., 2013] David W. Aha, Michael T. Cox, Héctor Muñoz-Avila (Eds.). Goal Reasoning: Papers from the ACS Workshop (Technical Report CS-TR-5029). University of Maryland, Department of Computer Science, 2013.","title":"Goal Reasoning: Papers from the ACS Workshop","authors":null,"year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Alford et al., 2015] Ron Alford, Hayley Borck, Justin Karneeb, and David W. Aha. Active behavior recognition in beyond visual range air combat. In Proceedings of the Third Conference on Advances in Cognitive Systems, 2015.","title":"Active behavior recognition in beyond visual range air combat","authors":"Ron Alford, Hayley Borck, Justin Karneeb, David W Aha","year":"2015","venue":"Proceedings of the Third Conference on Advances in Cognitive Systems","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Borck et al., 2015] Hayley Borck, Justin Karneeb, Michael W. Floyd, Ron Alford, and David W. Aha. Case-based policy and goal recognition. In Proceedings of the 23rd International Conference on Case-Based Reasoning, Frankfurt am Main, Germany, pages 30-43, 2015.","title":"Case-based policy and goal recognition","authors":"Hayley Borck, Justin Karneeb, Michael W Floyd, Ron Alford, David W Aha","year":"2015","venue":"Proceedings of the 23rd International Conference on Case-Based Reasoning","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Borrajo et al., 2015] Daniel Borrajo, Anna Roubíčková, and Ivan Serina. Progress in case-based planning. ACM Computing Surveys, 47(2): 35:1-35:39, 2015.","title":"Progress in case-based planning","authors":"Daniel Borrajo, Anna Roubíčková, Ivan Serina","year":"2015","venue":"ACM Computing Surveys","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Clive et al., 2015] Peter D. Clive, Jeffrey A. Johnson, Michael J. Moss, James M. Zeh, Brian M. Birkmire, and Douglas D. Hodson. Advanced Framework for Simulation, Integration and Modeling (AFSIM). In Proceedings of the 13th International Conference on Scientific Computing, pages 73-77, 2015.","title":"Advanced Framework for Simulation, Integration and Modeling (AFSIM)","authors":"Peter D Clive, Jeffrey A Johnson, Michael J Moss, James M Zeh, Brian M Birkmire, Douglas D Hodson","year":"2015","venue":"Proceedings of the 13th International Conference on Scientific Computing","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Coddington et al., 2005] Alexandra M. Coddington, Maria Fox, Jonathan Gough, Derek Long, and Ivan Serina. MADbot: A motivated and goal directed robot. In Proceedings of the 20th AAAI National Conference on Artificial Intelligence, pages 1680-1681, 2005.","title":"MADbot: A motivated and goal directed robot","authors":"Alexandra M Coddington, Maria Fox, Jonathan Gough, Derek Long, Ivan Serina","year":"2005","venue":"Proceedings of the 20th AAAI National Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Gillespie et al., 2015] Kellen Gillespie, Matthew Molineaux, Michael W. Floyd, Swaroop S. Vattam, and David W. Aha. Goal reasoning for an autonomous squad member. In Goal Reasoning: Papers from the ACS Workshop, pages 52-67, 2015.","title":"Goal reasoning for an autonomous squad member","authors":"Kellen Gillespie, Matthew Molineaux, Michael W Floyd, Swaroop S Vattam, David W Aha","year":"2015","venue":"Goal Reasoning: Papers from the ACS Workshop","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Jaidee et al., 2013] Ulit Jaidee, Héctor Muñoz-Avila, and David W. Aha. Case-based goal-driven coordination of multiple learning agents. In Proceedings of the 21st International Conference on Case-Based Reasoning, pages 164-178, 2013.","title":"Case-based goal-driven coordination of multiple learning agents","authors":"Ulit Jaidee, Héctor Muñoz-Avila, David W Aha","year":"2013","venue":"Proceedings of the 21st International Conference on Case-Based Reasoning","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Johnson et al., 2016] Benjamin Johnson, Mark Roberts, Thomas Apker, and David W. Aha. Goal reasoning with information measures. In Proceedings of the Fourth Conference on Advances in Cognitive Systems, 2016.","title":"Goal reasoning with information measures","authors":"Benjamin Johnson, Mark Roberts, Thomas Apker, David W Aha","year":"2016","venue":"Proceedings of the Fourth Conference on Advances in Cognitive Systems","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Karneeb et al., 2016] Justin Karneeb, Michael W. Floyd, Philip Moore, and David W. Aha. Distributed discrepancy detection for BVR air combat. In Goal Reasoning: Papers from the IJCAI Workshop, 2016.","title":"Distributed discrepancy detection for BVR air combat","authors":"Justin Karneeb, Michael W Floyd, Philip Moore, David W Aha","year":"2016","venue":"Goal Reasoning: Papers from the IJCAI Workshop","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Luo et al., 2005] De-Lin Luo, Chun-Lin Shen, Biao Wang, and Wen-Hai Wu. Air combat decision-making for cooperative multiple target attack using heuristic adaptive genetic algorithm. In Proceedings of the 4th International Conference on Machine Learning and Cybernetics, pages 473-478, 2005.","title":"Air combat decision-making for cooperative multiple target attack using heuristic adaptive genetic algorithm","authors":"Chun-Lin De-Lin Luo, Biao Shen, Wen-Hai Wang, Wu","year":"2005","venue":"Proceedings of the 4th International Conference on Machine Learning and Cybernetics","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Mulgund et al., 1998] Sandeep Mulgund, Karen Harper, Kalmanje Krishnakumar, and Greg Zacharias. Air combat tactics optimization using stochastic genetic algorithms. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pages 3136-3141, 1998.","title":"Air combat tactics optimization using stochastic genetic algorithms","authors":"Sandeep Mulgund, Karen Harper, Kalmanje Krishnakumar, Greg Zacharias","year":"1998","venue":"Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Roberts et al., 2016] Mark Roberts, Daniel Borrajo, Michael T. Cox, Neil Yorke-Smith (Eds.). Goal Reasoning: Papers from the IJCAI Workshop, 2016.","title":"Goal Reasoning: Papers from the IJCAI Workshop","authors":null,"year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Talamadupula et al., 2011] Kartik Talamadupula, Paul Schermerhorn, J. Benton, Subbarao Kambhampati, and Matthias Scheutz. Planning for agents with changing goals. In Proceedings of the 21st International Conference on Automated Planning and Scheduling: System Demonstrations, pages 71-74, 2011.","title":"Planning for agents with changing goals","authors":"Kartik Talamadupula, J Paul Schermerhorn, Subbarao Benton, Matthias Kambhampati, Scheutz","year":"2011","venue":"Proceedings of the 21st International Conference on Automated Planning and Scheduling: System Demonstrations","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Weber et al., 2012] Ben G. Weber, Michael Mateas, and Arnav Jhala. Learning from demonstration for goal- driven autonomy. In Proceedings of the 26th AAAI Conference on Artificial Intelligence, pages 1176-1182, 2012.","title":"Learning from demonstration for goaldriven autonomy","authors":"Ben G Weber, Michael Mateas, Arnav Jhala","year":"2012","venue":"Proceedings of the 26th AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Wilson et al., 2016] Mark A. Wilson, James McMahon, Artur Wolek, David W. Aha, and Brian H. Houston. Toward goal reasoning for autonomous underwater vehicles: Responding to unexpected agents. In Goal Reasoning: Papers from the IJCAI Workshop, 2016.","title":"Toward goal reasoning for autonomous underwater vehicles: Responding to unexpected agents","authors":"Mark A Wilson, James Mcmahon, Artur Wolek, David W Aha, Brian H Houston","year":"2016","venue":"Goal Reasoning: Papers from the IJCAI Workshop","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}