{"type":"ScholarlyArticle","title":"Proactive and Reactive Coordination of Non-dedicated Agent Teams Operating in Uncertain Environments","authors":[{"name":"Pritee Agrawal","slug":"pritee-agrawal","given":"Pritee","family":"Agrawal","affiliation":"School of Information Systems , Singapore Management University , Singapore 188065"},{"name":"Pradeep Varakantham","slug":"pradeep-varakantham","given":"Pradeep","family":"Varakantham","affiliation":"School of Information Systems , Singapore Management University , Singapore 188065"}],"abstract":"Domains such as disaster rescue, security patrolling etc. often feature dynamic environments where allocations of tasks to agents become ineffective due to unforeseen conditions that may require agents to leave the team. Agents leave the team either due to arrival of high priority tasks (e.g., emergency, accident or violation) or due to some damage to the agent. Existing research in task allocation has only considered fixed number of agents and in some instances arrival of new agents on the team. However, there is little or no literature that considers situations where agents leave the team after task allocation. To that end, we first provide a general model to represent non-dedicated teams. Second, we provide a proactive approach based on sample average approximation to generate a strategy that works well across different feasible scenarios of agents leaving the team. Furthermore, we also provide a 2-stage approach that provides a 2-stage policy that changes allocation based on observed state of the team.  Third, we provide a reactive approach that rearranges the allocated tasks to better adapt to leaving agents. Finally, we provide a detailed evaluation of our approaches on existing benchmark problems.","doi":"10.24963/ijcai.2017/5","url":"https://ijcai.org/proceedings/2017/5","pdf":"https://ijcai.org/proceedings/2017/0005.pdf","markdown":"https://ijcai.org/proceedings/2017/5.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/5","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Agent-based and Multi-agent Systems","track":"Main track","number":5,"pages":{"first":28,"last":34},"keywords":["Planning and Scheduling: Markov Decisions Processes","Planning and Scheduling: Planning under Uncertainty","Agent-based and Multi-agent Systems: Coordination and cooperation","Agent-based and Multi-agent Systems: Multi-agent Planning"],"videos":[],"references":[{"position":1,"raw":"[Agrawal et al., 2016] Pritee Agrawal, Pradeep Varakan- tham, and William Yeoh. Scalable greedy algorithms for task/resource constrained multi-agent stochastic plan- ning. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI, pages 10-16, 2016.","title":"Scalable greedy algorithms for task/resource constrained multi-agent stochastic planning","authors":"Agrawal","year":"2016","venue":"Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2016/9"},{"position":2,"raw":"[Barrett et al., 2017] Samuel Barrett, Avi Rosenfeld, Sarit Kraus, and Peter Stone. Making friends on the fly: Co- operating with new teammates. Artificial Intelligence, 242:132-171, 2017.","title":"Making friends on the fly: Cooperating with new teammates","authors":"Barrett","year":"2017","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bertsekas, 1999] Dimitri P. Bertsekas. Nonlinear Program- ming. Athena Scientific, 2nd edition, 1999.","title":"Nonlinear Programming","authors":"Dimitri P Bertsekas","year":"1999","venue":"Athena Scientific","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Brown et al., 2014] Matthew Brown, Sandhya Saisubra- manian, Pradeep Varakantham, and Milind Tambe. STREETS: game-theoretic traffic patrolling with explo- ration and exploitation. In Proceedings of the Twenty- Eighth AAAI Conference on Artificial Intelligence, pages 2966-2971, 2014.","title":"STREETS: game-theoretic traffic patrolling with exploration and exploitation","authors":"Matthew Brown, Sandhya Saisubramanian, Pradeep Varakantham, Milind Tambe","year":"2014","venue":"Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cohen and Levesque, 1991] Philip R Cohen and Hector J Levesque. Teamwork. Nous, 25(4):487-512, 1991.","title":"Teamwork. Nous","authors":"Hector J Philip R Cohen, Levesque","year":"1991","venue":"Teamwork. Nous","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dantzig and Ramser, 1959] B. Dantzig and J. H. Ramser. The truck dispatching problem. Management Science, 6:80-91, 1959.","title":"The truck dispatching problem","authors":"B Dantzig, J H Ramser","year":"1959","venue":"Management Science","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Dolgov and Durfee, 2006] Dmitri Dolgov and Edmund Durfee. Resource allocation among agents with MDP- induced preferences. Journal of Artificial Intelligence Re- search, 27:505-549, 2006.","title":"Resource allocation among agents with MDPinduced preferences","authors":"Dmitri Dolgov, Edmund Durfee","year":"2006","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Grosz and Kraus, 1996] Barbara J Grosz and Sarit Kraus. Collaborative plans for complex group action. Artificial Intelligence, 86(2):269-357, 1996.","title":"Collaborative plans for complex group action","authors":"J Barbara, Sarit Grosz, Kraus","year":"1996","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Handoko et al., 2014] Stephanus Daniel Handoko, Duc Thien Nguyen, and Hoong Chuin Lau. An auc- tion mechanism for the last-mile deliveries via urban consolidation centre. In Proceedings of the International Conference on Automation Science and Engineering (CASE), pages 607-612, 2014.","title":"An auction mechanism for the last-mile deliveries via urban consolidation centre","authors":"Stephanus Daniel Handoko, Duc Thien Nguyen, Hoong Chuin Lau","year":"2014","venue":"Proceedings of the International Conference on Automation Science and Engineering (CASE)","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Hazard et al., 2006] Christopher Hazard, Peter Wurman, and Raffaello D'Andrea. Alphabet soup: A testbed for studying resource allocation in multi-vehicle systems. In Proceedings of the AAAI Workshop on Auction Mecha- nisms for Robot Coordination, pages 23-30, 2006.","title":"Alphabet soup: A testbed for studying resource allocation in multi-vehicle systems","authors":"Christopher Hazard, Peter Wurman, Raffaello D' Andrea","year":"2006","venue":"Proceedings of the AAAI Workshop on Auction Mechanisms for Robot Coordination","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Puterman, 1994] Martin L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming.","title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","authors":"Martin L Puterman","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Shieh et al., 2014] Eric Anyung Shieh, Albert Xin Jiang, Amulya Yadav, Pradeep Varakantham, and Milind Tambe. Unleashing dec-mdps in security games: Enabling effec- tive defender teamwork. In ECAI 2014 -21st Euro- pean Conference on Artificial Intelligence, pages 819-824, 2014.","title":"Unleashing dec-mdps in security games: Enabling effective defender teamwork","authors":"Eric Anyung Shieh, Albert Xin Jiang, Amulya Yadav, Pradeep Varakantham, Milind Tambe","year":"2014","venue":"ECAI 2014 -21st European Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Tambe, 1997] Milind Tambe. Towards flexible teamwork. Journal of artificial intelligence research, 7:83-124, 1997.","title":"Towards flexible teamwork","authors":"Milind Tambe","year":"1997","venue":"Journal of artificial intelligence research","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Varakantham et al., 2009] Pradeep Varakantham, Jun- Young Kwak, Matthew Taylor, Janusz Marecki, Paul Scerri, and Milind Tambe. Exploiting coordination locales in distributed POMDPs via social model shaping. In Proceedings of the International Conference on Planning and Scheduling (ICAPS), pages 313-320, 2009.","title":"Exploiting coordination locales in distributed POMDPs via social model shaping","authors":"Pradeep Varakantham, Jun-Young Kwak, Matthew Taylor, Janusz Marecki, Paul Scerri, Milind Tambe","year":"2009","venue":"Proceedings of the International Conference on Planning and Scheduling (ICAPS)","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Varakantham et al., 2013] Pradeep Varakantham, Hoong Chuin Lau, and Zhi Yuan. Scalable random- ized patrolling for securing rapid transit networks. In Proceedings of the Twenty-Fifth Innovative Applications of Artificial Intelligence Conference, IAAI, 2013.","title":"Scalable randomized patrolling for securing rapid transit networks","authors":"Pradeep Varakantham, Hoong, Chuin Lau, Zhi Yuan","year":"2013","venue":"Proceedings of the Twenty-Fifth Innovative Applications of Artificial Intelligence Conference","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Varakantham et al., 2014] Pradeep Varakantham, Yossiri Adulyasak, and Patrick Jaillet. Decentralized stochastic planning with anonymity in interactions. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), pages 2505-2512, 2014.","title":"Decentralized stochastic planning with anonymity in interactions","authors":"Pradeep Varakantham, Yossiri Adulyasak, Patrick Jaillet","year":"2014","venue":"Proceedings of the AAAI Conference on Artificial Intelligence (AAAI)","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Velagapudi et al., 2011] Prasanna Velagapudi, Pradeep Varakantham, Paul Scerri, and Katia Sycara. Distributed model shaping for scaling to decentralized POMDPs with hundreds of agents. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pages 955-962, 2011.","title":"Distributed model shaping for scaling to decentralized POMDPs with hundreds of agents","authors":"Prasanna Velagapudi, Pradeep Varakantham, Paul Scerri, Katia Sycara","year":"2011","venue":"Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS)","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Wurman et al., 2007] Peter R. Wurman, Raffaello D'Andrea, and Mick Mountz. Coordinating hun- dreds of cooperative, autonomous vehicles in warehouses. In Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, pages 1752-1760, 2007.","title":"Coordinating hundreds of cooperative, autonomous vehicles in warehouses","authors":"R Peter, Wurman, Mick Raffaello D'andrea, Mountz","year":"2007","venue":"Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}