{"type":"ScholarlyArticle","title":"A Virtual Environment with Multi-Robot Navigation, Analytics, and Decision Support for Critical Incident Investigation","authors":[{"name":"David L. Smyth","slug":"david-l-smyth","given":"David L.","family":"Smyth","affiliation":"School of Computer Science , National University of Ireland Galway , Ireland"},{"name":"James Fennell","slug":"james-fennell","given":"James","family":"Fennell","affiliation":"School of Computer Science , National University of Ireland Galway , Ireland"},{"name":"Sai Abinesh","slug":"sai-abinesh","given":"Sai","family":"Abinesh","affiliation":"School of Computer Science , National University of Ireland Galway , Ireland"},{"name":"Nazli B. Karimi","slug":"nazli-b-karimi","given":"Nazli B.","family":"Karimi","affiliation":"School of Computer Science , National University of Ireland Galway , Ireland"},{"name":"Frank G. Glavin","slug":"frank-g-glavin","given":"Frank G.","family":"Glavin","affiliation":"School of Computer Science , National University of Ireland Galway , Ireland"},{"name":"Ihsan Ullah","slug":"ihsan-ullah","given":"Ihsan","family":"Ullah","affiliation":"School of Computer Science , National University of Ireland Galway , Ireland"},{"name":"Brett Drury","slug":"brett-drury","given":"Brett","family":"Drury","affiliation":"School of Computer Science , National University of Ireland Galway , Ireland"},{"name":"Michael G. Madden","slug":"michael-g-madden","given":"Michael G.","family":"Madden","affiliation":"School of Computer Science , National University of Ireland Galway , Ireland"}],"abstract":"Accidents and attacks that involve chemical, biological, radiological/nuclear or explosive (CBRNE) substances are rare, but can be of high consequence. Since the investigation of such events is not anybody's routine work, a range of AI techniques can reduce investigators' cognitive load and support decision-making, including: planning the assessment of the scene; ongoing evaluation and updating of risks; control of autonomous vehicles for collecting images and sensor data; reviewing images/videos for items of interest; identification of anomalies; and retrieval of relevant documentation. Because of the rare and high-risk nature of these events, realistic simulations can support the development and evaluation of AI-based tools. We have developed realistic models of CBRNE scenarios and implemented an initial set of tools.","doi":"10.24963/ijcai.2018/863","url":"https://ijcai.org/proceedings/2018/863","pdf":"https://ijcai.org/proceedings/2018/0863.pdf","markdown":"https://ijcai.org/proceedings/2018/863.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/863","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Demos","track":"Demos","number":863,"pages":{"first":5862,"last":5864},"keywords":["Uncertainty in AI: Uncertainty in AI","Agent-based and Multi-agent Systems: Multi-agent Planning","Machine Learning: Deep Learning","Agent-based and Multi-agent Systems: Agent-Based Simulation and Emergence"],"videos":[],"references":[{"position":1,"raw":"[Aubry et al., 2014] Mathieu Aubry, Daniel Maturana, Alexei A Efros, Bryan C Russell, and Josef Sivic. Seeing 3d chairs: exemplar part-based 2d-3d alignment using a large dataset of cad models. In Conference on computer vision and pattern recognition, pages 3762-3769, 2014.","title":"Seeing 3d chairs: exemplar part-based 2d-3d alignment using a large dataset of cad models","authors":"Aubry Mathieu, Daniel Maturana, Alexei A Efros, Bryan C Russell, Josef Sivic","year":"2014","venue":"Conference on computer vision and pattern recognition","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Baums, 2017] A Baums. Response to cbrne and human- caused accidents by using land and air robots. Automatic Control and Computer Sciences, 51(6):410-416, 2017.","title":"Response to cbrne and humancaused accidents by using land and air robots","authors":"Baums","year":"2017","venue":"Automatic Control and Computer Sciences","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chroust and Aumayr, 2017] Gerhard Chroust and Georg Aumayr. Resilience 2.0: Computer-aided disaster man- agement. Journal of Systems Science and Systems Engi- neering, 26(3):321-335, 2017.","title":"Resilience 2.0: Computer-aided disaster management","authors":"Aumayr Chroust, Gerhard Chroust, Georg Aumayr","year":"2017","venue":"Journal of Systems Science and Systems Engineering","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Cohen et al., 2013a] Daniel Cohen, Nick Sevdalis, Vishal Patel, Michael Taylor, Henry Lee, Mick Vokes, Mick Heys, David Taylor, Nicola Batrick, and Ara Darzi. Tacti- cal and operational response to major incidents: feasibility and reliability of skills assessment using novel virtual en- vironments. Resuscitation, 84(7):992-998, 2013.","title":"Tactical and operational response to major incidents: feasibility and reliability of skills assessment using novel virtual environments","authors":"Cohen","year":"2013","venue":"Resuscitation","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cohen et al., 2013b] Daniel Cohen, Nick Sevdalis, David Taylor, Karen Kerr, Mick Heys, Keith Willett, Nicola Ba- trick, and Ara Darzi. Emergency preparedness in the 21st century: training and preparation modules in virtual envi- ronments. Resuscitation, 84(1):78-84, 2013.","title":"Emergency preparedness in the 21st century: training and preparation modules in virtual environments","authors":"Cohen","year":"2013","venue":"Resuscitation","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Daniel et al., 2009] Kai Daniel, Bjoern Dusza, Andreas Lewandowski, and Christian Wietfeld. Airshield: A system-of-systems muav remote sensing architecture for disaster response. In \"3rd Annual IEEE Systems confer- ence\", pages 196-200, 2009.","title":"Airshield: A system-of-systems muav remote sensing architecture for disaster response","authors":"Kai Daniel, Bjoern Dusza, Andreas Lewandowski, Christian Wietfeld","year":"2009","venue":"3rd Annual IEEE Systems conference","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Drury et al., 2017] Brett M Drury, Nazli B Karimi, and Michael G Madden. ROCSAFE: Remote forensics for high risk incidents. In First International Workshop on Artificial Intelligence in Security. IJCAI, 2017.","title":"ROCSAFE: Remote forensics for high risk incidents","authors":"Nazli B Brett M Drury, Michael G Karimi, Madden","year":"2017","venue":"First International Workshop on Artificial Intelligence in Security. IJCAI","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Gautam et al., 2017] Sima Gautam, Navneet Sharma, Rakesh Kumar Sharma, and Mitra Basu. Human patient simulator based cbrn casualty management training. Defence Life Science Journal, 2(1):80-84, 2017.","title":"Human patient simulator based cbrn casualty management training","authors":"Sima Gautam, Navneet Sharma, Rakesh Kumar Sharma, Mitra Basu","year":"2017","venue":"Defence Life Science Journal","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Hattori et al., 2015] Hironori Hattori, Vishnu Naresh Bod- deti, Kris Kitani, and Takeo Kanade. Learning scene- specific pedestrian detectors without real data. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3819-3827, 2015.","title":"Learning scenespecific pedestrian detectors without real data","authors":"Hironori Hattori, Naresh Vishnu, Kris Boddeti, Takeo Kitani, Kanade","year":"2015","venue":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[He et al., 2017] Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. Mask R-CNN. In Conference on Computer Vision (ICCV), pages 2980-2988, 2017.","title":"Mask R-CNN","authors":"He","year":"2017","venue":"Conference on Computer Vision (ICCV)","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Jasiobedzki et al., 2009] Piotr Jasiobedzki, Ho-Kong Ng, Michel Bondy, and CH McDiarmid. C2SM: a mobile sys- tem for detecting and 3d mapping of chemical, radiologi- cal, and nuclear contamination. In Sensors, and Command, Control, Communications, and Intelligence (C3I), 2009.","title":"C2SM: a mobile system for detecting and 3d mapping of chemical, radiological, and nuclear contamination","authors":"Piotr Jasiobedzki, Ho-Kong Ng, Michel Bondy, Mcdiarmid","year":"2009","venue":"Sensors, and Command, Control, Communications, and Intelligence (C3I)","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Marques et al., 2017] Mario Monteiro Marques, Rodolfo Santos Carapau, Alexandre Valério Rodrigues, V Lobo, Júlio Gouveia-Carvalho, Wilson Antunes, Tiago Gonc ¸alves, Filipe Duarte, and Bernardino Verissimo. Gammaex project: A solution for cbrn remote sensing using unmanned aerial vehicles in maritime environments. In OCEANS-Anchorage, pages 1-6. IEEE, 2017.","title":"Gammaex project: A solution for cbrn remote sensing using unmanned aerial vehicles in maritime environments","authors":"Mario Monteiro Marques, Rodolfo Santos Carapau, Alexandre Valério Rodrigues, V Lobo, Júlio Gouveia-Carvalho, Wilson Antunes, Tiago Gonc ¸alves, Filipe Duarte, Bernardino Verissimo","year":"2017","venue":"OCEANS-Anchorage","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Milch et al., 2007] Brian Milch, Bhaskara Marthi, Stuart Russell, David Sontag, Daniel L Ong, and Andrey Kolobov. BLOG: Probabilistic models with unknown ob- jects. Statistical relational learning, page 373, 2007.","title":"BLOG: Probabilistic models with unknown objects","authors":"Brian Milch, Bhaskara Marthi, Stuart Russell, David Sontag, Daniel L Ong, Andrey Kolobov","year":"2007","venue":"Statistical relational learning","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Mossel et al., 2017] Annette Mossel, Andreas Peer, Jo- hannes Göllner, and Hannes Kaufmann. Requirements analysis on a virtual reality training system for cbrn crisis preparedness. In 59th Annual Meeting of the ISSS, vol- ume 1, pages 928-947, 2017.","title":"Requirements analysis on a virtual reality training system for cbrn crisis preparedness","authors":"Annette Mossel, Andreas Peer, Johannes Göllner, Hannes Kaufmann","year":"2017","venue":"59th Annual Meeting of the ISSS","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Pan et al., 2017] Xinlei Pan, Yurong You, Ziyan Wang, and Cewu Lu. Virtual to real reinforcement learning for au- tonomous driving. arXiv:1704.03952, 2017.","title":"Virtual to real reinforcement learning for autonomous driving","authors":"Pan","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Ren et al., 2015] Shaoqing Ren, Kaiming He, Ross Gir- shick, and Jian Sun. Faster R-CNN: Towards real-time object detection with region proposal networks. In Neural Information Processing Systems, pages 91-99, 2015.","title":"Faster R-CNN: Towards real-time object detection with region proposal networks","authors":"Ren","year":"2015","venue":"Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Richardson et al., 2013] Leonard Richardson, Mike Amundsen, and Sam Ruby. RESTful Web APIs. O'Reilly Media, Inc., 2013.","title":"RESTful Web APIs","authors":"Leonard Richardson, Mike Amundsen, Sam Ruby","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Schneider et al., 2012] Frank E Schneider, Jochen Welle, Dennis Wildermuth, and Markus Ducke. Unmanned multi-robot cbrne reconnaissance with mobile manipula- tion system description and technical validation. In 13th International Carpathian Control Conference (ICCC), pages 637-642. IEEE, 2012.","title":"Unmanned multi-robot cbrne reconnaissance with mobile manipulation system description and technical validation","authors":"Jochen Frank E Schneider, Dennis Welle, Markus Wildermuth, Ducke","year":"2012","venue":"13th International Carpathian Control Conference (ICCC)","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Shah et al., 2017] Shital Shah, Debadeepta Dey, Chris Lovett, and Ashish Kapoor. Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In Field and Service Robotics, pages 621-635, 2017.","title":"Airsim: High-fidelity visual and physical simulation for autonomous vehicles","authors":"Shital Shah, Debadeepta Dey, Chris Lovett, Ashish Kapoor","year":"2017","venue":"Field and Service Robotics","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Smyth et al., 2018a] David L Smyth, Frank G Glavin, and Michael G Madden. UE4 Virtual Environment: Rural Rail Radiation Scenario. In https:// github.com/ ROCSAFE/ CBRNeVirtualEnvMultiRobot/ releases, 2018.","title":"UE4 Virtual Environment: Rural Rail Radiation Scenario","authors":"Smyth","year":"2018","venue":null,"doi":null,"url":"https://github.com/ROCSAFE/CBRNeVirtualEnvMultiRobot/releases","internal_url":null},{"position":21,"raw":"[Smyth et al., 2018b] David L Smyth, Frank G Glavin, and Michael G Madden. Using a game engine to simulate crit- ical incidents and data collection by autonomous drones. In IEEE Games, Entertainment and Media, 2018.","title":"Using a game engine to simulate critical incidents and data collection by autonomous drones","authors":"Smyth","year":"2018","venue":"IEEE Games","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Tian et al., 2018] Yonglin Tian, Xuan Li, Kunfeng Wang, and Fei-Yue Wang. Training and testing object detec- tors with virtual images. Journal of Automatica Sinica, 5(2):539-546, 2018.","title":"Training and testing object detectors with virtual images","authors":"Yonglin Tian, Xuan Li, Kunfeng Wang, Fei-Yue Wang","year":"2018","venue":"Journal of Automatica Sinica","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Ulmer et al., 2017] Marlin W Ulmer, Justin C Goodson, Dirk C Mattfeld, and Barrett W Thomas. Route-based markov decision processes for dynamic vehicle routing problems. Technical report, Braunschweig, 2017.","title":"Route-based markov decision processes for dynamic vehicle routing problems","authors":"Marlin W Ulmer, Justin C Goodson, Dirk C Mattfeld, Barrett W Thomas","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Wang et al., 2017] Yue Wang, Min-Xia Zhang, and Yu-Jun Zheng. A hyper-heuristic method for uav search planning. In Advances in Swarm Intelligence, pages 454-464, 2017.","title":"A hyper-heuristic method for uav search planning","authors":"Yue Wang, Min-Xia Zhang, Yu-Jun Zheng","year":"2017","venue":"Advances in Swarm Intelligence","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Xia et al., 2017] Gui-Song Xia, Xiang Bai, Jian Ding, Zhen Zhu, Serge Belongie, Jiebo Luo, Mihai Datcu, Marcello Pelillo, and Liangpei Zhang. DOTA: A large-scale dataset for object detection in aerial images. arXiv:1711.10398, 2017.","title":"DOTA: A large-scale dataset for object detection in aerial images","authors":"Gui-Song Xia, Xiang Bai, Jian Ding, Zhen Zhu, Serge Belongie, Jiebo Luo, Mihai Datcu, Marcello Pelillo, Liangpei Zhang","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}