{"type":"ScholarlyArticle","title":"Near Real-Time Detection of Poachers from Drones in AirSim","authors":[{"name":"Elizabeth Bondi","slug":"elizabeth-bondi","given":"Elizabeth","family":"Bondi","affiliation":"University of Southern California"},{"name":"Ashish Kapoor","slug":"ashish-kapoor","given":"Ashish","family":"Kapoor","affiliation":""},{"name":"Debadeepta Dey","slug":"debadeepta-dey","given":"Debadeepta","family":"Dey","affiliation":""},{"name":"James Piavis","slug":"james-piavis","given":"James","family":"Piavis","affiliation":""},{"name":"Shital Shah","slug":"shital-shah","given":"Shital","family":"Shah","affiliation":""},{"name":"Robert Hannaford","slug":"robert-hannaford","given":"Robert","family":"Hannaford","affiliation":"Air Shepherd"},{"name":"Arvind Iyer","slug":"arvind-iyer","given":"Arvind","family":"Iyer","affiliation":"Air Shepherd"},{"name":"Lucas Joppa","slug":"lucas-joppa","given":"Lucas","family":"Joppa","affiliation":""},{"name":"Milind Tambe","slug":"milind-tambe","given":"Milind","family":"Tambe","affiliation":"University of Southern California"}],"abstract":"The unrelenting threat of poaching has led to increased development of new technologies to combat it. One such example is the use of thermal infrared cameras mounted on unmanned aerial vehicles (UAVs or drones) to spot poachers at night and report them to park rangers before they are able to harm any animals. However, monitoring the live video stream from these conservation UAVs all night is an arduous task. Therefore, we discuss SPOT (Systematic Poacher deTector), a novel application that augments conservation drones with the ability to automatically detect poachers and animals in near real time. SPOT illustrates the feasibility of building upon state-of-the-art AI techniques, such as Faster RCNN, to address the challenges of automatically detecting animals and poachers in infrared images. This paper reports (i) the design of SPOT, (ii) efficient processing techniques to ensure usability in the field, (iii) evaluation of SPOT based on historical videos and a real-world test run by the end-users, Air Shepherd, in the field, and (iv) the use of AirSim for live demonstration of SPOT. The promising results from a field test have led to a plan for larger-scale deployment in a national park in southern Africa. While SPOT is developed for conservation drones, its design and novel techniques have wider application for automated detection from UAV videos.","doi":"10.24963/ijcai.2018/847","url":"https://ijcai.org/proceedings/2018/847","pdf":"https://ijcai.org/proceedings/2018/0847.pdf","markdown":"https://ijcai.org/proceedings/2018/847.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/847","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Demos","track":"Demos","number":847,"pages":{"first":5814,"last":5816},"keywords":["Robotics and Vision: Vision and Perception","Multidisciplinary Topics and Applications: Computational Sustainability"],"videos":[],"references":[{"position":1,"raw":"[Bondi et al., 2018a] Elizabeth Bondi, Debadeepta Dey, Ashish Kapoor, Jim Piavis, Shital Shah, Fei Fang, Bistra Dilkina, Robert Hannaford, Arvind Iyer, Lucas Joppa, and Milind Tambe. Airsim-w: A simulation environment for wildlife conservation with uavs. In ACM COMPASS, 2018.","title":"Airsim-w: A simulation environment for wildlife conservation with uavs","authors":"Bondi","year":"2018","venue":"ACM COMPASS","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bondi et al., 2018b] Elizabeth Bondi, Fei Fang, Mark Hamilton, Debarun Kar, Donnabell Dmello, Jongmoo Choi, Robert Hannaford, Arvind Iyer, Lucas Joppa, Milind Tambe, and Ram Nevatia. Spot poachers in action: Aug- menting conservation drones with automatic detection in near real time. In IAAI, 2018.","title":"Spot poachers in action: Augmenting conservation drones with automatic detection in near real time","authors":"Bondi","year":"2018","venue":"IAAI","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Hannaford, 2017] Robert Hannaford. Eyespy. Private Com- munication, 2017.","title":"Eyespy. Private Communication","authors":"Robert Hannaford","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Lucas et al., 1981] Bruce D Lucas, Takeo Kanade, et al. An iterative image registration technique with an application to stereo vision. 1981.","title":"An iterative image registration technique with an application to stereo vision","authors":"Takeo Bruce D Lucas, Kanade","year":"1981","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Olivares-Mendez et al., 2015] Miguel A Olivares-Mendez, Changhong Fu, Philippe Ludivig, Tegawendé F Bis- syandé, Somasundar Kannan, Maciej Zurad, Arun An- naiyan, Holger Voos, and Pascual Campoy. Towards an autonomous vision-based unmanned aerial system against wildlife poachers. Sensors, 15(12):31362-31391, 2015.","title":"Towards an autonomous vision-based unmanned aerial system against wildlife poachers","authors":"Miguel A Olivares-Mendez, Changhong Fu, Philippe Ludivig, F Tegawendé, Somasundar Bissyandé, Maciej Kannan, Arun Zurad, Holger Annaiyan, Pascual Voos, Campoy","year":"2015","venue":"Sensors","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Otsu, 1979] Nobuyuki Otsu. A threshold selection method from gray-level histograms. IEEE transactions on systems, man, and cybernetics, 9(1):62-66, 1979.","title":"A threshold selection method from gray-level histograms","authors":"Nobuyuki Otsu","year":"1979","venue":"IEEE transactions on systems, man, and cybernetics","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Ren et al., 2015] Shaoqing Ren, Kaiming He, Ross Gir- shick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. In NIPS, pages 91-99, 2015.","title":"Faster r-cnn: Towards real-time object detection with region proposal networks","authors":"Ren","year":"2015","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Shah et al., 2017] Shital Shah, Debadeepta Dey, Chris Lovett, and Ashish Kapoor. Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In Field and Service Robotics, 2017.","title":"Airsim: High-fidelity visual and physical simulation for autonomous vehicles","authors":"Shital Shah, Debadeepta Dey, Chris Lovett, Ashish Kapoor","year":"2017","venue":"Field and Service Robotics","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[van Gemert et al., 2014] Jan C van Gemert, Camiel R Ver- schoor, Pascal Mettes, Kitso Epema, Lian Pin Koh, Serge Wich, et al. Nature conservation drones for automatic lo- calization and counting of animals. In ECCV Workshops (1), pages 255-270, 2014.","title":"Nature conservation drones for automatic localization and counting of animals","authors":"Van Gemert","year":"2014","venue":"ECCV Workshops","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}