Robot Scavenger Hunt: A Standardized Framework for Evaluating Intelligent Mobile Robots

Zhang, Shiqi; Lu, Dongcai; Chen, Xiaoping; Stone, Peter

Robot Scavenger Hunt: A Standardized Framework for Evaluating Intelligent Mobile Robots

Shiqi Zhang, Dongcai Lu, Xiaoping Chen, Peter Stone

Download BibTeX Cite

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. Pages 4276-4276.

Abstract

In recent years, many different types of intelligent mobile robots have been developed in research and industrial labs. Although there are significant differences in both hardware and software over these robots, many of them share a common set of AI capabilities, e.g., planning, learning, vision and natural language processing. At the same time, almost all of them are equipped with traditional robotic capabilities such as mapping, localization, and navigation. However, to date it has been difficult to compare and contrast their capabilities in any controlled way. The main goal of the Robot Scavenger Hunt is to provide a standardized framework that includes a set of standardized tasks for evaluating the AI and robotic capabilities of medium-sized intelligent mobile robots. Compared to existing benchmarks, e.g., RoboCup@Home, Robot Scavenger Hunt aims at evaluations in larger spaces (multi-floor buildings vs. rooms) over longer periods of time (hours vs.minutes) while interacting with real human residents.

Shiqi Zhang, Dongcai Lu, Xiaoping Chen, and Peter Stone. 2016. Robot Scavenger Hunt: A Standardized Framework for Evaluating Intelligent Mobile Robots. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16. IJCAI, 4276–4276. https://ijcai.org/proceedings/2016/658

@inproceedings{ijcai2016p658,
  title     = {Robot Scavenger Hunt: A Standardized Framework for Evaluating Intelligent Mobile Robots},
  author    = {Zhang, Shiqi and Lu, Dongcai and Chen, Xiaoping and Stone, Peter},
  booktitle = {Proceedings of the Twenty-Fifth International Joint Conference on
               Artificial Intelligence, {IJCAI-16}},
  publisher = {AAAI Press / International Joint Conferences on Artificial Intelligence},
  editor    = {Subbarao Kambhampati},
  pages     = {4276--4276},
  year      = {2016},
  month     = {7},
  url       = {https://ijcai.org/proceedings/2016/658},
}

TY  - CPAPER
TI  - Robot Scavenger Hunt: A Standardized Framework for Evaluating Intelligent Mobile Robots
AU  - Zhang, Shiqi
AU  - Lu, Dongcai
AU  - Chen, Xiaoping
AU  - Stone, Peter
T2  - Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16
PB  - AAAI Press / International Joint Conferences on Artificial Intelligence
PY  - 2016
SP  - 4276
EP  - 4276
UR  - https://ijcai.org/proceedings/2016/658
ER  -