{"type":"ScholarlyArticle","title":"Interactive, Collaborative Robots: Challenges and Opportunities","authors":[{"name":"Danica Kragic","slug":"danica-kragic","given":"Danica","family":"Kragic","affiliation":"Robotics, Perception and Learning lab , KTH Royal Institute of Technology , Stockholm , Sweden"},{"name":"Joakim Gustafson","slug":"joakim-gustafson","given":"Joakim","family":"Gustafson","affiliation":"Speech , Music and Hearing department , KTH Royal Institute of Technology , Stockholm , Sweden"},{"name":"Hakan Karaoguz","slug":"hakan-karaoguz","given":"Hakan","family":"Karaoguz","affiliation":"Robotics, Perception and Learning lab , KTH Royal Institute of Technology , Stockholm , Sweden"},{"name":"Patric Jensfelt","slug":"patric-jensfelt","given":"Patric","family":"Jensfelt","affiliation":"Robotics, Perception and Learning lab , KTH Royal Institute of Technology , Stockholm , Sweden"},{"name":"Robert Krug","slug":"robert-krug","given":"Robert","family":"Krug","affiliation":"Robotics, Perception and Learning lab , KTH Royal Institute of Technology , Stockholm , Sweden"}],"abstract":"Robotic technology has transformed manufacturing\r\nindustry ever since the first industrial robot was put\r\nin use in the beginning of the 60s. The challenge\r\nof developing flexible solutions where production\r\nlines can be quickly re-planned, adapted and structured\r\nfor new or slightly changed products is still\r\nan important open problem. Industrial robots today\r\nare still largely preprogrammed for their tasks,\r\nnot able to detect errors in their own performance\r\nor to robustly interact with a complex environment\r\nand a human worker. The challenges are even more\r\nserious when it comes to various types of service\r\nrobots. Full robot autonomy, including natural interaction,\r\nlearning from and with human, safe and\r\nflexible performance for challenging tasks in unstructured\r\nenvironments will remain out of reach\r\nfor the foreseeable future. In the envisioned future\r\nfactory setups, home and office environments,\r\nhumans and robots will share the same workspace\r\nand perform different object manipulation tasks in\r\na collaborative manner. We discuss some of the\r\nmajor challenges of developing such systems and\r\nprovide examples of the current state of the art.","doi":"10.24963/ijcai.2018/3","url":"https://ijcai.org/proceedings/2018/3","pdf":"https://ijcai.org/proceedings/2018/0003.pdf","markdown":"https://ijcai.org/proceedings/2018/3.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/3","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Invited Speakers","track":"Invited Speakers","number":3,"pages":{"first":18,"last":25},"keywords":["Robotics: Robotics","Robotics: Behavior and Control","Computer Vision: Language and Vision","Robotics: Vision and Perception"],"videos":[],"references":[{"position":1,"raw":"[Admoni et al., 2016] Henny Admoni, Thomas Weng, and Brian Scassellati. Modeling communicative behaviors for object references in human-robot interaction. In Proc. IEEE Int. Conf. Robotics and Autom., pages 3352-3359. IEEE, 2016.","title":"Modeling communicative behaviors for object references in human-robot interaction","authors":"Admoni","year":"2016","venue":"Proc. IEEE Int. Conf. Robotics and Autom","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Akgun and Thomaz, 2016] Baris Akgun and Andrea Thomaz. Simultaneously learning actions and goals from demonstration. Auton. Rob., 40(2):211-227, 2016.","title":"Simultaneously learning actions and goals from demonstration","authors":"Akgun, Thomaz, Baris Akgun, Andrea Thomaz","year":"2016","venue":"Auton. Rob","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Al Moubayed et al., 2012] Samer Al Moubayed, Jonas Beskow, Gabriel Skantze, and Björn Granström. Furhat: a back-projected human-like robot head for multiparty human-machine interaction. In Cognitive behavioural sys- tems, pages 114-130. Springer, 2012.","title":"Furhat: a back-projected human-like robot head for multiparty human-machine interaction","authors":"Al Samer, Jonas Moubayed, Gabriel Beskow, Björn Skantze, Granström","year":"2012","venue":"Cognitive behavioural systems","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Baraglia et al., 2016] Jimmy Baraglia, Maya Cakmak, Yukie Nagai, Rajesh Rao, and Minoru Asada. Initiative in robot assistance during collaborative task execution. In Proc. ACM/IEEE Int. Conf. Human-robot Int., pages 67- 74. IEEE Press, 2016.","title":"Initiative in robot assistance during collaborative task execution","authors":"Jimmy Baraglia, Maya Cakmak, Yukie Nagai, Rajesh Rao, Minoru Asada","year":"2016","venue":"Proc. ACM/IEEE Int. Conf. Human-robot Int","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Björkman et al., 2013] Mårten Björkman, Yasmin Bekiroglu, Virgile Högman, and Danica Kragic. En- hancing visual perception of shape through tactile glances. In Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., pages 3180-3186, 2013.","title":"Enhancing visual perception of shape through tactile glances","authors":"Björkman","year":"2013","venue":"Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Bohg et al., 2017] Jeannette Bohg, Karol Hausman, Bharath Sankaran, Oliver Brock, Danica Kragic, Stefan Schaal, and Gaurav S. Sukhatme. Interactive perception: Leveraging action in perception and perception in action. IEEE Trans. Rob., 33(6):1273-1291, Dec 2017.","title":"Interactive perception: Leveraging action in perception and perception in action","authors":"Jeannette Bohg, Karol Hausman, Bharath Sankaran, Oliver Brock, Danica Kragic, Stefan Schaal, Gaurav S Sukhatme","year":"2017","venue":"IEEE Trans. Rob","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Brooks, 1986] Rodney Brooks. A robust layered control system for a mobile robot. IEEE Journal on Robotics and Automation, 2(1):14-23, 1986.","title":"A robust layered control system for a mobile robot","authors":"Rodney Brooks","year":"1986","venue":"IEEE Journal on Robotics and Automation","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Bütepage et al., 2017] Judith Bütepage, Michael Black, Danica Kragic, and Hedvig Kjellström. Deep represen- tation learning for human motion prediction and classifi- cation. In Proc. IEEE Int. Conf. Comp. Vision and Pattern Recogn. IEEE, 2017.","title":"Deep representation learning for human motion prediction and classification","authors":"Bütepage","year":"2017","venue":"Proc. IEEE Int. Conf. Comp. Vision and Pattern Recogn. IEEE","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Cai et al., 2016] Minjie Cai, Kris M. Kitani, and Yoichi Sato. Understanding hand-object manipulation with grasp types and object attributes. In Robotics: Science and Sys- tems, 2016.","title":"Understanding hand-object manipulation with grasp types and object attributes","authors":"Minjie Cai, Kris M Kitani, Yoichi Sato","year":"2016","venue":"Robotics: Science and Systems","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Chadalavada et al., 2015] Ravi Teja Chadalavada, Henrik Andreasson, Robert Krug, and Achim J Lilienthal. That's on my mind! robot to human intention communication through on-board projection on shared floor space. In Proc. European Conf. on Mobile Robots, pages 1-6, 2015.","title":"That's on my mind! robot to human intention communication through on-board projection on shared floor space","authors":"Ravi Teja, Chadalavada, Henrik Andreasson, Robert Krug, Achim J Lilienthal","year":"2015","venue":"Proc. European Conf. on Mobile Robots","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Chai et al., 2014] Joyce Y. Chai, Lanbo She, Rui Fang, Spencer Ottarson, Cody Littley, Changsong Liu, and Kenneth Hanson. Collaborative effort towards com- mon ground in situated human-robot dialogue. In Proc. ACM/IEEE Int. Conf. Human-robot Int., pages 33-40. ACM, 2014.","title":"Collaborative effort towards common ground in situated human-robot dialogue","authors":"Joyce Y Chai, Lanbo She, Rui Fang, Spencer Ottarson, Cody Littley, Changsong Liu, Kenneth Hanson","year":"2014","venue":"Proc. ACM/IEEE Int. Conf. Human-robot Int","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Colledanchise and Ögren, 2017] Michele Colledanchise and Petter Ögren. How behavior trees modularize hy- brid control systems and generalize sequential behavior compositions, the subsumption architecture, and decision trees. IEEE Trans. Rob., 33(2):372-389, 2017.","title":"How behavior trees modularize hybrid control systems and generalize sequential behavior compositions, the subsumption architecture, and decision trees","authors":"Michele Colledanchise, Petter Ögren","year":"2017","venue":"IEEE Trans. Rob","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Erdmann and Mason, 1988] Michael A. Erdmann and Matthew T. Mason. An exploration of sensorless ma- nipulation. Robotics and Automation, IEEE Journal of, 4(4):369-379, August 1988.","title":"An exploration of sensorless manipulation","authors":"Michael A Erdmann, Matthew T Mason","year":"1988","venue":"Robotics and Automation","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Escande et al., 2014] Adrien Escande, Nicolas Mansard, and Pierre-Brice Wieber. Hierarchical quadratic program- ming: Fast online humanoid-robot motion generation. Int.","title":"Hierarchical quadratic programming: Fast online humanoid-robot motion generation","authors":"Adrien Escande, Nicolas Mansard, Pierre-Brice Wieber","year":null,"venue":"Int","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"J. Rob. Res., 33(7):1006-1028, 2014.","title":"J. Rob. Res","authors":null,"year":"2014","venue":"J. Rob. Res","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Feix et al., 2013] Thomas Feix, Javier Romero, Carl Hen- rik Ek, Heinz-Bodo Schmiedmayer, and Danica Kragic. A metric for comparing the anthropomorphic motion capa- bility of artificial hands. IEEE Trans. Rob., 29(1):82-93, 2013.","title":"A metric for comparing the anthropomorphic motion capability of artificial hands","authors":"Thomas Feix, Javier Romero, Carl Henrik Ek, Heinz-Bodo Schmiedmayer, Danica Kragic","year":"2013","venue":"IEEE Trans. Rob","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Kappler et al., 2018] Daniel Kappler, Franziska Meier, Jan Issac, Jim Mainprice, Cristina G. Cifuentes, Manuel Wthrich, Vincent Berenz, Stefan Schaal, Nathan Ratliff, and Jeannette Bohg. Real-time perception meets reactive motion generation. IEEE Rob. Autom. Letters, 3(3):1864- 1871, 2018.","title":"Real-time perception meets reactive motion generation","authors":"Daniel Kappler, Franziska Meier, Jan Issac, Jim Mainprice, Cristina G Cifuentes, Manuel Wthrich, Vincent Berenz, Stefan Schaal, Nathan Ratliff, Jeannette Bohg","year":"2018","venue":"IEEE Rob. Autom. Letters","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Kennington and Schlangen, 2017] Casey Kennington and David Schlangen. A simple generative model of incremen- tal reference resolution for situated dialogue. Computer Speech & Language, 41:43-67, 2017.","title":"A simple generative model of incremental reference resolution for situated dialogue","authors":"Casey Kennington, David Schlangen","year":"2017","venue":"Computer Speech & Language","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Kruijff et al., 2006] Geert-Jan M. Kruijff, Hendrik Zender, Patric Jensfelt, and Henrik I. Christensen. Clarifica- tion dialogues in human-augmented mapping. In Proc. ACM/IEEE Int. Conf. Human-robot Int., Salt Lake City, UT, March 2006.","title":"Clarification dialogues in human-augmented mapping","authors":"Kruijff","year":"2006","venue":"Proc. ACM/IEEE Int. Conf. Human-robot Int","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Kyrarini et al., 2018] Maria Kyrarini, Muhammad Abdul Haseeb, Danijela Ristić-Durrant, and Axel Gräser. Robot learning of industrial assembly task via human demonstra- tions. Auton. Rob., pages 1-19, 2018.","title":"Robot learning of industrial assembly task via human demonstrations","authors":"Maria Kyrarini, Muhammad Abdul Haseeb, Danijela Ristić-Durrant, Axel Gräser","year":"2018","venue":"Auton. Rob","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Levine et al., 2016] Sergey Levine, Chelsea Finn, Trevor Darrell, and Pieter Abbeel. End-to-end training of deep vi- suomotor policies. J. Machine Learning Res., 17(1):1334- 1373, 2016.","title":"End-to-end training of deep visuomotor policies","authors":"Sergey Levine, Chelsea Finn, Trevor Darrell, Pieter Abbeel","year":"2016","venue":"J. Machine Learning Res","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Li et al., 2014] Miao Li, Yasmin Bekiroglu, Danica Kragic, and Aude Billard. Learning of grasp adaptation through experience and tactile sensing. In Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., pages 3339-3346, 2014.","title":"Learning of grasp adaptation through experience and tactile sensing","authors":"Miao Li, Yasmin Bekiroglu, Danica Kragic, Aude Billard","year":"2014","venue":"Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Li et al., 2016] Miao Li, Kaiyu Hang, Danica Kragic, and Aude Billard. Dexterous grasping under shape uncertainty. Robotics and Autonomous Systems, 75:352 -364, 2016.","title":"Dexterous grasping under shape uncertainty","authors":"Miao Li, Kaiyu Hang, Danica Kragic, Aude Billard","year":"2016","venue":"Robotics and Autonomous Systems","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Liu and Zhang, 2017] Rui Liu and Xiaoli Zhang. Systems of natural-language-facilitated human-robot cooperation: A review. arXiv preprint arXiv:1701.08269, 2017.","title":"Systems of natural-language-facilitated human-robot cooperation: A review","authors":"Rui Liu, Xiaoli Zhang","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Lombard et al., 2009] Matthew Lombard, Theresa B. Dit- ton, and Lisa Weinstein. Measuring presence: the tem- ple presence inventory. In Proceedings of the 12th Annual International Workshop on Presence, pages 1-15, 2009.","title":"Measuring presence: the temple presence inventory","authors":"Matthew Lombard, Theresa B Ditton, Lisa Weinstein","year":"2009","venue":"Proceedings of the 12th Annual International Workshop on Presence","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Mehlmann et al., 2014] Gregor Mehlmann, Markus Häring, Kathrin Janowski, Tobias Baur, Patrick Gebhard, and Elis- abeth André. Exploring a model of gaze for grounding in multimodal hri. In Proc. Int. Conf. on Multimodal Inter- action, pages 247-254. ACM, 2014.","title":"Exploring a model of gaze for grounding in multimodal hri","authors":"Gregor Mehlmann, Markus Häring, Kathrin Janowski, Tobias Baur, Patrick Gebhard, Elisabeth André","year":"2014","venue":"Proc. Int. Conf. on Multimodal Interaction","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Nalpantidis et al., 2012] Lazaros Nalpantidis, Mårten Björkman, and Danica Kragic. YES -YEt another object segmentation: Exploiting camera movement. In Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., pages 2116-2121, 2012.","title":"YES -YEt another object segmentation: Exploiting camera movement","authors":"Lazaros Nalpantidis, Mårten Björkman, Danica Kragic","year":"2012","venue":"Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Pandey and Alami, 2014] Amit Kumar Pandey and Rachid Alami. Towards human-level semantics understanding of human-centered object manipulation tasks for hri: Rea- soning about effect, ability, effort and perspective taking. Int. J. Social Rob., 6(4):593-620, 2014.","title":"Towards human-level semantics understanding of human-centered object manipulation tasks for hri: Reasoning about effect, ability, effort and perspective taking","authors":"Amit Kumar, Pandey, Rachid Alami","year":"2014","venue":"Int. J. Social Rob","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Paul et al., 2017] Rohan Paul, Jacob Arkin, Nicholas Roy, and Thomas Howard. Grounding abstract spatial concepts for language interaction with robots. In Proc. Int. Joint Conf. on Artificial Intelligence, pages 4929-4933, 2017.","title":"Grounding abstract spatial concepts for language interaction with robots","authors":"Rohan Paul, Jacob Arkin, Nicholas Roy, Thomas Howard","year":"2017","venue":"Proc. Int. Joint Conf. on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2017/696"},{"position":30,"raw":"[Pereira et al., 2017] André Pereira, Elizabeth J Carter, Iolanda Leite, John Mars, and Jill Fain Lehman. Aug- mented reality dialog interface for multimodal teleopera- tion. In Proc. IEEE Int. Symp. on Rob. and Human Int. Comm., pages 764-771, 2017.","title":"Augmented reality dialog interface for multimodal teleoperation","authors":"André Pereira, Elizabeth J Carter, Iolanda Leite, John Mars, Jill Fain Lehman","year":"2017","venue":"Proc. IEEE Int. Symp. on Rob. and Human Int. Comm","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Van Hoof et al., 2014] Herke Van Hoof, Oliver Kroemer, and Jan Peters. Probabilistic segmentation and targeted exploration of objects in cluttered environments. IEEE Trans. Rob., 30(5):1198-1209, 2014.","title":"Probabilistic segmentation and targeted exploration of objects in cluttered environments","authors":"Van Hoof","year":"2014","venue":"IEEE Trans. Rob","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Vollmer and Schillingmann, 2017] Anna-Lisa Vollmer and Lars Schillingmann. On studying human teaching behav- ior with robots: a review. Review of Philosophy and Psy- chology, pages 1-41, 2017.","title":"On studying human teaching behavior with robots: a review","authors":"Anna-Lisa Vollmer, Lars Schillingmann","year":"2017","venue":"Review of Philosophy and Psychology","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Vollmer et al., 2014] Anna-Lisa Vollmer, Manuel Mühlig, Jochen J Steil, Karola Pitsch, Jannik Fritsch, Katharina J Rohlfing, and Britta Wrede. Robots show us how to teach them: Feedback from robots shapes tutoring behavior dur- ing action learning. PloS one, 9(3):e91349, 2014.","title":"Robots show us how to teach them: Feedback from robots shapes tutoring behavior during action learning","authors":"Anna-Lisa Vollmer, Manuel Mühlig, J Jochen, Karola Steil, Jannik Pitsch, Katharina J Fritsch, Britta Rohlfing, Wrede","year":"2014","venue":"PloS one","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Witmer and Singer, 1998] Bob G Witmer and Michael J Singer. Measuring presence in virtual environments: A presence questionnaire. Presence, 7(3):225-240, 1998.","title":"Measuring presence in virtual environments: A presence questionnaire","authors":"G Bob, Michael J Witmer, Singer","year":"1998","venue":"Presence","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}