{"type":"ScholarlyArticle","title":"Instructing Novice Users on How to Use Tools in DIY Projects","authors":[{"name":"Gregor Behnke","slug":"gregor-behnke","given":"Gregor","family":"Behnke","affiliation":"Faculty of Engineering, Computer Science, and Psychology , Ulm University , Germany"},{"name":"Marvin Schiller","slug":"marvin-schiller","given":"Marvin","family":"Schiller","affiliation":"Faculty of Engineering, Computer Science, and Psychology , Ulm University , Germany"},{"name":"Matthias Kraus","slug":"matthias-kraus","given":"Matthias","family":"Kraus","affiliation":"Faculty of Engineering, Computer Science, and Psychology , Ulm University , Germany"},{"name":"Pascal Bercher","slug":"pascal-bercher","given":"Pascal","family":"Bercher","affiliation":"Faculty of Engineering, Computer Science, and Psychology , Ulm University , Germany"},{"name":"Mario Schmautz","slug":"mario-schmautz","given":"Mario","family":"Schmautz","affiliation":"Faculty of Engineering, Computer Science, and Psychology , Ulm University , Germany"},{"name":"Michael Dorna","slug":"michael-dorna","given":"Michael","family":"Dorna","affiliation":"Corporate Research Sector , Robert Bosch GmbH , Renningen , Germany"},{"name":"Wolfgang Minker","slug":"wolfgang-minker","given":"Wolfgang","family":"Minker","affiliation":"Faculty of Engineering, Computer Science, and Psychology , Ulm University , Germany"},{"name":"Birte Glimm","slug":"birte-glimm","given":"Birte","family":"Glimm","affiliation":"Faculty of Engineering, Computer Science, and Psychology , Ulm University , Germany"},{"name":"Susanne Biundo","slug":"susanne-biundo","given":"Susanne","family":"Biundo","affiliation":"Faculty of Engineering, Computer Science, and Psychology , Ulm University , Germany"}],"abstract":"Novice users require assistance when performing handicraft tasks. Adequate instruction ensures task completion and conveys knowledge and abilities required to perform the task. We present an assistant teaching novice users how to operate electronic tools, such as drills, saws, and sanders, in the context of Do-It-Yourself (DIY) home improvement projects. First, the actions that need to be performed for the project are determined by a planner. Second, a dialogue manager capable of natural language interaction presents these actions as instructions to the user. Third, questions on these actions and involved objects are answered by generating appropriate ontology-based explanations.","doi":"10.24963/ijcai.2018/844","url":"https://ijcai.org/proceedings/2018/844","pdf":"https://ijcai.org/proceedings/2018/0844.pdf","markdown":"https://ijcai.org/proceedings/2018/844.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/844","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Demos","track":"Demos","number":844,"pages":{"first":5805,"last":5807},"keywords":["Natural Language Processing: Dialogue","Multidisciplinary Topics and Applications: Human-Computer Interaction","Planning and Scheduling: Applications of Planning","Knowledge Representation, Reasoning, and Logic: Description Logics and Ontologies"],"videos":[],"references":[{"position":1,"raw":"[Behnke et al., 2015a] Gregor Behnke, Pascal Bercher, Su- sanne Biundo, Birte Glimm, Denis Ponomaryov, and Mar- vin Schiller. Integrating ontologies and planning for cog- nitive systems. In Proceedings of the 28th International Workshop on Description Logics (DL 2015). CEUR Work- shop Proceedings, 2015.","title":"Integrating ontologies and planning for cognitive systems","authors":"Behnke","year":"2015","venue":"Proceedings of the 28th International Workshop on Description Logics","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Behnke et al., 2015b] Gregor Behnke, Denis Ponomaryov, Marvin Schiller, Pascal Bercher, Florian Nothdurft, Birte Glimm, and Susanne Biundo. Coherence across compo- nents in cognitive systems -one ontology to rule them all. In Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI 2015), pages 1442-1449. AAAI Press, 2015.","title":"Coherence across components in cognitive systems -one ontology to rule them all","authors":"Behnke","year":"2015","venue":"Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI 2015)","doi":null,"url":null,"internal_url":"/proceedings/2015/207"},{"position":3,"raw":"[Behnke et al., 2018a] Gregor Behnke, Daniel Höller, and Susanne Biundo. totSAT -Totally-ordered hierarchical planning through SAT. In Proceedings of the 32th AAAI Conference on AI (AAAI 2018), pages 6110-6118. AAAI Press, 2018.","title":"totSAT -Totally-ordered hierarchical planning through SAT","authors":"Behnke","year":"2018","venue":"Proceedings of the 32th AAAI Conference on AI (AAAI 2018)","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Behnke et al., 2018b] Gregor Behnke, Daniel Höller, and Susanne Biundo. Tracking branches in trees -A propo- sitional encoding for solving partially-ordered HTN plan- ning problems. In Proceedings of the First ICAPS Work- shop on Hierarchical Planning, 2018.","title":"Tracking branches in trees -A propositional encoding for solving partially-ordered HTN planning problems","authors":"Behnke","year":"2018","venue":"Proceedings of the First ICAPS Workshop on Hierarchical Planning","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Bercher et al., 2014] Pascal Bercher, Susanne Biundo, Thomas Geier, Thilo Hörnle, Florian Nothdurft, Felix Richter, and Bernd Schattenberg. Plan, repair, execute, ex- plain -how planning helps to assemble your home theater. In Proceedings of the 24th International Conference on Automated Planning and Scheduling (ICAPS 2014), pages 386-394. AAAI Press, 2014.","title":"Plan, repair, execute, explain -how planning helps to assemble your home theater","authors":"Pascal Bercher, Susanne Biundo, Thomas Geier, Thilo Hörnle, Florian Nothdurft, Felix Richter, Bernd Schattenberg","year":"2014","venue":"Proceedings of the 24th International Conference on Automated Planning and Scheduling (ICAPS 2014)","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Bercher et al., 2015] Pascal Bercher, Felix Richter, Thilo Hörnle, Thomas Geier, Daniel Höller, Gregor Behnke, Florian Nothdurft, Frank Honold, Wolfgang Minker, Michael Weber, and Susanne Biundo. A planning-based assistance system for setting up a home theater. In Pro- ceedings of the 29th AAAI Conference on AI (AAAI 2015), pages 4264-4265. AAAI Press, 2015.","title":"A planning-based assistance system for setting up a home theater","authors":"Pascal Bercher, Felix Richter, Thilo Hörnle, Thomas Geier, Daniel Höller, Gregor Behnke, Florian Nothdurft, Frank Honold, Wolfgang Minker, Michael Weber, Susanne Biundo","year":"2015","venue":"Proceedings of the 29th AAAI Conference on AI (AAAI 2015)","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Bercher et al., 2017] Pascal Bercher, Felix Richter, Thilo Hörnle, Thomas Geier, Daniel Höller, Gregor Behnke, Florian Nielsen, Frank Honold, Felix Schüssel, Stephan Reuter, Wolfgang Minker, Michael Weber, Klaus Diet- mayer, and Susanne Biundo. Advanced User Assistance for Setting Up a Home Theater, chapter 24, pages 485- 491. Cognitive Technologies. Springer, 2017.","title":"Advanced User Assistance for Setting Up a Home Theater","authors":"Pascal Bercher, Felix Richter, Thilo Hörnle, Thomas Geier, Daniel Höller, Gregor Behnke, Florian Nielsen, Frank Honold, Felix Schüssel, Stephan Reuter, Wolfgang Minker, Michael Weber, Klaus Dietmayer, Susanne Biundo","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Erol et al., 1996] Kutluhan Erol, James Hendler, and Dana Nau. Complexity results for HTN planning. Annals of Mathematics and AI, 18(1):69-93, 1996.","title":"Complexity results for HTN planning","authors":"Erol","year":"1996","venue":"Annals of Mathematics and AI","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Ghallab et al., 2016] Malik Ghallab, Dana S. Nau, and Paolo Traverso. Automated Planning and Acting. Cam- bridge University Press, 2016.","title":"Automated Planning and Acting","authors":"Malik Ghallab, Dana S Nau, Paolo Traverso","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Glimm et al., 2014] Birte Glimm, Ian Horrocks, Boris Motik, Giorgos Stoilos, and Zhe Wang. HermiT: An OWL 2 reasoner. Journal of Automated Reasoning, 53(3):245- 269, 2014.","title":"HermiT: An OWL 2 reasoner","authors":"Birte Glimm, Ian Horrocks, Boris Motik, Giorgos Stoilos, Zhe Wang","year":"2014","venue":"Journal of Automated Reasoning","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Kraus et al., 2018] Matthias Kraus, Gregor Behnke, Pascal Bercher, Marvin Schiller, Susanne Biundo, Birte Glimm, and Wolfgang Minker. A multimodal dialogue framework for cloud-based companion systems. In Proceedings of the 10th International Workshop on Spoken Dialog Systems Technology (IWSDS 2018), 2018.","title":"A multimodal dialogue framework for cloud-based companion systems","authors":"Matthias Kraus, Gregor Behnke, Pascal Bercher, Marvin Schiller, Susanne Biundo, Birte Glimm, Wolfgang Minker","year":"2018","venue":"Proceedings of the 10th International Workshop on Spoken Dialog Systems Technology","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Pnueli, 1977] Amir Pnueli. The temporal logic of programs. In Proceedings of the 18th Annual Symposium on Foun- dations of Computer Science (SFCS 1977), pages 46-57. IEEE, 1977.","title":"The temporal logic of programs","authors":"Amir Pnueli, Pnueli","year":"1977","venue":"Proceedings of the 18th Annual Symposium on Foundations of Computer Science (SFCS 1977)","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Schiller et al., 2017] Marvin Schiller, Gregor Behnke, Mario Schmautz, Pascal Bercher, Matthias Kraus, Michael Dorna, Wolfgang Minker, Birte Glimm, and Susanne Biundo. A paradigm for coupling procedural and conceptual knowledge in companion systems. In Proceedings of the 2nd International Conference on Companion Technology (ICCT 2017). IEEE, 2017.","title":"A paradigm for coupling procedural and conceptual knowledge in companion systems","authors":"Marvin Schiller, Gregor Behnke, Mario Schmautz, Pascal Bercher, Matthias Kraus, Michael Dorna, Wolfgang Minker, Birte Glimm, Susanne Biundo","year":"2017","venue":"Proceedings of the 2nd International Conference on Companion Technology (ICCT 2017)","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Williams et al., 2015] Jason Williams, Eslam Kamal, Mokhtar Ashour, Hani Amr, Jessica Miller, and Geoff Zweig. Fast and easy language understanding for dialog systems with Microsoft Language Understanding Intelli- gent service (LUIS). In Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2015), pages 159-161. Association for Computational Linguistics, 2015.","title":"Fast and easy language understanding for dialog systems with Microsoft Language Understanding Intelligent service (LUIS)","authors":"Jason Williams, Eslam Kamal, Mokhtar Ashour, Hani Amr, Jessica Miller, Geoff Zweig","year":"2015","venue":"Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2015)","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}