{"type":"ScholarlyArticle","title":"Evaluating the Interpretability of the Knowledge Compilation Map: Communicating Logical Statements Effectively","authors":[{"name":"Serena Booth","slug":"serena-booth","given":"Serena","family":"Booth","affiliation":"MIT Computer Science and Artificial Intelligence Laboratory"},{"name":"Christian Muise","slug":"christian-muise","given":"Christian","family":"Muise","affiliation":"IBM Research; MIT - IBM Watson AI Lab"},{"name":"Julie Shah","slug":"julie-shah","given":"Julie","family":"Shah","affiliation":"MIT Computer Science and Artificial Intelligence Laboratory"}],"abstract":"Knowledge compilation techniques translate propositional theories into equivalent forms to increase their computational tractability. But, how should we best present these propositional theories to a human? We analyze the standard taxonomy of propositional theories for relative interpretability across three model domains: highway driving, emergency triage, and the chopsticks game. We generate decision-making agents which produce logical explanations for their actions and apply knowledge compilation to these explanations. Then, we evaluate how quickly, accurately, and confidently users comprehend the generated explanations. We find that domain, formula size, and negated logical connectives significantly affect comprehension while formula properties typically associated with interpretability are not strong predictors of human ability to comprehend the theory.","doi":"10.24963/ijcai.2019/804","url":"https://ijcai.org/proceedings/2019/804","pdf":"https://ijcai.org/proceedings/2019/0804.pdf","markdown":"https://ijcai.org/proceedings/2019/804.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/804","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"AI for Improving Human Well-being","track":"AI for Improving Human Well-being","number":804,"pages":{"first":5801,"last":5807},"keywords":["Special Track on AI for Improving Human-Well Being: AI standards (Special Track on AI and Human Wellbeing)","Special Track on AI for Improving Human-Well Being: AI certification (Special Track on AI and Human Wellbeing)","Special Track on AI for Improving Human-Well Being: AI ethics (Special Track on AI and Human Wellbeing)","Special Track on AI for Improving Human-Well Being: AI safety (Special Track on AI and Human Wellbeing)"],"videos":[],"references":[{"position":1,"raw":"[Allahyari and Lavesson, 2011] Hiva Allahyari and Niklas Lavesson. User-oriented assessment of classification model understandability. In 11th scandinavian conference on Artificial intelligence. IOS Press, 2011.","title":"Hiva Allahyari and Niklas Lavesson. User-oriented assessment of classification model understandability","authors":"Lavesson Allahyari","year":"2011","venue":"11th scandinavian conference on Artificial intelligence","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Barrett, 2005] Anthony Barrett. Model compilation for real- time planning and diagnosis with feedback. In IJCAI, 2005.","title":"Model compilation for realtime planning and diagnosis with feedback","authors":"Anthony Barrett","year":"2005","venue":"IJCAI","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chase and Clark, 1972] William G Chase and Herbert H Clark. Mental operations in the comparison of sentences and pictures. Cognition in learning and memory, 1972.","title":"Mental operations in the comparison of sentences and pictures","authors":"G William, Herbert H Chase, Clark","year":"1972","venue":"Cognition in learning and memory","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Darwiche and Marquis, 2002] Adnan Darwiche and Pierre Marquis. A knowledge compilation map. Journal of Artificial Intelligence Research, 17:229-264, 2002.","title":"A knowledge compilation map","authors":"Marquis ; Darwiche, Adnan Darwiche, Pierre Marquis","year":"2002","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Doshi-Velez and Kim, 2017] Finale Doshi-Velez and Been Kim. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608, 2017.","title":"Finale Doshi-Velez and Been Kim. Towards a rigorous science of interpretable machine learning","authors":"Kim Doshi-Velez","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Elliott and Williams, 2006] Paul Elliott and Brian Williams. DNNF-based belief state estimation. In Proceedings of the National Conference on Artificial Intelligence, volume 21, page 36. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999, 2006.","title":"DNNF-based belief state estimation","authors":"Williams ; Elliott, Paul Elliott, Brian Williams","year":"1999","venue":"Proceedings of the National Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Freitas, 2014] Alex A Freitas. Comprehensible classification models: a position paper. ACM SIGKDD explorations newsletter, 15(1):1-10, 2014.","title":"Comprehensible classification models: a position paper","authors":"Alex A Freitas","year":"2014","venue":"ACM SIGKDD explorations newsletter","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Gilpin et al., 2018] Leilani H Gilpin, David Bau, Ben Z Yuan, Ayesha Bajwa, Michael Specter, and Lalana Kagal. Explaining explanations: An overview of interpretability of machine learning. In 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA), pages 80-89. IEEE, 2018.","title":"Explaining explanations: An overview of interpretability of machine learning","authors":"David Leilani H Gilpin, Bau, Ayesha Ben Z Yuan, Michael Bajwa, Lalana Specter, Kagal","year":"2018","venue":"IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA)","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Goodman and Flaxman, 2017] Bryce Goodman and Seth Flaxman. European Union regulations on algorithmic decision-making and a \"right to explanation\". AI Magazine, 38(3):50-57, 2017.","title":"European Union regulations on algorithmic decision-making and a \"right to explanation","authors":"Flaxman Goodman, Bryce Goodman, Seth Flaxman","year":"2017","venue":"AI Magazine","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Grier, 2015] Rebecca A Grier. How high is high? a meta-analysis of NASA-TLX global workload scores. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 59, pages 1727-1731. SAGE Publications Sage CA: Los Angeles, CA, 2015.","title":"How high is high? a meta-analysis of NASA-TLX global workload scores","authors":"Rebecca A Grier","year":"2015","venue":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Hart and Staveland, 1988] Sandra G Hart and Lowell E Staveland. Development of NASA-TLX (task load index): Results of empirical and theoretical research. In Advances in psychology, volume 52, pages 139-183. Elsevier, 1988.","title":"Development of NASA-TLX (task load index): Results of empirical and theoretical research","authors":"G Sandra, Lowell E Hart, Staveland","year":"1988","venue":"Advances in psychology","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hauser et al., 2010] John R Hauser, Olivier Toubia, Theodoros Evgeniou, Rene Befurt, and Daria Dzyabura. Disjunctions of conjunctions, cognitive simplicity, and consideration sets. Journal of Marketing Research, 47(3):485-496, 2010.","title":"Disjunctions of conjunctions, cognitive simplicity, and consideration sets","authors":"Olivier John R Hauser, Theodoros Toubia, Rene Evgeniou, Daria Befurt, Dzyabura","year":"2010","venue":"Journal of Marketing Research","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Hayes and Shah, 2017] Bradley Hayes and Julie A Shah. Im- proving robot controller transparency through autonomous policy explanation. In Proceedings of the 2017 ACM/IEEE international conference on human-robot interaction, pages 303-312. ACM, 2017.","title":"Improving robot controller transparency through autonomous policy explanation","authors":"Bradley Hayes, Julie A Shah","year":"2017","venue":"Proceedings of the 2017 ACM/IEEE international conference on human-robot interaction","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Hodgetts and Porter, 2002] Timothy J. Hodgetts and Crispin Porter. Major incident management system: the scene aid memoire for major incident medical management and support. BMJ, 2002.","title":"Major incident management system: the scene aid memoire for major incident medical management and support","authors":"Hodgetts, Timothy J Porter, Crispin Hodgetts, Porter","year":"2002","venue":"BMJ","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Huang and Darwiche, 2005] Jinbo Huang and Adnan Dar- wiche. On compiling system models for faster and more scalable diagnosis. In Proceedings Of The National Confer- ence On Artificial Intelligence, volume 20, page 300, 2005.","title":"On compiling system models for faster and more scalable diagnosis","authors":"Darwiche Huang","year":"2005","venue":"Proceedings Of The National Conference On Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Huysmans et al., 2011] Johan Huysmans, Karel Dejaeger, Christophe Mues, Jan Vanthienen, and Bart Baesens. An empirical evaluation of the comprehensibility of decision table, tree and rule based predictive models. Decision Support Systems, 51(1):141-154, 2011.","title":"An empirical evaluation of the comprehensibility of decision table, tree and rule based predictive models","authors":"Johan Huysmans, Karel Dejaeger, Christophe Mues, Jan Vanthienen, Bart Baesens","year":"2011","venue":"Decision Support Systems","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Kaptein, 2016] Maurits Kaptein. Using Generalized Linear (Mixed) Models in HCI, pages 251-274. 03 2016.","title":"Using Generalized Linear","authors":"Maurits Kaptein","year":"2016","venue":"Mixed) Models in HCI","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Lagniez and Marquis, 2014] Jean-Marie Lagniez and Pierre Marquis. Preprocessing for propositional model count- ing. In Twenty-Eighth AAAI Conference on Artificial Intelligence, 2014.","title":"Preprocessing for propositional model counting","authors":"Marquis ; Jean-Marie Lagniez, Pierre Lagniez, Marquis","year":"2014","venue":"Twenty-Eighth AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Lipton, 2016] Zachary C Lipton. The mythos of model interpretability. arXiv preprint arXiv:1606.03490, 2016.","title":"The mythos of model interpretability","authors":"Zachary C Lipton","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Miller, 1956] George A Miller. The magical number seven, plus or minus two: Some limits on our capacity for process- ing information. Psychological review, 63(2):81, 1956.","title":"The magical number seven, plus or minus two: Some limits on our capacity for processing information","authors":"George A Miller","year":"1956","venue":"Psychological review","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Miller, 2018] Tim Miller. Explanation in artificial intel- ligence: Insights from the social sciences. Artificial Intelligence, 2018.","title":"Explanation in artificial intelligence: Insights from the social sciences","authors":"Tim Miller","year":"2018","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Muise et al., 2012] Christian Muise, Sheila A McIlraith, J Christopher Beck, and Eric I Hsu. D sharp: fast d-DNNF compilation with sharpSAT. In Canadian Conference on Artificial Intelligence, pages 356-361. Springer, 2012.","title":"D sharp: fast d-DNNF compilation with sharpSAT","authors":"Christian Muise, Sheila A Mcilraith, Christopher Beck, Eric I Hsu","year":"2012","venue":"Canadian Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Siddiqi and Huang, 2011] Sajjad Ahmed Siddiqi and Jinbo Huang. Sequential diagnosis by abstraction. Journal of Artificial Intelligence Research, 41:329-365, 2011.","title":"Sequential diagnosis by abstraction","authors":"Ahmed Sajjad, Jinbo Siddiqi, Huang","year":"2011","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Subramanian et al., 1992] Girish H. Subramanian, John Nosek, Sankaran P. Raghunathan, and Santosh S. Kanitkar. A comparison of the decision table and tree. Commun. ACM, 35(1):89-94, January 1992.","title":"A comparison of the decision table and tree","authors":"H Girish, John Subramanian, Nosek, P Sankaran, Santosh S Raghunathan, Kanitkar","year":"1992","venue":"Commun. ACM","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Sztipanovits and Misra, 1996] Janos Sztipanovits and Amit Misra. Diagnosis of discrete event systems using ordered binary decision diagrams. In Seventh International Workshop on Principles of Diagnosis. Citeseer, 1996.","title":"Diagnosis of discrete event systems using ordered binary decision diagrams","authors":"Misra Sztipanovits, Janos Sztipanovits, Amit Misra","year":"1996","venue":"Seventh International Workshop on Principles of Diagnosis","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Torasso and Torta, 2006] Pietro Torasso and Gianluca Torta. Model-based diagnosis through OBDD compilation: A complexity analysis. In Reasoning, Action and Interaction in AI Theories and Systems, pages 287-305. Springer, 2006.","title":"Pietro Torasso and Gianluca Torta. Model-based diagnosis through OBDD compilation: A complexity analysis","authors":"Torta Torasso","year":"2006","venue":"Reasoning, Action and Interaction in AI Theories and Systems","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[van Wijk, 2006] Maarten van Wijk. Logical connectives in natural language: a cultural evolutionary approach. PhD thesis, Universiteit Leiden, 2006.","title":"Logical connectives in natural language: a cultural evolutionary approach","authors":"; Van Wijk, Maarten Van Wijk","year":"2006","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Wang et al., 2015] Tong Wang, Cynthia Rudin, Finale Doshi-Velez, Yimin Liu, Erica Klampfl, and Perry Mac- Neille. Or's of and's for interpretable classification, with application to context-aware recommender systems. CoRR, abs/1504.07614, 2015.","title":"Or's of and's for interpretable classification, with application to context-aware recommender systems","authors":"Tong Wang, Cynthia Rudin, Finale Doshi-Velez, Yimin Liu, Erica Klampfl, Perry Mac-Neille","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}