{"type":"ScholarlyArticle","title":"Leveraging Qualitative Reasoning to Improve SFL","authors":[{"name":"Alexandre Perez","slug":"alexandre-perez","given":"Alexandre","family":"Perez","affiliation":"University of Porto , Portugal; HASLab , INESC-TEC"},{"name":"Rui Abreu","slug":"rui-abreu","given":"Rui","family":"Abreu","affiliation":"IST , University of Lisbon , Portugal; INESC-ID"}],"abstract":"Spectrum-based fault localization (SFL) correlates a system's components with observed failures. By reasoning about coverage, SFL allows for a lightweight way of pinpointing faults. This abstraction comes at the cost of missing certain faults, such as errors of omission, and failing to provide enough contextual information to explain why components are considered suspicious. We propose an approach, named Q-SFL, that leverages qualitative reasoning to augment the information made available to SFL techniques. It qualitatively partitions system components, and treats each qualitative state as a new SFL component to be used when diagnosing. Our empirical evaluation shows that augmenting SFL with qualitative components can improve diagnostic accuracy in 54% of the considered real-world subjects.","doi":"10.24963/ijcai.2018/267","url":"https://ijcai.org/proceedings/2018/267","pdf":"https://ijcai.org/proceedings/2018/0267.pdf","markdown":"https://ijcai.org/proceedings/2018/267.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/267","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Knowledge Representation and Reasoning","track":"Main track","number":267,"pages":{"first":1935,"last":1941},"keywords":["Knowledge Representation and Reasoning: Qualitative Reasoning","Knowledge Representation and Reasoning: Diagnosis and Abductive Reasoning"],"videos":[],"references":[{"position":1,"raw":"[Abreu and van Gemund, 2009] Rui Abreu and Arjan J. C. van Gemund. A low-cost approximate minimal hitting set algorithm and its application to model-based diagnosis. In SARA'09, 2009.","title":"A low-cost approximate minimal hitting set algorithm and its application to model-based diagnosis","authors":"Rui Abreu And Arjan, J C Van Gemund","year":"2009","venue":"SARA'09","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Abreu et al., 2009a] Rui Abreu, Peter Zoeteweij, and Arjan J. C. van Gemund. A new bayesian approach to multiple intermittent fault diagnosis. In IJCAI'09, pages 653-658, 2009.","title":"A new bayesian approach to multiple intermittent fault diagnosis","authors":"Abreu","year":"2009","venue":"IJCAI'09","doi":null,"url":null,"internal_url":"/proceedings/2009/114"},{"position":3,"raw":"[Abreu et al., 2009b] Rui Abreu, Peter Zoeteweij, and Arjan J. C. van Gemund. Spectrum-based multiple fault localization. In ASE'09, pages 88-99, 2009.","title":"Spectrum-based multiple fault localization","authors":"Abreu","year":"2009","venue":"ASE'09","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Ang et al., 2017] Aaron Ang, Alexandre Perez, Arie van Deursen, and Rui Abreu. Revisiting the practical use of automated soft- ware fault localization techniques. In IWPD'17, pages 175-182, 2017.","title":"Revisiting the practical use of automated software fault localization techniques","authors":"Aaron Ang, Alexandre Perez, Arie Van Deursen, Rui Abreu","year":"2017","venue":"IWPD'","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Campos et al., 2012] José Campos, André Riboira, Alexandre Perez, and Rui Abreu. GZoltar: an eclipse plug-in for testing and debugging. In ASE'12, pages 378-381, 2012.","title":"GZoltar: an eclipse plug-in for testing and debugging","authors":"Campos","year":"2012","venue":"ASE'12","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Cardoso and Abreu, 2013a] Nuno Cardoso and Rui Abreu. A kernel density estimate-based approach to component goodness modeling. In AAAI'13, 2013.","title":"A kernel density estimate-based approach to component goodness modeling","authors":"Abreu Cardoso, Nuno Cardoso, Rui Abreu","year":"2013","venue":"AAAI'13","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Cardoso and Abreu, 2013b] Nuno Cardoso and Rui Abreu. MHS2: A map-reduce heuristic-driven minimal hitting set search algorithm. In MUSEPAT'13, pages 25-36, 2013.","title":"MHS2: A map-reduce heuristic-driven minimal hitting set search algorithm","authors":"Abreu Cardoso, Nuno Cardoso, Rui Abreu","year":"2013","venue":"MUSEPAT'","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Carey et al., 1999] John Carey, Neil Gross, Marcia Stepanek, and Otis Port. Software hell. In Business Week, pages 391-411, 1999.","title":"Software hell","authors":"John Carey, Neil Gross, Marcia Stepanek, Otis Port","year":"1999","venue":"Business Week","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[D'Ambros et al., 2010] Marco D'Ambros, Michele Lanza, and Romain Robbes. An extensive comparison of bug prediction ap- proaches. In MSR'10, pages 31-41, 2010.","title":"An extensive comparison of bug prediction approaches","authors":"Ambros","year":"2010","venue":"MSR'10","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[de Kleer, 1977] Johan de Kleer. Multiple representations of knowledge in a mechanics problem-solver. In IJCAI'77, pages 299-304, 1977.","title":"Multiple representations of knowledge in a mechanics problem-solver","authors":"; Johan De Kleer, De Kleer","year":"1977","venue":"IJCAI'77","doi":null,"url":null,"internal_url":"/proceedings/1977/67"},{"position":11,"raw":"[Elmishali et al., 2016] Amir Elmishali, Roni Stern, and Meir Kalech. Data-augmented software diagnosis. In AAAI'16, pages 4003-4009, 2016.","title":"Data-augmented software diagnosis","authors":"Amir Elmishali, Roni Stern, Meir Kalech","year":"2016","venue":"AAAI'16","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Feldman et al., 2008] Alexander Feldman, Gregory M. Provan, and Arjan J. C. van Gemund. Computing minimal diagnoses by greedy stochastic search. In AAAI'08, pages 911-918, 2008.","title":"Computing minimal diagnoses by greedy stochastic search","authors":"Alexander Feldman, Gregory M Provan, Arjan J C Van Gemund","year":"2008","venue":"AAAI'08","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Forbus, 1997] Kenneth D. Forbus. Qualitative reasoning. In The Computer Science and Engineering Handbook, pages 715-733. 1997.","title":"Qualitative reasoning","authors":"D Kenneth, Forbus","year":"1997","venue":"The Computer Science and Engineering Handbook","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Gouveia et al., 2013] Carlos Gouveia, José Campos, and Rui Abreu. Using HTML5 visualizations in software fault localiza- tion. In VISSOFT'13, pages 1-10, 2013.","title":"Using HTML5 visualizations in software fault localization","authors":"Carlos Gouveia, José Campos, Rui Abreu","year":"2013","venue":"VISSOFT'13","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Han et al., 2011] Jiawei Han, Jian Pei, and Micheline Kamber. Data Mining: Concepts and Techniques. Elsevier, 2011. [Hofer and Wotawa, 2012] Birgit Hofer and Franz Wotawa. Spec- trum enhanced dynamic slicing for better fault localization. In ECAI'12, pages 420-425, 2012.","title":"Spectrum enhanced dynamic slicing for better fault localization","authors":"Jiawei Han, Jian Pei, Micheline Kamber, Birgit Hofer, Franz Wotawa","year":"2011","venue":"ECAI'12","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Jones et al., 2002] James A. Jones, Mary Jean Harrold, and John T. Stasko. Visualization of test information to assist fault localiza- tion. In ICSE'02, pages 467-477, 2002.","title":"Visualization of test information to assist fault localization","authors":"James A Jones, Mary Jean Harrold, John T Stasko","year":"2002","venue":"ICSE'02","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Just et al., 2014] René Just, Darioush Jalali, and Michael D. Ernst. Defects4j: a database of existing faults to enable controlled test- ing studies for java programs. In ISSTA'14, pages 437-440, 2014.","title":"Defects4j: a database of existing faults to enable controlled testing studies for java programs","authors":"Just","year":"2014","venue":"ISSTA'14","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Ko and Myers, 2004] Andrew Jensen Ko and Brad A. Myers. De- signing the whyline: a debugging interface for asking questions about program behavior. In CHI'04, pages 151-158, 2004.","title":"Designing the whyline: a debugging interface for asking questions about program behavior","authors":"Andrew Jensen Ko, Brad A Myers","year":"2004","venue":"CHI'04","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Kuipers, 1986] Benjamin Kuipers. Qualitative simulation. Artifi- cial Intelligence, 29(3):289-338, 1986.","title":"Qualitative simulation","authors":"Benjamin Kuipers","year":"1986","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Lucia et al., 2014] Lucia, David Lo, Lingxiao Jiang, Ferdian Thung, and Aditya Budi. Extended comprehensive study of as- sociation measures for fault localization. Journal of Software: Evolution and Process, 26(2):172-219, 2014.","title":"Extended comprehensive study of association measures for fault localization","authors":"David Lucia, Lingxiao Lo, Ferdian Jiang, Aditya Thung, Budi","year":"2014","venue":"Journal of Software: Evolution and Process","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Mao et al., 2014] Xiaoguang Mao, Yan Lei, Ziying Dai, Yuhua Qi, and Chengsong Wang. Slice-based statistical fault localization. Journal of Systems and Software, 89:51-62, 2014.","title":"Slice-based statistical fault localization","authors":"Xiaoguang Mao, Yan Lei, Ziying Dai, Yuhua Qi, Chengsong Wang","year":"2014","venue":"Journal of Systems and Software","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Parnin and Orso, 2011] Chris Parnin and Alessandro Orso. Are au- tomated debugging techniques actually helping programmers? In ISSTA'11, pages 199-209, 2011.","title":"Are automated debugging techniques actually helping programmers?","authors":"Chris Parnin, Alessandro Orso","year":"2011","venue":"ISSTA'11","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Pelleg and Moore, 2000] Dan Pelleg and Andrew W. Moore. X- means: Extending k-means with efficient estimation of the num- ber of clusters. In ICML'00, pages 727-734, 2000.","title":"Xmeans: Extending k-means with efficient estimation of the number of clusters","authors":"Dan Pelleg, Andrew W Moore","year":"2000","venue":"ICML'00","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Perez et al., 2014] Alexandre Perez, Rui Abreu, and André Ri- boira. A dynamic code coverage approach to maximize fault lo- calization efficiency. Journal of Systems and Software, 90:18-28, 2014.","title":"A dynamic code coverage approach to maximize fault localization efficiency","authors":"Alexandre Perez, Rui Abreu, André Riboira","year":"2014","venue":"Journal of Systems and Software","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Richardson and Thompson, 1993] Debra J. Richardson and Mar- garet C. Thompson. An analysis of test data selection criteria using the RELAY model of fault detection. IEEE Transactions on Software Engineering, 19(6):533-553, 1993.","title":"An analysis of test data selection criteria using the RELAY model of fault detection","authors":"Debra J Richardson, Margaret C Thompson","year":"1993","venue":"IEEE Transactions on Software Engineering","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Shapiro and Wilk, 1965] S. S. Shapiro and M. B. Wilk. An analy- sis of variance test for normality (complete samples). Biometrika, 52(3-4):591-611, 1965.","title":"An analysis of variance test for normality (complete samples)","authors":"S S Shapiro, M B Wilk","year":"1965","venue":"Biometrika","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[de Souza and Chaim, 2013] Higor Amario de Souza and Mar- cos Lordello Chaim. Adding context to fault localization with integration coverage. In ASE'13, pages 628-633, 2013.","title":"Higor Amario de Souza and Marcos Lordello Chaim. Adding context to fault localization with integration coverage","authors":"Chaim De Souza","year":"2013","venue":"ASE'13","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Stenbakken et al., 1989] G. N. Stenbakken, T. M. Souders, and G. W. Stewart. Ambiguity groups and testability. IEEE Trans- actions on Instrumentation and Measurement, 38(5):941-947, 1989.","title":"Ambiguity groups and testability","authors":"G N Stenbakken, T M Souders, G W Stewart","year":"1989","venue":"IEEE Transactions on Instrumentation and Measurement","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Wang and Lo, 2014] Shaowei Wang and David Lo. Version his- tory, similar report, and structure: putting them together for im- proved bug localization. In ICPC'14, pages 53-63, 2014.","title":"Version history, similar report, and structure: putting them together for improved bug localization","authors":"Wang, Lo, Shaowei Wang, David Lo","year":"2014","venue":"ICPC'14","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Wilcoxon, 1945] Frank Wilcoxon. Individual comparisons by ranking methods. Biometrics Bulletin, 1(6):80-83, 1945.","title":"Individual comparisons by ranking methods","authors":"Frank Wilcoxon","year":"1945","venue":"Biometrics Bulletin","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Williams and de Kleer, 1991] Brian C. Williams and Johan de Kleer. Qualitative reasoning about physical systems: A return to roots. Artificial Intelligence, 51(1-3):1-9, 1991.","title":"Qualitative reasoning about physical systems: A return to roots","authors":"Brian C Williams, Johan De Kleer","year":"1991","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Xu et al., 2011] Xiaofeng Xu, Vidroha Debroy, W. Eric Wong, and Donghui Guo. Ties within fault localization rankings: Exposing and addressing the problem. International Journal of Software Engineering and Knowledge Engineering, 21(6):803-827, 2011.","title":"Ties within fault localization rankings: Exposing and addressing the problem","authors":"Xiaofeng Xu, W Eric Vidroha Debroy, Donghui Wong, Guo","year":"2011","venue":"International Journal of Software Engineering and Knowledge Engineering","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}