{"type":"ScholarlyArticle","title":"Learning Co-Substructures by Kernel Dependence Maximization","authors":[{"name":"Sho Yokoi","slug":"sho-yokoi","given":"Sho","family":"Yokoi","affiliation":"Tohoku University , Sendai , Japan"},{"name":"Daichi Mochihashi","slug":"daichi-mochihashi","given":"Daichi","family":"Mochihashi","affiliation":"The Institute of Statistical Mathematics , Tokyo , Japan"},{"name":"Ryo Takahashi","slug":"ryo-takahashi","given":"Ryo","family":"Takahashi","affiliation":"Tohoku University , Sendai , Japan"},{"name":"Naoaki Okazaki","slug":"naoaki-okazaki","given":"Naoaki","family":"Okazaki","affiliation":"Tohoku University , Sendai , Japan"},{"name":"Kentaro Inui","slug":"kentaro-inui","given":"Kentaro","family":"Inui","affiliation":"Tohoku University , Sendai , Japan"}],"abstract":"Modeling associations between items in a dataset is a problem that is frequently encountered in data and knowledge mining research. Most previous studies have simply applied a predefined fixed pattern for extracting the substructure of each item pair and then analyzed the associations between these substructures. Using such fixed patterns may not, however, capture the significant association. We, therefore, propose the novel machine learning task of extracting a strongly associated substructure pair (co-substructure) from each input item pair. We call this task dependent co-substructure extraction (DCSE), and formalize it as a dependence maximization problem. Then, we discuss critical issues with this task: the data sparsity problem and a huge search space. To address the data sparsity problem, we adopt the Hilbert--Schmidt independence criterion as an objective function. To improve search efficiency, we adopt the Metropolis--Hastings algorithm. We report the results of empirical evaluations, in which the proposed method is applied for acquiring and predicting narrative event pairs, an active task in the field of natural language processing.","doi":"10.24963/ijcai.2017/465","url":"https://ijcai.org/proceedings/2017/465","pdf":"https://ijcai.org/proceedings/2017/0465.pdf","markdown":"https://ijcai.org/proceedings/2017/465.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/465","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra, IIIA-CSIC","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Machine Learning S-Z","track":"Main track","number":465,"pages":{"first":3329,"last":3335},"keywords":["Natural Language Processing: Natural Language Processing","Natural Language Processing: Information Extraction","Machine Learning: Unsupervised Learning","Machine Learning: Kernel Methods"],"videos":[],"references":[{"position":1,"raw":"[Chambers and Jurafsky, 2008] Nathanael Chambers and Dan Jurafsky. Unsupervised Learning of Narrative Event Chains. In ACL, pages 789-797, 2008.","title":"Unsupervised Learning of Narrative Event Chains","authors":"Jurafsky Chambers","year":"2008","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Chambers and Jurafsky, 2009] Nathanael Chambers and Dan Jurafsky. Unsupervised Learning of Narrative Schemas and their Participants. In ACL, pages 602-610, 2009.","title":"Unsupervised Learning of Narrative Schemas and their Participants","authors":"Jurafsky Chambers, Nathanael Chambers, Dan Jurafsky","year":"2009","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chib and Greenberg, 1995] Siddhartha Chib and Edward Greenberg. Understanding the Metropolis-Hastings Al- gorithm. The American Statistician, 49(4):327-335, 1995.","title":"Understanding the Metropolis-Hastings Algorithm","authors":"Greenberg Chib","year":"1995","venue":"The American Statistician","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Church and Hanks, 1990] Kenneth Ward Church and Patrick Hanks. Word Association Norms, Mutual Information, and Lexicography. Computational linguistics, 16(1):22-29, 1990.","title":"Word Association Norms, Mutual Information, and Lexicography","authors":"Kenneth Ward Church, Patrick Hanks","year":"1990","venue":"Computational linguistics","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Fawcett, 2006] Tom Fawcett. An introduction to ROC anal- ysis. Pattern Recognition Letters, 27(8):861-874, 2006.","title":"Tom Fawcett. An introduction to ROC analysis","authors":"Fawcett","year":"2006","venue":"Pattern Recognition Letters","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Fukumizu et al., 2009] Kenji Fukumizu, Francis R. Bach, and Michael I. Jordan. Kernel dimension reduction in regression. Annals of Statistics, 37(4):1871-1905, 2009.","title":"Kernel dimension reduction in regression","authors":"Kenji Fukumizu, Francis R Bach, Michael I Jordan","year":"2009","venue":"Annals of Statistics","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Graff and Cieri, 2003] David Graff and Christopher Cieri. English Gigaword, LDC2003T05. Philadelphia: Linguistic Data Consortium, 2003.","title":"English Gigaword, LDC2003T05","authors":"David Graff, Christopher Cieri","year":"2003","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Granroth-Wilding and Clark, 2016] Mark Granroth-Wilding and Stephen Clark. What Happens Next? Event Prediction Using a Compositional Neural Network Model. In AAAI, pages 2727-2733, 2016.","title":"What Happens Next? Event Prediction Using a Compositional Neural Network Model","authors":"Granroth-Wilding, Clark ; Mark Granroth-Wilding, Stephen Clark","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Gretton et al., 2005] Arthur Gretton, Olivier Bousquet, Alex Smola, and Bernhard Schölkopf. Measuring Statistical Dependence with Hilbert-Schmidt Norms. In ALT, pages 63-77, 2005.","title":"Measuring Statistical Dependence with Hilbert-Schmidt Norms","authors":"Arthur Gretton, Olivier Bousquet, Alex Smola, Bernhard Schölkopf","year":"2005","venue":"ALT","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Jans et al., 2012] Bram Jans, Steven Bethard, Ivan Vulić, and M. Francine Moens. Skip N-grams and Ranking Functions for Predicting Script Events. In EACL, pages 336-344, 2012.","title":"Skip N-grams and Ranking Functions for Predicting Script Events","authors":"Jans","year":"2012","venue":"EACL","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Maes et al., 1997] Frederik Maes, Andre Collignon, Dirk Vandermeulen, Guy Marchal, and Paul Suetens. Multi- modality Image Registration by Maximization of Mutual Information. IEEE Trans. on Medical Imaging, 16(2):187- 198, 1997.","title":"Multimodality Image Registration by Maximization of Mutual Information","authors":"Frederik Maes, Andre Collignon, Dirk Vandermeulen, Guy Marchal, Paul Suetens","year":"1997","venue":"IEEE Trans. on Medical Imaging","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Manning et al., 2014] Christopher D. Manning, John Bauer, Jenny Finkel, Steven J. Bethard, Mihai Surdeanu, and David McClosky. The Stanford CoreNLP Natural Lan- guage Processing Toolkit. In ACL System Demonstrations, pages 55-60, 2014.","title":"The Stanford CoreNLP Natural Language Processing Toolkit","authors":"D Christopher, John Manning, Jenny Bauer, Steven J Finkel, Mihai Bethard, David Surdeanu, Mcclosky","year":"2014","venue":"ACL System Demonstrations","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Muandet et al., 2016] Krikamol Muandet, Kenji Fukumizu, Bharath Sriperumbudur, and Bernhard Schölkopf. Kernel Mean Embedding of Distributions: A Review and Beyonds. arXiv preprint arXiv:1605.09522, 2016.","title":"Krikamol Muandet, Kenji Fukumizu, Bharath Sriperumbudur","authors":"Muandet","year":"2016","venue":"Kernel Mean Embedding of Distributions: A Review and Beyonds","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Peng et al., 2005] Hanchuan Peng, Fuhui Long, and Chris Ding. Feature selection based on mutual information: Criteria of Max-Dependency, Max-Relevance, and Min- Redundancy. IEEE Trans. on Pattern Analysis and Machine Intelligence, 27(8):1226-1238, 2005.","title":"Feature selection based on mutual information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy","authors":"Peng","year":"2005","venue":"IEEE Trans. on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Quadrianto et al., 2009] Novi Quadrianto, Le Song, and Alex J. Smola. Kernelized sorting. In NIPS, pages 1289- 1296, 2009.","title":"Kernelized sorting","authors":"Quadrianto","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Resnik, 1997] Philip Stuart Resnik. Selectional Preference and Sense Disambiguation. In ACL SIGLEX Workshop on Tagging Text with Lexical Semantics: Why, What, and How, pages 52-57, 1997.","title":"Selectional Preference and Sense Disambiguation","authors":"Philip Stuart, Resnik","year":"1997","venue":"ACL SIGLEX Workshop on Tagging Text with Lexical Semantics: Why, What, and How","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Song et al., 2012] Le Song, Alex Smola, Arthur Gretton, Justin Bedo, and Karsten Borgwardt. Feature Selection via Dependence Maximization. Journal of Machine Learn- ing Research, 13:1393-1434, 2012.","title":"Feature Selection via Dependence Maximization","authors":"Le Song, Alex Smola, Arthur Gretton, Justin Bedo, Karsten Borgwardt","year":"2012","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Torkkola, 2003] Kari Torkkola. Feature Extraction by Non- Parametric Mutual Information Maximization. Journal of Machine Learning Research, 3:1415-1438, 2003.","title":"Feature Extraction by Non-Parametric Mutual Information Maximization","authors":"Kari Torkkola","year":"2003","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Turney, 2002] Peter D. Turney. Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews. In ACL, pages 417-424, 2002.","title":"Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews","authors":"D Peter, Turney","year":"2002","venue":"ACL","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}