{"type":"ScholarlyArticle","title":"Data Sparseness in Linear SVM","authors":[{"name":"Xiang Li","slug":"xiang-li","given":"Xiang","family":"Li","affiliation":""},{"name":"Huaimin Wang","slug":"huaimin-wang","given":"Huaimin","family":"Wang","affiliation":""},{"name":"Bin Gu","slug":"bin-gu","given":"Bin","family":"Gu","affiliation":""},{"name":"Charles X. Ling","slug":"charles-x-ling","given":"Charles X.","family":"Ling","affiliation":""}],"abstract":"Large sparse datasets are common in many real-world applications. Linear SVM has been shown to be very efficient for classifying such datasets. However, it is still unknown how data sparseness would affect its convergence behavior. To study this problem in a systematic manner, we propose a novel approach to generate large and sparse data from real-world datasets, using statistical inference and the data sampling process in the PAC framework. We first study the convergence behavior of linear SVM experimentally, and make several observations, useful for real-world applications. We then offer theoretical proofs for our observations by studying the Bayes risk and PAC bound. Our experiment and theoretic results are valuable for learning large sparse datasets with linear SVM.","doi":null,"url":"https://ijcai.org/proceedings/2015/510","pdf":"https://ijcai.org/proceedings/2015/0510.pdf","markdown":"https://ijcai.org/proceedings/2015/510.md","bibtex":"https://ijcai.org/proceedings/2015/bibtex/510","volume":{"slug":"2015","title":"Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2015","url":"https://ijcai.org/proceedings/2015/","year":2015,"location":"Buenos Aires, Argentina","dates":"25–31 July 2015","editors":"Qiang Yang and Michael Wooldridge","isbn":"978-1-57735-738-4","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":"Special Track on Machine Learning","track":"Special Track on Machine Learning","number":510,"pages":{"first":3628,"last":3633},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}