{"type":"ScholarlyArticle","title":"Training-Efficient Feature Map for Shift-Invariant Kernels","authors":[{"name":"Xixian Chen","slug":"xixian-chen","given":"Xixian","family":"Chen","affiliation":""},{"name":"Haiqin Yang","slug":"haiqin-yang","given":"Haiqin","family":"Yang","affiliation":""},{"name":"Irwin King","slug":"irwin-king","given":"Irwin","family":"King","affiliation":""},{"name":"Michael R. Lyu","slug":"michael-r-lyu","given":"Michael R.","family":"Lyu","affiliation":""}],"abstract":"Random feature map is popularly used to scale up kernel methods. However, employing a large number of mapped features to ensure an accurate approximation will still make the training time consuming. In this paper, we aim to improve the training efficiency of shift-invariant kernels by using fewer informative features without sacrificing precision. We propose a novel feature map method by extending Random Kitchen Sinks through fast data-dependent subspace embedding to generate the desired features. More specifically, we describe two algorithms with different tradeoffs on the running speed and accuracy, and prove that O(l) features induced by them are able to perform as accurately as O(l2) features by other feature map methods. In addition, several experiments are conducted on the real-world datasets demonstrating the superiority of our proposed algorithms.","doi":null,"url":"https://ijcai.org/proceedings/2015/478","pdf":"https://ijcai.org/proceedings/2015/0478.pdf","markdown":"https://ijcai.org/proceedings/2015/478.md","bibtex":"https://ijcai.org/proceedings/2015/bibtex/478","volume":{"slug":"2015","title":"Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2015","url":"https://ijcai.org/proceedings/2015/","year":2015,"location":"Buenos Aires, Argentina","dates":"25–31 July 2015","editors":"Qiang Yang and Michael Wooldridge","isbn":"978-1-57735-738-4","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":"Special Track on Machine Learning","track":"Special Track on Machine Learning","number":478,"pages":{"first":3395,"last":3400},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}