{"type":"ScholarlyArticle","title":"Sequence Prediction Exploiting Similary Information","authors":[{"name":"István Bíró","slug":"istvan-biro","given":"István","family":"Bíró","affiliation":""},{"name":"Zoltán Szamonek","slug":"zoltan-szamonek","given":"Zoltán","family":"Szamonek","affiliation":""},{"name":"Csaba Szepesvári","slug":"csaba-szepesvari","given":"Csaba","family":"Szepesvári","affiliation":""}],"abstract":"When data is scarce or the alphabet is large, smoothing the probability estimates becomes inescapable when estimating n-gram models. In this paper we propose a method that implements a form of smoothing by exploiting similarity information of the alphabet elements. The idea is to view the log-conditional probability function as a smooth function defined over the similarity graph. The algorithm that we propose uses the eigenvectors of the similarity graph as the basis of the expansion of the log conditional probability function whose coefficients are found by solving a regularized logistic regression problem. The experimental results demonstrate the superiority of the method when the similarity graph contains relevant information, whilst the method still remains competitive with state-of-the-art smoothing methods even in the lack of such information.","doi":null,"url":"https://ijcai.org/proceedings/2007/254","pdf":"https://ijcai.org/proceedings/2007/0254.pdf","markdown":"https://ijcai.org/proceedings/2007/254.md","bibtex":"https://ijcai.org/proceedings/2007/bibtex/254","volume":{"slug":"2007","title":"Proceedings of the Twentieth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2007","url":"https://ijcai.org/proceedings/2007/","year":2007,"location":"Hyderabad, India","dates":"","editors":"Ramon López de Mántaras","isbn":"","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":254,"pages":{"first":1576,"last":1580},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}