{"type":"ScholarlyArticle","title":"A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation Using First-Order Logic","authors":[{"name":"David Andrzejewski","slug":"david-andrzejewski","given":"David","family":"Andrzejewski","affiliation":""},{"name":"Xiaojin Zhu","slug":"xiaojin-zhu","given":"Xiaojin","family":"Zhu","affiliation":""},{"name":"Mark Craven","slug":"mark-craven","given":"Mark","family":"Craven","affiliation":""},{"name":"Benjamin Recht","slug":"benjamin-recht","given":"Benjamin","family":"Recht","affiliation":""}],"abstract":"Topic models have been used successfully for a variety of problems, often in the form of application-specific extensions of the basic Latent Dirichlet Allocation (LDA) model. Because deriving these new models in order to encode domain knowledge can be difficult and time-consuming, we propose the Fold·all model, which allows the user to specify general domain knowledge in First-Order Logic (FOL). However, combining topic modeling with FOL can result in inference problems beyond the capabilities of existing techniques. We have therefore developed a scalable inference technique using stochastic gradient descent which may also be useful to the Markov Logic Network (MLN) research community. Experiments demonstrate the expresive power of Fold·all, as well as the scalability of our proposed inference method.","doi":"10.5591/978-1-57735-516-8/IJCAI11-200","url":"https://ijcai.org/proceedings/2011/200","pdf":"https://ijcai.org/proceedings/2011/0200.pdf","markdown":"https://ijcai.org/proceedings/2011/200.md","bibtex":"https://ijcai.org/proceedings/2011/bibtex/200","volume":{"slug":"2011","title":"Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2011","url":"https://ijcai.org/proceedings/2011/","year":2011,"location":"Barcelona, Catalonia, Spain","dates":"16–22 July 2011","editors":"Toby Walsh","isbn":"978-1-57735-512-0; 978-1-57735-513-7; 978-1-57735-514-4; 978-1-57735-515-1; 978-1-57735-516-8","publisher":"AAAI Press/International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":200,"pages":{"first":1171,"last":1176},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}