A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation Using First-Order Logic

Andrzejewski, David; Zhu, Xiaojin; Craven, Mark; Recht, Benjamin

doi:10.5591/978-1-57735-516-8/IJCAI11-200

A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation Using First-Order Logic

David Andrzejewski, Xiaojin Zhu, Mark Craven, Benjamin Recht

Download BibTeX Cite

Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. Pages 1171-1176.

https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-200

Abstract

Topic models have been used successfully for a variety of problems, often in the form of application-specific extensions of the basic Latent Dirichlet Allocation (LDA) model. Because deriving these new models in order to encode domain knowledge can be difficult and time-consuming, we propose the Fold·all model, which allows the user to specify general domain knowledge in First-Order Logic (FOL). However, combining topic modeling with FOL can result in inference problems beyond the capabilities of existing techniques. We have therefore developed a scalable inference technique using stochastic gradient descent which may also be useful to the Markov Logic Network (MLN) research community. Experiments demonstrate the expresive power of Fold·all, as well as the scalability of our proposed inference method.

David Andrzejewski, Xiaojin Zhu, Mark Craven, and Benjamin Recht. 2011. A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation Using First-Order Logic. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI-11. IJCAI, 1171–1176. https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-200

@inproceedings{ijcai2011p200,
  title     = {A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation Using First-Order Logic},
  author    = {Andrzejewski, David and Zhu, Xiaojin and Craven, Mark and Recht, Benjamin},
  booktitle = {Proceedings of the Twenty-Second International Joint Conference on
               Artificial Intelligence, {IJCAI-11}},
  publisher = {AAAI Press/International Joint Conferences on Artificial Intelligence},
  editor    = {Toby Walsh},
  pages     = {1171--1176},
  year      = {2011},
  month     = {7},
  doi       = {10.5591/978-1-57735-516-8/IJCAI11-200},
  url       = {https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-200},
}

TY  - CPAPER
TI  - A Framework for Incorporating General Domain Knowledge into Latent Dirichlet Allocation Using First-Order Logic
AU  - Andrzejewski, David
AU  - Zhu, Xiaojin
AU  - Craven, Mark
AU  - Recht, Benjamin
T2  - Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI-11
PB  - AAAI Press/International Joint Conferences on Artificial Intelligence
PY  - 2011
SP  - 1171
EP  - 1176
DO  - 10.5591/978-1-57735-516-8/IJCAI11-200
UR  - https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-200
ER  -