Incorporating External Knowledge into Crowd Intelligence for More Specific Knowledge Acquisition

Han, Tao; Sun, Hailong; Song, Yangqiu; Fang, Yili; Liu, Xudong

Incorporating External Knowledge into Crowd Intelligence for More Specific Knowledge Acquisition

Tao Han, Hailong Sun, Yangqiu Song, Yili Fang, Xudong Liu

Download BibTeX Cite

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. Pages 1541-1546.

Abstract

Crowdsourcing has been a helpful mechanism to leverage human intelligence to acquire useful knowledge for well defined tasks. However, when aggregating the crowd knowledge based on the currently developed voting algorithms, it often results in common knowledge that may not be expected. In this paper, we consider the problem of collecting as specific as possible knowledge via crowdsourcing. With the help of using external knowledge base such as WordNet, we incorporate the semantic relations between the alternative answers into a probabilistic model to determine which answer is more specific. We formulate the probabilistic model considering both worker's ability and task's difficulty, and solve it by expectation-maximization (EM) algorithm. Experimental results show that our approach achieved 35.88% improvement over majority voting when more specific answers are expected.

Tao Han, Hailong Sun, Yangqiu Song, Yili Fang, and Xudong Liu. 2016. Incorporating External Knowledge into Crowd Intelligence for More Specific Knowledge Acquisition. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16. IJCAI, 1541–1546. https://ijcai.org/proceedings/2016/221

@inproceedings{ijcai2016p221,
  title     = {Incorporating External Knowledge into Crowd Intelligence for More Specific Knowledge Acquisition},
  author    = {Han, Tao and Sun, Hailong and Song, Yangqiu and Fang, Yili and Liu, Xudong},
  booktitle = {Proceedings of the Twenty-Fifth International Joint Conference on
               Artificial Intelligence, {IJCAI-16}},
  publisher = {AAAI Press / International Joint Conferences on Artificial Intelligence},
  editor    = {Subbarao Kambhampati},
  pages     = {1541--1546},
  year      = {2016},
  month     = {7},
  url       = {https://ijcai.org/proceedings/2016/221},
}

TY  - CPAPER
TI  - Incorporating External Knowledge into Crowd Intelligence for More Specific Knowledge Acquisition
AU  - Han, Tao
AU  - Sun, Hailong
AU  - Song, Yangqiu
AU  - Fang, Yili
AU  - Liu, Xudong
T2  - Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16
PB  - AAAI Press / International Joint Conferences on Artificial Intelligence
PY  - 2016
SP  - 1541
EP  - 1546
UR  - https://ijcai.org/proceedings/2016/221
ER  -