{"type":"ScholarlyArticle","title":"Optimal Complex Task Assignment in Service Crowdsourcing","authors":[{"name":"Feilong Tang","slug":"feilong-tang","given":"Feilong","family":"Tang","affiliation":"Department of Computer Science and Engineering , Shanghai Jiao Tong University , China"}],"abstract":"Existing schemes cannot assign complex tasks to the most suitable workers because they either cannot measure skills quantitatively or do not consider assigning tasks to workers who are the most suitable but unavailable temporarily. In this paper, we investigate how to realize optimal complex task assignment. Firstly, we formulate the multiple-skill based task assignment problem in service crowdsourcing. We then propose a weighted multi-skill tree (WMST) to model multiple skills and their correlations. Next, we propose the acceptance expectation to uniformly measure the probabilities that different categories of workers will accept and complete specified tasks. Finally, we propose an acceptance-expectation-based task assignment (AE-TA) algorithm, which reserves tasks for the most suitable workers even unavailable temporarily. Comprehensive experimental results demonstrate that our WMST model and AE-TA algorithm significantly outperform related proposals.","doi":"10.24963/ijcai.2020/217","url":"https://ijcai.org/proceedings/2020/217","pdf":"https://ijcai.org/proceedings/2020/0217.pdf","markdown":"https://ijcai.org/proceedings/2020/217.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/217","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Humans and AI","track":"Main track","number":217,"pages":{"first":1563,"last":1569},"keywords":["Humans and AI: Human-AI Collaboration","Humans and AI: Human Computation and Crowdsourcing"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/25362/file_25362.m3u8","length_sec":298,"provider":"hls"}],"references":[{"position":1,"raw":"[Alon et al., 2015] Noga Alon, Michal Feldman, Omer Lev, and Moshe Tennenholtz. How robust is the wisdom of the crowds? In IJCAI, pages 2055-2061, 2015.","title":"How robust is the wisdom of the crowds?","authors":"Noga Alon, Michal Feldman, Omer Lev, Moshe Tennenholtz","year":"2015","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2015/291"},{"position":2,"raw":"[Assadi, Hsu, and Jabbari, 2015] Sepehr Assadi, Justin Hsu, and Shahin Jabbari. Online assignment of heterogeneous tasks in crowdsourcing markets. In HCOMP, pages 12-21, 2015.","title":"Online assignment of heterogeneous tasks in crowdsourcing markets","authors":"Sepehr Assadi, Justin Hsu, Shahin Jabbari","year":"2015","venue":"HCOMP","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Boutsis and Kalogeraki, 2013] Ioannis Boutsis and Vana Kalogeraki. Crowdsourcing under real-time constraints. In IPDPS, pages 753-764, 2013.","title":"Crowdsourcing under real-time constraints","authors":"Ioannis Boutsis, Vana Kalogeraki","year":"2013","venue":"IPDPS","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Boutsis and Kalogeraki, 2014] Ioannis Boutsis and Vana Kalogeraki. On task assignment for real-time reliable crowdsourcing. In ICDCS, pages 1-10, 2014.","title":"Ioannis Boutsis and Vana Kalogeraki. On task assignment for real-time reliable crowdsourcing","authors":"Kalogeraki Boutsis","year":"2014","venue":"ICDCS","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chandra et al., 2015] Praphul Chandra, Yadati Narahari, Debmalya Mandal, and Prasenjit Dey. Novel mechanisms for online crowdsourcing with unreliable, strategic agents. In AAAI, pages 1256-1262, 2015.","title":"Novel mechanisms for online crowdsourcing with unreliable, strategic agents","authors":"Chandra","year":"2015","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Cheng et al., 2016] Peng Cheng, Xiang Lian, Lei Chen, and Jizhong Zhao. Task assignment on multi-skill oriented s- patial crowdsourcing. IEEE Transactions on Knowledge and Data Engineering, 28(8):2201-2215, 2016.","title":"Task assignment on multi-skill oriented spatial crowdsourcing","authors":"Peng Cheng, Xiang Lian, Lei Chen, Jizhong Zhao","year":"2016","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Choi, Yoo, and Lee, 2018] Jihun Choi, Kang Min Yoo, and Sang-goo Lee. Learning to compose task-specific tree structures. In AAAI, 5094-5101, 2018.","title":"Learning to compose task-specific tree structures","authors":"Jihun Choi, Min Kang, Sang-Goo Yoo, Lee","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Desmarais and Baker, 2012] Michel Desmarais and Ryan Baker. A review of recent advances in learner and skill modeling in intelligent learning environments. User Mod- eling and User-Adapted Interaction, 22(1-2):9-38, 2012.","title":"A review of recent advances in learner and skill modeling in intelligent learning environments","authors":"Baker Desmarais, Michel Desmarais, Ryan Baker","year":"2012","venue":"User Modeling and User-Adapted Interaction","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[El Maarry et al., 2014] Kinda El Maarry, Wolf-Tilo Balke, Hyunsouk Cho, Seung-won Hwang, and Yukino Ba- ba. Skill ontology-based model for quality assurance in crowdsourcing. In DASFAA, pages 376-387, 2014.","title":"Skill ontology-based model for quality assurance in crowdsourcing","authors":"El Maarry","year":"2014","venue":"DASFAA","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Fan et al., 2015] Ju Fan, Guoliang Li, Beng Chin Ooi, Kian- lee Tan, and Jianhua Feng. icrowd: An adaptive crowd- sourcing framework. In SIGMOD, pages 1015-1030, 2015.","title":"icrowd: An adaptive crowdsourcing framework","authors":"Ju Fan, Guoliang Li, Beng, Chin Ooi, Kianlee Tan, Jianhua Feng","year":"2015","venue":"SIGMOD","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Goel, Nikzad, and Singla, 2014] Gagan Goel, Afshin Nikzad, and Adish Singla. Allocating tasks to workers with matching constraints: truthful mechanisms for crowdsourcing markets. In WWW, pages 279-280, 2014.","title":"Allocating tasks to workers with matching constraints: truthful mechanisms for crowdsourcing markets","authors":"Gagan Goel, Afshin Nikzad, Adish Singla","year":"2014","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Haas et al., 2015] Daniel Haas, Jason Ansel, Lydia Gu, and Adam Marcus. Argonaut: macrotask crowdsourcing for complex data processing. Proceedings of the VLDB En- dowment 8(12):1642-1653, 2015.","title":"Argonaut: macrotask crowdsourcing for complex data processing","authors":"Daniel Haas, Jason Ansel, Lydia Gu, Adam Marcus","year":"2015","venue":"Proceedings of the VLDB Endowment","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Ho and Vaughan, 2012] Chien-Ju Ho and Jennifer Wortman Vaughan. Online task assignment in crowdsourcing mar- kets. In AAAI, pages 45-51, 2012.","title":"Online task assignment in crowdsourcing markets","authors":"Chien-Ju Ho, Jennifer Wortman Vaughan","year":"2012","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Ho et al., 2013] Chien-Ju Ho, Shahin Jabbari, and Jennifer Wortman Vaughan. Adaptive task assignment for crowd- sourced classification. In ICML, pages 534-542, 2013.","title":"Adaptive task assignment for crowdsourced classification","authors":"Chien-Ju Ho, Shahin Jabbari, Jennifer Wortman Vaughan","year":"2013","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Ipeirotis, 2010] Panagiotis G Ipeirotis. Analyzing the ama- zon mechanical turk marketplace. XRDS: Crossroads, The ACM Magazine for Students, 17(2):16-21, 2010.","title":"Analyzing the amazon mechanical turk marketplace","authors":"G Panagiotis, Ipeirotis","year":"2010","venue":"The ACM Magazine for Students","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Kobren et al., 2015] Ari Kobren, Chun How Tan, Panagiotis Ipeirotis, and Evgeniy Gabrilovich. Getting more for less: Optimized crowdsourcing with dynamic tasks and goals. In WWW, pages 592-602, 2015.","title":"Getting more for less: Optimized crowdsourcing with dynamic tasks and goals","authors":"Kobren","year":"2015","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Liu et al., 2018] Liyuan Liu, Jingbo Shang, Xiang Ren, Frank Fangzheng Xu, Huan Gui, Jian Peng, Jiawei Han Empower sequence labeling with task-aware neural lan- guage model. In AAAI, pages 5253-5260, 2018.","title":"Empower sequence labeling with task-aware neural language model","authors":"Liyuan Liu, Jingbo Shang, Xiang Ren, Frank Fangzheng Xu, Huan Gui, Jian Peng, Jiawei Han","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Lykourentzou and Schmitz, 2015] Ioanna Lykourentzou, and Heinz Schmitz. An online approach to task as- signment and sequencing in expert crowdsourcing. In HCOMP, pages 1-2, 2015.","title":"An online approach to task assignment and sequencing in expert crowdsourcing","authors":"Schmitz ; Ioanna Lykourentzou, Heinz Lykourentzou, Schmitz","year":"2015","venue":"HCOMP","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Magazine and Chern, 1984] Michael J Magazine and Maw- Sheng Chern. A note on approximation schemes for mul- tidimensional knapsack problems. Mathematics of Opera- tions Research, 9(2):244-247, 1984.","title":"A note on approximation schemes for multidimensional knapsack problems","authors":"J Michael, Maw-Sheng Magazine, Chern","year":"1984","venue":"Mathematics of Operations Research","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Mavridis et al., 2016] Panagiotis Mavridis, David Gross- Amblard, and Zoltán Miklós. Using hierarchical skills for optimized task assignment in knowledge-intensive crowd- sourcing. In WWW, 843-853, 2016.","title":"Using hierarchical skills for optimized task assignment in knowledge-intensive crowdsourcing","authors":"Panagiotis Mavridis, David Gross-Amblard, Zoltán Miklós","year":"2016","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Qiu et al., 2016] Chenxi Qiu, Anna Cinzia Squicciarini, Barbara Carminati, James Caverlee, and Dev Rishi Khare. Crowdselect: Increasing accuracy of crowdsourcing tasks through behavior prediction and user selection. In CIKM, 539-548, 2016.","title":"Crowdselect: Increasing accuracy of crowdsourcing tasks through behavior prediction and user selection","authors":"Chenxi Qiu, Anna Cinzia Squicciarini, Barbara Carminati, James Caverlee, Dev Rishi, Khare","year":"2016","venue":"CIKM","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Rasch, 1993] Georg Rasch. Probabilistic models for some intelligence and attainment tests. ERIC, 1993.","title":"Probabilistic models for some intelligence and attainment tests","authors":"Georg Rasch, Rasch","year":"1993","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Roy et al., 2015] Senjuti Basu Roy, Ioanna Lykourentzou, Saravanan Thirumuruganathan, Sihem Amer-Yahia, and Gautam Das. Task assignment optimization in knowledge- intensive crowdsourcing. The VLDB Journal, 24(4):467- 491, 2015.","title":"Senjuti Basu Roy, Ioanna Lykourentzou, Saravanan Thirumuruganathan, Sihem Amer","authors":"Roy","year":"2015","venue":"The VLDB Journal","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Salek et al., 2013] Mahyar Salek, Yoram Bachrach, and Pe- ter Key. Hotspotting-a probabilistic graphical model for image object localization through crowdsourcing. In AAAI, pages 1156-1162, 2013.","title":"Hotspotting-a probabilistic graphical model for image object localization through crowdsourcing","authors":"Mahyar Salek, Yoram Bachrach, Peter Key","year":"2013","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Tang, 2019] Feilong Tang. Bidirectional Active Learning with Gold-Instance-Based Human Training. In IJCAL, pages 5989-5996, 2019.","title":"Bidirectional Active Learning with Gold-Instance-Based Human Training","authors":"Feilong Tang","year":"2019","venue":"IJCAL","doi":null,"url":null,"internal_url":"/proceedings/2019/830"},{"position":26,"raw":"[Tang et al., 2019] Feilong Tang, Heteng Zhang, and Lau- rence T. Yang. Multipath cooperative routing with efficient acknowledgement for LEO satellite networks. IEEE Transactions on Mobile Computing, 18(1): 179-192, 2019.","title":"Multipath cooperative routing with efficient acknowledgement for LEO satellite networks","authors":"Feilong Tang, Heteng Zhang, Laurence T Yang","year":"2019","venue":"IEEE Transactions on Mobile Computing","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Xu et al., 2018] Tong Xu, Hengshu Zhu, Chen Zhu, Pan Li, and Hui Xiong. Measuring the popularity of job skills in recruitment market: A multi-criteria approach. In AAAI, pages 2572-2579, 2018.","title":"Measuring the popularity of job skills in recruitment market: A multi-criteria approach","authors":"Tong Xu, Hengshu Zhu, Chen Zhu, Pan Li, Hui Xiong","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Yuen, King, and Leung, 2011] Man-Ching Yuen, Irwin K- ing, and Kwong-Sak Leung. Task matching in crowd- sourcing. In iThings/CPSCom 2011, pages 409-412, 2011.","title":"Task matching in crowdsourcing","authors":"King Yuen, Man-Ching Leung, Irwin Yuen, Kwong-Sak King, Leung","year":"2011","venue":"iThings/CPSCom 2011","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Zheng et al., 2015] Yudian Zheng, JiannanWang, Guoliang Li, Reynold Cheng, and Jianhua Feng. Qasca: a quality- aware task assignment system for crowdsourcing applica- tions. In SIGMOD, pages 1031-1046, 2015.","title":"Qasca: a qualityaware task assignment system for crowdsourcing applications","authors":"Zheng","year":"2015","venue":"SIGMOD","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}