{"type":"ScholarlyArticle","title":"Dynamically Forming a Group of Human Forecasters and Machine Forecaster for Forecasting Economic Indicators","authors":[{"name":"Takahiro Miyoshi","slug":"takahiro-miyoshi","given":"Takahiro","family":"Miyoshi","affiliation":"Kyoto University"},{"name":"Shigeo Matsubara","slug":"shigeo-matsubara","given":"Shigeo","family":"Matsubara","affiliation":"Kyoto University"}],"abstract":"How can human forecasts and a machine forecast be combined in inflation forecast tasks? A machine-learning-based forecaster makes a forecast based on a statistical model constructed from past time-series data, while humans take varied information such as economic policies into account. Combination methods for different forecasts have been studied such as ensemble and consensus methods. These methods, however, always use the same manner of combination regardless of the situation (input), which makes it difficult to use the advantages of different types of forecasters. To overcome this drawback, we propose an ensemble method for estimating the expected error of a machine forecast and dynamically determining the optimal number of humans included in the ensemble. We evaluated the proposed method by using the seven datasets on U.S. inflation and confirmed that it attained the highest forecast accuracy for four datasets and the same accuracy as the highest one of traditional methods for two datasets.","doi":"10.24963/ijcai.2018/64","url":"https://ijcai.org/proceedings/2018/64","pdf":"https://ijcai.org/proceedings/2018/0064.pdf","markdown":"https://ijcai.org/proceedings/2018/64.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/64","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Agent-based and Multi-agent Systems","track":"Main track","number":64,"pages":{"first":461,"last":467},"keywords":["Agent-based and Multi-agent Systems: Coordination and Cooperation","Humans and AI: Human-AI Collaboration"],"videos":[],"references":[{"position":1,"raw":"[Ang et al., 2007] Andrew Ang, Geert Bekaert, and Min Wei. Do macro variables, asset markets or surveys fore- cast inflation better? Journal of Monetary Economics, 54(4):1163-1212, 2007.","title":"Do macro variables, asset markets or surveys forecast inflation better","authors":"Andrew Ang, Geert Bekaert, Min Wei","year":"2007","venue":"Journal of Monetary Economics","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Armstrong, 2001] J. Scott Armstrong. Combining forecasts. In Principles of Forecasting: A Handbook for Researchers and Practitioners, pages 417-439. Springer US, 2001.","title":"Combining forecasts","authors":"J, Scott Armstrong","year":"2001","venue":"Principles of Forecasting: A Handbook for Researchers and Practitioners","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Berea and Twardy, 2013] Anamaria Berea and Charles Twardy. Automated trading in prediction markets. In","title":"Automated trading in prediction markets","authors":"Twardy Berea, Anamaria Berea, Charles Twardy","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"Ariel M. Greenberg, William G. Kennedy, and Nathan D. Bos, editors, Social Computing, Behavioral-Cultural Modeling and Prediction, pages 111-122, Berlin, Heidelberg, 2013. Springer Berlin Heidelberg.","title":"Social Computing, Behavioral-Cultural Modeling and Prediction","authors":null,"year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Brandt et al., 2013] Felix Brandt, Vincent Conitzer, and Ulle Endriss. Computational social choice. In Gerhard Weiss, editor, Multiagent Systems, chapter 6, pages 213- 283. The MIT Press, 2013.","title":"Computational social choice","authors":"Felix Brandt, Vincent Conitzer, Ulle Endriss","year":"2013","venue":"Multiagent Systems","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dietterich, 2000] Thomas G. Dietterich. Ensemble Methods in Machine Learning, pages 1-15. Springer Berlin Heidel- berg, Berlin, Heidelberg, 2000.","title":"Ensemble Methods in Machine Learning","authors":"G Thomas, Dietterich","year":"2000","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Graves, 2012] Alex Graves. Long short-term memory. In Supervised Sequence Labelling with Recurrent Neural Networks, chapter 4, pages 37-45. Springer, 2012.","title":"Long short-term memory","authors":"Alex Graves","year":"2012","venue":"Supervised Sequence Labelling with Recurrent Neural Networks","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Guo et al., 2017] Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q. Weinberger. On calibration of modern neural networks. In Proceedings of the 34th International Con- ference on Machine Learning, pages 1321-1330, Sydney, Australia, 06-11 Aug 2017.","title":"On calibration of modern neural networks","authors":"Chuan Guo, Geoff Pleiss, Yu Sun, Kilian Q Weinberger","year":"2017","venue":"Proceedings of the 34th International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Krogh and Vedelsby, 1994] Anders Krogh and Jesper Vedelsby. Neural network ensembles, cross validation and active learning. In Proceedings of the 7th International Conference on Neural Information Processing Systems, NIPS'94, pages 231-238. MIT Press, 1994.","title":"Neural network ensembles, cross validation and active learning","authors":"Vedelsby Krogh, Anders Krogh, Jesper Vedelsby","year":"1994","venue":"Proceedings of the 7th International Conference on Neural Information Processing Systems, NIPS'94","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Lamberson and Page, 2012] P. J. Lamberson and Scott E. Page. Optimal forecasting groups. Management Science, 58(4):805-810, apr 2012.","title":"Optimal forecasting groups","authors":"P J Lamberson, Scott E Page","year":"2012","venue":"Management Science","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Merz, 1996] Christopher J. Merz. Dynamical selection of learning algorithms. In Doug Fisher and Hans-J. Lenz, editors, Learning from Data: Artificial Intelligence and Statistics V, pages 281-290. Springer New York, New York, NY, 1996.","title":"Dynamical selection of learning algorithms","authors":"J Christopher, Merz","year":"1996","venue":"Learning from Data: Artificial Intelligence and Statistics V","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"Scott E. Page. The Defference: How The Power of Diversity Creates Better Groups, Firms, Schools, and Societies. Princeton University Press, 2007.","title":"The Defference: How The Power of Diversity Creates Better Groups, Firms, Schools, and Societies","authors":"Scott E Page","year":"2007","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Parameswaran et al., 2012] Aditya G. Parameswaran, Hec- tor Garcia-Molina, Hyunjung Park, Neoklis Polyzotis, Aditya Ramesh, and Jennifer Widom. Crowdscreen: Al- gorithms for filtering data with humans. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, SIGMOD '12, pages 361-372, New York, NY, USA, 2012. ACM.","title":"Crowdscreen: Algorithms for filtering data with humans","authors":"Aditya G Parameswaran, Hector Garcia-Molina, Hyunjung Park, Neoklis Polyzotis, Aditya Ramesh, Jennifer Widom","year":"2012","venue":"Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, SIGMOD '12","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Rothe et al., 2018] Rasmus Rothe, Radu Timofte, and Luc Van Gool. Deep expectation of real and apparent age from a single image without facial landmarks. International Journal of Computer Vision, 126(2):144-157, Apr 2018.","title":"Deep expectation of real and apparent age from a single image without facial landmarks","authors":"Radu Rasmus Rothe, Luc Timofte, Van Gool","year":"2018","venue":"International Journal of Computer Vision","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Tsymbal and Puuronen, 2000] Alexey Tsymbal and Seppo Puuronen. Bagging and boosting with dynamic integration of classifiers. In Proceedings of the 4th European Confer- ence on Principles of Data Mining and Knowledge Dis- covery, PKDD '00, pages 116-125, London, UK, 2000. Springer-Verlag.","title":"Bagging and boosting with dynamic integration of classifiers","authors":"Alexey Tsymbal, Seppo Puuronen","year":"2000","venue":"Proceedings of the 4th European Conference on Principles of Data Mining and Knowledge Discovery, PKDD '00","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Ueda and Nakano, 1996] Naonori Ueda and Ryohei Nakano. Generalization error of ensemble estimators. In Neural Networks, 1996., IEEE International Conference on, volume 1, pages 90-95 vol.1, 1996.","title":"Generalization error of ensemble estimators","authors":"Nakano Ueda, Naonori Ueda, Ryohei Nakano","year":"1996","venue":"IEEE International Conference on","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Zhou, 2012] Zhi-Hua Zhou. Combination method. In En- semble Methods: Foundations and Algorithms, chapter 4, pages 67-98. CRC Press, 2012.","title":"Combination method","authors":"Zhi-Hua Zhou","year":"2012","venue":"Ensemble Methods: Foundations and Algorithms","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}