{"type":"ScholarlyArticle","title":"Multi-Group Encoder-Decoder Networks to Fuse Heterogeneous Data for Next-Day Air Quality Prediction","authors":[{"name":"Yawen Zhang","slug":"yawen-zhang","given":"Yawen","family":"Zhang","affiliation":"University of Colorado Boulder"},{"name":"Qin Lv","slug":"qin-lv","given":"Qin","family":"Lv","affiliation":"University of Colorado Boulder"},{"name":"Duanfeng Gao","slug":"duanfeng-gao","given":"Duanfeng","family":"Gao","affiliation":"University of Colorado Boulder"},{"name":"Si Shen","slug":"si-shen","given":"Si","family":"Shen","affiliation":"University of Colorado Boulder"},{"name":"Robert Dick","slug":"robert-dick","given":"Robert","family":"Dick","affiliation":"University of Michigan"},{"name":"Michael Hannigan","slug":"michael-hannigan","given":"Michael","family":"Hannigan","affiliation":"University of Colorado Boulder"},{"name":"Qi Liu","slug":"qi-liu","given":"Qi","family":"Liu","affiliation":"Unsupervised Inc."}],"abstract":"Accurate next-day air quality prediction is essential to enable warning and prevention measures for cities and individuals to cope with potential air pollution, such as vehicle restriction, factory shutdown, and limiting outdoor activities. The problem is challenging because air quality is affected by a diverse set of complex factors. There has been prior work on short-term (e.g., next 6 hours) prediction, however, there is limited research on modeling local weather influences or fusing heterogeneous data for next-day air quality prediction. This paper tackles this problem through three key contributions: (1) we leverage multi-source data, especially high-frequency grid-based weather data, to model air pollutant dynamics at station-level; (2) we add convolution operators on grid weather data to capture the impacts of various weather parameters on air pollutant variations; and (3) we automatically group (cross-domain) features based on their correlations, and propose multi-group Encoder-Decoder networks (MGED-Net) to effectively fuse multiple feature groups for next-day air quality prediction. The experiments with real-world data demonstrate the improved prediction performance of MGED-Net over state-of-the-art solutions (4.2% to 9.6% improvement in MAE and 9.2% to 16.4% improvement in RMSE).","doi":"10.24963/ijcai.2019/603","url":"https://ijcai.org/proceedings/2019/603","pdf":"https://ijcai.org/proceedings/2019/0603.pdf","markdown":"https://ijcai.org/proceedings/2019/603.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/603","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"Machine Learning M-Z","track":"Main track","number":603,"pages":{"first":4341,"last":4347},"keywords":["Machine Learning Applications: Environmental","Machine Learning: Deep Learning","Machine Learning: Time-series;Data Streams"],"videos":[],"references":[{"position":1,"raw":"[Alam et al., 2017] Furqan Alam, Rashid Mehmood, Iyad Katib, Nasser N Albogami, and Aiiad Albeshri. Data fusion and iot for smart ubiquitous environments: A survey. IEEE Access, 5:9533-9554, 2017.","title":"Data fusion and iot for smart ubiquitous environments: A survey","authors":"Furqan Alam, Rashid Mehmood, Iyad Katib, Aiiad Nasser N Albogami, Albeshri","year":"2017","venue":"IEEE Access","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cho et al., 2014] Kyunghyun Cho, Bart Van Merriënboer, Dzmitry Bahdanau, and Yoshua Bengio. On the properties of neural machine translation: Encoder-decoder approaches. arXiv preprint arXiv:1409.1259, 2014.","title":"On the properties of neural machine translation: Encoder-decoder approaches","authors":"Cho","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Guo et al., 2014] Song Guo, Min Hu, Misti L. Zamora, Ji- anfei Peng, Dongjie Shang, Jing Zheng, Zhuofei Du, Zhijun Wu, Min Shao, Limin Zeng, Mario J. Molina, and Renyi Zhang. Elucidating severe urban haze formation in china. Proceedings of the National Academy of Sciences, 111(49):17373-17378, 2014.","title":"Elucidating severe urban haze formation in china","authors":"Song Guo, Min Hu, Misti L Zamora, Jianfei Peng, Dongjie Shang, Jing Zheng, Zhuofei Du, Zhijun Wu, Min Shao, Limin Zeng, Mario J Molina, Renyi Zhang","year":"2014","venue":"Proceedings of the National Academy of Sciences","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Li et al., 2017] Xiang Li, Ling Peng, Xiaojing Yao, Shao- long Cui, Yuan Hu, Chengzeng You, and Tianhe Chi. Long short-term memory neural network for air pollutant concen- tration predictions: Method development and evaluation. Environmental Pollution, 231:997 -1004, 2017.","title":"Long short-term memory neural network for air pollutant concentration predictions: Method development and evaluation","authors":"Xiang Li, Ling Peng, Xiaojing Yao, Shaolong Cui, Yuan Hu, Chengzeng You, Tianhe Chi","year":"2017","venue":"Environmental Pollution","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Liang et al., 2018] Yuxuan Liang, Songyu Ke, Junbo Zhang, Xiuwen Yi, and Yu Zheng. Geoman: Multi-level attention networks for geo-sensory time series prediction. In Inter- national Joint Conference on Artificial Intelligence, pages 3428-3434, 2018.","title":"Geoman: Multi-level attention networks for geo-sensory time series prediction","authors":"Yuxuan Liang, Songyu Ke, Junbo Zhang, Xiuwen Yi, Yu Zheng","year":"2018","venue":"International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2018/476"},{"position":6,"raw":"[Lin et al., 2017] Yijun Lin, Yao-Yi Chiang, Fan Pan, Di- mitrios Stripelis, Jose Luis Ambite, Sandrah P. Eckel, and Rima Habre. Mining public datasets for modeling intra- city pm2.5 concentrations at a fine spatial resolution. In Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Sys- tems, SIGSPATIAL '17, pages 25:1-25:10, New York, NY, USA, 2017. ACM.","title":"Mining public datasets for modeling intracity pm2.5 concentrations at a fine spatial resolution","authors":"Yijun Lin, Yao-Yi Chiang, Fan Pan, Dimitrios Stripelis, Jose Luis Ambite, P Sandrah, Rima Eckel, Habre","year":"2017","venue":"Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, SIGSPATIAL '17","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Liu et al., 2018] Zhun Liu, Ying Shen, Varun Bharadhwaj Lakshminarasimhan, Paul Pu Liang, AmirAli Bagher Za- deh, and Louis-Philippe Morency. Efficient low-rank mul- timodal fusion with modality-specific factors. In Proceed- ings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2247-2256. Association for Computational Linguistics, 2018.","title":"Efficient low-rank multimodal fusion with modality-specific factors","authors":"Zhun Liu, Ying Shen, Varun Bharadhwaj Lakshminarasimhan, Paul Pu Liang, Amirali Bagher Zadeh, Louis-Philippe Morency","year":"2018","venue":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Long et al., 2018] Xiang Long, Chuang Gan, Gerard Melo, Xiao Liu, Yandong Li, Fu Li, and Shilei Wen. Multimodal keyless attention fusion for video classification. In The Thirty-Second AAAI Conference on Artificial Intelligence, 2018.","title":"Multimodal keyless attention fusion for video classification","authors":"Xiang Long, Chuang Gan, Gerard Melo, Xiao Liu, Yandong Li, Fu Li, Shilei Wen","year":"2018","venue":"The Thirty-Second AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Ngiam et al., 2011] Jiquan Ngiam, Aditya Khosla, Mingyu Kim, Juhan Nam, Honglak Lee, and Andrew Y. Ng. Mul- timodal deep learning. In Proceedings of the 28th Interna- tional Conference on International Conference on Machine Learning, ICML'11, pages 689-696, USA, 2011. Omni- press.","title":"Multimodal deep learning","authors":"Ngiam","year":"2011","venue":"Proceedings of the 28th International Conference on International Conference on Machine Learning, ICML'11","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Nojavanasghari et al., 2016] Behnaz Nojavanasghari, Deepak Gopinath, Jayanth Koushik, Tadas Baltrušaitis, and Louis-Philippe Morency. Deep multimodal fusion for persuasiveness prediction. In Proceedings of the 18th ACM International Conference on Multimodal Interaction, pages 284-288. ACM, 2016.","title":"Deep multimodal fusion for persuasiveness prediction","authors":"Behnaz Nojavanasghari, Deepak Gopinath, Jayanth Koushik, Tadas Baltrušaitis, Louis-Philippe Morency","year":"2016","venue":"Proceedings of the 18th ACM International Conference on Multimodal Interaction","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Ren et al., 2016] Jimmy Ren, Yongtao Hu, Yu-Wing Tai, Chuan Wang, Li Xu, Wenxiu Sun, and Qiong Yan. Look, listen and learn?a multimodal lstm for speaker identifica- tion. In The Thirtieth AAAI Conference on Artificial Intelli- gence, 2016.","title":"Look, listen and learn?a multimodal lstm for speaker identification","authors":"Jimmy Ren, Yongtao Hu, Yu-Wing Tai, Chuan Wang, Li Xu, Wenxiu Sun, Qiong Yan","year":"2016","venue":"The Thirtieth AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Shi et al., 2018] Xiaoqin Shi, Chuanfeng Zhao, Jonathan H. Jiang, Chunying Wang, Xin Yang, and Yuk L. Yung. Spatial representativeness of pm2.5 concentrations obtained using observations from network stations. Journal of Geophysical Research: Atmospheres, 123(6):3145-3158, 2018.","title":"Spatial representativeness of pm2.5 concentrations obtained using observations from network stations","authors":"Xiaoqin Shi, Chuanfeng Zhao, Jonathan H Jiang, Chunying Wang, Xin Yang, Yuk L Yung","year":"2018","venue":"Journal of Geophysical Research: Atmospheres","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Sutskever et al., 2014] Ilya Sutskever, Oriol Vinyals, and Quoc V Le. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems, pages 3104-3112, 2014.","title":"Quoc V Le. Sequence to sequence learning with neural networks","authors":"Sutskever","year":"2014","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Wu et al., 2004] Yi Wu, Edward Y. Chang, Kevin Chen- Chuan Chang, and John R. Smith. Optimal multimodal fusion for multimedia data analysis. In Proceedings of the 12th Annual ACM International Conference on Multimedia, MULTIMEDIA '04, pages 572-579, New York, NY, USA, 2004. ACM.","title":"Optimal multimodal fusion for multimedia data analysis","authors":"Yi Wu, Edward Y Chang, Kevin Chen-Chuan, Chang, John R Smith","year":"2004","venue":"Proceedings of the 12th Annual ACM International Conference on Multimedia, MULTIMEDIA '04","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Yi et al., 2018] Xiuwen Yi, Junbo Zhang, Zhaoyuan Wang, Tianrui Li, and Yu Zheng. Deep distributed fusion network for air quality prediction. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discov- ery, KDD '18, pages 965-973, New York, NY, USA, 2018. ACM.","title":"Deep distributed fusion network for air quality prediction","authors":"Xiuwen Yi, Junbo Zhang, Zhaoyuan Wang, Tianrui Li, Yu Zheng","year":"2018","venue":"Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery, KDD '18","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Yuan et al., 2018] Zhuoning Yuan, Xun Zhou, and Tianbao Yang. Hetero-convlstm: A deep learning approach to traffic accident prediction on heterogeneous spatio-temporal data. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 984-992. ACM, 2018.","title":"Hetero-convlstm: A deep learning approach to traffic accident prediction on heterogeneous spatio-temporal data","authors":"Yuan","year":"2018","venue":"Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Zadeh et al., 2017] Amir Zadeh, Minghai Chen, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency. Tensor fusion network for multimodal sentiment analysis. arXiv preprint arXiv:1707.07250, 2017.","title":"Tensor fusion network for multimodal sentiment analysis","authors":"Amir Zadeh, Minghai Chen, Soujanya Poria, Erik Cambria, Louis-Philippe Morency","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Zheng et al., 2015] Yu Zheng, Xiuwen Yi, Ming Li, Ruiyuan Li, Zhangqing Shan, Eric Chang, and Tianrui Li. Forecast- ing fine-grained air quality based on big data. In Proceed- ings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '15, pages 2267-2276, New York, NY, USA, 2015. ACM.","title":"Forecasting fine-grained air quality based on big data","authors":"Yu Zheng, Xiuwen Yi, Ming Li, Ruiyuan Li, Zhangqing Shan, Eric Chang, Tianrui Li","year":"2015","venue":"Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '15","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Zheng, 2015] Yu Zheng. Methodologies for cross-domain data fusion: An overview. IEEE Transactions on Big Data, 1(1):16-34, 2015.","title":"Methodologies for cross-domain data fusion: An overview","authors":"Yu Zheng","year":"2015","venue":"IEEE Transactions on Big Data","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}