{"type":"ScholarlyArticle","title":"HireVAE: An Online and Adaptive Factor Model Based on Hierarchical and Regime-Switch VAE","authors":[{"name":"Zikai Wei","slug":"zikai-wei","given":"Zikai","family":"Wei","affiliation":"The Chinese University of Hong Kong"},{"name":"Anyi Rao","slug":"anyi-rao","given":"Anyi","family":"Rao","affiliation":"Stanford University"},{"name":"Bo Dai","slug":"bo-dai","given":"Bo","family":"Dai","affiliation":"Shanghai AI Laboratory"},{"name":"Dahua Lin","slug":"dahua-lin","given":"Dahua","family":"Lin","affiliation":"The Chinese University of Hong Kong; Shanghai AI Laboratory"}],"abstract":"Factor model is a fundamental investment tool in quantitative investment, which can be empowered by deep learning to become more flexible and efficient in practical complicated investing situations. However, it is still an open question to build a factor model that can conduct stock prediction in an online and adaptive setting, where the model can adapt itself to match the current market regime identified based on only point-in-time market information. To tackle this problem, we propose the first deep learning based online and adaptive factor model, HireVAE, at the core of which is a hierarchical latent space that embeds the underlying relationship between the market situation and stock-wise latent factors, so that HireVAE can effectively estimate useful latent factors given only historical market information and subsequently predict accurate stock returns. Across four commonly used real stock market benchmarks, the proposed HireVAE demonstrate superior performance in terms of active returns over previous methods, verifying the potential of such online and adaptive factor model.","doi":"10.24963/ijcai.2023/545","url":"https://ijcai.org/proceedings/2023/545","pdf":"https://ijcai.org/proceedings/2023/0545.pdf","markdown":"https://ijcai.org/proceedings/2023/545.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/545","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Multidisciplinary Topics and Applications","track":"Main Track","number":545,"pages":{"first":4903,"last":4911},"keywords":["Machine Learning: ML: Applications","Multidisciplinary Topics and Applications: MDA: Finance"],"videos":[],"references":[{"position":1,"raw":"[Akioyamen et al., 2020] Peter Akioyamen, Yi Zhou Tang, and Hussien Hussien. A hybrid learning approach to de- tecting regime switches in financial markets. In Proceed- ings of the First ACM International Conference on AI in Finance, pages 1-7, 2020.","title":"A hybrid learning approach to detecting regime switches in financial markets","authors":"Yi Zhou Peter Akioyamen, Hussien Tang, Hussien","year":"2020","venue":"Proceedings of the First ACM International Conference on AI in Finance","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Ang and Bekaert, 2002] Andrew Ang and Geert Bekaert. Regime switches in interest rates. Journal of Business & Economic Statistics, 20(2):163-182, 2002.","title":"Regime switches in interest rates","authors":"Andrew Ang, Geert Bekaert","year":"2002","venue":"Journal of Business & Economic Statistics","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Botte and Bao, 2021] Alex Botte and Doris Bao. A machine learning approach to regime modeling. Two Sigma, 2021.","title":"A machine learning approach to regime modeling","authors":"Alex Botte, Doris Bao","year":"2021","venue":"Two Sigma","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chung et al., 2014] Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. Empirical evalua- tion of gated recurrent neural networks on sequence mod- eling. arXiv preprint arXiv:1412.3555, 2014.","title":"Empirical evaluation of gated recurrent neural networks on sequence modeling","authors":"Chung","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chung et al., 2015] Junyoung Chung, Kyle Kastner, Lau- rent Dinh, Kratarth Goel, Aaron C Courville, and Yoshua Bengio. A recurrent latent variable model for sequential data. Advances in neural information processing systems, 28, 2015.","title":"A recurrent latent variable model for sequential data","authors":"Chung","year":"2015","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Ding et al., 2020] Qianggang Ding, Sifan Wu, Hao Sun, Ji- adong Guo, and Jian Guo. Hierarchical multi-scale gaus- sian transformer for stock movement prediction. In IJCAI, pages 4640-4646, 2020.","title":"Hierarchical multi-scale gaussian transformer for stock movement prediction","authors":"Ding","year":"2020","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2020/640"},{"position":7,"raw":"[Duan et al., 2022] Yitong Duan, Lei Wang, Qizhong Zhang, and Jian Li. Factorvae: A probabilistic dynamic fac- tor model based on variational autoencoder for predicting cross-sectional stock returns. In 36th AAAI Conference on Artificial Intelligence, 2022.","title":"Factorvae: A probabilistic dynamic factor model based on variational autoencoder for predicting cross-sectional stock returns","authors":"Yitong Duan, Lei Wang, Qizhong Zhang, Jian Li","year":"2022","venue":"36th AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Fama and French, 1992] Eugene F Fama and Kenneth R French. The cross-section of expected stock returns. the Journal of Finance, 47(2):427-465, 1992.","title":"The cross-section of expected stock returns","authors":"F Eugene, Kenneth R Fama, French","year":"1992","venue":"the Journal of Finance","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Fama and French, 2020] Eugene F Fama and Kenneth R French. Comparing cross-section and time-series factor models. The Review of Financial Studies, 33(5):1891- 1926, 2020.","title":"Comparing cross-section and time-series factor models","authors":"F Eugene, Kenneth R Fama, French","year":"2020","venue":"The Review of Financial Studies","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Gu et al., 2021] Shihao Gu, Bryan Kelly, and Dacheng Xiu. Autoencoder asset pricing models. Journal of Economet- rics, 222(1):429-450, 2021.","title":"Autoencoder asset pricing models","authors":"Shihao Gu, Bryan Kelly, Dacheng Xiu","year":"2021","venue":"Journal of Econometrics","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Guidolin and Timmermann, 2007] Massimo Guidolin and Allan Timmermann. Asset allocation under multivariate regime switching. Journal of Economic Dynamics and Control, 31(11):3503-3544, 2007.","title":"Asset allocation under multivariate regime switching","authors":"Timmermann Guidolin, Massimo Guidolin, Allan Timmermann","year":"2007","venue":"Journal of Economic Dynamics and Control","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hamilton, 1989] James D Hamilton. A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica: Journal of the econometric society, pages 357-384, 1989.","title":"A new approach to the economic analysis of nonstationary time series and the business cycle","authors":"James D Hamilton","year":"1989","venue":"Econometrica: Journal of the econometric society","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Hou et al., 2019] Ruibing Hou, Hong Chang, Bingpeng Ma, Shiguang Shan, and Xilin Chen. Cross attention network for few-shot classification. Advances in Neural Informa- tion Processing Systems, 32, 2019.","title":"Cross attention network for few-shot classification","authors":"Hou","year":"2019","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Kingma and Welling, 2013] Diederik P Kingma and Max Welling. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013.","title":"Auto-encoding variational bayes","authors":"P Diederik, Max Kingma, Welling","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Levin, 1995] Asriel Levin. Stock selection via nonlinear multi-factor models. Advances in Neural Information Pro- cessing Systems, 8, 1995.","title":"Stock selection via nonlinear multi-factor models","authors":"Levin ;, Asriel Levin","year":"1995","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Li et al., 2021] Wei Li, Ruihan Bao, Keiko Harimoto, Deli Chen, Jingjing Xu, and Qi Su. Modeling the stock relation with graph network for overnight stock movement predic- tion. In IJCAI, pages 4541-4547, 2021.","title":"Modeling the stock relation with graph network for overnight stock movement prediction","authors":"Wei Li, Ruihan Bao, Keiko Harimoto, Deli Chen, Jingjing Xu, Qi Su","year":"2021","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2020/626"},{"position":17,"raw":"[Lin et al., 2021] Hengxu Lin, Dong Zhou, Weiqing Liu, and Jiang Bian. Deep risk model: a deep learning solution for mining latent risk factors to improve covariance matrix es- timation. In Proceedings of the Second ACM International Conference on AI in Finance, pages 1-8, 2021.","title":"Deep risk model: a deep learning solution for mining latent risk factors to improve covariance matrix estimation","authors":"Hengxu Lin, Dong Zhou, Weiqing Liu, Jiang Bian","year":"2021","venue":"Proceedings of the Second ACM International Conference on AI in Finance","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Luo et al., 2018] Rui Luo, Weinan Zhang, Xiaojun Xu, and Jun Wang. A neural stochastic volatility model. In Pro- ceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018.","title":"A neural stochastic volatility model","authors":"Rui Luo, Weinan Zhang, Xiaojun Xu, Jun Wang","year":"2018","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Mari and Mari, 2022] Carlo Mari and Emiliano Mari. Deep learning based regime-switching models of energy com- modity prices. Energy Systems, pages 1-22, 2022.","title":"Deep learning based regime-switching models of energy commodity prices","authors":"Mari, Mari ;, Carlo Mari, Emiliano Mari","year":"2022","venue":"Energy Systems","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Ng et al., 1992] Victor Ng, Robert F Engle, and Michael Rothschild. A multi-dynamic-factor model for stock re- turns. Journal of Econometrics, 52(1-2):245-266, 1992.","title":"A multi-dynamic-factor model for stock returns","authors":"Victor Ng, Robert F Engle, Michael Rothschild","year":"1992","venue":"Journal of Econometrics","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Su et al., 2018] Jinsong Su, Shan Wu, Deyi Xiong, Yaojie Lu, Xianpei Han, and Biao Zhang. Variational recurrent neural machine translation. In Proceedings of the AAAI conference on artificial intelligence, volume 32, 2018.","title":"Variational recurrent neural machine translation","authors":"Jinsong Su, Shan Wu, Deyi Xiong, Yaojie Lu, Xianpei Han, Biao Zhang","year":"2018","venue":"Proceedings of the AAAI conference on artificial intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Uysal and Mulvey, 2021] A Sinem Uysal and John M Mul- vey. A machine learning approach in regime-switching risk parity portfolios. The Journal of Financial Data Sci- ence, 3(2):87-108, 2021.","title":"A machine learning approach in regime-switching risk parity portfolios","authors":"Mulvey ; A Sinem Uysal, John M Uysal, Mulvey","year":"2021","venue":"The Journal of Financial Data Science","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Vahdat and Kautz, 2020] Arash Vahdat and Jan Kautz. Nvae: A deep hierarchical variational autoencoder. Advances in Neural Information Processing Systems, 33:19667-19679, 2020.","title":"Nvae: A deep hierarchical variational autoencoder","authors":"Kautz Vahdat, Arash Vahdat, Jan Kautz","year":"2020","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Veličković et al., 2018] Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. Graph attention networks. In Interna- tional Conference on Learning Representations, 2018.","title":"Graph attention networks","authors":"Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, Yoshua Bengio","year":"2018","venue":"International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Wang et al., 2020] Matthew Wang, Yi-Hong Lin, and Ilya Mikhelson. Regime-switching factor investing with hid- den markov models. Journal of Risk and Financial Man- agement, 13(12), 2020.","title":"Regime-switching factor investing with hidden markov models","authors":"Matthew Wang, Yi-Hong Lin, Ilya Mikhelson","year":"2020","venue":"Journal of Risk and Financial Management","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Wang et al., 2021a] Heyuan Wang, Shun Li, Tengjiao Wang, and Jiayi Zheng. Hierarchical adaptive temporal- relational modeling for stock trend prediction. In IJCAI, pages 3691-3698, 2021.","title":"Hierarchical adaptive temporalrelational modeling for stock trend prediction","authors":"Wang","year":"2021","venue":"IJCAI","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Wang et al., 2021b] Heyuan Wang, Tengjiao Wang, Shun Li, Shijie Guan, Jiayi Zheng, and Wei Chen. Heteroge- neous interactive snapshot network for review-enhanced stock profiling and recommendation. In IJCAI, pages 4541-4547, 2021.","title":"Heterogeneous interactive snapshot network for review-enhanced stock profiling and recommendation","authors":"Wang","year":"2021","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2022/550"},{"position":28,"raw":"[Wang et al., 2022] Heyuan Wang, Tengjiao Wang, Shun Li, Jiayi Zheng, Shijie Guan, and Wei Chen. Adaptive long- short pattern transformer for stock investment selection. In IJCAI, pages 3970-3977, 2022.","title":"Adaptive longshort pattern transformer for stock investment selection","authors":"Heyuan Wang, Tengjiao Wang, Shun Li, Jiayi Zheng, Shijie Guan, Wei Chen","year":"2022","venue":"IJCAI","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Wei et al., 2022] Zikai Wei, Bo Dai, and Dahua Lin. Fac- tor investing with a deep multi-factor model. In NeurIPS Workshop on GLIndA, 2022.","title":"Factor investing with a deep multi-factor model","authors":"Wei","year":"2022","venue":"NeurIPS Workshop on GLIndA","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Xu and Cohen, 2018] Yumo Xu and Shay B Cohen. Stock movement prediction from tweets and historical prices. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1970-1979, 2018.","title":"Stock movement prediction from tweets and historical prices","authors":"Cohen ; ] Yumo Xu, Shay B Xu, Cohen","year":"2018","venue":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Zhang et al., 2017] Liheng Zhang, Charu Aggarwal, and Guo-Jun Qi. Stock price prediction via discovering multi- frequency trading patterns. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pages 2141-2149, 2017.","title":"Stock price prediction via discovering multifrequency trading patterns","authors":"Zhang","year":"2017","venue":"Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Zhu, 2022] Brian Zhu. Regime-switching factor mod- els with applications to portfolio selection and demand estimation. https://economics.yale.edu/sites/default/files/ Forms/zhu brian senior essay econ 492.pdf, 2022. On- line; accessed 10 January 2023.","title":"Regime-switching factor models with applications to portfolio selection and demand estimation","authors":"Brian Zhu","year":"2022","venue":null,"doi":null,"url":"https://economics.yale.edu/sites/default/files/Forms/zhubriansenioressayecon492.pdf","internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}