{"type":"ScholarlyArticle","title":"Empowering Time Series Analysis with Large Language Models: A Survey","authors":[{"name":"Yushan Jiang","slug":"yushan-jiang","given":"Yushan","family":"Jiang","affiliation":"School of Computing , University of Connecticut , USA"},{"name":"Zijie Pan","slug":"zijie-pan","given":"Zijie","family":"Pan","affiliation":"School of Computing , University of Connecticut , USA"},{"name":"Xikun Zhang","slug":"xikun-zhang","given":"Xikun","family":"Zhang","affiliation":"School of Computer Science , The University of Sydney , Australia"},{"name":"Sahil Garg","slug":"sahil-garg","given":"Sahil","family":"Garg","affiliation":"Department of Machine Learning Research , Morgan Stanley , USA"},{"name":"Anderson Schneider","slug":"anderson-schneider","given":"Anderson","family":"Schneider","affiliation":"Department of Machine Learning Research , Morgan Stanley , USA"},{"name":"Yuriy Nevmyvaka","slug":"yuriy-nevmyvaka","given":"Yuriy","family":"Nevmyvaka","affiliation":"Department of Machine Learning Research , Morgan Stanley , USA"},{"name":"Dongjin Song","slug":"dongjin-song","given":"Dongjin","family":"Song","affiliation":"School of Computing , University of Connecticut , USA"}],"abstract":"Recently, remarkable progress has been made over large language models (LLMs), demonstrating their unprecedented capability in varieties of natural language tasks. However, completely training a large general-purpose model from the scratch is challenging for time series analysis, due to the large volumes and varieties of time series data, as well as the non-stationarity that leads to concept drift impeding continuous model adaptation and re-training. Recent advances have shown that pre-trained LLMs can be exploited to capture complex dependencies in time series data and facilitate various applications. In this survey, we provide a systematic overview of existing methods that leverage LLMs for time series analysis. Specifically, we first state the challenges and motivations of applying language models in the context of time series as well as brief preliminaries of LLMs. Next, we summarize the general pipeline for LLM-based time series analysis, categorize existing methods into different groups (\\textit{i.e.}, direct query, tokenization, prompt design, fine-tune, and model integration), and highlight the key ideas within each group. We also discuss the applications of LLMs for both general and spatial-temporal time series data, tailored to specific domains. Finally, we thoroughly discuss future research opportunities to empower time series analysis with LLMs.","doi":"10.24963/ijcai.2024/895","url":"https://ijcai.org/proceedings/2024/895","pdf":"https://ijcai.org/proceedings/2024/0895.pdf","markdown":"https://ijcai.org/proceedings/2024/895.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/895","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Survey Track","track":"Survey Track","number":895,"pages":{"first":8095,"last":8103},"keywords":["Machine Learning: ML: Time series and data streams","Data Mining: DM: Mining spatial and/or temporal data"],"videos":[],"references":[{"position":1,"raw":"[Achiam and et al., 2023] OpenAI Josh Achiam and Steven Adler et al. GPT-4 Technical Report. 2023.","title":"OpenAI Josh Achiam and Steven Adler et al","authors":"Achiam","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Ansari et al., 2024] Abdul Fatir Ansari, Lorenzo Stella, Caner Turkmen, Xiyuan Zhang, Pedro Mercado, et al. Chronos: Learn- ing the language of time series. arXiv:2403.07815, 2024.","title":"Chronos: Learning the language of time series","authors":"Abdul Fatir, Ansari, Lorenzo Stella, Caner Turkmen, Xiyuan Zhang, Pedro Mercado","year":"2024","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Arisoy et al., 2012] Ebru Arisoy, Tara N Sainath, Brian Kingsbury, and Bhuvana Ramabhadran. Deep Neural Network Language Models. In NAACL-HLT 2012 Workshop, 2012.","title":"Deep Neural Network Language Models","authors":"Ebru Arisoy, Tara N Sainath, Brian Kingsbury, Bhuvana Ramabhadran","year":"2012","venue":"NAACL-HLT 2012 Workshop","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bian et al., 2024] Yuxuan Bian, Xuan Ju, Jiangtong Li, Zhi- jian Xu, Dawei Cheng, and Qiang Xu. Multi-Patch Predic- tion: Adapting LLMs for Time Series Representation Learning. arXiv:2402.04852, 2024.","title":"Multi-Patch Prediction: Adapting LLMs for Time Series Representation Learning","authors":"Yuxuan Bian, Xuan Ju, Jiangtong Li, Zhijian Xu, Dawei Cheng, Qiang Xu","year":"2024","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Brown et al., 2020] Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, et al. Lan- guage Models are Few-Shot Learners. In NeurIPS, 2020.","title":"Language Models are Few-Shot Learners","authors":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal","year":"2020","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Cao et al., 2024] Defu Cao, Furong Jia, Sercan O Arik, Tomas Pfister, Yixiang Zheng, Wen Ye, and Yan Liu. TEMPO: Prompt- based Generative Pre-trained Transformer for Time Series Fore- casting. In ICLR, 2024.","title":"TEMPO: Promptbased Generative Pre-trained Transformer for Time Series Forecasting","authors":"Defu Cao, Furong Jia, O Sercan, Tomas Arik, Yixiang Pfister, Wen Zheng, Yan Ye, Liu","year":"2024","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Chang et al., 2023] Ching Chang, Wen-Chih Peng, and Tien-Fu Chen. LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters. arXiv:2308.08469, 2023.","title":"LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters","authors":"Ching Chang, Wen-Chih Peng, Tien-Fu Chen","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Chen et al., 2023a] Yakun Chen, Xianzhi Wang, and Guan- dong Xu. GATGPT: A Pre-trained Large Language Model with Graph Attention Network for Spatiotemporal Imputation. arXiv:2311.14332, 2023.","title":"GATGPT: A Pre-trained Large Language Model with Graph Attention Network for Spatiotemporal Imputation","authors":"Chen","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Chen et al., 2023b] Zihan Chen, Lei Nico Zheng, Cheng Lu, Jialu Yuan, and Di Zhu. ChatGPT Informed Graph Neural Network for Stock Movement Prediction. KDD 2023 Workshop, 2023.","title":"ChatGPT Informed Graph Neural Network for Stock Movement Prediction","authors":"Chen","year":"2023","venue":"KDD 2023 Workshop","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Chowdhery et al., 2023] Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, et al. PaLM: Scaling Language Modeling with Pathways. JMLR, 2023.","title":"PaLM: Scaling Language Modeling with Pathways","authors":"Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra","year":"2023","venue":"JMLR","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Chung et al., 2022] Hyung Won Chung, Le Hou, Shayne Long- pre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, et al. Scaling Instruction-Finetuned Language Models. arXiv:2210.11416, 2022.","title":"Scaling Instruction-Finetuned Language Models","authors":"Chung Hyung Won, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Cleveland et al., 1990] Robert B Cleveland, William S Cleveland, Jean E McRae, and Irma Terpenning. STL: A Seasonal-Trend Decomposition Procedure Based on Loess. J. Off. Stat, 6(1):3- 73, 1990.","title":"STL: A Seasonal-Trend Decomposition Procedure Based on Loess","authors":"William S Robert B Cleveland, Jean E Cleveland, Irma Mcrae, Terpenning","year":"1990","venue":"J. Off. Stat","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Computer, 2023] Together Computer. RedPajama-Data: An Open Source Recipe to Reproduce LLaMA training dataset. 2023.","title":"Together Computer. RedPajama-Data: An Open Source Recipe to Reproduce LLaMA training dataset","authors":null,"year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Deldari et al., 2022] Shohreh Deldari, Hao Xue, Aaqib Saeed, Ji- ayuan He, Daniel V Smith, and Flora D Salim. Beyond Just Vi- sion: A Review on Self-Supervised Representation Learning on Multimodal and Temporal Data. arXiv:2206.02353, 2022.","title":"Beyond Just Vision: A Review on Self-Supervised Representation Learning on Multimodal and Temporal Data","authors":"Shohreh Deldari, Aaqib Hao Xue, Jiayuan Saeed, Daniel V He, Flora D Smith, Salim","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Devlin et al., 2018] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina N Toutanova. BERT: Pre-training of Deep Bidirec- tional Transformers for Language Understanding. In ICLR, 2018.","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","authors":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina N Toutanova","year":"2018","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Du et al., 2022] Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, et al. GLM: General Language Model Pretraining with Autoregressive Blank Infilling. In ACL, 2022.","title":"GLM: General Language Model Pretraining with Autoregressive Blank Infilling","authors":"Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang","year":"2022","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Garza and Mergenthaler-Canseco, 2023] Azul Garza and Max Mergenthaler-Canseco. TimeGPT-1. arXiv:2310.03589, 2023.","title":"Azul Garza and Max Mergenthaler-Canseco","authors":"Mergenthaler-Canseco Garza","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Geng and Liu, 2023] Xinyang Geng and Hao Liu. OpenLLaMA: An Open Reproduction of LLaMA. 2023. [Gruver et al., 2023] Nate Gruver, Marc Finzi, Shikai Qiu, and An- drew Gordon Wilson. Large Language Models Are Zero Shot Time Series Forecasters. In NeurIPS, 2023.","title":"OpenLLaMA: An Open Reproduction of LLaMA","authors":"Geng, Liu, Xinyang Geng, Hao Liu","year":"2023","venue":"Large Language Models Are Zero Shot Time Series Forecasters","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Gunjal and Durrett, 2023] Anisha Gunjal and Greg Durrett. Draft- ing Event Schemas using Language Models. arXiv:2305.14847, 2023.","title":"Drafting Event Schemas using Language Models","authors":"Anisha Gunjal, Greg Durrett","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Houlsby et al., 2019] Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. Parameter- Efficient Transfer Learning for NLP. In ICML, 2019.","title":"Parameter-Efficient Transfer Learning for NLP","authors":"Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, Sylvain Gelly","year":"2019","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Hu et al., 2021] Edward J Hu, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, et al. LoRA: Low-Rank Adaptation of Large Language Models. In ICLR, 2021.","title":"LoRA: Low-Rank Adaptation of Large Language Models","authors":"J Edward, Phillip Hu, Zeyuan Wallis, Yuanzhi Allen-Zhu, Shean Li, Lu Wang, Wang","year":"2021","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Huang et al., 2020] Kexin Huang, Jaan Altosaar, and Rajesh Ran- ganath. ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission. CHIL-2020 Workshop, 2020.","title":"ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission","authors":"Kexin Huang, Jaan Altosaar, Rajesh Ranganath","year":"2020","venue":"CHIL-2020 Workshop","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Jia et al., 2024] Furong Jia, Kevin Wang, Yixiang Zheng, Defu Cao, and Yan Liu. GPT4MTS: Prompt-based Large Language Model for Multimodal Time-series Forecasting. In AAAI, 2024.","title":"GPT4MTS: Prompt-based Large Language Model for Multimodal Time-series Forecasting","authors":"Furong Jia, Kevin Wang, Yixiang Zheng, Defu Cao, Yan Liu","year":"2024","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Jiang et al., 2023] Lavender Yao Jiang, Xujin Chris Liu, Nima Pour Nejatian, Mustafa Nasir-Moin, Duo Wang, Anas Abidin, et al. Health system-scale language models are all-purpose prediction engines. Nature, pages 1-6, 2023.","title":"Health system-scale language models are all-purpose prediction engines","authors":"Jiang","year":"2023","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Jin et al., 2023] Ming Jin, Qingsong Wen, Yuxuan Liang, Chaoli Zhang, Siqiao Xue, Xue Wang, James Zhang, Yi Wang, Haifeng Chen, Xiaoli Li, et al. Large Models for Time Series and Spatio- Temporal Data: A Survey and Outlook. arXiv:2310.10196, 2023.","title":"Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook","authors":"Ming Jin, Qingsong Wen, Yuxuan Liang, Chaoli Zhang, Siqiao Xue, Xue Wang, James Zhang, Yi Wang, Haifeng Chen, Xiaoli Li","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Jin et al., 2024] Ming Jin, Shiyu Wang, Lintao Ma, Zhixuan Chu, James Y Zhang, Xiaoming Shi, Pin-Yu Chen, et al. Time- LLM: Time Series Forecasting by Reprogramming Large Lan- guage Models. In ICLR, 2024.","title":"Time-LLM: Time Series Forecasting by Reprogramming Large Language Models","authors":"Ming Jin, Shiyu Wang, Lintao Ma, Zhixuan Chu, James Y Zhang, Xiaoming Shi, Pin-Yu Chen","year":"2024","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Kim et al., 2021] Taesung Kim, Jinhee Kim, Yunwon Tae, Cheon- bok Park, Jang-Ho Choi, and Jaegul Choo. Reversible Instance Normalization for Accurate Time-Series Forecasting against Dis- tribution Shift. In ICLR, 2021.","title":"Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift","authors":"Kim","year":"2021","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Lester et al., 2021] Brian Lester, Rami Al-Rfou, and Noah Con- stant. The Power of Scale for Parameter-Efficient Prompt Tuning. arXiv:2104.08691, 2021.","title":"The Power of Scale for Parameter-Efficient Prompt Tuning","authors":"Brian Lester, Rami Al-Rfou, Noah Constant","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Li et al., 2023] Jun Li, Che Liu, Sibo Cheng, Rossella Arcucci, and Shenda Hong. Frozen Language Model Helps ECG Zero- Shot Learning. In MIDL, 2023.","title":"Frozen Language Model Helps ECG Zero-Shot Learning","authors":"Li","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Lightman et al., 2023] Hunter Lightman, Vineet Kosaraju, Yura Burda, Harri Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. Let's Verify Step by Step. arXiv:2305.20050, 2023.","title":"Let's Verify Step by Step","authors":"Lightman","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Liu et al., 2019] Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. RoBERTa: A Robustly Op- timized BERT Pretraining Approach. 2019.","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","authors":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Liu et al., 2023a] Xin Liu, Daniel McDuff, Geza Kovacs, Isaac Galatzer-Levy, Jacob Sunshine, et al. Large Language Models are Few-Shot Health Learners. arXiv:2305.15525, 2023.","title":"Large Language Models are Few-Shot Health Learners","authors":"Liu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Liu et al., 2023b] Xu Liu, Junfeng Hu, Yuan Li, Shizhe Diao, Yux- uan Liang, Bryan Hooi, and Roger Zimmermann. UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting. arXiv:2310.09751, 2023.","title":"UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting","authors":"Liu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Liu et al., 2024] Chenxi Liu, Sun Yang, Qianxiong Xu, Zhishuai Li, Cheng Long, Ziyue Li, and Rui Zhao. Spatial-Temporal Large Language Model for Traffic Prediction, 2024.","title":"Spatial-Temporal Large Language Model for Traffic Prediction","authors":"Chenxi Liu, Sun Yang, Qianxiong Xu, Zhishuai Li, Cheng Long, Ziyue Li, Rui Zhao","year":"2024","venue":null,"doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Lopez-Lira and Tang, 2023] Alejandro Lopez-Lira and Yuehua Tang. Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models. arXiv:2304.07619, 2023.","title":"Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models","authors":"Lopez-Lira, Alejandro Tang, Yuehua Lopez-Lira, Tang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Lu et al., 2022] Kevin Lu, Aditya Grover, Pieter Abbeel, and Igor Mordatch. Pretrained Transformers as Universal Computation Engines. In AAAI, 2022.","title":"Pretrained Transformers as Universal Computation Engines","authors":"Kevin Lu, Aditya Grover, Pieter Abbeel, Igor Mordatch","year":"2022","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Ma et al., 2023] Qianli Ma, Zhen Liu, Zhenjing Zheng, Ziyang Huang, Siying Zhu, Zhongzhong Yu, et al. A Survey on Time- Series Pre-Trained Models. arXiv:2305.10716, 2023.","title":"A Survey on Time-Series Pre-Trained Models","authors":"Qianli Ma, Zhen Liu, Zhenjing Zheng, Ziyang Huang, Siying Zhu, Zhongzhong Yu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Mai et al., 2023a] C Mai, Y Chang, C Chen, and Z Zheng. En- hanced Scalable Graph Neural Network via Knowledge Distilla- tion. IEEE TNNLS, 2023.","title":"Enhanced Scalable Graph Neural Network via Knowledge Distillation","authors":"Mai","year":"2023","venue":"IEEE TNNLS","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Mai et al., 2023b] Gengchen Mai, Weiming Huang, Jin Sun, Suhang Song, Deepak Mishra, Ninghao Liu, Song Gao, et al. On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligence. arXiv:2304.06798, 2023.","title":"On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligence","authors":"Mai","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Nie et al., 2023] Yuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam. A Time Series is Worth 64 Words: Long-term Forecasting with Transformers. In ICLR, 2023.","title":"A Time Series is Worth 64 Words: Long-term Forecasting with Transformers","authors":"Yuqi Nie, Nam H Nguyen, Phanwadee Sinthong, Jayant Kalagnanam","year":"2023","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Pan et al., 2024] Zijie Pan, Yushan Jiang, Sahil Garg, Anderson Schneider, Yuriy Nevmyvaka, and Dongjin Song. S 2 IP-LLM: Semantic Space Informed Prompt Learning with LLM for Time Series Forecasting. arXiv:2403.05798, 2024.","title":"S 2 IP-LLM: Semantic Space Informed Prompt Learning with LLM for Time Series Forecasting","authors":"Pan","year":"2024","venue":null,"doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Radford et al., 2019] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. Language Mod- els are Unsupervised Multitask Learners. OpenAI blog, 2019.","title":"Language Models are Unsupervised Multitask Learners","authors":"Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever","year":"2019","venue":"OpenAI blog","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Raffel et al., 2020] Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the Limits of Transfer Learn- ing with a Unified Text-to-text Transformer. JMLR, 2020.","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-text Transformer","authors":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J Liu","year":"2020","venue":"JMLR","doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Rasul et al., 2023] Kashif Rasul, Arjun Ashok, Andrew Robert Williams, Arian Khorasani, George Adamopoulos, Rishika Bhagwatkar, et al. Lag-Llama: Towards Foundation Models for Time Series Forecasting, 2023.","title":"Lag-Llama: Towards Foundation Models for Time Series Forecasting","authors":"Kashif Rasul, Arjun Ashok, Andrew Robert Williams, Arian Khorasani, George Adamopoulos, Rishika Bhagwatkar","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Shi et al., 2023] Xiaoming Shi, Siqiao Xue, Kangrui Wang, Fan Zhou, James Y Zhang, Jun Zhou, Chenhao Tan, and Hongyuan Mei. Language Models Can Improve Event Prediction by Few- Shot Abductive Reasoning. In NeurIPS, 2023.","title":"Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoning","authors":"Xiaoming Shi, Siqiao Xue, Kangrui Wang, Fan Zhou, James Y Zhang, Jun Zhou, Chenhao Tan, Hongyuan Mei","year":"2023","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Spathis and Kawsar, 2023] Dimitris Spathis and Fahim Kawsar. The first step is the hardest: Pitfalls of Representing and Tokenizing Temporal Data for Large Language Models. arXiv:2309.06236, 2023.","title":"The first step is the hardest: Pitfalls of Representing and Tokenizing Temporal Data for Large Language Models","authors":"Dimitris Spathis, Fahim Kawsar","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":47,"raw":"[Sun et al., 2024] Chenxi Sun, Yaliang Li, Hongyan Li, and Shenda Hong. TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Series. In ICLR, 2024.","title":"TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Series","authors":"Chenxi Sun, Yaliang Li, Hongyan Li, Shenda Hong","year":"2024","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":48,"raw":"[Touvron et al., 2023a] Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, et al. LLaMA: Open and Efficient Foundation Language Models. arXiv:2302.13971, 2023.","title":"LLaMA: Open and Efficient Foundation Language Models","authors":"Touvron","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Touvron et al., 2023b] Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, et al. Llama 2: Open Foundation and Fine-Tuned Chat Models. arXiv:2307.09288, 2023.","title":"Llama 2: Open Foundation and Fine-Tuned Chat Models","authors":"Touvron","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":50,"raw":"[Wang et al., 2022] Zifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang, Ruoxi Sun, Xiaoqi Ren, Guolong Su, Vincent Perot, et al. Learning to Prompt for Continual Learning. In CVPR, 2022.","title":"Learning to Prompt for Continual Learning","authors":"Zifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang, Ruoxi Sun, Xiaoqi Ren, Guolong Su, Vincent Perot","year":"2022","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":51,"raw":"[Wang et al., 2023] Xinglei Wang, Meng Fang, Zichao Zeng, and Tao Cheng. Where Would I Go Next? Large Language Models as Human Mobility Predictors, 2023.","title":"Where Would I Go Next? Large Language Models as Human Mobility Predictors","authors":"Xinglei Wang, Meng Fang, Zichao Zeng, Tao Cheng","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":52,"raw":"[Wei et al., 2022] Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, et al. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. In NeurIPS, 2022.","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","authors":"Wei","year":"2022","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":53,"raw":"[Wu et al., 2022] Haixu Wu, Tengge Hu, Yong Liu, Hang Zhou, Jianmin Wang, et al. TimesNet: Temporal 2D-Variation Mod- eling for General Time Series Analysis. In ICLR, 2022.","title":"TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis","authors":"Haixu Wu, Tengge Hu, Yong Liu, Hang Zhou, Jianmin Wang","year":"2022","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":54,"raw":"[Wu et al., 2023] Shijie Wu, Ozan Irsoy, Steven Lu, Vadim Dabravolski, Mark Dredze, Sebastian Gehrmann, Prab- hanjan Kambadur, David Rosenberg, and Gideon Mann. BloombergGPT: A Large Language Model for Finance. 2023.","title":"BloombergGPT: A Large Language Model for Finance","authors":"Shijie Wu, Ozan Irsoy, Steven Lu, Vadim Dabravolski, Mark Dredze, Sebastian Gehrmann, Prabhanjan Kambadur, David Rosenberg, Gideon Mann","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":55,"raw":"[Xie et al., 2023] Qianqian Xie, Weiguang Han, Yanzhao Lai, Min Peng, and Jimin Huang. The Wall Street Neophyte: A Zero- Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challenges. arXiv:2304.05351, 2023.","title":"The Wall Street Neophyte: A Zero-Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challenges","authors":"Qianqian Xie, Weiguang Han, Yanzhao Lai, Min Peng, Jimin Huang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":56,"raw":"[Xu et al., 2023] Haojun Xu, Yan Gao, Zheng Hui, Jie Li, and Xinbo Gao. Language Knowledge-Assisted Repre- sentation Learning for Skeleton-Based Action Recognition. arXiv:2305.12398, 2023.","title":"Language Knowledge-Assisted Representation Learning for Skeleton-Based Action Recognition","authors":"Haojun Xu, Yan Gao, Zheng Hui, Jie Li, Xinbo Gao","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":57,"raw":"[Xue and Salim, 2023] Hao Xue and Flora D Salim. PromptCast: A New Prompt-based Learning Paradigm for Time Series Fore- casting. IEEE TKDE, 2023.","title":"PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecasting","authors":"Hao Xue, Flora D Salim","year":"2023","venue":"IEEE TKDE","doi":null,"url":null,"internal_url":null},{"position":58,"raw":"[Xue et al., 2022a] Hao Xue, Bhanu Prakash Voutharoja, and Flora D Salim. Leveraging Language Foundation Models for Hu- man Mobility Forecasting. In SIGSPATIAL, 2022.","title":"Leveraging Language Foundation Models for Human Mobility Forecasting","authors":"Xue","year":"2022","venue":"SIGSPATIAL","doi":null,"url":null,"internal_url":null},{"position":59,"raw":"[Xue et al., 2022b] Siqiao Xue, Xiaoming Shi, James Zhang, and Hongyuan Mei. HYPRO: A Hybridly Normalized Probabilis- tic Model for Long-Horizon Prediction of Event Sequences. NeurIPS, 2022.","title":"HYPRO: A Hybridly Normalized Probabilistic Model for Long-Horizon Prediction of Event Sequences","authors":"Xue","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":60,"raw":"[Xue et al., 2023] Siqiao Xue, Fan Zhou, Yi Xu, Hongyu Zhao, Shuo Xie, et al. WeaverBird: Empowering Financial Decision- Making with Large Language Model, Knowledge Base, and Search Engine. arXiv:2308.05361, 2023.","title":"WeaverBird: Empowering Financial Decision-Making with Large Language Model","authors":"Siqiao Xue, Fan Zhou, Yi Xu, Hongyu Zhao, Shuo Xie","year":"2023","venue":"Knowledge Base, and Search Engine","doi":null,"url":null,"internal_url":null},{"position":61,"raw":"[Yang et al., 2019] Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. XLNet: Gen- eralized Autoregressive Pretraining for Language Understanding. In NeurIPS, 2019.","title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","authors":"Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, Quoc V Le","year":"2019","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":62,"raw":"[Yang et al., 2022] Xi Yang, Aokun Chen, Nima PourNejatian, Hoo Chang Shin, et al. A large language model for electronic health records. NPJ Digital Medicine, 5(1):194, 2022.","title":"A large language model for electronic health records","authors":"Xi Yang, Aokun Chen, Nima Pournejatian, Chang Hoo, Shin","year":"2022","venue":"NPJ Digital Medicine","doi":null,"url":null,"internal_url":null},{"position":63,"raw":"[Yin et al., 2023] Shukang Yin, Chaoyou Fu, Sirui Zhao, Ke Li, Xing Sun, Tong Xu, and Enhong Chen. A Survey on Multimodal Large Language Models. arXiv:2306.13549, 2023.","title":"A Survey on Multimodal Large Language Models","authors":"Shukang Yin, Chaoyou Fu, Sirui Zhao, Ke Li, Xing Sun, Tong Xu, Enhong Chen","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":64,"raw":"[Yu et al., 2023] Xinli Yu, Zheng Chen, Yuan Ling, Shujing Dong, Zongyi Liu, and Yanbin Lu. Temporal Data Meets LLM-Explainable Financial Time Series Forecasting. arXiv:2306.11025, 2023.","title":"Temporal Data Meets LLM-Explainable Financial Time Series Forecasting","authors":"Xinli Yu, Zheng Chen, Yuan Ling, Shujing Dong, Zongyi Liu, Yanbin Lu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":65,"raw":"[Zhang et al., 2023a] Boyu Zhang, Hongyang Yang, and Xiao- Yang Liu. Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Models. arXiv:2306.12659, 2023.","title":"Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Models","authors":"Zhang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":66,"raw":"[Zhang et al., 2023b] Zhuosheng Zhang, Aston Zhang, Mu Li, Hai Zhao, George Karypis, et al. Multimodal Chain-of-Thought Rea- soning in Language Models. arXiv:2302.00923, 2023.","title":"Multimodal Chain-of-Thought Reasoning in Language Models","authors":"Zhang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":67,"raw":"[Zhao et al., 2023] Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, et al. A Survey of Large Lan- guage Models. arXiv:2303.18223, 2023.","title":"A Survey of Large Language Models","authors":"Kun Wayne Xin Zhao, Junyi Zhou, Tianyi Li, Xiaolei Tang, Yupeng Wang, Hou","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":68,"raw":"[Zhou et al., 2023] Tian Zhou, PeiSong Niu, Xue Wang, Liang Sun, and Rong Jin. One Fits All: Power General Time Series Analysis by Pretrained LM. In NeurIPS, 2023.","title":"One Fits All: Power General Time Series Analysis by Pretrained LM","authors":"Tian Zhou, Peisong Niu, Xue Wang, Liang Sun, Rong Jin","year":"2023","venue":"NeurIPS","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}