{"type":"ScholarlyArticle","title":"Recent Advances in End-to-End Simultaneous Speech Translation","authors":[{"name":"Xiaoqian Liu","slug":"xiaoqian-liu","given":"Xiaoqian","family":"Liu","affiliation":"School of Computer Science and Engineering , Northeastern University , Shenyang , China"},{"name":"Guoqiang Hu","slug":"guoqiang-hu","given":"Guoqiang","family":"Hu","affiliation":"International School , Jinan University , Guangzhou , China"},{"name":"Yangfan Du","slug":"yangfan-du","given":"Yangfan","family":"Du","affiliation":"School of Computer Science and Engineering , Northeastern University , Shenyang , China"},{"name":"Erfeng He","slug":"erfeng-he","given":"Erfeng","family":"He","affiliation":"School of Computer Science and Engineering , Northeastern University , Shenyang , China"},{"name":"YingFeng Luo","slug":"yingfeng-luo","given":"YingFeng","family":"Luo","affiliation":"School of Computer Science and Engineering , Northeastern University , Shenyang , China"},{"name":"Chen Xu","slug":"chen-xu","given":"Chen","family":"Xu","affiliation":"College of Computer Science and Technology , Harbin Engineering University , Harbin , China"},{"name":"Tong Xiao","slug":"tong-xiao","given":"Tong","family":"Xiao","affiliation":"School of Computer Science and Engineering , Northeastern University , Shenyang , China; NiuTrans Research , Shenyang , China"},{"name":"Jingbo Zhu","slug":"jingbo-zhu","given":"Jingbo","family":"Zhu","affiliation":"School of Computer Science and Engineering , Northeastern University , Shenyang , China; NiuTrans Research , Shenyang , China"}],"abstract":"Simultaneous speech translation (SimulST) is a demanding task that involves generating translations in real-time while continuously processing speech input. This paper offers a comprehensive overview of the recent developments in SimulST research, focusing on four major challenges. Firstly, the complexities associated with processing lengthy and continuous speech streams pose significant hurdles. Secondly, satisfying real-time requirements presents inherent difficulties due to the need for immediate translation output. Thirdly, striking a balance between translation quality and latency constraints remains a critical challenge. Finally, the scarcity of annotated data adds another layer of complexity to the task. Through our exploration of these challenges and the proposed solutions, we aim to provide valuable insights into the current landscape of SimulST research and suggest promising directions for future exploration.","doi":"10.24963/ijcai.2024/900","url":"https://ijcai.org/proceedings/2024/900","pdf":"https://ijcai.org/proceedings/2024/0900.pdf","markdown":"https://ijcai.org/proceedings/2024/900.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/900","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Survey Track","track":"Survey Track","number":900,"pages":{"first":8142,"last":8150},"keywords":["Natural Language Processing: NLP: Speech","Natural Language Processing: General"],"videos":[],"references":[{"position":1,"raw":"[Chang and Lee, 2022] Chih-Chiang Chang and Hung-yi Lee. Exploring continuous integrate-and-fire for adaptive simultaneous speech translation. In Interspeech, 2022.","title":"Exploring continuous integrate-and-fire for adaptive simultaneous speech translation","authors":"Chang, Lee ; Chih-Chiang Chang, Hung-Yi Lee","year":"2022","venue":"Interspeech","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Chen et al., 2021] Junkun Chen, Mingbo Ma, Renjie Zheng, and Liang Huang. Direct simultaneous speech-to- text translation assisted by synchronized streaming ASR. In ACL Findings, 2021.","title":"Direct simultaneous speech-totext translation assisted by synchronized streaming ASR","authors":"Chen","year":"2021","venue":"ACL Findings","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chen et al., 2023] Junkun Chen, Jian Xue, Peidong Wang, Jing Pan, and Jinyu Li. Improving stability in simultane- ous speech translation: A revision-controllable decoding approach. CoRR, 2023.","title":"Improving stability in simultaneous speech translation: A revision-controllable decoding approach","authors":"Junkun Chen, Jian Xue, Peidong Wang, Jing Pan, Jinyu Li","year":"2023","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Cherry and Foster, 2019] Colin Cherry and George F. Fos- ter. Thinking slow about latency evaluation for simultane- ous machine translation. CoRR, 2019.","title":"Thinking slow about latency evaluation for simultaneous machine translation","authors":"Colin Cherry, George F Foster","year":"2019","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Communication et al., 2023] Seamless Communication, Loïc Barrault, Yu-An Chung, Mariano Coria Meglioli, David Dale, Ning Dong, Mark Duppenthaler, Paul- Ambroise Duquenne, Brian Ellis, Hady Elsahar, et al. Seamless: Multilingual expressive and streaming speech translation. CoRR, 2023.","title":"Seamless: Multilingual expressive and streaming speech translation","authors":"Communication","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Deng et al., 2022] Keqi Deng, Shinji Watanabe, Jiatong Shi, and Siddhant Arora. Blockwise streaming trans- former for spoken language understanding and simultane- ous speech translation. In Interspeech, 2022.","title":"Blockwise streaming transformer for spoken language understanding and simultaneous speech translation","authors":"Deng","year":"2022","venue":"Interspeech","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Dong et al., 2022] Qian Dong, Yaoming Zhu, Mingxuan Wang, and Lei Li. Learning when to translate for stream- ing speech. In ACL, 2022.","title":"Learning when to translate for streaming speech","authors":"Qian Dong, Yaoming Zhu, Mingxuan Wang, Lei Li","year":"2022","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Graves et al., 2006] Alex Graves, Santiago Fernández, Faustino J. Gomez, and Jürgen Schmidhuber. Connec- tionist temporal classification: labelling unsegmented se- quence data with recurrent neural networks. In ICML, 2006.","title":"Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks","authors":"Alex Graves, Santiago Fernández, Faustino J Gomez, Jürgen Schmidhuber","year":"2006","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Graves, 2012] Alex Graves. Sequence transduction with re- current neural networks. CoRR, 2012.","title":"Sequence transduction with recurrent neural networks","authors":"Alex Graves","year":"2012","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Han et al., 2020] Hou Jeung Han, Mohd Abbas Zaidi, Sathish Reddy Indurthi, Nikhil Kumar Lakumarapu, Beomseok Lee, and Sangha Kim. End-to-end simulta- neous translation system for IWSLT2020 using modality agnostic meta-learning. In IWSLT, 2020.","title":"End-to-end simultaneous translation system for IWSLT2020 using modality agnostic meta-learning","authors":"Jeung Hou, Mohd Abbas Han, Sathish Zaidi, Nikhil Reddy Indurthi, Beomseok Kumar Lakumarapu, Sangha Lee, Kim","year":"2020","venue":"IWSLT","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Huang et al., 2023a] Wuwei Huang, Renren Jin, Wen Zhang, Jian Luan, Bin Wang, and Deyi Xiong. Joint train- ing and decoding for multilingual end-to-end simultaneous speech translation. In ICASSP, 2023.","title":"Joint training and decoding for multilingual end-to-end simultaneous speech translation","authors":"Huang","year":"2023","venue":"ICASSP","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Huang et al., 2023b] Wuwei Huang, Mengge Liu, Xiang Li, Yanzhi Tian, Fengyu Yang, Wen Zhang, Jian Luan, Bin Wang, Yuhang Guo, and Jinsong Su. The xiaomi AI lab's speech translation systems for IWSLT 2023 offline task, simultaneous task and speech-to-speech task. In IWSLT, 2023.","title":"The xiaomi AI lab's speech translation systems for IWSLT 2023 offline task, simultaneous task and speech-to-speech task","authors":"Huang","year":"2023","venue":"IWSLT","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kano et al., 2022] Yasumasa Kano, Katsuhito Sudoh, and Satoshi Nakamura. Average token delay: A latency metric for simultaneous translation. CoRR, 2022.","title":"Average token delay: A latency metric for simultaneous translation","authors":"Yasumasa Kano, Katsuhito Sudoh, Satoshi Nakamura","year":"2022","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Ko et al., 2023] Yuka Ko, Ryo Fukuda, Yuta Nishikawa, Yasumasa Kano, Katsuhito Sudoh, and Satoshi Nakamura. Tagged end-to-end simultaneous speech translation train- ing using simultaneous interpretation data. In IWSLT, 2023.","title":"Tagged end-to-end simultaneous speech translation training using simultaneous interpretation data","authors":"Yuka Ko, Ryo Fukuda, Yuta Nishikawa, Yasumasa Kano, Katsuhito Sudoh, Satoshi Nakamura","year":"2023","venue":"IWSLT","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Le et al., 2023] Chenyang Le, Yao Qian, Long Zhou, Shu- jie Liu, Michael Zeng, and Xuedong Huang. Comsl: A composite speech-language model for end-to-end speech- to-text translation. In NeurIPS, 2023.","title":"Comsl: A composite speech-language model for end-to-end speechto-text translation","authors":"Chenyang Le, Yao Qian, Long Zhou, Shujie Liu, Michael Zeng, Xuedong Huang","year":"2023","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Liu et al., 2020] Danni Liu, Gerasimos Spanakis, and Jan Niehues. Low-latency sequence-to-sequence speech recognition and translation by partial hypothesis selection. In Interspeech, 2020.","title":"Low-latency sequence-to-sequence speech recognition and translation by partial hypothesis selection","authors":"Danni Liu, Gerasimos Spanakis, Jan Niehues","year":"2020","venue":"Interspeech","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Liu et al., 2021] Dan Liu, Mengge Du, Xiaoxi Li, Ya Li, and Enhong Chen. Cross attention augmented transducer networks for simultaneous translation. In EMNLP, 2021.","title":"Cross attention augmented transducer networks for simultaneous translation","authors":"Dan Liu, Mengge Du, Xiaoxi Li, Ya Li, Enhong Chen","year":"2021","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Ma et al., 2019] Mingbo Ma, Liang Huang, Hao Xiong, Renjie Zheng, Kaibo Liu, Baigong Zheng, Chuanqiang Zhang, Zhongjun He, Hairong Liu, et al. STACL: Simul- taneous translation with implicit anticipation and control- lable latency using prefix-to-prefix framework. In ACL, 2019.","title":"STACL: Simultaneous translation with implicit anticipation and controllable latency using prefix-to-prefix framework","authors":"Mingbo Ma, Liang Huang, Hao Xiong, Renjie Zheng, Kaibo Liu, Baigong Zheng, Chuanqiang Zhang, Zhongjun He, Hairong Liu","year":"2019","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Ma et al., 2020a] Xutai Ma, Mohammad Javad Dousti, Changhan Wang, Jiatao Gu, and Juan Pino. SIMULE- VAL: An evaluation toolkit for simultaneous translation. In EMNLP, 2020.","title":"SIMULE-VAL: An evaluation toolkit for simultaneous translation","authors":"Ma","year":"2020","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Ma et al., 2020b] Xutai Ma, Juan Pino, and Philipp Koehn. SimulMT to SimulST: Adapting simultaneous text trans- lation to end-to-end simultaneous speech translation. In AACL, 2020.","title":"SimulMT to SimulST: Adapting simultaneous text translation to end-to-end simultaneous speech translation","authors":"Ma","year":"2020","venue":"AACL","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Ma et al., 2021] Xutai Ma, Yongqiang Wang, Moham- mad Javad Dousti, Philipp Koehn, and Juan Miguel Pino. Streaming simultaneous speech translation with aug- mented memory transformer. In ICASSP, 2021.","title":"Streaming simultaneous speech translation with augmented memory transformer","authors":"Ma","year":"2021","venue":"ICASSP","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Machácek et al., 2023] Dominik Machácek, Ondrej Bojar, and Raj Dabre. MT metrics correlate with human ratings of simultaneous speech translation. In IWSLT, 2023.","title":"MT metrics correlate with human ratings of simultaneous speech translation","authors":"Dominik Machácek, Ondrej Bojar, Raj Dabre","year":"2023","venue":"IWSLT","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Nguyen et al., 2021a] Ha Nguyen, Yannick Estève, and Laurent Besacier. An empirical study of end-to-end simul- taneous speech translation decoding strategies. In ICASSP, 2021.","title":"An empirical study of end-to-end simultaneous speech translation decoding strategies","authors":"Nguyen","year":"2021","venue":"ICASSP","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Nguyen et al., 2021b] Ha Nguyen, Yannick Estève, and Laurent Besacier. Impact of encoding and segmentation strategies on end-to-end simultaneous speech translation. In Interspeech, 2021.","title":"Impact of encoding and segmentation strategies on end-to-end simultaneous speech translation","authors":"Nguyen","year":"2021","venue":"Interspeech","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Niehues et al., 2018] Jan Niehues, Ngoc-Quan Pham, Thanh-Le Ha, Matthias Sperber, and Alex Waibel. Low-latency neural speech translation. In Interspeech, 2018.","title":"Low-latency neural speech translation","authors":"Niehues","year":"2018","venue":"Interspeech","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Papi et al., 2022] Sara Papi, Marco Gaido, Matteo Negri, and Marco Turchi. Does simultaneous speech translation need simultaneous models? In EMNLP Findings, 2022.","title":"Does simultaneous speech translation need simultaneous models?","authors":"Sara Papi, Marco Gaido, Matteo Negri, Marco Turchi","year":"2022","venue":"EMNLP Findings","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Papi et al., 2023a] Sara Papi, Matteo Negri, and Marco Turchi. Attention as a guide for simultaneous speech trans- lation. In ACL, 2023.","title":"Attention as a guide for simultaneous speech translation","authors":"Papi","year":"2023","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Papi et al., 2023b] Sara Papi, Marco Turchi, and Matteo Negri. Alignatt: Using attention-based audio-translation alignments as a guide for simultaneous speech translation. CoRR, 2023.","title":"Alignatt: Using attention-based audio-translation alignments as a guide for simultaneous speech translation","authors":"Papi","year":"2023","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Papineni et al., 2002] Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. Bleu: a method for au- tomatic evaluation of machine translation. In ACL, 2002.","title":"Bleu: a method for automatic evaluation of machine translation","authors":"Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu","year":"2002","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Polák et al., 2023] Peter Polák, Brian Yan, Shinji Watanabe, Alex Waibel, and Ondrej Bojar. Incremental blockwise beam search for simultaneous speech translation with con- trollable quality-latency tradeoff. CoRR, 2023.","title":"Incremental blockwise beam search for simultaneous speech translation with controllable quality-latency tradeoff","authors":"Peter Polák, Brian Yan, Shinji Watanabe, Alex Waibel, Ondrej Bojar","year":"2023","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Polák, 2023] Peter Polák. Long-form simultaneous speech translation: Thesis proposal. CoRR, 2023.","title":"Long-form simultaneous speech translation: Thesis proposal","authors":"Peter Polák, Polák","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Post, 2018] Matt Post. A call for clarity in reporting BLEU scores. In WMT 2018, 2018.","title":"A call for clarity in reporting BLEU scores","authors":"Matt Post","year":"2018","venue":"WMT 2018","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Radford et al., 2023] Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. Robust speech recognition via large-scale weak supervision. In ICML, 2023.","title":"Robust speech recognition via large-scale weak supervision","authors":"Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine Mcleavey, Ilya Sutskever","year":"2023","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Raffel and Chen, 2023] Matthew Raffel and Lizhong Chen. Implicit memory transformer for computationally efficient simultaneous speech translation. In ACL Findings, 2023.","title":"Implicit memory transformer for computationally efficient simultaneous speech translation","authors":"Chen ; Raffel, Matthew Raffel, Lizhong Chen","year":"2023","venue":"ACL Findings","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Raffel et al., 2023] Matthew Raffel, Drew Penney, and Lizhong Chen. Shiftable context: Addressing training- inference context mismatch in simultaneous speech trans- lation. In ICML, 2023.","title":"Shiftable context: Addressing traininginference context mismatch in simultaneous speech translation","authors":"Matthew Raffel, Drew Penney, Lizhong Chen","year":"2023","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Rei et al., 2020] Ricardo Rei, Craig Stewart, Ana C Farinha, and Alon Lavie. Unbabel's participation in the WMT20 metrics shared task. In WMT, 2020.","title":"Unbabel's participation in the WMT20 metrics shared task","authors":"Ricardo Rei, Craig Stewart, Ana C Farinha, Alon Lavie","year":"2020","venue":"WMT","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Ren et al., 2020] Yi Ren, Jinglin Liu, Xu Tan, Chen Zhang, Tao Qin, Zhou Zhao, and Tie-Yan Liu. SimulSpeech: End- to-end simultaneous speech to text translation. In ACL, 2020.","title":"SimulSpeech: Endto-end simultaneous speech to text translation","authors":"Yi Ren, Jinglin Liu, Xu Tan, Chen Zhang, Tao Qin, Zhou Zhao, Tie-Yan Liu","year":"2020","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Rubenstein et al., 2023] Paul K. Rubenstein, Chulayuth Asawaroengchai, Duc Dung Nguyen, Ankur Bapna, Zalán Borsos, Félix de Chaumont Quitry, Peter Chen, Dalia El Badawy, Wei Han, Eugene Kharitonov, et al. Audiopalm: A large language model that can speak and listen. CoRR, 2023.","title":"Audiopalm: A large language model that can speak and listen","authors":"Paul K Rubenstein, Chulayuth Asawaroengchai, Dung Duc, Ankur Nguyen, Zalán Bapna, Félix Borsos, De Chaumont, Peter Quitry, Dalia El Chen, Wei Badawy, Eugene Han, Kharitonov","year":"2023","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Sethiya and Maurya, 2023] Nivedita Sethiya and Chan- dresh Kumar Maurya. End-to-end speech-to-text transla- tion: A survey. CoRR, 2023.","title":"End-to-end speech-to-text translation: A survey","authors":"Nivedita Sethiya, Chandresh Kumar, Maurya","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Subramanya and Niehues, 2022] Shashank Subramanya and Jan Niehues. Multilingual simultaneous speech translation. CoRR, 2022.","title":"Multilingual simultaneous speech translation","authors":"Shashank Subramanya, Jan Niehues","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Tang et al., 2023] Yun Tang, AnnaY. Sun, Hirofumi In- aguma, Xinyue Chen, Ning Dong, Xutai Ma, PadenD. Tomasello, and Juan Pino. Hybrid transducer and attention based encoder-decoder modeling for speech-to-text tasks. CoRR, 2023.","title":"Hybrid transducer and attention based encoder-decoder modeling for speech-to-text tasks","authors":"Yun Tang, Annay Sun, Hirofumi Inaguma, Xinyue Chen, Ning Dong, Xutai Ma, Padend Tomasello, Juan Pino","year":"2023","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. In NeurIPS, 2017.","title":"Attention is all you need","authors":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, Illia Polosukhin","year":"2017","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Wang et al., 2022] Peidong Wang, Eric Sun, Jian Xue, Yu Wu, Long Zhou, Yashesh Gaur, Shujie Liu, and Jinyu Li. Lamassu: Streaming language-agnostic multilingual speech recognition and translation using neural transduc- ers. CoRR, 2022.","title":"Lamassu: Streaming language-agnostic multilingual speech recognition and translation using neural transducers","authors":"Peidong Wang, Eric Sun, Jian Xue, Yu Wu, Long Zhou, Yashesh Gaur, Shujie Liu, Jinyu Li","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Xu et al., 2023] Chen Xu, Rong Ye, Qianqian Dong, Chengqi Zhao, Tom Ko, Mingxuan Wang, Tong Xiao, and Jingbo Zhu. Recent advances in direct speech-to-text translation. In IJCAI, 2023.","title":"Recent advances in direct speech-to-text translation","authors":"Chen Xu, Rong Ye, Qianqian Dong, Chengqi Zhao, Tom Ko, Mingxuan Wang, Tong Xiao, Jingbo Zhu","year":"2023","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2023/761"},{"position":45,"raw":"[Zaidi et al., 2021] Mohd Abbas Zaidi, Beomseok Lee, Nikhil Kumar Lakumarapu, Sangha Kim, and Chanwoo Kim. Decision attentive regularization to improve simul- taneous speech translation systems. CoRR, 2021.","title":"Decision attentive regularization to improve simultaneous speech translation systems","authors":"Abbas Mohd, Beomseok Zaidi, Nikhil Lee, Sangha Kumar Lakumarapu, Chanwoo Kim, Kim","year":"2021","venue":"CoRR","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Zeng et al., 2021] Xingshan Zeng, Liangyou Li, and Qun Liu. RealTranS: End-to-end simultaneous speech trans- lation with convolutional weighted-shrinking transformer. In ACL Findings, 2021.","title":"RealTranS: End-to-end simultaneous speech translation with convolutional weighted-shrinking transformer","authors":"Zeng","year":"2021","venue":"ACL Findings","doi":null,"url":null,"internal_url":null},{"position":47,"raw":"[Zhang and Feng, 2023] Shaolei Zhang and Yang Feng. End-to-end simultaneous speech translation with differen- tiable segmentation. In ACL Findings, 2023.","title":"End-to-end simultaneous speech translation with differentiable segmentation","authors":"Feng Zhang, Shaolei Zhang, Yang Feng","year":"2023","venue":"ACL Findings","doi":null,"url":null,"internal_url":null},{"position":48,"raw":"[Zhang et al., 2022] Ruiqing Zhang, Zhongjun He, Hua Wu, and Haifeng Wang. Learning adaptive segmentation policy for end-to-end simultaneous translation. In ACL, 2022.","title":"Learning adaptive segmentation policy for end-to-end simultaneous translation","authors":"Zhang","year":"2022","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Zhao et al., 2023] Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al. A survey of large language models. CoRR, 2023.","title":"A survey of large language models","authors":"Kun Wayne Xin Zhao, Junyi Zhou, Tianyi Li, Xiaolei Tang, Yupeng Wang, Yingqian Hou, Beichen Min, Junjie Zhang, Zican Zhang, Dong","year":"2023","venue":"CoRR","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}