{"type":"ScholarlyArticle","title":"Ten Words Only Still Help: Improving Black-Box AI-Generated Text Detection via Proxy-Guided Efficient Re-Sampling","authors":[{"name":"Yuhui Shi","slug":"yuhui-shi","given":"Yuhui","family":"Shi","affiliation":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences , Institute of Computing Technology , Chinese Academy of Sciences; University of Chinese Academy of Sciences {shiyuhui22s ,"},{"name":"Qiang Sheng","slug":"qiang-sheng","given":"Qiang","family":"Sheng","affiliation":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences , Institute of Computing Technology , Chinese Academy of Sciences"},{"name":"Juan Cao","slug":"juan-cao","given":"Juan","family":"Cao","affiliation":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences , Institute of Computing Technology , Chinese Academy of Sciences; University of Chinese Academy of Sciences {shiyuhui22s ,"},{"name":"Hao Mi","slug":"hao-mi","given":"Hao","family":"Mi","affiliation":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences , Institute of Computing Technology , Chinese Academy of Sciences; University of Chinese Academy of Sciences {shiyuhui22s ,"},{"name":"Beizhe Hu","slug":"beizhe-hu","given":"Beizhe","family":"Hu","affiliation":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences , Institute of Computing Technology , Chinese Academy of Sciences; University of Chinese Academy of Sciences {shiyuhui22s ,"},{"name":"Danding Wang","slug":"danding-wang","given":"Danding","family":"Wang","affiliation":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences , Institute of Computing Technology , Chinese Academy of Sciences"}],"abstract":"With the rapidly increasing application of large language models (LLMs), their abuse has caused many undesirable societal problems such as fake news, academic dishonesty, and information pollution. This makes AI-generated text (AIGT) detection of great importance. Among existing methods, white-box methods are generally superior to black-box methods in terms of performance and generalizability, but they require access to LLMs' internal states and are not applicable to black-box settings. In this paper, we propose to estimate word generation probabilities as pseudo white-box features via multiple re-sampling to help improve AIGT detection under the black-box setting. Specifically, we design POGER, a proxy-guided efficient re-sampling method, which selects a small subset of representative words (e.g., 10 words) for performing multiple re-sampling in black-box AIGT detection. Experiments on datasets containing texts from humans and seven LLMs show that POGER outperforms all baselines in macro F1 under black-box, partial white-box, and out-of-distribution settings and maintains lower re-sampling costs than its existing counterparts.","doi":"10.24963/ijcai.2024/55","url":"https://ijcai.org/proceedings/2024/55","pdf":"https://ijcai.org/proceedings/2024/0055.pdf","markdown":"https://ijcai.org/proceedings/2024/55.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/55","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"AI Ethics, Trust, Fairness","track":"Main Track","number":55,"pages":{"first":494,"last":502},"keywords":["AI Ethics, Trust, Fairness: ETF: Trustworthy AI","Natural Language Processing: NLP: Applications"],"videos":[],"references":[{"position":1,"raw":"[Aich et al., 2022] Ankit Aich, Souvik Bhattacharya, and Natalie Parde. Demystifying Neural Fake News via Lin- guistic Feature-Based Interpretation. In Proceedings of the 29th International Conference on Computational Linguis- tics, pages 6586-6599, 2022.","title":"Demystifying Neural Fake News via Linguistic Feature-Based Interpretation","authors":"Ankit Aich, Souvik Bhattacharya, Natalie Parde","year":"2022","venue":"Proceedings of the 29th International Conference on Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Beresneva, 2016] Daria Beresneva. Computer-Generated Text Detection Using Machine Learning: A Systematic Review. In Proceedings of the 21st International Confer- ence on Applications of Natural Language to Information System, pages 421-426, 2016.","title":"Computer-Generated Text Detection Using Machine Learning: A Systematic Review","authors":"Daria Beresneva","year":"2016","venue":"Proceedings of the 21st International Conference on Applications of Natural Language to Information System","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bhattacharjee et al., 2023] Amrita Bhattacharjee, Tharindu Kumarage, Raha Moraffah, and Huan Liu. ConDA: Con- trastive Domain Adaptation for AI-generated Text Detec- tion. In Proceedings of the 13th International Joint Con- ference on Natural Language Processing and the 3rd Con- ference of the Asia-Pacific Chapter of the Association for Computational Linguistics, pages 598-610, 2023.","title":"ConDA: Contrastive Domain Adaptation for AI-generated Text Detection","authors":"Amrita Bhattacharjee, Tharindu Kumarage, Raha Moraffah, Huan Liu","year":"2023","venue":"Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bohacek, 2023] Matyas Bohacek. The Unseen A+ Student: Navigating the Impact of Large Language Models in the Classroom. In ICML 2023 Workshop on Deployment Chal- lenges for Generative AI, 2023.","title":"The Unseen A+ Student: Navigating the Impact of Large Language Models in the Classroom","authors":"Matyas Bohacek","year":"2023","venue":"ICML 2023 Workshop on Deployment Challenges for Generative AI","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Brewster et al., 2023] Jack Brewster, Zack Fishman, and Elisa Xu. Funding the Next Generation of Content Farms. https://www.newsguardtech.com/ misinformation-monitor/june-2023/, 2023. Accessed: 2024-05-15.","title":"Funding the Next Generation of Content Farms","authors":"Brewster","year":"2023","venue":null,"doi":null,"url":"https://www.newsguardtech.com/misinformation-monitor/june-2023/,2023","internal_url":null},{"position":6,"raw":"[Chen et al., 2023] Yutian Chen, Hao Kang, Vivian Zhai, Liangze Li, Rita Singh, and Bhiksha Raj. Token Predic- tion as Implicit Classification to Identify LLM-Generated Text. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 13112- 13120, 2023.","title":"Token Prediction as Implicit Classification to Identify LLM-Generated Text","authors":"Yutian Chen, Hao Kang, Vivian Zhai, Liangze Li, Rita Singh, Bhiksha Raj","year":"2023","venue":"Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Fan et al., 2019] Angela Fan, Yacine Jernite, Ethan Perez, David Grangier, Jason Weston, and Michael Auli. ELI5: Long Form Question Answering. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3558-3567, 2019.","title":"ELI5: Long Form Question Answering","authors":"Angela Fan, Yacine Jernite, Ethan Perez, David Grangier, Jason Weston, Michael Auli","year":"2019","venue":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Fröhling and Zubiaga, 2021] Leon Fröhling and Arkaitz Zubiaga. Feature-based detection of automated language models: tackling GPT-2, GPT-3 and Grover. PeerJ Com- puter Science, 7:e443, 2021.","title":"Leon Fröhling and Arkaitz Zubiaga. Feature-based detection of automated language models: tackling GPT-2, GPT-3 and Grover","authors":"Zubiaga Fröhling","year":"2021","venue":"PeerJ Computer Science","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Gehrmann et al., 2019] Sebastian Gehrmann, Hendrik Stro- belt, and Alexander M Rush. GLTR: Statistical Detection and Visualization of Generated Text. In Proceedings of the 57th Annual Meeting of the Association for Compu- tational Linguistics: System Demonstrations, pages 111- 116, 2019.","title":"GLTR: Statistical Detection and Visualization of Generated Text","authors":"Sebastian Gehrmann, Hendrik Strobelt, Alexander M Rush","year":"2019","venue":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Greene and Cunningham, 2006] Derek Greene and Pádraig Cunningham. Practical Solutions to the Problem of Diag- onal Dominance in Kernel Document Clustering. In Pro- ceedings of the 23rd International Conference on Machine Learning, pages 377-384, 2006.","title":"Practical Solutions to the Problem of Diagonal Dominance in Kernel Document Clustering","authors":"Cunningham Greene, Derek Greene, Pádraig Cunningham","year":"2006","venue":"Proceedings of the 23rd International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Gu et al., 2023] Chenchen Gu, Xiang Lisa Li, Percy Liang, and Tatsunori Hashimoto. On the Learnability of Watermarks for Language Models. arXiv preprint arXiv:2312.04469, 2023.","title":"On the Learnability of Watermarks for Language Models","authors":"Chenchen Gu, Lisa Xiang, Percy Li, Tatsunori Liang, Hashimoto","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Guo et al., 2023] Biyang Guo, Xin Zhang, Ziyuan Wang, Minqi Jiang, Jinran Nie, Yuxuan Ding, Jianwei Yue, and Yupeng Wu. How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection. arXiv preprint arXiv:2301.07597, 2023.","title":"How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection","authors":"Biyang Guo, Xin Zhang, Ziyuan Wang, Minqi Jiang, Jinran Nie, Yuxuan Ding, Jianwei Yue, Yupeng Wu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Ippolito et al., 2023] Daphne Ippolito, Nicholas Carlini, Katherine Lee, Milad Nasr, and Yun William Yu. Reverse- Engineering Decoding Strategies Given Blackbox Access to a Language Generation System. In Proceedings of the 16th International Natural Language Generation Confer- ence, pages 396-406, 2023.","title":"Reverse-Engineering Decoding Strategies Given Blackbox Access to a Language Generation System","authors":"Daphne Ippolito, Nicholas Carlini, Katherine Lee, Milad Nasr, Yun William Yu","year":"2023","venue":"Proceedings of the 16th International Natural Language Generation Conference","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Jakesch et al., 2023] Maurice Jakesch, Jeffrey T Hancock, and Mor Naaman. Human Heuristics for AI-Generated Language are Flawed. Proceedings of the National Academy of Sciences, 120(11):e2208839120, 2023.","title":"Human Heuristics for AI-Generated Language are Flawed","authors":"Maurice Jakesch, Jeffrey T Hancock, Mor Naaman","year":"2023","venue":"Proceedings of the National Academy of Sciences","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Kirchenbauer et al., 2023] John Kirchenbauer, Jonas Geip- ing, Yuxin Wen, Jonathan Katz, Ian Miers, and Tom Gold- stein. A watermark for large language models. In Pro- ceedings of the 40th International Conference on Machine Learning, volume 202, pages 17061-17084, 2023.","title":"A watermark for large language models","authors":"John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers, Tom Goldstein","year":"2023","venue":"Proceedings of the 40th International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Lavergne et al., 2008] Thomas Lavergne, Tanguy Urvoy, and Franc ¸ois Yvon. Detecting Fake Content with Rela- tive Entropy Scoring. In Proceedings of the 2008 Inter- national Conference on Uncovering Plagiarism, Author- ship and Social Software Misuse-Volume 377, pages 27- 31, 2008.","title":"Detecting Fake Content with Relative Entropy Scoring","authors":"Thomas Lavergne, Tanguy Urvoy, Franc ¸ois Yvon","year":"2008","venue":"Proceedings of the 2008 International Conference on Uncovering Plagiarism","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Li et al., 2023a] Linyang Li, Pengyu Wang, Ke Ren, Tianx- iang Sun, and Xipeng Qiu. Origin Tracing and Detecting of LLMs. arXiv preprint arXiv:2304.14072, 2023.","title":"Origin Tracing and Detecting of LLMs","authors":"Li","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Li et al., 2023b] Yafu Li, Qintong Li, Leyang Cui, Wei Bi, Longyue Wang, Linyi Yang, Shuming Shi, and Yue Zhang. Deepfake Text Detection in the Wild. arXiv preprint arXiv:2305.13242, 2023.","title":"Deepfake Text Detection in the Wild","authors":"Li","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Liu et al., 2019] Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. RoBERTa: A robustly optimized BERT pretraining ap- proach. arXiv preprint arXiv:1907.11692, 2019.","title":"RoBERTa: A robustly optimized BERT pretraining approach","authors":"Liu","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Liu et al., 2023] Aiwei Liu, Leyi Pan, Xuming Hu, Shiao Meng, and Lijie Wen. A Semantic Invariant Robust Watermark for Large Language Models. arXiv preprint arXiv:2310.06356, 2023.","title":"A Semantic Invariant Robust Watermark for Large Language Models","authors":"Liu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Lucas et al., 2023] Jason Lucas, Adaku Uchendu, Michi- haru Yamashita, Jooyoung Lee, Shaurya Rohatgi, and Dongwon Lee. Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinforma- tion. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 14279- 14305, 2023.","title":"Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformation","authors":"Jason Lucas, Adaku Uchendu, Michiharu Yamashita, Jooyoung Lee, Shaurya Rohatgi, Dongwon Lee","year":"2023","venue":"Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Mitchell et al., 2023] Eric Mitchell, Yoonho Lee, Alexan- der Khazatsky, Christopher D. Manning, and Chelsea Finn. DetectGPT: Zero-Shot Machine-Generated Text De- tection Using Probability Curvature. In Proceedings of the 40th International Conference on Machine Learning, 2023.","title":"DetectGPT: Zero-Shot Machine-Generated Text Detection Using Probability Curvature","authors":"Eric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D Manning, Chelsea Finn","year":"2023","venue":"Proceedings of the 40th International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[OpenAI, 2022] OpenAI. ChatGPT: Optimizing language models for dialogue. https://openai.com/index/chatgpt/, 2022. Accessed: 2024-05-15.","title":"OpenAI. ChatGPT: Optimizing language models for dialogue","authors":"Openai","year":"2022","venue":null,"doi":null,"url":"https://openai.com/index/chatgpt/,2022","internal_url":null},{"position":24,"raw":"[OpenAI, 2023] OpenAI. GPT-4 Technical Report. arXiv preprint arXiv:2303.08774, 2023.","title":null,"authors":"Openai","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Radford et al., 2019] Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. Language Models are Unsupervised Multitask Learners. OpenAI blog, 2019.","title":"Language Models are Unsupervised Multitask Learners","authors":"Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever","year":"2019","venue":"OpenAI blog","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Solaiman et al., 2019] Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, Gretchen Krueger, Jong Wook Kim, Sarah Kreps, et al. Release strategies and the social impacts of language models. arXiv preprint arXiv:1908.09203, 2019.","title":"Release strategies and the social impacts of language models","authors":"Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, Gretchen Krueger, Jong Wook Kim, Sarah Kreps","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Taori et al., 2023] Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. Stanford Alpaca: An Instruction-following LLaMA model. https://github.com/ tatsu-lab/stanford alpaca, 2023. Accessed: 2024-05-15.","title":"Stanford Alpaca: An Instruction-following LLaMA model","authors":"Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li, Carlos Guestrin, Percy Liang, Tatsunori B Hashimoto","year":"2023","venue":null,"doi":null,"url":"https://github.com/tatsu-lab/stanfordalpaca","internal_url":null},{"position":28,"raw":"[Tian, 2023] Edward Tian. GPTZero: An AI Text Detector. https://gptzero.me/, 2023. Accessed: 2024-05-15.","title":"GPTZero: An AI Text Detector","authors":"Edward Tian","year":"2024","venue":null,"doi":null,"url":"https://gptzero.me/,2023","internal_url":null},{"position":29,"raw":"[Touvron et al., 2023] Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288, 2023.","title":"Llama 2: Open foundation and fine-tuned chat models","authors":"Touvron","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Uchendu et al., 2020] Adaku Uchendu, Thai Le, Kai Shu, and Dongwon Lee. Authorship attribution for neural text generation. In Proceedings of the 2020 Conference on Em- pirical Methods in Natural Language Processing, pages 8384-8395, 2020.","title":"Authorship attribution for neural text generation","authors":"Uchendu","year":"2020","venue":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Uchendu et al., 2023] Adaku Uchendu, Jooyoung Lee, Hua Shen, Thai Le, Ting-Hao 'Kenneth' Huang, and Dongwon Lee. Does Human Collaboration Enhance the Accuracy of Identifying LLM-Generated Deepfake Texts? In Proceed- ings of the AAAI Conference on Human Computation and Crowdsourcing, volume 11, pages 163-174, 2023.","title":"Does Human Collaboration Enhance the Accuracy of Identifying LLM-Generated Deepfake Texts?","authors":"Uchendu","year":"2023","venue":"Proceedings of the AAAI Conference on Human Computation and Crowdsourcing","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Verma et al., 2023] Vivek Verma, Eve Fleisig, Nicholas Tomlin, and Dan Klein. Ghostbuster: Detecting Text Ghostwritten by Large Language Models. arXiv preprint arXiv:2305.15047, 2023.","title":"Ghostbuster: Detecting Text Ghostwritten by Large Language Models","authors":"Vivek Verma, Eve Fleisig, Nicholas Tomlin, Dan Klein","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Wang and Komatsuzaki, 2021] Ben Wang and Aran Ko- matsuzaki. GPT-J-6B: A 6 Billion Parameter Autore- gressive Language Model. https://github.com/kingoflolz/ mesh-transformer-jax, 2021. Accessed: 2024-05-15.","title":"GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model","authors":"Ben Wang, Aran Komatsuzaki","year":"2024","venue":null,"doi":null,"url":"https://github.com/kingoflolz/mesh-transformer-jax,2021","internal_url":null},{"position":34,"raw":"[Wang et al., 2023a] Lean Wang, Wenkai Yang, Deli Chen, Hao Zhou, Yankai Lin, Fandong Meng, Jie Zhou, and Xu Sun. Towards codable text watermarking for large lan- guage models. arXiv preprint arXiv:2307.15992, 2023.","title":"Towards codable text watermarking for large language models","authors":"Wang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Wang et al., 2023b] Pengyu Wang, Linyang Li, Ke Ren, Botian Jiang, Dong Zhang, and Xipeng Qiu. SeqXGPT: Sentence-Level AI-Generated Text Detection. In Proceed- ings of the 2023 Conference on Empirical Methods in Nat- ural Language Processing, pages 1144-1156, 2023.","title":"SeqXGPT: Sentence-Level AI-Generated Text Detection","authors":"Wang","year":"2023","venue":"Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Yang et al., 2023a] Xianjun Yang, Wei Cheng, Linda Pet- zold, William Yang Wang, and Haifeng Chen. DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Text. arXiv preprint arXiv:2305.17359, 2023.","title":"DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Text","authors":"Yang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Yang et al., 2023b] Xianjun Yang, Liangming Pan, Xuan- dong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, and Wei Cheng. A Survey on Detection of LLMs- Generated Content. arXiv preprint arXiv:2310.15654, 2023.","title":"A Survey on Detection of LLMs-Generated Content","authors":"Yang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Yoo et al., 2023] KiYoon Yoo, Wonhyuk Ahn, Jiho Jang, and Nojun Kwak. Robust multi-bit natural language water- marking through invariant features. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2092-2115, Toronto, Canada, July 2023.","title":"Robust multi-bit natural language watermarking through invariant features","authors":"Yoo","year":"2023","venue":"Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Yu et al., 2023] Xiao Yu, Yuang Qi, Kejiang Chen, Guo- qiang Chen, Xi Yang, Pengyuan Zhu, Weiming Zhang, and Nenghai Yu. GPT Paternity Test: GPT Generated Text Detection with GPT Genetic Inheritance. arXiv preprint arXiv:2305.12519, 2023.","title":"GPT Paternity Test: GPT Generated Text Detection with GPT Genetic Inheritance","authors":"Xiao Yu, Yuang Qi, Kejiang Chen, Guoqiang Chen, Xi Yang, Pengyuan Zhu, Weiming Zhang, Nenghai Yu","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Zhan et al., 2023] Haolan Zhan, Xuanli He, Qiongkai Xu, Yuxiang Wu, and Pontus Stenetorp. G3Detector: Gen- eral GPT-Generated Text Detector. arXiv preprint arXiv:2305.12680, 2023.","title":"G3Detector: General GPT-Generated Text Detector","authors":"Zhan","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Zheng et al., 2023] Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. Judging LLM-as-a- judge with MT-Bench and Chatbot Arena. In Advances in Neural Information Processing Systems, volume 36, 2023.","title":"Judging LLM-as-ajudge with MT-Bench and Chatbot Arena","authors":"Zheng","year":"2023","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}