{"type":"ScholarlyArticle","title":"Preference-based Deep Reinforcement Learning for Historical Route Estimation","authors":[{"name":"Boshen Pan","slug":"boshen-pan","given":"Boshen","family":"Pan","affiliation":""},{"name":"Yaoxin Wu","slug":"yaoxin-wu","given":"Yaoxin","family":"Wu","affiliation":""},{"name":"Zhiguang Cao","slug":"zhiguang-cao","given":"Zhiguang","family":"Cao","affiliation":""},{"name":"Yaqing Hou","slug":"yaqing-hou","given":"Yaqing","family":"Hou","affiliation":""},{"name":"Guangyu Zou","slug":"guangyu-zou","given":"Guangyu","family":"Zou","affiliation":""},{"name":"Qiang Zhang","slug":"qiang-zhang","given":"Qiang","family":"Zhang","affiliation":""}],"abstract":"Recent Deep Reinforcement Learning (DRL) techniques have advanced solutions to Vehicle Routing Problems (VRPs). However, many of these methods focus exclusively on optimizing distance-oriented objectives (i.e., minimizing route length), often overlooking the implicit drivers' preferences for routes. These preferences, which are crucial in practice, are challenging to model using traditional DRL approaches. To address this gap, we propose a preference-based DRL method characterized by its reward design and optimization objective, which is specialized to learn historical route preferences. Our experiments demonstrate that the method aligns generated solutions more closely with human preferences. Moreover, it exhibits strong generalization performance across a variety of instances, offering a robust solution for different VRP scenarios.","doi":"10.24963/ijcai.2025/955","url":"https://ijcai.org/proceedings/2025/955","pdf":"https://ijcai.org/proceedings/2025/0955.pdf","markdown":"https://ijcai.org/proceedings/2025/955.md","bibtex":"https://ijcai.org/proceedings/2025/bibtex/955","volume":{"slug":"2025","title":"Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2025","url":"https://ijcai.org/proceedings/2025/","year":2025,"location":"Montreal, Canada","dates":"16-22 August 2025","editors":"James Kwok","isbn":"978-1-956792-06-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2025"},"section":"Planning and Scheduling","track":"Main Track","number":955,"pages":{"first":8591,"last":8599},"keywords":["Machine Learning: ML: Reinforcement learning","Planning and Scheduling: PS: Routing","Machine Learning: ML: Learning preferences or rankings"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}