{"type":"ScholarlyArticle","title":"Reward Adaptation via Q-Manipulation: Provably Beneficial Reward Function Transfer in Reinforcement Learning","authors":[{"name":"Kevin Jatin Vora","slug":"kevin-jatin-vora","given":"Kevin Jatin","family":"Vora","affiliation":""}],"abstract":"Reinforcement Learning has made great strides in game playing and robotics but faces challenges with sample complexity and generalization. Transfer learning, which allows agents to reuse knowledge from prior tasks, offers a promising solution. My current research focuses on Reward Adaptation, where agents adjust to new reward functions while leveraging knowledge from tasks with different reward functions. I propose Q-Manipulation (Q-M), a method that adapts Q-functions to new rewards by computing and iteratively tightening bounds, akin to value iteration. This allows for action pruning before learning begins, enhancing sample efficiency without compromising policy optimality. Through empirical comparisons I demonstrate its effectiveness, generalizability, and practicality. Future work will handle changes in transition dynamics and continuous MDPs.","doi":"10.24963/ijcai.2025/1244","url":"https://ijcai.org/proceedings/2025/1244","pdf":"https://ijcai.org/proceedings/2025/1244.pdf","markdown":"https://ijcai.org/proceedings/2025/1244.md","bibtex":"https://ijcai.org/proceedings/2025/bibtex/1244","volume":{"slug":"2025","title":"Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2025","url":"https://ijcai.org/proceedings/2025/","year":2025,"location":"Montreal, Canada","dates":"16-22 August 2025","editors":"James Kwok","isbn":"978-1-956792-06-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2025"},"section":"Doctoral Consortium","track":"Doctoral Consortium","number":1244,"pages":{"first":10979,"last":10980},"keywords":["Machine Learning: ML: Multi-task and transfer learning","Machine Learning: ML: Reinforcement learning"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}