{"type":"ScholarlyArticle","title":"Reexamining the Exploration–Exploitation Dilemma from an Entropy-Driven Perspective","authors":[{"name":"Renye Yan","slug":"renye-yan","given":"Renye","family":"Yan","affiliation":""},{"name":"Yaozhong Gan","slug":"yaozhong-gan","given":"Yaozhong","family":"Gan","affiliation":""},{"name":"Jikang Cheng","slug":"jikang-cheng","given":"Jikang","family":"Cheng","affiliation":""},{"name":"Yi Sun","slug":"yi-sun","given":"Yi","family":"Sun","affiliation":""},{"name":"Zongwei Wang","slug":"zongwei-wang","given":"Zongwei","family":"Wang","affiliation":""},{"name":"Ling Liang","slug":"ling-liang","given":"Ling","family":"Liang","affiliation":""},{"name":"Yimao Cai","slug":"yimao-cai","given":"Yimao","family":"Cai","affiliation":""}],"abstract":"Achieving an optimal balance between exploration and exploitation remains a fundamental challenge in reinforcement learning. This work revisits the exploration-exploitation dilemma through the lens of entropy, offering a novel perspective on this enduring problem. It establishes a theoretical connection between policy's entropy and exploratory behavior, using entropy as a rational measure to quantify the exploration-exploitation trade-off. Theoretical analyses demonstrate that a modified Bellman equation, augmented with a novelty-seeking term, ensures appropriate entropy adjustment and guarantees its globally monotonic decay. The derived policy optimization process inherently accommodates all three regimes of the exploration-exploitation spectrum, enabling a principled transition from exploration to exploitation. Building on these theoretical insights, this work introduces AdaZero, an adaptive deep architecture that dynamically balances exploration and exploitation. Extensive empirical evaluations highlight AdaZero's robust performance and validate the theory's feasibility.","doi":"10.24963/ijcai.2026/571","url":"https://ijcai.org/proceedings/2026/571","pdf":"https://ijcai.org/proceedings/2026/0571.pdf","markdown":"https://ijcai.org/proceedings/2026/571.md","bibtex":"https://ijcai.org/proceedings/2026/bibtex/571","volume":{"slug":"2026","title":"Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2026","url":"https://ijcai.org/proceedings/2026/","year":2026,"location":"Bremen, Germany","dates":"15-21 August 2026","editors":"Diego Calvanese","isbn":"978-1-956792-09-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2026"},"section":"Machine Learning","track":"Main Track","number":571,"pages":{"first":5128,"last":5136},"keywords":["Machine Learning: Reinforcement learning"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}