{"type":"ScholarlyArticle","title":"Confidence Based Dual Reinforcement Q-Routing: An adaptive online network routing algorithm","authors":[{"name":"Shailesh Kumar","slug":"shailesh-kumar","given":"Shailesh","family":"Kumar","affiliation":""},{"name":"Risto Miikkulainen","slug":"risto-miikkulainen","given":"Risto","family":"Miikkulainen","affiliation":""}],"abstract":"This paper describes and evaluates the Confidence-based Dual Reinforcement Q-Routing algorithm (CDRQ-Routing) for adaptive packet routing in communication networks. CDRQ-Routing is based on the Qlearning framework of Q-Routing. The main contribution of this work is the increased quantity and improved quality of exploration in CDRQ-Routing, which lead to faster adaptation and better routing policies learned as compared to Q-Routing, the state-of-the-art adaptive Bellman-Ford Routing, and the nonadaptive shortest path routing. Experiments over several network topologies have shown that at different loads, CDRQ-Routing learns superior policies significantly faster than QRouting. Moreover, CDRQ-Routing learns policies that sustain higher load levels than QRouting. Analysis shows that overhead due to exploration is insignificant as cqmpared to the improvements in CDRQ-Routing.","doi":null,"url":"https://ijcai.org/proceedings/1999/108","pdf":"https://ijcai.org/proceedings/1999/0108.pdf","markdown":"https://ijcai.org/proceedings/1999/108.md","bibtex":"https://ijcai.org/proceedings/1999/bibtex/108","volume":{"slug":"1999","title":"Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 1999","url":"https://ijcai.org/proceedings/1999/","year":1999,"location":"Stockholm, Sweden","dates":"","editors":"Thomas Dean","isbn":"","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":"Machine Learning","track":"Machine Learning","number":108,"pages":{"first":758,"last":762},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}