Proceedings

SMaRT: Online Reusable Resource Assignment and an Application to Mediation in the Kenyan Judiciary

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. AI and Social Good. Pages 7138-7146.

https://doi.org/10.24963/ijcai.2026/794

© 2026 International Joint Conferences on Artificial Intelligence

Abstract

Motivated by the problem of assigning mediators to cases in the Kenyan judicial system, we study an online resource allocation problem where incoming tasks (cases) must be immediately assigned to available, capacity-constrained resources (mediators). The resources differ in their quality, which may need to be learned. In addition, resources can only be assigned to a subset of tasks that overlaps to varying degrees with the subset of tasks other resources can be assigned to. The objective is to maximize task completion while satisfying soft capacity constraints across all the resources. The scale of the real-world problem poses substantial challenges, since there are over 2000 mediators, and a multitude of combinations of geographic locations (87) and case types (12) that each mediator is qualified to work on. Together, these features—unknown quality of new resources (newly onboarded mediators), soft capacity constraints (due to the mandate to assign cases without delay), and high-dimensional state space—make existing scheduling and resource allocation algorithms either inapplicable or inefficient. We formalize the problem in a tractable manner, using a quadratic program formulation for assignment and a multi-agent bandit style framework for learning. We demonstrate the key properties and advantages of our new algorithm, SMaRT (Selecting Mediators that are Right for the Task), compared with baselines on some stylized instances of the mediator allocation problem. We then turn to considering its application to real-world data on cases and mediators from the Kenyan Judiciary. SMaRT outperforms baselines and allows for controlling the tradeoff between the strictness of the capacity constraints and overall case resolution rates, both in situations where mediator quality is known beforehand and when the problem is bandit-like in that learning is part of the problem definition. On the strength of these results, we plan to conduct a randomized controlled trial in which we deploy SMaRT in the Judiciary's mediation management system.

  1. [Agrawal and Devanur, 2014] Shipra Agrawal and Nikhil R. Devanur. Bandits with Concave Rewards and Convex Knap- sacks. In Proceedings of the Fifteenth ACM Conference on Economics and Computation, EC '14, page 989-1006, New York, NY, USA, 2014. Association for Computing Machinery.
  2. [Badanidiyuru et al., 2018] Ashwinkumar Badanidiyuru, Robert Kleinberg, and Aleksandrs Slivkins. Bandits with Knapsacks. J. ACM, 65(3), March 2018.
  3. [Bernasconi et al., 2024] Martino Bernasconi, Matteo Cas- tiglioni, Andrea Celli, and Federico Fusco. Bandits with Replenishable Knapsacks: the Best of both Worlds. In The Twelfth International Conference on Learning Representa- tions, ICLR 2024, Vienna, Austria, May 7-11, 2024.
  4. [Boehmer et al., 2025] Niclas Boehmer, Yunfan Zhao, Guo- jun Xiong, Paula Rodriguez-Diaz, Paola Del Cueto Cibrian, Joseph Ngonzi, Adeline Boatin, and Milind Tambe. Op- timizing Vital Sign Monitoring in Resource-Constrained Maternal Care: An RL-Based Restless Bandit Approach. In Proceedings of the AAAI Conference on Artificial Intelli- gence, volume 39 of AAAI'25, pages 28843-28849. AAAI Press, 2025.
  5. [Bouneffouf et al., 2020] Djallel Bouneffouf, Irina Rish, and Charu Aggarwal. Survey on Applications of Multi-Armed and Contextual Bandits. In 2020 IEEE Congress on Evolu- tionary Computation (CEC), page 1-8. IEEE Press, 2020.
  6. [Cavalcante et al., 2013] Victor F. Cavalcante, Carlos H. Car- donha, and Ricardo G. Herrmann. A Resource Constrained page 359-376, New York, NY, USA, 2014. Association for Computing Machinery.
  7. [Ippoliti and Tria, 2020] R. Ippoliti and G. Tria. Efficiency of Judicial Systems: Model Definition and Output Estimation. Journal of Applied Economics, 23(1):385-408, 2020.
  8. [Kane and Staiger, 2008] Thomas J Kane and Douglas O Staiger. Estimating Teacher Impacts on Student Achieve- ment: An Experimental Evaluation. Working Paper 14607, National Bureau of Economic Research, December 2008.
  9. [Kapopoulos and Rizos, 2024] Panayotis Kapopoulos and Anastasios Rizos. Judicial Efficiency and Economic Growth: Evidence based on European Union data. Scottish Journal of Political Economy, 71(1):101-131, 2024.
  10. [Li et al., 2019] Zhuoshu Li, Kelsey Lieberman, William Macke, Sofia Carrillo, Chien-Ju Ho, Jason Wellen, and Sanmay Das. Incorporating Compatible Pairs in Kidney Exchange: A Dynamic Weighted Matching Model. In Pro- ceedings of the 2019 ACM Conference on Economics and Computation, EC '19, page 349-367, New York, NY, USA, 2019. Association for Computing Machinery.
  11. [Liang et al., 2025a] Biyonka Liang, Lily Xu, Aparna Taneja, Milind Tambe, and Lucas Janson. Context in Public Health for Underserved Communities: A Bayesian Approach to Online Restless Bandits. In Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence, volume 39 of AAAI'25, page 28195-28203. AAAI Press, 2025.
  12. [Liang et al., 2025b] Jun Liang, Zongjia Zhang, and Yanpeng Zhi. Multi-Armed Bandit Approaches for Location Plan- ning with Dynamic Relief Supplies Allocation Under Dis- aster Uncertainty. Smart Cities, 8(1), 2025.
  13. [Liu and Chen, 2017] Yang Liu and Yiling Chen. Sequential Peer Prediction: Learning to Elicit Effort using Posted Prices. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, volume 31 of AAAI'17, page 607-613. AAAI Press, 2017.
  14. [Martin and Johnson, 2020] David M Martin and Fred A Johnson. A Multiarmed Bandit Approach to Adaptive Wa- ter Quality Management. Integrated Environmental Assess- ment and Management, 16(6):841-852, 2020.
  15. [Mate et al., 2020] Aditya Mate, Jackson A. Killian, Haifeng Xu, Andrew Perrault, and Milind Tambe. Collapsing Ban- dits and Their Application to Public Health Interventions. In Proceedings of the 34th International Conference on Neural Information Processing Systems, NIPS '20, Red Hook, NY, USA, 2020.
  16. Curran Associates Inc. [Mate et al., 2021]
  17. Aditya Mate, Andrew Perrault, and Milind Tambe. Risk-Aware Interventions in Public Health: Planning with Restless Multi-Armed Bandits. In Pro- ceedings of the 20th International Conference on Au- tonomous Agents and MultiAgent Systems, AAMAS '21, page 880-888, Richland, SC, 2021. International Founda- tion for Autonomous Agents and Multiagent Systems.
  18. [Mate et al., 2022] Aditya Mate, Lovish Madaan, Aparna Taneja, Neha Madhiwalla, Shresth Verma, Gargi Singh, Aparna Hegde, Pradeep Varakantham, and Milind Tambe. Field Study in Deploying Restless Multi-Armed Bandits: Assisting Non-profits in Improving Maternal and Child Health. In Proceedings of the AAAI Conference on Artifi- cial Intelligence, volume 36, pages 12017-12025, 2022.
  19. [Odhiambo, 2016] Oginga Jared Odhiambo. Technical Effi- ciency of the Kenyan Judiciary: A Case of the Magistrates' Courts. Master's thesis, University of Nairobi, 2016.
  20. [Puterman, 1994] Martin L. Puterman. Markov Decision Pro- cesses: Discrete Stochastic Dynamic Programming. Wiley Series in Probability and Statistics. Wiley, 1994.
  21. [Rangi and Franceschetti, 2018] Anshuka Rangi and Mas- simo Franceschetti. Multi-Armed Bandit Algorithms for Crowdsourcing Systems with Online Estimation of Work- ers' Ability. In Proceedings of the 17th International Con- ference on Autonomous Agents and MultiAgent Systems, AAMAS '18, page 1345-1352, Richland, SC, 2018. Inter- national Foundation for Autonomous Agents and Multia- gent Systems.
  22. [Ron et al., 2021] Tom Ron, Omer Ben-Porat, and Uri Shalit. Corporate Social Responsibility via Multi-Armed Bandits. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT '21, page 26-40, New York, NY, USA, 2021. Association for Computing Machinery.
  23. [Slivkins, 2019] Aleksandrs Slivkins. Introduction to Multi- Armed Bandits. Foundations and Trends in Machine Learn- ing, 12(1-2):1-286, November 2019.
  24. [Tran-Thanh et al., 2014] Long Tran-Thanh, Sebastian Stein, Alex Rogers, and Nicholas R Jennings. Efficient Crowd- sourcing of Unknown Experts Using Bounded Multi- Armed Bandits. Artificial Intelligence, 214:89-111, 2014.
  25. [Verma et al., 2023] Shresth Verma, Aditya Mate, Kai Wang, Neha Madhiwalla, Aparna Hegde, Aparna Taneja, and Milind Tambe. Restless Multi-Armed Bandits for Maternal and Child Health: Results from Decision-Focused Learn- ing. In Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems, AAMAS '23, page 1312-1320, Richland, SC, 2023. International Foundation for Autonomous Agents and Multiagent Sys- tems.
  26. [Wang et al., 2023] Kai Wang, Shresth Verma, Aditya Mate, Sanket Shah, Aparna Taneja, Neha Madhiwalla, Aparna Hegde, and Milind Tambe. Scalable Decision-Focused Learning in Restless Multi-Armed Bandits with Appli- cation to Maternal and Child Health. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 37, pages 12138-12146, 2023.
  27. [Xu et al., 2020] Huanle Xu, Yang Liu, Wing Cheong Lau, Tiantong Zeng, Jun Guo, and Alex X. Liu. Online resource allocation with machine variability: A bandit perspective. IEEE/ACM Transactions on Networking, 28(5):2243-2256, 2020.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards