{"type":"ScholarlyArticle","title":"Generalizing Bayesian Human-AI Collaboration: Theory and Application in Data-Scarce Environments","authors":[{"name":"Peng Liu","slug":"peng-liu","given":"Peng","family":"Liu","affiliation":""},{"name":"Hailong Sun","slug":"hailong-sun","given":"Hailong","family":"Sun","affiliation":""},{"name":"Chung-Piaw Teo","slug":"chung-piaw-teo","given":"Chung-Piaw","family":"Teo","affiliation":""},{"name":"Mabel Chou","slug":"mabel-chou","given":"Mabel","family":"Chou","affiliation":""}],"abstract":"Combining predictions from heterogeneous classifiers—such as in-house deep learning models, human experts, and large language models (LLMs)—is a key challenge, especially in data-scarce environments such as humanitarian operations. We propose a flexible Bayesian framework to effectively fuse these diverse inputs. By integrating classifier logits with auxiliary human feedback (e.g., confidence, image clarity) using an ordered probit process, our model generalizes prior work to accommodate the real-world properties of these classifiers. We validate our framework on a challenging product recognition task in food bank operations, an environment defined by data scarcity and an inexperienced volunteer workforce. Our combined model significantly outperforms standalone ResNet, human, and LLM-based approaches, demonstrating the practical benefits of fusing these heterogeneous signal sources.","doi":"10.24963/ijcai.2026/406","url":"https://ijcai.org/proceedings/2026/406","pdf":"https://ijcai.org/proceedings/2026/0406.pdf","markdown":"https://ijcai.org/proceedings/2026/406.md","bibtex":"https://ijcai.org/proceedings/2026/bibtex/406","volume":{"slug":"2026","title":"Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2026","url":"https://ijcai.org/proceedings/2026/","year":2026,"location":"Bremen, Germany","dates":"15-21 August 2026","editors":"Diego Calvanese","isbn":"978-1-956792-09-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2026"},"section":"Humans and AI","track":"Main Track","number":406,"pages":{"first":3648,"last":3655},"keywords":["AI: Humans and AI","Humans and AI: Human-AI collaboration","Humans and AI: Human-computer interaction","Agent-based and Multi-agent Systems: Human-agent interaction"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}