{"type":"ScholarlyArticle","title":"Raise One and Infer Three: Toward Reasoning- and Memory-Augmented Diffusion Policy Generalization","authors":[{"name":"Yihang Zhu","slug":"yihang-zhu","given":"Yihang","family":"Zhu","affiliation":""},{"name":"Yuxuan Wang","slug":"yuxuan-wang","given":"Yuxuan","family":"Wang","affiliation":""},{"name":"Tong Li","slug":"tong-li","given":"Tong","family":"Li","affiliation":""},{"name":"Jiexi Yan","slug":"jiexi-yan","given":"Jiexi","family":"Yan","affiliation":""},{"name":"Xu Yang","slug":"xu-yang","given":"Xu","family":"Yang","affiliation":""},{"name":"Cheng Deng","slug":"cheng-deng","given":"Cheng","family":"Deng","affiliation":""}],"abstract":"Diffusion policy has shown impressive performance in robotic manipulation tasks while struggling with out-of-distribution shifts and limited demonstrations. Recent advances primarily focus on improving geometric or perceptual representations for diffusion policy.  However, these approaches rely heavily on instantaneous observations, making them vulnerable when visual inputs deviate from the training distribution. Our key insight is that robust generalization in diffusion policy requires both structured reasoning over skill compositions and an explicit memory mechanism for accumulating and reusing learned policy knowledge.  To this end, we propose \"raise one and infer three\" diffusion policy (ROITDP), a novel approach that introduces two complementary mechanisms. First, we propose a reasoning mechanism built upon the Chain-of-Skill Noise Watermark, which encodes skill-level reasoning graph representations into the initial noise space, thereby enabling temporally coherent multi-step reasoning throughout the diffusion process under distribution shifts. We further introduce a memory mechanism in the form of a Self-evolving Policy Knowledge Bank that discretizes spatio-temporally refined trajectories into reusable skill primitives via a VQ-VAE architecture, providing adaptive memory to guide and refine action generation. Extensive experimental results on both simulated and real-world environments demonstrate the superiority and robustness of our method.","doi":"10.24963/ijcai.2026/241","url":"https://ijcai.org/proceedings/2026/241","pdf":"https://ijcai.org/proceedings/2026/0241.pdf","markdown":"https://ijcai.org/proceedings/2026/241.md","bibtex":"https://ijcai.org/proceedings/2026/bibtex/241","volume":{"slug":"2026","title":"Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2026","url":"https://ijcai.org/proceedings/2026/","year":2026,"location":"Bremen, Germany","dates":"15-21 August 2026","editors":"Diego Calvanese","isbn":"978-1-956792-09-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2026"},"section":"Computer Vision","track":"Main Track","number":241,"pages":{"first":2163,"last":2171},"keywords":["Computer Vision: Multimodal learning","Robotics: Manipulation"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}