Proceedings

PIANO: A Parametric Hand Bone Model from Magnetic Resonance Imaging

Yuwei Li, Minye Wu, Yuyao Zhang, Lan Xu, Jingyi Yu

Download BibTeX Cite

Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence. Main Track. Pages 816-822.

https://doi.org/10.24963/ijcai.2021/113

Keywords

  • Computer Vision: Biomedical Image Understanding
  • Computer Vision: Recognition: Detection, Categorization, Indexing, Matching, Retrieval, Semantic Interpretation
  • Computer Vision: Statistical Methods and Machine Learning

Abstract

Hand modeling is critical for immersive VR/AR, action understanding, or human healthcare. Existing parametric models account only for hand shape, pose, or texture, without modeling the anatomical attributes like bone, which is essential for realistic hand biomechanics analysis. In this paper, we present PIANO, the first parametric bone model of human hands from MRI data. Our PIANO model is biologically correct, simple to animate, and differentiable, achieving more anatomically precise modeling of the inner hand kinematic structure in a data-driven manner than the traditional hand models based on the outer surface only. Furthermore, our PIANO model can be applied in neural network layers to enable training with a fine-grained semantic loss, which opens up the new task of data-driven fine-grained hand bone anatomic and semantic understanding from MRI or even RGB images. We make our model publicly available.

Yuwei Li, Minye Wu, Yuyao Zhang, Lan Xu, and Jingyi Yu. 2021. PIANO: A Parametric Hand Bone Model from Magnetic Resonance Imaging. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21. IJCAI, 816–822. https://doi.org/10.24963/ijcai.2021/113
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards