A Coarse-to-Fine Fusion Network for Event-Based Image Deblurring
A Coarse-to-Fine Fusion Network for Event-Based Image Deblurring
Huan Li, Hailong Shi, Xingyu Gao
Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence
Main Track. Pages 974-982.
https://doi.org/10.24963/ijcai.2024/108
Event-driven image deblurring is an innovative approach involving the input of events obtained from the event camera alongside blurred frames to facilitate the deblurring process. Unlike conventional cameras, event cameras in event-driven imaging exhibit low-latency characteristics and are immune to motion blur, resulting in significant advancements in image deblurring. In this paper, we propose a pioneering event-based coarse-to-fine image deblurring network named CFFNet. In contrast to existing deblurring methods, our approach incorporates event data, generating multiple coarse frames from a single frame before further refining them into a sharp image. We introduce an Event Image Fusion Block (EIFB) for the coarse fusion of events and images, producing coarse frames at different time points. Additionally, we propose a Bidirectional Frame Fusion Block (BFFB) for the fine fusion of coarse frames. CFFNet effectively harnesses the spatiotemporal information of event data through a comprehensive fusion process from coarse to fine. Experimental results on the GoPro and REBlur datasets demonstrate that our method achieves state-of-the-art performance for image deblurring task.
Keywords:
Computer Vision: CV: Applications