{"type":"ScholarlyArticle","title":"Scene Text Detection in Video by Learning Locally and Globally","authors":[{"name":"Shu Tian","slug":"shu-tian","given":"Shu","family":"Tian","affiliation":""},{"name":"Wei-Yi Pei","slug":"wei-yi-pei","given":"Wei-Yi","family":"Pei","affiliation":""},{"name":"Ze-Yu Zuo","slug":"ze-yu-zuo","given":"Ze-Yu","family":"Zuo","affiliation":""},{"name":"Xu-Cheng Yin","slug":"xu-cheng-yin","given":"Xu-Cheng","family":"Yin","affiliation":""}],"abstract":"There are a variety of grand challenges for text extraction in scene videos by robots and users, e.g., heterogeneous background, varied text, nonuniform illumination, arbitrary motion and poor contrast. Most previous video text detection methods are investigated with local information, i.e., within individual frames, with limited performance. In this paper, we propose a unified tracking based text detection system by learning locally and globally, which uniformly integrates detection, tracking, recognition and their interactions. In this system, scene text is first detected locally in individual frames. Second, an optimal tracking trajectory is learned and linked globally with all detection, recognition and prediction information by dynamic programming. With the tracking trajectory, final detection and tracking results are simultaneously and immediately obtained. Moreover, our proposed techniques are extensively evaluated on several public scene video text databases, and are much better than the state-of-the-art methods.","doi":null,"url":"https://ijcai.org/proceedings/2016/376","pdf":"https://ijcai.org/proceedings/2016/0376.pdf","markdown":"https://ijcai.org/proceedings/2016/376.md","bibtex":"https://ijcai.org/proceedings/2016/bibtex/376","volume":{"slug":"2016","title":"Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2016","url":"https://ijcai.org/proceedings/2016/","year":2016,"location":"New York, NY, USA","dates":"9–15 July 2016","editors":"Subbarao Kambhampati","isbn":"978-1-57735-770-4; 978-1-57735-771-1","publisher":"AAAI Press / International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":376,"pages":{"first":2647,"last":2652},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}