{"type":"ScholarlyArticle","title":"From 2D to 3D: AISG-SLA Visual Localization Challenge","authors":[{"name":"Jialin Gao","slug":"jialin-gao","given":"Jialin","family":"Gao","affiliation":"AI Singapore , Singapore"},{"name":"Bill Ong","slug":"bill-ong","given":"Bill","family":"Ong","affiliation":"AI Singapore , Singapore"},{"name":"Darld Lwi","slug":"darld-lwi","given":"Darld","family":"Lwi","affiliation":"Singapore Land Authority , Singapore"},{"name":"Zhen Hao Ng","slug":"zhen-hao-ng","given":"Zhen Hao","family":"Ng","affiliation":"Singapore Land Authority , Singapore"},{"name":"Xun Wei Yee","slug":"xun-wei-yee","given":"Xun Wei","family":"Yee","affiliation":"AI Singapore , Singapore"},{"name":"Mun-Thye Mak","slug":"mun-thye-mak","given":"Mun-Thye","family":"Mak","affiliation":"AI Singapore , Singapore"},{"name":"Wee Siong Ng","slug":"wee-siong-ng","given":"Wee Siong","family":"Ng","affiliation":"Institute for Infocomm Research , Singapore"},{"name":"See-Kiong Ng","slug":"see-kiong-ng","given":"See Kiong","family":"Ng","affiliation":"National Univerity of Singapore , Singapore"},{"name":"Hui Ying Teo","slug":"hui-ying-teo","given":"Hui Ying","family":"Teo","affiliation":"Singapore Land Authority , Singapore"},{"name":"Victor Khoo","slug":"victor-khoo","given":"Victor","family":"Khoo","affiliation":"Singapore Land Authority , Singapore"},{"name":"Georg Bökman","slug":"georg-bokman","given":"Georg","family":"Bökman","affiliation":"Chalmers University of Technology , Sweden"},{"name":"Johan Edstedt","slug":"johan-edstedt","given":"Johan","family":"Edstedt","affiliation":"Linköping University , Sweden"},{"name":"Kirill Brodt","slug":"kirill-brodt","given":"Kirill","family":"Brodt","affiliation":"Université de Montréal , Canada"},{"name":"Clémentin Boittiaux","slug":"clementin-boittiaux","given":"Clémentin","family":"Boittiaux","affiliation":"Ifremer , Centre Méditerranée , France"},{"name":"Maxime Ferrera","slug":"maxime-ferrera","given":"Maxime","family":"Ferrera","affiliation":"Ifremer , Centre Méditerranée , France"},{"name":"Stepan Konev","slug":"stepan-konev","given":"Stepan","family":"Konev","affiliation":"Booking.com , Netherlands"}],"abstract":"Research in 3D mapping is crucial for smart city applications, yet the cost of acquiring 3D data often hinders progress. Visual localization, particularly monocular camera position estimation, offers a solution by determining the camera's pose solely through visual cues. However, this task is challenging due to limited data from a single camera. To tackle these challenges, we organized the AISG–SLA Visual Localization Challenge (VLC) at IJCAI 2023 to explore how AI can accurately extract camera pose data from 2D images in 3D space. The challenge attracted over 300 participants worldwide, forming 50+ teams. Winning teams achieved high accuracy in pose estimation using images from a car-mounted camera with low frame rates. The VLC dataset is available for research purposes upon request via vlc-dataset@aisingapore.org.","doi":"10.24963/ijcai.2024/1003","url":"https://ijcai.org/proceedings/2024/1003","pdf":"https://ijcai.org/proceedings/2024/1003.pdf","markdown":"https://ijcai.org/proceedings/2024/1003.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/1003","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Demo Track","track":"Demo Track","number":1003,"pages":{"first":8661,"last":8664},"keywords":["Computer Vision: CV: Machine learning for vision","Computer Vision: CV: 3D computer vision","Computer Vision: CV: Scene analysis and understanding","Computer Vision: CV: Motion and tracking","Computer Vision: CV: Applications","Computer Vision: CV: Segmentation","Computer Vision: CV: Recognition (object detection, categorization)"],"videos":[],"references":[{"position":1,"raw":"[Barros et al., 2022] Andréa Macario Barros, Maugan Michel, Yoann Moline, Gwenolé Corre, and Frédérick Carrel. A comprehensive survey of visual slam algorithms. Robotics, 11:24, 2022.","title":"A comprehensive survey of visual slam algorithms","authors":"Andréa Macario Barros, Maugan Michel, Yoann Moline, Gwenolé Corre, Frédérick Carrel","year":"2022","venue":"Robotics","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Burri et al., 2016] Michael Burri, Janosch Nikolic, Pascal Gohl, Thomas Schneider, Joern Rehder, Sammy Omari, Markus W Achtelik, and Roland Siegwart. The euroc mi- cro aerial vehicle datasets. The International Journal of Robotics Research, 35(10):1157-1163, 2016.","title":"The euroc micro aerial vehicle datasets","authors":"Michael Burri, Janosch Nikolic, Pascal Gohl, Thomas Schneider, Joern Rehder, Sammy Omari, Markus W Achtelik, Roland Siegwart","year":"2016","venue":"The International Journal of Robotics Research","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Campos et al., 2021] Carlos Campos, Richard Elvira, Juan J Gómez Rodríguez, José MM Montiel, and Juan D Tardós. Orb-slam3: An accurate open-source library for visual, visual-inertial, and multimap slam. IEEE Transac- tions on Robotics, 37(6):1874-1890, 2021.","title":"Orb-slam3: An accurate open-source library for visual, visual-inertial, and multimap slam","authors":"Carlos Campos, Richard Elvira, Juan J Gómez Rodríguez, José Mm Montiel, Juan D Tardós","year":"2021","venue":"IEEE Transactions on Robotics","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Coors et al., 2000] Volker Coors, Tassilo Huch, and Ursula Kretschmer. Matching buildings: Pose estimation in an urban environment. In Proceedings IEEE and ACM Inter- national Symposium on Augmented Reality (ISAR 2000), pages 89-92. IEEE, 2000.","title":"Matching buildings: Pose estimation in an urban environment","authors":"Coors","year":"2000","venue":"Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000)","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Edstedt et al., 2023] Johan Edstedt, Qiyu Sun, Georg Bökman, Mårten Wadenbäck, and Michael Felsberg. Roma: Revisiting robust losses for dense feature match- ing. arXiv preprint arXiv:2305.15404, 2023.","title":"Roma: Revisiting robust losses for dense feature matching","authors":"Johan Edstedt, Qiyu Sun, Georg Bökman, Mårten Wadenbäck, Michael Felsberg","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Edstedt et al., 2024] Johan Edstedt, Georg Bökman, Mårten Wadenbäck, and Michael Felsberg. DeDoDe: Detect, Don't Describe -Describe, Don't Detect for Local Fea- ture Matching. In 2024 International Conference on 3D Vision (3DV). IEEE, 2024.","title":"DeDoDe: Detect, Don't Describe -Describe, Don't Detect for Local Feature Matching","authors":"Edstedt","year":"2024","venue":"International Conference on 3D Vision (3DV)","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Engel et al., 2014] Jakob Engel, Thomas Schöps, and Daniel Cremers. Lsd-slam: Large-scale direct monocular slam. In European conference on computer vision, pages 834-849. Springer, 2014.","title":"Lsd-slam: Large-scale direct monocular slam","authors":"Engel","year":"2014","venue":"European conference on computer vision","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Engel et al., 2017] Jakob Engel, Vladlen Koltun, and Daniel Cremers. Direct sparse odometry. IEEE trans- actions on pattern analysis and machine intelligence, 40(3):611-625, 2017.","title":"Direct sparse odometry","authors":"Engel","year":"2017","venue":"IEEE transactions on pattern analysis and machine intelligence","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Geiger et al., 2013] Andreas Geiger, Philip Lenz, Christoph Stiller, and Raquel Urtasun. Vision meets robotics: The kitti dataset. The International Journal of Robotics Re- search, 32(11):1231-1237, 2013.","title":"Vision meets robotics: The kitti dataset","authors":"Andreas Geiger, Philip Lenz, Christoph Stiller, Raquel Urtasun","year":"2013","venue":"The International Journal of Robotics Research","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[González-Sabbagh and Robles-Kelly, 2023] Salma P González-Sabbagh and Antonio Robles-Kelly. A survey on underwater computer vision. ACM Computing Surveys, 55(13s):1-39, 2023.","title":"A survey on underwater computer vision","authors":"González-Sabbagh, Robles-Kelly ; Salma, P González, - Sabbagh, Antonio Robles-Kelly","year":"2023","venue":"ACM Computing Surveys","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Lindenberger et al., 2023] Philipp Lindenberger, Paul- Edouard Sarlin, and Marc Pollefeys. Lightglue: Local feature matching at light speed. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 17627-17638, 2023.","title":"Lightglue: Local feature matching at light speed","authors":"Philipp Lindenberger, Paul-Edouard Sarlin, Marc Pollefeys","year":"2023","venue":"Proceedings of the IEEE/CVF International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Muja and Lowe, 2009] Marius Muja and David G Lowe. Fast approximate nearest neighbors with automatic algo- rithm configuration. VISAPP (1), 2(331-340):2, 2009.","title":"Fast approximate nearest neighbors with automatic algorithm configuration","authors":"Marius Muja, David G Lowe","year":"2009","venue":"VISAPP","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Mur-Artal et al., 2015] Raul Mur-Artal, Jose Maria Mar- tinez Montiel, and Juan D Tardos. Orb-slam: a versatile and accurate monocular slam system. IEEE transactions on robotics, 31(5):1147-1163, 2015.","title":"Orb-slam: a versatile and accurate monocular slam system","authors":"Mur-Artal","year":"2015","venue":"IEEE transactions on robotics","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Oquab et al., 2023] Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khali- dov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning ro- bust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023.","title":"Dinov2: Learning robust visual features without supervision","authors":"Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Rosinol et al., 2020] Antoni Rosinol, Marcus Abate, Yun Chang, and Luca Carlone. Kimera: an open-source library for real-time metric-semantic localization and mapping. In 2020 IEEE International Conference on Robotics and Au- tomation (ICRA), pages 1689-1696. IEEE, 2020.","title":"Kimera: an open-source library for real-time metric-semantic localization and mapping","authors":"Antoni Rosinol, Marcus Abate, Yun Chang, Luca Carlone","year":"2020","venue":"2020 IEEE International Conference on Robotics and Automation (ICRA)","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Sandler et al., 2018] Mark Sandler, Andrew Howard, Men- glong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4510-4520, 2018.","title":"Mobilenetv2: Inverted residuals and linear bottlenecks","authors":"Mark Sandler, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, Liang-Chieh Chen","year":"2018","venue":"Proceedings of the IEEE conference on computer vision and pattern recognition","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Schönberger and Frahm, 2016] Johannes L Schönberger and Jan-Michael Frahm. Structure-from-motion revisited. In Proceedings of the 2016 IEEE Conference on Com- puter Vision and Pattern Recognition (CVPR 2016), pages 4104-4113. IEEE, 2016.","title":"Structure-from-motion revisited","authors":"Frahm ; Schönberger, L Johannes, Jan-Michael Schönberger, Frahm","year":"2016","venue":"Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016)","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Schönberger et al., 2016] Johannes L Schönberger, Enliang Zheng, Jan-Michael Frahm, and Marc Pollefeys. Pixel- wise view selection for unstructured multi-view stereo. In Computer Vision-ECCV 2016: 14th European Confer- ence, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part III 14, pages 501-518. Springer, 2016.","title":"Pixelwise view selection for unstructured multi-view stereo","authors":"Enliang Johannes L Schönberger, Jan-Michael Zheng, Marc Frahm, Pollefeys","year":"2016","venue":"Computer Vision-ECCV 2016: 14th European Conference","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Wang et al., 2020] Wenshan Wang, Delong Zhu, Xiangwei Wang, Yaoyu Hu, Yuheng Qiu, Chen Wang, Yafei Hu, Ashish Kapoor, and Sebastian Scherer. Tartanair: A dataset to push the limits of visual slam. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Sys- tems (IROS), pages 4909-4916. IEEE, 2020.","title":"Tartanair: A dataset to push the limits of visual slam","authors":"Wang","year":"2020","venue":"IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Zhou et al., 2018] Huizhong Zhou, Benjamin Ummenhofer, and Thomas Brox. Deeptam: Deep tracking and mapping. In Proceedings of the European conference on computer vision (ECCV), pages 822-838, 2018.","title":"Deeptam: Deep tracking and mapping","authors":"Huizhong Zhou, Benjamin Ummenhofer, Thomas Brox","year":"2018","venue":"Proceedings of the European conference on computer vision (ECCV)","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Zubizarreta et al., 2020] Jon Zubizarreta, Iker Aguinaga, and Jose Maria Martinez Montiel. Direct sparse mapping. IEEE Transactions on Robotics, 36(4):1363-1370, 2020.","title":"Direct sparse mapping","authors":"Zubizarreta","year":"2020","venue":"IEEE Transactions on Robotics","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}