{"type":"ScholarlyArticle","title":"iFakeDetector: Real Time Integrated Web-based Deepfake Detection System","authors":[{"name":"Kangjun Lee","slug":"kangjun-lee","given":"Kangjun","family":"Lee","affiliation":"Department of Computer Science & Engineering , Sungkyunkwan University , Suwon , South Korea"},{"name":"Inho Jung","slug":"inho-jung","given":"Inho","family":"Jung","affiliation":"Department of Computer Science & Engineering , Sungkyunkwan University , Suwon , South Korea"},{"name":"Simon S. Woo","slug":"simon-s-woo","given":"Simon S.","family":"Woo","affiliation":"Department of Computer Science & Engineering , Sungkyunkwan University , Suwon , South Korea; FakeDetector Inc , Seoul , South Korea"}],"abstract":"Recently, deepfake detection research has been actively conducted. While many deepfake detectors have been proposed, validating the practicality of such systems against real world settings has not been explored much. Indeed, there are some gaps and disparities when they are applied in the real world. In this work, we developed a real time integrated web-based deepfake detection system, iFakeDetector, which incorporates the recent high performing deepfake detectors, and enables easy access for non-expert users to evaluate deepfake videos. Our system takes a deepfake video as input, allowing users to upload videos and select different detectors, and provides detection results on whether the uploaded video is a deepfake or not. Also, we provide an analysis tool that enables the video to be analyzed on a frame-by-frame basis with the probability of each frame being manipulated. Finally, we tested and deployed iFakeDetector in a real world scenario to verify its practicality and feasibility.","doi":"10.24963/ijcai.2024/1016","url":"https://ijcai.org/proceedings/2024/1016","pdf":"https://ijcai.org/proceedings/2024/1016.pdf","markdown":"https://ijcai.org/proceedings/2024/1016.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/1016","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Demo Track","track":"Demo Track","number":1016,"pages":{"first":8717,"last":8720},"keywords":["AI Ethics, Trust, Fairness: ETF: Ethical, legal and societal issues","Humans and AI: HAI: Applications","Computer Vision: CV: Machine learning for vision","Humans and AI: HAI: Human-computer interaction","AI Ethics, Trust, Fairness: ETF: Societal impact of AI","Computer Vision: CV: Applications"],"videos":[],"references":[{"position":1,"raw":"[Cho et al., 2023] Beomsang Cho, Binh M Le, Jiwon Kim, Simon Woo, Shahroz Tariq, Alsharif Abuadbba, and Kris- ten Moore. Towards understanding of deepfake videos in the wild. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, pages 4530-4537, 2023.","title":"Towards understanding of deepfake videos in the wild","authors":"Cho","year":"2023","venue":"Proceedings of the 32nd ACM International Conference on Information and Knowledge Management","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Chollet, 2017] Franc ¸ois Chollet. Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1251-1258, 2017.","title":"Franc ¸ois Chollet. Xception: Deep learning with depthwise separable convolutions","authors":"Chollet","year":"2017","venue":"Proceedings of the IEEE conference on computer vision and pattern recognition","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[ele, 2024] The national election commission. https://www. nec.go.kr/site/avt/main.do, 2024. Accessed: 2024-02-10.","title":"The national election commission","authors":"Ele","year":"2024","venue":null,"doi":null,"url":"https://www.nec.go.kr/site/avt/main.do,2024","internal_url":null},{"position":4,"raw":"[King, 2009] Davis E King. Dlib-ml: A machine learn- ing toolkit. The Journal of Machine Learning Research, 10:1755-1758, 2009.","title":"Dlib-ml: A machine learning toolkit","authors":"E Davis, King","year":"2009","venue":"The Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Le and Woo, 2021] Binh M Le and Simon S Woo. Add: Fre- quency attention and multi-view based knowledge distil- lation to detect low-quality compressed deepfake images. arXiv preprint arXiv:2112.03553, 2021.","title":"Add: Frequency attention and multi-view based knowledge distillation to detect low-quality compressed deepfake images","authors":"M Binh, Simon S Le, Woo","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Le and Woo, 2023] Binh M Le and Simon S Woo. Quality- agnostic deepfake detection with intra-model collabora- tive learning. In Proceedings of the IEEE/CVF Inter- national Conference on Computer Vision, pages 22378- 22389, 2023.","title":"Qualityagnostic deepfake detection with intra-model collaborative learning","authors":"M Binh, Simon S Le, Woo","year":"2023","venue":"Proceedings of the IEEE/CVF International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Lee et al., 2022] Sangyup Lee, Jaeju An, and Simon S Woo. Bznet: Unsupervised multi-scale branch zooming network for detecting low-quality deepfake videos. In Proceed- ings of the ACM Web Conference 2022, pages 3500-3510, 2022.","title":"Bznet: Unsupervised multi-scale branch zooming network for detecting low-quality deepfake videos","authors":"Lee","year":"2022","venue":"Proceedings of the ACM Web Conference 2022","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Misirlis and Munawar, 2023] Nikolaos Misirlis and Har- ris Bin Munawar. From deepfake to deep useful: risks and opportunities through a systematic literature review. arXiv preprint arXiv:2311.15809, 2023.","title":"Nikolaos Misirlis and Harris Bin Munawar. From deepfake to deep useful: risks and opportunities through a systematic literature review","authors":"Munawar Misirlis","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Rossler et al., 2019] Andreas Rossler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, and Matthias Nießner. Faceforensics++: Learning to de- tect manipulated facial images. In Proceedings of the IEEE/CVF international conference on computer vision, pages 1-11, 2019.","title":"Faceforensics++: Learning to detect manipulated facial images","authors":"Andreas Rossler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, Matthias Nießner","year":"2019","venue":"Proceedings of the IEEE/CVF international conference on computer vision","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Tariq et al., 2021] Shahroz Tariq, Sangyup Lee, and Simon Woo. One detector to rule them all: Towards a general deepfake attack detection framework. In Proceedings of the web conference 2021, pages 3625-3637, 2021.","title":"One detector to rule them all: Towards a general deepfake attack detection framework","authors":"Tariq","year":"2021","venue":"Proceedings of the web conference 2021","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}