Demo: Enhancing Wildlife Acoustic Data Annotation Efficiency through Transfer and Active Learning
Demo: Enhancing Wildlife Acoustic Data Annotation Efficiency through Transfer and Active Learning
Hannes Kath, Patricia P. Serafini, Ivan B. Campos, Thiago S. GouvĂȘa, Daniel Sonntag
Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence
Demo Track. Pages 8691-8695.
https://doi.org/10.24963/ijcai.2024/1010
Passive Acoustic Monitoring (PAM) has become a key technology in wildlife monitoring, generating large amounts of acoustic data. However, the effective application of machine learning methods for sound event detection in PAM datasets is highly dependent on the accessibility of annotated data, a process that can be labour intensive. As a team of domain experts and machine learning researchers, in this paper we present a no-code annotation tool designed for PAM datasets that incorporates transfer learning and active learning strategies to address the data annotation challenge inherent in PAM. Transfer learning is applied to use pre-trained models to compute meaningful embeddings from the PAM audio files. Active learning iteratively identifies the most informative samples and then presents them to the user for annotation. This iterative approach improves the performance of the model compared to random sample selection. In a preliminary evaluation of the tool, a domain expert annotated part of a real PAM data set. Compared to conventional tools, the workflow of the proposed tool showed a speed improvement of 2-4 times. Further enhancements, such as the incorporation of sound examples, have the potential to further improve efficiency.
Keywords:
Multidisciplinary Topics and Applications: MDA: Computational sustainability
Machine Learning: ML: Active learning
Machine Learning: ML: Applications
Machine Learning: ML: Classification
Machine Learning: ML: Few-shot learning