{"type":"ScholarlyArticle","title":"Self-Supervised Learning with Attention-based Latent Signal Augmentation for Sleep Staging with Limited Labeled Data","authors":[{"name":"Harim Lee","slug":"harim-lee","given":"Harim","family":"Lee","affiliation":"Department of Artificial Intelligence , Hanyang University , Seoul , South Korea"},{"name":"Eunseon Seong","slug":"eunseon-seong","given":"Eunseon","family":"Seong","affiliation":"Department of Artificial Intelligence , Hanyang University , Seoul , South Korea"},{"name":"Dong-Kyu Chae","slug":"dong-kyu-chae","given":"Dong-Kyu","family":"Chae","affiliation":"Department of Artificial Intelligence , Hanyang University , Seoul , South Korea"}],"abstract":"Sleep staging is an important task that enables sleep quality assessment and disorder diagnosis. Due to dependency on manually labeled data, many researches have turned from supervised approaches to self-supervised learning (SSL) for sleep staging. While existing SSL methods have made significant progress in terms of its comparable performance to supervised methods, there are still some limitations. Contrastive learning could potentially lead to false negative pair assignments in sleep signal data. Moreover, existing data augmentation techniques directly modify the original signal data, making it likely to lose important information. To mitigate these issues, we propose Self-Supervised Learning with Attention-aided Positive Pairs (SSLAPP). Instead of the contrastive learning, SSLAPP carefully draws high-quality positive pairs and exploits them in representation learning. Here, we propose attention-based latent signal augmentation, which plays a key role by capturing important features without losing valuable signal information. Experimental results show that our proposed method achieves state-of-the-art performance in sleep stage classification with limited labeled data. The code is available at: https://github.com/DILAB-HYU/SSLAPP","doi":"10.24963/ijcai.2022/537","url":"https://ijcai.org/proceedings/2022/537","pdf":"https://ijcai.org/proceedings/2022/0537.pdf","markdown":"https://ijcai.org/proceedings/2022/537.md","bibtex":"https://ijcai.org/proceedings/2022/bibtex/537","volume":{"slug":"2022","title":"Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2022","url":"https://ijcai.org/proceedings/2022/","year":2022,"location":"Vienna","dates":"23-29 July 2022","editors":"Luc De Raedt","isbn":"978-1-956792-00-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2022"},"section":"Multidisciplinary Topics and Applications","track":"Main Track","number":537,"pages":{"first":3868,"last":3876},"keywords":["Multidisciplinary Topics and Applications: Bioinformatics","Machine Learning: Self-supervised Learning","Data Mining: Mining Data Streams","Multidisciplinary Topics and Applications: Health and Medicine"],"videos":[{"label":"Video #1","url":"https://slideslive.com/38987073","length_sec":77,"provider":"slideslive"},{"label":"Video #2","url":"https://slideslive.com/38985216","length_sec":658,"provider":"slideslive"}],"references":[{"position":1,"raw":"[Banville et al., 2021] Hubert Banville et al. Uncovering the structure of clinical eeg signals with self-supervised learn- ing. Journal of Neural Engineering, 18(4):046020, 2021.","title":"Uncovering the structure of clinical eeg signals with self-supervised learning","authors":"Banville","year":"2021","venue":"Journal of Neural Engineering","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Berry et al., 2012] Richard B Berry et al. The aasm manual for the scoring of sleep and associated events. Rules, Ter- minology and Technical Specifications, Darien, Illinois, American Academy of Sleep Medicine, 176:2012, 2012.","title":"The aasm manual for the scoring of sleep and associated events. Rules, Terminology and Technical Specifications","authors":"B Richard, Berry","year":"2012","venue":"American Academy of Sleep Medicine","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chen and He, 2021] Xinlei Chen and Kaiming He. Explor- ing simple siamese representation learning. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15750-15758, 2021.","title":"Exploring simple siamese representation learning","authors":"Chen, He ;, Xinlei Chen, Kaiming He","year":"2021","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Eldele et al., 2021a] Emadeldeen Eldele et al. An attention- based deep learning approach for sleep stage classifica- tion with single-channel eeg. IEEE Transactions on Neu- ral Systems and Rehabilitation Engineering, 29:809-818, 2021.","title":"Emadeldeen Eldele et al. An attentionbased deep learning approach for sleep stage classification with single-channel eeg","authors":"Eldele","year":"2021","venue":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Eldele et al., 2021b] Emadeldeen Eldele et al. Time-series representation learning via temporal and contextual con- trasting. arXiv:2106.14112, 2021.","title":"Emadeldeen Eldele et al. Time-series representation learning via temporal and contextual contrasting","authors":"Eldele","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Franceschi et al., 2019] Jean-Yves Franceschi, Aymeric Dieuleveut, and Martin Jaggi. Unsupervised scalable representation learning for multivariate time series. arXiv:1901.10738, 2019.","title":"Unsupervised scalable representation learning for multivariate time series","authors":"Franceschi","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Gao et al., 2021] Tianyu Gao, Xingcheng Yao, and Danqi Chen. Simcse: Simple contrastive learning of sentence em- beddings. arXiv:2104.08821, 2021.","title":"Simcse: Simple contrastive learning of sentence embeddings","authors":"Tianyu Gao, Xingcheng Yao, Danqi Chen","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Goldberger et al., 2000] Ary L Goldberger et al. Phys- iobank, physiotoolkit, and physionet: components of a new research resource for complex physiologic signals. circu- lation, 101(23):e215-e220, 2000.","title":"Physiobank, physiotoolkit, and physionet: components of a new research resource for complex physiologic signals","authors":"L Ary, Goldberger","year":"2000","venue":"circulation","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Han et al., 2019] Tengda Han, Weidi Xie, and Andrew Zis- serman. Video representation learning by dense predic- tive coding. In Proceedings of the IEEE/CVF Interna- tional Conference on Computer Vision Workshops, pages 0-0, 2019.","title":"Video representation learning by dense predictive coding","authors":"Han","year":"2019","venue":"Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[He et al., 2020] Kaiming He et al. Momentum contrast for unsupervised visual representation learning. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9729-9738, 2020.","title":"Kaiming He et al. Momentum contrast for unsupervised visual representation learning","authors":"He","year":"2020","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Hearst et al., 1998] Marti A. Hearst et al. Support vector machines. IEEE Intelligent Systems and their applications, 13(4):18-28, 1998.","title":"Support vector machines","authors":"Marti A Hearst","year":"1998","venue":"IEEE Intelligent Systems and their applications","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hedner et al., 2011] Jan Hedner et al. Sleep staging based on autonomic signals: a multi-center validation study. Journal of clinical sleep medicine, 2011.","title":"Sleep staging based on autonomic signals: a multi-center validation study","authors":"Hedner","year":"2011","venue":"Journal of clinical sleep medicine","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Huang et al., 2014] Chih-Sheng Huang et al. Knowledge- based identification of sleep stages based on two fore- head electroencephalogram channels. Frontiers in neuro- science, 8:263, 2014.","title":"Knowledgebased identification of sleep stages based on two forehead electroencephalogram channels","authors":"Huang","year":"2014","venue":"Frontiers in neuroscience","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Jia et al., 2021] Ziyu Jia et al. Salientsleepnet: Multi- modal salient wave detection network for sleep staging. arXiv:2105.13864, 2021.","title":"Salientsleepnet: Multimodal salient wave detection network for sleep staging","authors":"Jia","year":"2021","venue":null,"doi":null,"url":null,"internal_url":"/proceedings/2021/360"},{"position":15,"raw":"[Jiang et al., 2019] Dihong Jiang, Ya-nan Lu, MA Yu, and WANG Yuanyuan. Robust sleep stage classification with single-channel eeg signals using multimodal decomposi- tion and hmm-based refinement. Expert Systems with Ap- plications, 121:188-203, 2019.","title":"Robust sleep stage classification with single-channel eeg signals using multimodal decomposition and hmm-based refinement","authors":"Jiang","year":"2019","venue":"Expert Systems with Applications","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Jiang et al., 2021] Xue Jiang et al. Self-supervised con- trastive learning for eeg-based sleep staging. In 2021 Inter- national Joint Conference on Neural Networks (IJCNN), pages 1-8. IEEE, 2021.","title":"Self-supervised contrastive learning for eeg-based sleep staging","authors":"Xue Jiang","year":"2021","venue":"2021 International Joint Conference on Neural Networks (IJCNN)","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Khalighi et al., 2016] Sirvan Khalighi et al. Isruc-sleep: A comprehensive public dataset for sleep researchers. Com- puter methods and programs in biomedicine, 124:180- 192, 2016.","title":"Sirvan Khalighi et al. Isruc-sleep: A comprehensive public dataset for sleep researchers","authors":"Khalighi","year":"2016","venue":"Computer methods and programs in biomedicine","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Lajnef et al., 2015] Tarek Lajnef et al. Learning machines and sleeping brains: automatic sleep stage classification using decision-tree multi-class support vector machines. Journal of neuroscience methods, 250:94-105, 2015.","title":"Learning machines and sleeping brains: automatic sleep stage classification using decision-tree multi-class support vector machines","authors":"Lajnef","year":"2015","venue":"Journal of neuroscience methods","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Malafeev et al., 2018] Alexander Malafeev, Dmitry Laptev, Stefan Bauer, Ximena Omlin, Aleksandra Wierzbicka, Adam Wichniak, Wojciech Jernajczyk, Robert Riener, Joachim Buhmann, and Peter Achermann. Automatic hu- man sleep stage scoring using deep neural networks. Fron- tiers in neuroscience, page 781, 2018.","title":"Automatic human sleep stage scoring using deep neural networks","authors":"Alexander Malafeev, Dmitry Laptev, Stefan Bauer, Ximena Omlin, Aleksandra Wierzbicka, Adam Wichniak, Wojciech Jernajczyk, Robert Riener, Joachim Buhmann, Peter Achermann","year":"2018","venue":"Frontiers in neuroscience","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Mousavi et al., 2019] Sajad Mousavi, Fatemeh Afghah, and U Rajendra Acharya. Sleepeegnet: Automated sleep stage scoring with sequence to sequence deep learning ap- proach. PloS one, 14(5):e0216456, 2019.","title":"Sleepeegnet: Automated sleep stage scoring with sequence to sequence deep learning approach","authors":"Sajad Mousavi, Fatemeh Afghah, U Rajendra, Acharya","year":"2019","venue":"PloS one","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Ojha et al., 2019] Utkarsh Ojha et al. Elastic-infogan: Un- supervised disentangled representation learning in class- imbalanced data. arXiv:1910.01112, 2019.","title":"Elastic-infogan: Unsupervised disentangled representation learning in classimbalanced data","authors":"Utkarsh Ojha","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Oord et al., 2018] Aaron van den Oord, Yazhe Li, and Oriol Vinyals. Representation learning with contrastive predic- tive coding. arXiv:1807.03748, 2018.","title":"Representation learning with contrastive predictive coding","authors":"Aaron Van Den Oord, Yazhe Li, Oriol Vinyals","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Perez-Pozuelo et al., 2020] Ignaci Perez-Pozuelo et al. The future of sleep health: a data-driven revolution in sleep sci- ence and medicine. NPJ digital medicine, 3(1):1-15, 2020.","title":"Ignaci Perez-Pozuelo et al. The future of sleep health: a data-driven revolution in sleep science and medicine","authors":"Perez-Pozuelo","year":"2020","venue":"NPJ digital medicine","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Phan et al., 2019] Huy Phan et al. Seqsleepnet: end-to- end hierarchical recurrent neural network for sequence- to-sequence automatic sleep staging. IEEE Transac- tions on Neural Systems and Rehabilitation Engineering, 27(3):400-410, 2019.","title":"Seqsleepnet: end-toend hierarchical recurrent neural network for sequenceto-sequence automatic sleep staging","authors":"Huy Phan","year":"2019","venue":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Sateia, 2014] Michael J Sateia. International classification of sleep disorders. Chest, 146(5):1387-1394, 2014.","title":"International classification of sleep disorders","authors":"J Michael, Sateia","year":"2014","venue":"Chest","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Supratak et al., 2017] Akara Supratak et al. Deepsleepnet: A model for automatic sleep stage scoring based on raw single-channel eeg. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25(11):1998-2008, 2017.","title":"Akara Supratak et al. Deepsleepnet: A model for automatic sleep stage scoring based on raw single-channel eeg","authors":"Supratak","year":"2017","venue":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Um et al., 2017] Terry T Um et al. Data augmentation of wearable sensor data for parkinson's disease monitoring using convolutional neural networks. In Proceedings of the 19th ACM International Conference on Multimodal Inter- action, pages 216-220, 2017.","title":"Data augmentation of wearable sensor data for parkinson's disease monitoring using convolutional neural networks","authors":"Terry T Um","year":"2017","venue":"Proceedings of the 19th ACM International Conference on Multimodal Interaction","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Wolpert, 1969] Edward A Wolpert. A manual of standard- ized terminology, techniques and scoring system for sleep stages of human subjects. Archives of General Psychiatry, 20(2):246-247, 1969.","title":"A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects","authors":"A Edward, Wolpert","year":"1969","venue":"Archives of General Psychiatry","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Xiao et al., 2021] Qinfeng Xiao et al. Self-supervised learn- ing for sleep stage classification with predictive and dis- criminative contrastive coding. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1290-1294. IEEE, 2021.","title":"Qinfeng Xiao et al. Self-supervised learning for sleep stage classification with predictive and discriminative contrastive coding","authors":"Xiao","year":"2021","venue":"ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Ye et al., 2021] Jianan Ye et al. Cosleep: A multi-view rep- resentation learning framework for self-supervised learn- ing of sleep stage classification. IEEE Signal Processing Letters, 2021.","title":"Cosleep: A multi-view representation learning framework for self-supervised learning of sleep stage classification","authors":"Jianan Ye","year":"2021","venue":"IEEE Signal Processing Letters","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}