{"type":"ScholarlyArticle","title":"Daytime Sleepiness Level Prediction Using Respiratory Information","authors":[{"name":"Kazuhiko Shinoda","slug":"kazuhiko-shinoda","given":"Kazuhiko","family":"Shinoda","affiliation":"Frontier Research Center , Toyota Motor Corporation {kazuhiko shinoda , masahiko yoshii ,"},{"name":"Masahiko Yoshii","slug":"masahiko-yoshii","given":"Masahiko","family":"Yoshii","affiliation":"Frontier Research Center , Toyota Motor Corporation {kazuhiko shinoda , masahiko yoshii ,"},{"name":"Hayato Yamaguchi","slug":"hayato-yamaguchi","given":"Hayato","family":"Yamaguchi","affiliation":"Frontier Research Center , Toyota Motor Corporation {kazuhiko shinoda , masahiko yoshii ,"},{"name":"Hirotaka Kaji","slug":"hirotaka-kaji","given":"Hirotaka","family":"Kaji","affiliation":"Frontier Research Center , Toyota Motor Corporation {kazuhiko shinoda , masahiko yoshii ,"}],"abstract":"Daytime sleepiness is not only the cause of productivity decline and accidents, but also an important metric of health risks. Despite its importance, the long-term quantitative analysis of sleepiness in daily living has hardly been done due to time and effort required for the continuous tracking of sleepiness. Although a number of sleepiness detection technologies have been proposed, most of them focused only on driver’s drowsiness. In this paper, we present the first step towards the continuous sleepiness tracking in daily living situations. We explore a methodology for predicting subjective sleepiness levels utilizing respiration and acceleration data obtained from a novel wearable sensor. A class imbalance handling technique and hidden Markov model are combined with supervised classifiers to overcome the difficulties in learning from an imbalanced and time series dataset. We evaluate the performance of our models through a comprehensive experiment.","doi":"10.24963/ijcai.2019/827","url":"https://ijcai.org/proceedings/2019/827","pdf":"https://ijcai.org/proceedings/2019/0827.pdf","markdown":"https://ijcai.org/proceedings/2019/827.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/827","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"AI for Improving Human Well-being","track":"AI for Improving Human Well-being","number":827,"pages":{"first":5967,"last":5974},"keywords":["Special Track on AI for Improving Human-Well Being: AI applications for Improving Human-Well Being (Special Track on AI and Human Wellbeing)","Special Track on AI for Improving Human-Well Being: Health applications (Special Track on AI and Human Wellbeing)"],"videos":[],"references":[{"position":1,"raw":"[Åkerstedt and Gillberg, 1990] Torbjörn Åkerstedt and Mats Gillberg. Subjective and objective sleepiness in the active individual. International Journal of Neuroscience, 52 1- 2:29-37, 1990.","title":"Torbjörn Åkerstedt and Mats Gillberg. Subjective and objective sleepiness in the active individual","authors":"Gillberg Åkerstedt","year":"1990","venue":"International Journal of Neuroscience","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Åkerstedt et al., 2005] Torbjörn Åkerstedt, Björn Peters, Anna Anund, and Göran Kecklund. Impaired alertness and performance driving home from the night shift: a driving simulator study. Journal of Sleep Research, 14(1):17-20, 2005.","title":"Impaired alertness and performance driving home from the night shift: a driving simulator study","authors":"Torbjörn Åkerstedt, Björn Peters, Anna Anund, Göran Kecklund","year":"2005","venue":"Journal of Sleep Research","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Åkerstedt et al., 2014] Torbjörn Åkerstedt, Anna Anund, John Axelsson, and Göran Kecklund. Subjective sleepi- ness is a sensitive indicator of insufficient sleep and im- paired waking function. Journal of Sleep Research, 23(3):242-254, 2014.","title":"Subjective sleepiness is a sensitive indicator of insufficient sleep and impaired waking function","authors":"Torbjörn Åkerstedt, Anna Anund, John Axelsson, Göran Kecklund","year":"2014","venue":"Journal of Sleep Research","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bao and Intille, 2004] Ling Bao and Stephen S. Intille. Ac- tivity recognition from user-annotated acceleration data. In International conference on pervasive computing, pages 1-17. Springer, 2004.","title":"Activity recognition from user-annotated acceleration data","authors":"Ling Bao, Stephen S Intille","year":"2004","venue":"International conference on pervasive computing","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Breiman, 2001] Leo Breiman. Random forests. Machine Learning, 45(1):5-32, Oct 2001.","title":"Leo Breiman. Random forests","authors":"Breiman","year":"2001","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Chang et al., 2003] Edward Y. Chang, Beitao Li, Gang Wu, and Kingshy Goh. Statistical learning for effective visual information retrieval. In ICIP 2003, volume 3, pages III- 609, Sept 2003.","title":"Statistical learning for effective visual information retrieval","authors":"Edward Y Chang, Beitao Li, Gang Wu, Kingshy Goh","year":"2003","venue":"ICIP 2003","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Chawla et al., 2002] Nitesh V. Chawla, Kevin W. Bowyer, Lawrence O. Hall, and W. Philip Kegelmeyer. Smote: Syn- thetic minority over-sampling technique. Journal of Arti- ficial Intelligence Research, 16(1):321-357, June 2002.","title":"Smote: Synthetic minority over-sampling technique","authors":"V Nitesh, Kevin W Chawla, Lawrence O Bowyer, W Philip Hall, Kegelmeyer","year":"2002","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Galar et al., 2012] Mikel Galar, Alberto Fernandez, Edurne Barrenechea, Humberto Bustince, and Francisco Herrera. A review on ensembles for the class imbalance problem: Bagging-, boosting-, and hybrid-based approaches. IEEE Transactions on Systems, Man, and Cybernetics, Part C, 42(4):463-484, July 2012.","title":"A review on ensembles for the class imbalance problem: Bagging-, boosting-, and hybrid-based approaches","authors":"Mikel Galar, Alberto Fernandez, Edurne Barrenechea, Humberto Bustince, Francisco Herrera","year":"2012","venue":"IEEE Transactions on Systems, Man, and Cybernetics, Part C","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Hachisuka et al., 2011] Satori Hachisuka, Kenji Ishida, Takeshi Enya, and Masayoshi Kamijo. Facial expres- sion measurement for detecting driver drowsiness. In Don Harris, editor, Engineering Psychology and Cognitive Er- gonomics, pages 135-144, 2011.","title":"Facial expression measurement for detecting driver drowsiness","authors":"Satori Hachisuka, Kenji Ishida, Takeshi Enya, Masayoshi Kamijo","year":"2011","venue":"Engineering Psychology and Cognitive Ergonomics","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Hafner et al., 2016] Marco Hafner, Martin Stepanek, Jirka Taylor, Wendy M. Troxel, and Christian Van Stolk. Why sleep matters -the economic costs of insufficient sleep: A cross-country comparative analysis. Research report, RAND Corporation, Santa Monica, CA, 2016.","title":"Why sleep matters -the economic costs of insufficient sleep: A cross-country comparative analysis","authors":"Hafner","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Häkkänen et al., 1999] Helinä Häkkänen, Heikki Summala, Markku Partinen, Mikko Tiihonen, and Jouni Silvo. Blink duration as an indicator of driver sleepiness in professional bus drivers. Sleep, 22(6):798-802, 1999.","title":"Blink duration as an indicator of driver sleepiness in professional bus drivers","authors":"Häkkänen","year":"1999","venue":"Sleep","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Han and Wang, 2014] Kun Han and DeLiang Wang. Neural networks for supervised pitch tracking in noise. In ICASSP 2014, pages 1488-1492, May 2014.","title":"Neural networks for supervised pitch tracking in noise","authors":"Wang ; ] Kun Han, Deliang Han, Wang","year":"2014","venue":"ICASSP 2014","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Hido and Kashima, 2008] Shohei Hido and Hisashi Kashima. Roughly balanced bagging for imbalanced data. In SDM08, pages 143-152, 2008.","title":"Roughly balanced bagging for imbalanced data","authors":"Kashima ; ] Shohei Hido, Hisashi Hido, Kashima","year":"2008","venue":"SDM","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Hillman et al., 2018] David Hillman, Scott Mitchell, Jared Streatfeild, Chloe Burns, Dorothy Bruck, and Lynne Pez- zullo. The economic cost of inadequate sleep. Sleep, 41(8):zsy083, 2018.","title":"The economic cost of inadequate sleep","authors":"David Hillman, Scott Mitchell, Jared Streatfeild, Chloe Burns, Dorothy Bruck, Lynne Pezzullo","year":"2018","venue":"Sleep","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Hoddes et al., 1973] E. Hoddes, Vincent Zarcone, Hugh Smythe, Roger Phillips, and William C. Dement. Quantifi- cation of sleepiness: A new approach. Psychophysiology, 10(4):431-436, 1973.","title":"Quantification of sleepiness: A new approach","authors":"E Hoddes, Vincent Zarcone, Hugh Smythe, Roger Phillips, William C Dement","year":"1973","venue":"Psychophysiology","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Horne and Reyner, 1999] Jim Horne and Louise Reyner. Vehicle accidents related to sleep: a review. Occupational and environmental medicine, 56(5):289-294, 1999.","title":"Vehicle accidents related to sleep: a review","authors":"Reyner Horne, Jim Horne, Louise Reyner","year":"1999","venue":"Occupational and environmental medicine","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Igasaki et al., 2016] Tomohiko Igasaki, Kazuki Nagasawa, Izzat Aulia Akbar, and Nao Kubo. Sleepiness classifica- tion by thoracic respiration using support vector machine. In BMEiCON 2016, pages 1-5, Dec 2016.","title":"Sleepiness classification by thoracic respiration using support vector machine","authors":"Tomohiko Igasaki, Kazuki Nagasawa, Izzat Aulia Akbar, Nao Kubo","year":"2016","venue":"BMEiCON","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Johns, 1991] Murray W. Johns. A new method for mea- suring daytime sleepiness: the epworth sleepiness scale. Sleep, 14(6):540-545, 1991.","title":"A new method for measuring daytime sleepiness: the epworth sleepiness scale","authors":"Murray W Johns","year":"1991","venue":"Sleep","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Kaida et al., 2006] Kosuke Kaida, Masaya Takahashi, Torbjörn Åkerstedt, Akinori Nakata, Yasumasa Otsuka, Takashi Haratani, and Kenji Fukasawa. Validation of the Karolinska sleepiness scale against performance and EEG variables. Clinical Neurophysiology, 117(7):1574 -1581, 2006.","title":"Validation of the Karolinska sleepiness scale against performance and EEG variables","authors":"Kosuke Kaida, Masaya Takahashi, Torbjörn Åkerstedt, Akinori Nakata, Yasumasa Otsuka, Takashi Haratani, Kenji Fukasawa","year":"2006","venue":"Clinical Neurophysiology","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Kaji et al., 2018] Hirotaka Kaji, Hayato Yamaguchi, Kazuhide Shigeto, and Hirokazu Kikuchi. Wearable respiration sensor platform using ultrasound transducer. In Adjunct Proceedings of ACM Ubicomp/ISWC, 2018.","title":"Wearable respiration sensor platform using ultrasound transducer","authors":"Hirotaka Kaji, Hayato Yamaguchi, Kazuhide Shigeto, Hirokazu Kikuchi","year":"2018","venue":"Adjunct Proceedings of ACM Ubicomp/ISWC","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Khoshgoftaar et al., 2011] Taghi M. Khoshgoftaar, Jason Van Hulse, and Amri Napolitano. Comparing boosting and bagging techniques with noisy and imbalanced data. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 41(3):552-568, May 2011.","title":"Comparing boosting and bagging techniques with noisy and imbalanced data","authors":"M Taghi, Jason Khoshgoftaar, Amri Van Hulse, Napolitano","year":"2011","venue":"IEEE Transactions on Systems, Man, and Cybernetics, Part A","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Lee et al., 2016] Boon-Leng Lee, Boon-Giin Lee, and Wan- Young Chung. Standalone wearable driver drowsiness de- tection system in a smartwatch. IEEE Sensors Journal, 16(13):5444-5451, July 2016.","title":"Standalone wearable driver drowsiness detection system in a smartwatch","authors":"Boon-Leng Lee, Boon-Giin Lee, Wan-Young Chung","year":"2016","venue":"IEEE Sensors Journal","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Monk, 1989] Timothy H. Monk. A visual analogue scale technique to measure global vigor and affect. Psychiatry research, 27:89-99, Feb 1989.","title":"A visual analogue scale technique to measure global vigor and affect","authors":"Timothy H Monk","year":"1989","venue":"Psychiatry research","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Plarre et al., 2011] Kurt Plarre, Andrew Raij, Syed Monowar Hossain, Amin Ahsan Ali, Motohiro Nakajima, Mustafa Al'absi, Emre Ertin, Thomas Ka- marck, Santosh Kumar, Marcia Scott, Daniel Siewiorek, Asim Smailagic, and Lorentz E. Wittmers. Continuous inference of psychological stress from sensory measure- ments collected in the natural environment. In IPSN 2011, pages 97-108, Apr 2011.","title":"Continuous inference of psychological stress from sensory measurements collected in the natural environment","authors":"Kurt Plarre, Andrew Raij, Syed Monowar Hossain, Ahsan Amin, Motohiro Ali, Mustafa Nakajima, Emre Al'absi, Thomas Ertin, Santosh Kamarck, Marcia Kumar, Daniel Scott, Asim Siewiorek, Lorentz E Smailagic, Wittmers","year":"2011","venue":"IPSN 2011","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Platt, 2000] John Platt. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In Alexander J. Smola, Peter Bartlett, Bernhard Schöelkopf, and Dale Schuurmans, editors, Advances in Large Margin Classifiers, pages 61-74. MIT Press, June 2000.","title":"Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods","authors":"John Platt","year":"2000","venue":"Advances in Large Margin Classifiers","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Pressman and Fry, 1989] Mark R. Pressman and June M. Fry. Relationship of autonomic nervous system activity to daytime sleepiness and prior sleep. Sleep, 12(3):239-45, July 1989.","title":"Relationship of autonomic nervous system activity to daytime sleepiness and prior sleep","authors":"Mark R Pressman, June M Fry","year":"1989","venue":"Sleep","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Rabiner, 1989] Lawrence R. Rabiner. A tutorial on hidden markov models and selected applications in speech recog- nition. Proceedings of the IEEE, 77(2):257-286, 1989.","title":"A tutorial on hidden markov models and selected applications in speech recognition","authors":"Lawrence R Rabiner","year":"1989","venue":"Proceedings of the IEEE","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Richard et al., 2018] Alexander Richard, Hilde Kuehne, Ahsan Iqbal, and Juergen Gall. Neuralnetwork-viterbi: A framework for weakly supervised video learning. In CVPR, 2018.","title":"Neuralnetwork-viterbi: A framework for weakly supervised video learning","authors":"Alexander Richard, Hilde Kuehne, Ahsan Iqbal, Juergen Gall","year":"2018","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Robertson et al., 2012] David Robertson, Italo Biaggioni, Geoffrey Burnstock, Phillip A. Low, and Julian F. R. Pa- ton, editors. Primer on the Autonomic Nervous System, Third Edition. Elsevier, 2012.","title":"Primer on the Autonomic Nervous System","authors":"David Robertson, Italo Biaggioni, Geoffrey Burnstock, Phillip A Low, Julian F R Paton","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Saeys et al., 2008] Yvan Saeys, Thomas Abeel, and Yves Van de Peer. Robust feature selection using ensemble feature selection techniques. In Walter Daelemans, Bart Goethals, and Katharina Morik, editors, Machine Learn- ing and Knowledge Discovery in Databases, pages 313- 325, Berlin, Heidelberg, 2008. Springer.","title":"Robust feature selection using ensemble feature selection techniques","authors":"Yvan Saeys, Thomas Abeel, Yves Van De Peer","year":"2008","venue":"Machine Learning and Knowledge Discovery in Databases","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Sforza et al., 2002] E. Sforza, S. Grandin, Christophe Jouny, T. Rochat, and V. Ibanez. Is waking electroen- cephalographic activity a predictor of daytime sleepiness in sleep-related breathing disorders? European Respira- tory Journal, 19(4):645-652, 2002.","title":"Is waking electroencephalographic activity a predictor of daytime sleepiness in sleep-related breathing disorders?","authors":"E Sforza, S Grandin, Christophe Jouny, T Rochat, V Ibanez","year":"2002","venue":"European Respiratory Journal","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Shimura et al., 2018] Akiyoshi Shimura, Hideo Sakai, Yoshikazu Takaesu, Ryota Nomura, Yoko Komada, and Takeshi Inoue. Comprehensive assessment of the im- pact of life habits on sleep disturbance, chronotype, and daytime sleepiness among high-school students. Sleep Medicine, 44:12 -18, 2018.","title":"Comprehensive assessment of the impact of life habits on sleep disturbance, chronotype, and daytime sleepiness among high-school students","authors":"Akiyoshi Shimura, Hideo Sakai, Yoshikazu Takaesu, Ryota Nomura, Yoko Komada, Takeshi Inoue","year":"2018","venue":"Sleep Medicine","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Tataraidze et al., 2015] Alexander Tataraidze, Lesya An- ishchenko, Lyudmila Korostovtseva, Bert Jan Kooij, Mikhail Bochkarev, and Yurii Sviryaev. Sleep stage classi- fication based on respiratory signal. In EMBC 2015, pages 358-361, Aug 2015.","title":"Sleep stage classification based on respiratory signal","authors":"Alexander Tataraidze, Lesya Anishchenko, Lyudmila Korostovtseva, Bert, Jan Kooij, Mikhail Bochkarev, Yurii Sviryaev","year":"2015","venue":"EMBC 2015","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Vapnik, 1998] Vladimir N. Vapnik. Statistical Learning Theory. Wiley-Interscience, 1998.","title":"Statistical Learning Theory","authors":"Vladimir N Vapnik","year":"1998","venue":null,"doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Vicente et al., 2016] José Vicente, Pablo Laguna, Ariadna Bartra, and Raquel Bailón. Drowsiness detection using heart rate variability. Medical & Biological Engineering & Computing, 54:927-937, 2016.","title":"José Vicente, Pablo Laguna, Ariadna Bartra, and Raquel Bailón. Drowsiness detection using heart rate variability","authors":"Vicente","year":"2016","venue":"Medical & Biological Engineering & Computing","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Yuan et al., 2013] George Yuan, Nicole A. Drost, and R. Andrew McIvor. Respiratory rate and breathing pat- tern. McMaster University Medical Journal, 10(1):23-28, 2013.","title":"Respiratory rate and breathing pattern","authors":"George Yuan, Nicole A Drost, R Andrew Mcivor","year":"2013","venue":"McMaster University Medical Journal","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Zhou, 2017] Zhi-Hua Zhou. A brief introduction to weakly supervised learning. National Science Review, 5(1):44-53, 2017.","title":"A brief introduction to weakly supervised learning","authors":"Zhi-Hua Zhou","year":"2017","venue":"National Science Review","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}