{"type":"ScholarlyArticle","title":"Multi-Sensor Mobile Platform for the Recognition of Activities of Daily Living and their Environments based on Artificial Neural Networks","authors":[{"name":"Ivan Miguel Pires","slug":"ivan-miguel-pires","given":"Ivan Miguel","family":"Pires","affiliation":""},{"name":"Nuno Pombo","slug":"nuno-pombo","given":"Nuno","family":"Pombo","affiliation":""},{"name":"Nuno M. Garcia","slug":"nuno-m-garcia","given":"Nuno M.","family":"Garcia","affiliation":""},{"name":"Francisco Flórez-Revuelta","slug":"francisco-florez-revuelta","given":"Francisco","family":"Flórez-Revuelta","affiliation":""}],"abstract":"The recognition of Activities of Daily Living (ADL) and their environments based on sensors available in off-the-shelf mobile devices is an emerging topic. These devices are capable to acquire and process the sensors' data for the correct recognition of the ADL and their environments, providing a fast and reliable feedback to the user. However, the methods implemented in a mobile application for this purpose should be adapted to the low resources of these devices. This paper focuses on the demonstration of a mobile application that implements a framework, that forks their implementation in several modules, including data acquisition, data processing, data fusion and classification methods based on the sensors? data acquired from the accelerometer, gyroscope, magnetometer, microphone and Global Positioning System (GPS) receiver. The framework presented is a function of the number of sensors available in the mobile devices and implements the classification with Deep Neural Networks (DNN) that reports an accuracy between 58.02% and 89.15%.","doi":"10.24963/ijcai.2018/859","url":"https://ijcai.org/proceedings/2018/859","pdf":"https://ijcai.org/proceedings/2018/0859.pdf","markdown":"https://ijcai.org/proceedings/2018/859.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/859","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Demos","track":"Demos","number":859,"pages":{"first":5850,"last":5852},"keywords":["Multidisciplinary Topics and Applications: Human-Computer Interaction","Planning and Scheduling: Activity and Plan Recognition","Multidisciplinary Topics and Applications: Computational Biology and e-Health","Multidisciplinary Topics and Applications: AI and Ubiquitous Computing Systems"],"videos":[],"references":[{"position":1,"raw":"[Foti et al., 2013] Diane Foti and Jean S. Koketsu, \"Activi- ties of daily living,\" Pedretti's Occupational Therapy: Practical Skills for Physical Dysfunction, vol. 7, pp. 157- 232, 2013","title":"Activities of daily living","authors":"Diane Foti, Jean S Koketsu","year":"2013","venue":"Pedretti's Occupational Therapy: Practical Skills for Physical Dysfunction","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Salazar et al., 2013] Luiz Henrique A. Salazar, Thaísa Lac- erda, Juliane Vargas Nunes, and Christiane Gresse von Wangenheim, \"A Systematic Literature Review on Usa- bility Heuristics for Mobile Phones,\" International Jour- nal of Mobile Human Computer Interaction, vol. 5, pp. 50-61, 2013. doi: 10.4018/jmhci.2013040103","title":"A Systematic Literature Review on Usability Heuristics for Mobile Phones","authors":"Luiz Henrique, A Salazar, Thaísa Lacerda, Juliane Vargas Nunes, Christiane Gresse Von Wangenheim","year":"2013","venue":"International Journal of Mobile Human Computer Interaction","doi":"10.4018/jmhci.2013040103","url":null,"internal_url":null},{"position":3,"raw":"[Pires et al., 2016a] Ivan Miguel Pires, Nuno M. Garcia, Nuno Pombo, and Francisco Flórez-Revuelta, \"From Data Acquisition to Data Fusion: A Comprehensive Re- view and a Roadmap for the Identification of Activities of Daily Living Using Mobile Devices,\" Sensors, vol. 16, p. 184, 2016 [","title":"From Data Acquisition to Data Fusion: A Comprehensive Review and a Roadmap for the Identification of Activities of Daily Living Using Mobile Devices","authors":"Pires","year":"2016","venue":"Sensors","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Pires et al., 2015] Ivan Miguel Pires, Nuno M. Garcia and Francisco Flórez-Revuelta, \"Multi-sensor data fusion techniques for the identification of activities of daily liv- ing using mobile devices,\" in Proceedings of the ECMLPKDD 2015 Doctoral Consortium, European Con- ference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Porto, Portugal, 2015.","title":"Multi-sensor data fusion techniques for the identification of activities of daily living using mobile devices","authors":"Ivan Miguel Pires, Nuno M Garcia, Francisco Flórez-Revuelta","year":"2015","venue":"Proceedings of the ECMLPKDD 2015 Doctoral Consortium, European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Pires et al., 2016b] Ivan Miguel Pires, Nuno M. Garcia, Nuno Pombo, and Francisco Flórez-Revuelta, \"Identifica- tion of Activities of Daily Living Using Sensors Availa- ble in off-the-shelf Mobile Devices: Research and Hy- pothesis,\" in Ambient Intelligence-Software and Applica- tions-7th International Symposium on Ambient Intelli- gence (ISAmI 2016), 2016, pp. 121-130.","title":"Identification of Activities of Daily Living Using Sensors Available in off-the-shelf Mobile Devices: Research and Hypothesis","authors":"Pires","year":"2016","venue":"Ambient Intelligence-Software and Applications-7th International Symposium on Ambient Intelligence (ISAmI 2016)","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Garcia, 2016] Nuno M. Garcia, \"A Roadmap to the Design of a Personal Digital Life Coach,\" in ICT Innovations 2015, ed: Springer, 2016.","title":"A Roadmap to the Design of a Personal Digital Life Coach","authors":"M Nuno, Garcia","year":"2016","venue":"ICT Innovations 2015","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Garcia et al., 2014] N. M. Garcia, J. J. P. C. Rodrigues, D. C. Elias, and M. S. Dias, Ambient Assisted Living: Taylor & Francis, 2014 [Pires et al., 2017a] Ivan Miguel Pires, Nuno M. Garcia, Nuno Pombo, and Francisco Flórez-Revuelta, \"User En- vironment Detection with Acoustic Sensors Embedded on Mobile Devices for the Recognition of Activities of Daily Living,\" ed: arXiv:1711.00124, 2017 (In Review).","title":"Ambient Assisted Living: Taylor & Francis","authors":"N M Garcia, J J P C Rodrigues, D C Elias, M S Dias ; Pires","year":"2014","venue":"User Environment Detection with Acoustic Sensors Embedded on Mobile Devices for the Recognition of Activities of Daily Living","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Pires et al., 2017b] Ivan Miguel Pires, Nuno M. Garcia, Nuno Pombo, and Francisco Flórez-Revuelta, \"A Multi- ple Source Framework for the Identification of Activities of Daily Living Based on Mobile Device Data,\" ed: arXiv:1711.00104, 2017 (In Review).","title":"A Multiple Source Framework for the Identification of Activities of Daily Living Based on Mobile Device Data","authors":"Pires","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Pires et al., 2017c] Ivan Miguel Pires, Nuno M. Garcia, Nuno Pombo, Francisco Flórez-Revuelta and Susanna Spinsante, \"Pattern Recognition Techniques for the Iden- tification of Activities of Daily Living using Mobile De- vice Accelerometer,\" ed: arXiv:1711.00096, 2017 (In Re- view).","title":"Pattern Recognition Techniques for the Identification of Activities of Daily Living using Mobile Device Accelerometer","authors":"Pires","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Pires et al., 2018] Ivan Miguel Pires, Nuno M. Garcia, Nuno Pombo, Francisco Flórez-Revuelta and Susanna Spinsante, \" 5. Identification of Activities of Daily Liv- ing through Data Fusion on Motion and Magnetic Sensors embedded on Mobile Devices,\" Pervasive and Mobile Computing, 2018 (In Press).","title":"5. Identification of Activities of Daily Living through Data Fusion on Motion and Magnetic Sensors embedded on Mobile Devices","authors":"Ivan Miguel Pires, Nuno M Garcia, Nuno Pombo, Francisco Flórez-Revuelta, Susanna Spinsante","year":"2018","venue":"Pervasive and Mobile Computing","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[ALLab, 2017] ALLab. (2017, September 2nd). August 2017-Multi-sensor data fusion in mobile devices for the identification of activities of daily living -ALLab Signals. Available: https://allab.di.ubi.pt/mediawiki/in- dex.php/August_2017-_Multi-sensor_data_fu- sion_in_mobile_devices_for_the_identification_of_ac- tivities_of_daily_living","title":"August 2017-Multi-sensor data fusion in mobile devices for the identification of activities of daily living -ALLab Signals","authors":"Allab","year":"2017","venue":null,"doi":null,"url":"https://allab.di.ubi.pt/mediawiki/in-dex.php/August_2017-_Multi-sensor_data_fu-sion_in_mobile_devices_for_the_identification_of_ac-tivities_of_daily_living","internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}