{"type":"ScholarlyArticle","title":"Speech-based Medical Decision Support in VR using a Deep Neural Network (Demonstration)","authors":[{"name":"Alexander Prange","slug":"alexander-prange","given":"Alexander","family":"Prange","affiliation":"German Research Center for Artificial Intelligence , DFKI , Saarbrücken , Germany"},{"name":"Michael Barz","slug":"michael-barz","given":"Michael","family":"Barz","affiliation":"German Research Center for Artificial Intelligence , DFKI , Saarbrücken , Germany"},{"name":"Daniel Sonntag","slug":"daniel-sonntag","given":"Daniel","family":"Sonntag","affiliation":"German Research Center for Artificial Intelligence , DFKI , Saarbrücken , Germany"}],"abstract":"We present a speech dialogue system that facilitates medical decision support for doctors in a virtual reality (VR) application. The therapy prediction is based on a recurrent neural network model that incorporates the examination history of patients. A central supervised patient database provides input to our predictive model and allows us, first, to add new examination reports by a pen-based mobile application on-the-fly, and second, to get therapy prediction results in real-time. This demo includes a visualisation of patient records, radiology image data, and the therapy prediction results in VR.","doi":"10.24963/ijcai.2017/777","url":"https://ijcai.org/proceedings/2017/777","pdf":"https://ijcai.org/proceedings/2017/0777.pdf","markdown":"https://ijcai.org/proceedings/2017/777.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/777","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Demos","track":"Demos","number":777,"pages":{"first":5241,"last":5242},"keywords":["Machine Learning: Deep Learning","Natural Language Processing: Speech","Multidisciplinary Topics and Applications: Intelligent User Interfaces","Natural Language Processing: Dialogue"],"videos":[],"references":[{"position":1,"raw":"[Esteban et al., 2016] C. Esteban, O. Staeck, S. Baier, Y. Yang, and V. Tresp. Predicting clinical events by com- bining static and dynamic information using recurrent neu- ral networks. In 2016 IEEE International Conference on Healthcare Informatics (ICHI), pages 93-101, Oct 2016.","title":"Predicting clinical events by combining static and dynamic information using recurrent neural networks","authors":"C Esteban, O Staeck, S Baier, Y Yang, V Tresp","year":"2016","venue":"IEEE International Conference on Healthcare Informatics (ICHI)","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Luxenburger et al., 2016] Andreas Luxenburger, Alexander Prange, Mohammad Mehdi Moniri, and Daniel Sonntag. Medicalvr: Towards medical remote collaboration using virtual reality. In Proceedings of the 2016 ACM Inter- national Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, UbiComp '16, pages 321-324, New York, NY, USA, 2016. ACM.","title":"Medicalvr: Towards medical remote collaboration using virtual reality","authors":"Andreas Luxenburger, Alexander Prange, Mohammad Mehdi Moniri, Daniel Sonntag","year":"2016","venue":"Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, UbiComp '16","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Neßelrath, 2015] Robert Neßelrath. SiAM-dp : An open development platform for massively multimodal dia- logue systems in cyber-physical environments. PhD the- sis, Universität des Saarlandes, Postfach 151141, 66041 Saarbrücken, December 2015.","title":"SiAM-dp : An open development platform for massively multimodal dialogue systems in cyber-physical environments","authors":"Robert Neßelrath","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Sonntag et al., 2009] Daniel Sonntag, Pinar Wennerberg, Paul Buitelaar, and Sonja Zillner. Pillars of ontology treat- ment in the medical domain. J. Cases on Inf. Techn., 11(4):47-73, 2009.","title":"Pillars of ontology treatment in the medical domain","authors":"Daniel Sonntag, Pinar Wennerberg, Paul Buitelaar, Sonja Zillner","year":"2009","venue":"J. Cases on Inf. Techn","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Sonntag et al., 2012] Daniel Sonntag, Christian Husodo- Schulz, Christian Reuschling, and Luis Galárraga. Rad- speech's mobile dialogue system for radiologists. In 17th International Conference on Intelligent User Interfaces, IUI '12, Lisbon, Portugal, February 14-17, 2012, pages 317-318. ACM, 2012.","title":"Radspeech's mobile dialogue system for radiologists","authors":"Daniel Sonntag, Christian Husodo-Schulz, Christian Reuschling, Luis Galárraga","year":"2012","venue":"17th International Conference on Intelligent User Interfaces, IUI '12","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Sonntag et al., 2014] Daniel Sonntag, Markus Weber, Alexander Cavallaro, and Matthias Hammon. Integrating digital pens in breast imaging for instant knowledge acquisition. AI Magazine, 35(1):26-37, 2014.","title":"Integrating digital pens in breast imaging for instant knowledge acquisition","authors":"Daniel Sonntag, Markus Weber, Alexander Cavallaro, Matthias Hammon","year":"2014","venue":"AI Magazine","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Sonntag et al., 2016] Daniel Sonntag, Volker Tresp, Sonja Zillner, Alexander Cavallaro, Matthias Hammon, André Reis, Peter A. Fasching, Martin Sedlmayr, Thomas Gans- landt, Hans-Ulrich Prokosch, Klemens Budde, Danilo Schmidt, Carl Hinrichs, Thomas Wittenberg, Philipp Daumke, and Patricia G. Oppelt. The clinical data intelli- gence project. Informatik-Spektrum, 39(4):290-300, 2016.","title":"The clinical data intelligence project","authors":"Daniel Sonntag, Sonja Volker Tresp, Alexander Zillner, Matthias Cavallaro, André Hammon, Peter A Reis, Martin Fasching, Thomas Sedlmayr, Hans-Ulrich Ganslandt, Klemens Prokosch, Danilo Budde, Carl Schmidt, Thomas Hinrichs, Philipp Wittenberg, Patricia G Daumke, Oppelt","year":"2016","venue":"Informatik-Spektrum","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}