Reinforcement Learning Framework for Deep Brain Stimulation Study

Dmitrii Krylov, Remi Tachet des Combes, Romain Laroche, Michael Rosenblum, Dmitry V. Dylov

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence

Main track. Pages 2847-2854.

https://doi.org/10.24963/ijcai.2020/394

PDF BibTeX Video

Abstract

Malfunctioning neurons in the brain sometimes operate synchronously, reportedly causing many neurological diseases, e.g. Parkinson’s. Suppression and control of this collective synchronous activity are therefore of great importance for neuroscience, and can only rely on limited engineering trials due to the need to experiment with live human brains. We present the first Reinforcement Learning (RL) gym framework that emulates this collective behavior of neurons and allows us to find suppression parameters for the environment of synthetic degenerate models of neurons. We successfully suppress synchrony via RL for three pathological signaling regimes, characterize the framework’s stability to noise, and further remove the unwanted oscillations by engaging multiple PPO agents.

Keywords

  • Machine Learning: Reinforcement Learning
  • Multidisciplinary Topics and Applications: Biology and Medicine
  • Machine Learning Applications: Applications of Reinforcement Learning
Welcome Future Conferences AI Journal Division IJCAI Proceedings Travel Grant Program IJCAI Awards