Proceedings

Sensitivity Direction Learning with Neural Networks Using Domain Knowledge as Soft Shape Constraints

Kazuyuki Wakasugi

Download BibTeX Cite

Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence. Main Track. Pages 3067-3074.

https://doi.org/10.24963/ijcai.2021/422

Keywords

  • Constraints and SAT: Constraints and Data Mining; Constraints and Machine Learning
  • Machine Learning: Explainable/Interpretable Machine Learning

Abstract

If domain knowledge can be integrated as an appropriate constraint, it is highly possible that the generalization performance of a neural network model can be improved. We propose Sensitivity Direction Learning (SDL) for learning about the neural network model with user-specified relationships (e.g., monotonicity, convexity) between each input feature and the output of the model by imposing soft shape constraints which represent domain knowledge. To impose soft shape constraints, SDL uses a novel penalty function, Sensitivity Direction Error (SDE) function, which returns the squared error between coefficients of the approximation curve for each Individual Conditional Expectation plot and coefficient constraints which represent domain knowledge. The effectiveness of our concept was verified by simple experiments. Similar to those such as L2 regularization and dropout, SDL and SDE can be used without changing neural network architecture. We believe our algorithm can be a strong candidate for neural network users who want to incorporate domain knowledge.

Kazuyuki Wakasugi. 2021. Sensitivity Direction Learning with Neural Networks Using Domain Knowledge as Soft Shape Constraints. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21. IJCAI, 3067–3074. https://doi.org/10.24963/ijcai.2021/422
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards