---
title: "Measuring Statistical Dependence via the Mutual Information Dimension"
authors:
  - "Mahito Sugiyama"
  - "Karsten M. Borgwardt"
doi: ""
url: "https://ijcai.org/proceedings/2013/251"
pdf: "https://ijcai.org/proceedings/2013/0251.pdf"
venue: "Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence"
year: 2013
pages: "1692-1697"
track: ""
keywords:
---

# Measuring Statistical Dependence via the Mutual Information Dimension

Mahito Sugiyama, Karsten M. Borgwardt

*Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence*, pages 1692-1697.

## Abstract

We propose to measure statistical dependence between two random variables by the mutual information dimension (MID), and present a scalable parameter-free estimation method for this task. Supported by sound dimension theory, our method gives an effective solution to the problem of detecting interesting relationships of variables in massive data, which is nowadays a heavily studied topic in many scientific disciplines. Different from classical Pearson's correlation coefficient, MID is zero if and only if two random variables are statistically independent and is translation and scaling invariant. We experimentally show superior performance of MID in detecting various types of relationships in the presence of noise data. Moreover, we illustrate that MID can be effectively used for feature selection in regression.