---
title: "Is Nonparametric Learning Practical in Very High Dimensional Spaces?"
authors:
  - "Gregory Z. Grudic"
  - "Peter D. Lawrence"
doi: ""
url: "https://ijcai.org/proceedings/1997/116"
pdf: "https://ijcai.org/proceedings/1997/0116.pdf"
venue: "Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence"
year: 1997
pages: "804-808"
track: "Learning"
keywords:
---

# Is Nonparametric Learning Practical in Very High Dimensional Spaces?

Gregory Z. Grudic, Peter D. Lawrence

*Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence*, pages 804-808.

## Abstract

Many of the challenges faced by the field of Computational Intelligence in building intelligent agents, involve determining mappings between numerous and varied sensor inputs and complex and flexibl e action sequences. In applying nonparametric learning techniques to such problems we must therefore ask: "Is nonparametric lea rning practical in very high dimensional spaces?" Contemporary wisdom states that variable selection and a "greedy" choice of appropriate functional structures are esse ntial ingredients for non parametric learning algorithms. However, neither of these strat egies is practical when learning problems have thousands of input variables , and tens of thousands of learning examples. We conclude that such non parametric learning is practical by using a methodology which does not use either of these techniques. We propose a simple nonparam et ric learning algorithm to support our conclusion. The algorithm is evaluated first on 10 well known regression data sets, where it is shown to produce regression functions which are as good or better than published results on 9 of these data sets. The algorithm is further evaluated on 15 larg e, very high dimensional data sets (40,000 learning examples of 100 , 200 , 400, 800 and 1600 dimensional data) and is shown to construct effective regression functions despite the presence of noise in both inputs and outputs .