{"type":"ScholarlyArticle","title":"ROME: Robust Multi-Modal Density Estimator","authors":[{"name":"Anna Mészáros","slug":"anna-meszaros","given":"Anna","family":"Mészáros","affiliation":"Cognitive Robotics , TU Delft , Netherlands"},{"name":"Julian F. Schumann","slug":"julian-f-schumann","given":"Julian F.","family":"Schumann","affiliation":"Cognitive Robotics , TU Delft , Netherlands"},{"name":"Javier Alonso-Mora","slug":"javier-alonso-mora","given":"Javier","family":"Alonso-Mora","affiliation":"Cognitive Robotics , TU Delft , Netherlands"},{"name":"Arkady Zgonnikov","slug":"arkady-zgonnikov","given":"Arkady","family":"Zgonnikov","affiliation":"Cognitive Robotics , TU Delft , Netherlands"},{"name":"Jens Kober","slug":"jens-kober","given":"Jens","family":"Kober","affiliation":"Cognitive Robotics , TU Delft , Netherlands"}],"abstract":"The estimation of probability density functions is a fundamental problem in science and engineering. However, common methods such as kernel density estimation (KDE) have been demonstrated to lack robustness, while more complex methods have not been evaluated in multi-modal estimation problems. In this paper, we present ROME (RObust Multi-modal Estimator), a non-parametric approach for density estimation which addresses the challenge of estimating multi-modal, non-normal, and highly correlated distributions. ROME utilizes clustering to segment a multi-modal set of samples into multiple uni-modal ones and then combines simple KDE estimates obtained for individual clusters in a single multi-modal estimate. We compared our approach to state-of-the-art methods for density estimation as well as ablations of ROME, showing that it not only outperforms established methods but is also more robust to a variety of distributions. Our results demonstrate that ROME can overcome the issues of over-fitting and over-smoothing exhibited by other estimators.","doi":"10.24963/ijcai.2024/525","url":"https://ijcai.org/proceedings/2024/525","pdf":"https://ijcai.org/proceedings/2024/0525.pdf","markdown":"https://ijcai.org/proceedings/2024/525.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/525","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Machine Learning","track":"Main Track","number":525,"pages":{"first":4751,"last":4759},"keywords":["Machine Learning: ML: Probabilistic machine learning","Machine Learning: ML: Evaluation"],"videos":[],"references":[{"position":1,"raw":"[Ankerst et al., 1999] Mihael Ankerst, Markus M Breunig, Hans-Peter Kriegel, and Jörg Sander. Optics: Ordering points to identify the clustering structure. ACM Sigmod Record, 28(2):49-60, 1999.","title":"Optics: Ordering points to identify the clustering structure","authors":"Mihael Ankerst, Markus M Breunig, Hans-Peter Kriegel, Jörg Sander","year":"1999","venue":"ACM Sigmod Record","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bakam and Pommeret, 2023] Yves I Ngounou Bakam and Denys Pommeret. Nonparametric estimation of copulas and copula densities by orthogonal projections. Econo- metrics and Statistics, 2023.","title":"Nonparametric estimation of copulas and copula densities by orthogonal projections","authors":"Pommeret Bakam","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Deisenroth et al., 2020] Marc Peter Deisenroth, A Aldo Faisal, and Cheng Soon Ong. Mathematics for Machine Learning. Cambridge University Press, 2020.","title":"Mathematics for Machine Learning","authors":"Marc Peter Deisenroth, Aldo Faisal, Soon Cheng, Ong","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Ester et al., 1996] Martin Ester, Hans-Peter Kriegel, Jörg Sander, and Xiaowei Xu. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, volume 96, pages 226-231, 1996.","title":"A density-based algorithm for discovering clusters in large spatial databases with noise","authors":"Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu","year":"1996","venue":"Proceedings of the Second International Conference on Knowledge Discovery and Data Mining","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Gao et al., 2022] Jia-Xing Gao, Da-Quan Jiang, and Min- Ping Qian. Adaptive manifold density estimation. Journal of Statistical Computation and Simulation, 92(11):2317- 2331, 2022.","title":"Adaptive manifold density estimation","authors":"Jia-Xing Gao, Da-Quan, Min-Ping Jiang, Qian","year":"2022","venue":"Journal of Statistical Computation and Simulation","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Goodfellow et al., 2020] Ian Goodfellow, Jean Pouget- Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Gen- erative adversarial networks. Communications of the ACM, 63(11):139-144, 2020.","title":"Generative adversarial networks","authors":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio","year":"2020","venue":"Communications of the ACM","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Heidenreich et al., 2013] Nils-Bastian Heidenreich, Anja Schindler, and Stefan Sperlich. Bandwidth selection for kernel density estimation: a review of fully automatic se- lectors. AStA Advances in Statistical Analysis, 97:403- 433, 2013.","title":"Bandwidth selection for kernel density estimation: a review of fully automatic selectors","authors":"Nils-Bastian Heidenreich, Anja Schindler, Stefan Sperlich","year":"2013","venue":"AStA Advances in Statistical Analysis","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Joe, 2014] Harry Joe. Dependence modeling with copulas. CRC press, 2014.","title":"Dependence modeling with copulas","authors":"Harry Joe","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Kobyzev et al., 2020] Ivan Kobyzev, Simon JD Prince, and Marcus A Brubaker. Normalizing flows: An introduc- tion and review of current methods. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(11):3964- 3979, 2020.","title":"Normalizing flows: An introduction and review of current methods","authors":"Ivan Kobyzev, Simon Jd Prince, Marcus A Brubaker","year":"2020","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kvalseth, 1997] Tarald O Kvalseth. Generalized divergence and gibbs' inequality. In 1997 IEEE International Confer- ence on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation, volume 2, pages 1797-1801. IEEE, 1997.","title":"Tarald O Kvalseth. Generalized divergence and gibbs' inequality","authors":"Kvalseth","year":"1997","venue":"IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Liang et al., 2020] Junwei Liang, Lu Jiang, Kevin Mur- phy, Ting Yu, and Alexander Hauptmann. The garden of forking paths: Towards multi-future trajectory predic- tion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10508- 10518, 2020.","title":"The garden of forking paths: Towards multi-future trajectory prediction","authors":"Junwei Liang, Lu Jiang, Kevin Murphy, Ting Yu, Alexander Hauptmann","year":"2020","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Lin, 1991] Jianhua Lin. Divergence measures based on the shannon entropy. IEEE Transactions on Information The- ory, 37(1):145-151, 1991.","title":"Divergence measures based on the shannon entropy","authors":"Jianhua Lin","year":"1991","venue":"IEEE Transactions on Information Theory","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Loftsgaarden and Quesenberry, 1965] Don O Loftsgaarden and Charles P Quesenberry. A nonparametric estimate of a multivariate density function. The Annals of Mathematical Statistics, 36(3):1049-1051, 1965.","title":"A nonparametric estimate of a multivariate density function","authors":"O Don, Charles P Loftsgaarden, Quesenberry","year":"1965","venue":"The Annals of Mathematical Statistics","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[McLachlan and Rathnayake, 2014] Geoffrey J McLachlan and Suren Rathnayake. On the number of components in a gaussian mixture model. Wiley Interdisciplinary Re- views: Data Mining and Knowledge Discovery, 4(5):341- 355, 2014.","title":"On the number of components in a gaussian mixture model","authors":"J Geoffrey, Suren Mclachlan, Rathnayake","year":"2014","venue":"Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Moulavi et al., 2014] Davoud Moulavi, Pablo A Jaskowiak, Ricardo JGB Campello, Arthur Zimek, and Jörg Sander. Density-based clustering validation. In Proceedings of the 2014 SIAM International Conference on Data Mining, pages 839-847. SIAM, 2014.","title":"Density-based clustering validation","authors":"Moulavi","year":"2014","venue":"Proceedings of the 2014 SIAM International Conference on Data Mining","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Mozaffari et al., 2020] Sajjad Mozaffari, Omar Y Al-Jarrah, Mehrdad Dianati, Paul Jennings, and Alexandros Mouza- kitis. Deep learning-based vehicle behavior prediction for autonomous driving applications: A review. IEEE Trans- actions on Intelligent Transportation Systems, 23(1):33- 47, 2020.","title":"Deep learning-based vehicle behavior prediction for autonomous driving applications: A review","authors":"Sajjad Mozaffari, Omar Y Al-Jarrah, Mehrdad Dianati, Paul Jennings, Alexandros Mouzakitis","year":"2020","venue":"IEEE Transactions on Intelligent Transportation Systems","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Nagler and Czado, 2016] Thomas Nagler and Claudia Czado. Evading the curse of dimensionality in nonpara- metric density estimation with simplified vine copulas. Journal of Multivariate Analysis, 151:69-89, 2016.","title":"Evading the curse of dimensionality in nonparametric density estimation with simplified vine copulas","authors":"Thomas Nagler, Claudia Czado","year":"2016","venue":"Journal of Multivariate Analysis","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Otneim and Tjøstheim, 2017] Håkon Otneim and Dag Tjøstheim. The locally gaussian density estimator for multivariate data. Statistics and Computing, 27:1595- 1616, 2017.","title":"Håkon Otneim and Dag Tjøstheim. The locally gaussian density estimator for multivariate data","authors":"Tjøstheim Otneim","year":"2017","venue":"Statistics and Computing","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Parzen, 1962] Emanuel Parzen. On estimation of a proba- bility density function and mode. The Annals of Mathe- matical Statistics, 33(3):1065-1076, 1962.","title":"On estimation of a probability density function and mode","authors":"Emanuel Parzen","year":"1962","venue":"The Annals of Mathematical Statistics","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Rasouli, 2020] Amir Rasouli. Deep learning for vision-based prediction: A survey. arXiv preprint arXiv:2007.00095, 2020.","title":"Deep learning for vision-based prediction: A survey","authors":"Amir Rasouli, Rasouli","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Rousseeuw, 1987] Peter J Rousseeuw. Silhouettes: a graph- ical aid to the interpretation and validation of cluster anal- ysis. Journal of Computational and Applied Mathematics, 20:53-65, 1987.","title":"Silhouettes: a graphical aid to the interpretation and validation of cluster analysis","authors":"J Peter, Rousseeuw","year":"1987","venue":"Journal of Computational and Applied Mathematics","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Silverman, 1998] Bernard W Silverman. Density estimation for statistics and data analysis. Routledge, 1998.","title":"Density estimation for statistics and data analysis","authors":"Bernard W Silverman","year":"1998","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Villani, 2009] Cédric Villani. Optimal transport: Old and new, volume 338. Springer, 2009.","title":"Optimal transport: Old and new","authors":"Villani","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Vincent and Bengio, 2002] Pascal Vincent and Yoshua Ben- gio. Manifold parzen windows. Advances in Neural Infor- mation Processing Systems, 15, 2002.","title":"Manifold parzen windows","authors":"Pascal Vincent, Yoshua Bengio","year":"2002","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Wang et al., 2009] Xiaoxia Wang, Peter Tino, Mark A Fardal, Somak Raychaudhury, and Arif Babul. Fast parzen window density estimator. In 2009 International Joint Conference on Neural Networks, pages 3267-3274. IEEE, 2009.","title":"Fast parzen window density estimator","authors":"Xiaoxia Wang, Peter Tino, Mark A Fardal, Somak Raychaudhury, Arif Babul","year":"2009","venue":"2009 International Joint Conference on Neural Networks","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Wei et al., 2020] Ruoqi Wei, Cesar Garcia, Ahmed El- Sayed, Viyaleta Peterson, and Ausif Mahmood. Vari- ations in variational autoencoders-a comparative evalua- tion. IEEE Access, 8:153651-153670, 2020.","title":"Variations in variational autoencoders-a comparative evaluation","authors":"Wei","year":"2020","venue":"IEEE Access","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Wold et al., 1987] Svante Wold, Kim Esbensen, and Paul Geladi. Principal component analysis. Chemometrics and Intelligent Laboratory Systems, 2(1-3):37-52, 1987.","title":"Principal component analysis","authors":"Svante Wold, Kim Esbensen, Paul Geladi","year":"1987","venue":"Chemometrics and Intelligent Laboratory Systems","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Xu et al., 2019] Donna Xu, Yaxin Shi, Ivor W Tsang, Yew- Soon Ong, Chen Gong, and Xiaobo Shen. Survey on multi-output learning. IEEE Transactions on Neural Net- works and Learning Systems, 31(7):2409-2429, 2019.","title":"Survey on multi-output learning","authors":"Donna Xu, Yaxin Shi, Ivor W Tsang, Yew-Soon Ong, Chen Gong, Xiaobo Shen","year":"2019","venue":"IEEE Transactions on Neural Networks and Learning Systems","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}