{"type":"ScholarlyArticle","title":"Finding Frequent Entities in Continuous Data","authors":[{"name":"Ferran Alet","slug":"ferran-alet","given":"Ferran","family":"Alet","affiliation":"MIT Computer Science and Artificial Intelligence Laboratory"},{"name":"Rohan Chitnis","slug":"rohan-chitnis","given":"Rohan","family":"Chitnis","affiliation":"MIT Computer Science and Artificial Intelligence Laboratory"},{"name":"Leslie P. Kaelbling","slug":"leslie-p-kaelbling","given":"Leslie P.","family":"Kaelbling","affiliation":"MIT Computer Science and Artificial Intelligence Laboratory"},{"name":"Tomas Lozano-Perez","slug":"tomas-lozano-perez","given":"Tomas","family":"Lozano-Perez","affiliation":"MIT Computer Science and Artificial Intelligence Laboratory"}],"abstract":"In many applications that involve processing high-dimensional data, it is important to identify a small set of entities that account for a significant fraction of detections. Rather than formalize this as a clustering problem, in which all detections must be grouped into hard or soft categories, we formalize it as an instance of the frequent items or heavy hitters problem, which finds groups of tightly clustered objects that have a high density in the feature space. We show that the heavy hitters formulation generates solutions that are more accurate and effective than the clustering formulation. In addition, we present a novel online algorithm for heavy hitters, called HAC, which addresses problems in continuous space, and demonstrate its effectiveness on real video and household domains.","doi":"10.24963/ijcai.2018/275","url":"https://ijcai.org/proceedings/2018/275","pdf":"https://ijcai.org/proceedings/2018/0275.pdf","markdown":"https://ijcai.org/proceedings/2018/275.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/275","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Machine Learning","track":"Main track","number":275,"pages":{"first":1992,"last":1999},"keywords":["Machine Learning Applications: Applications of Unsupervised Learning","Computer Vision: Video: Events, Activities and Surveillance","Machine Learning: Clustering","Machine Learning: Time-series;Data Streams"],"videos":[],"references":[{"position":1,"raw":"[Braverman et al., 2017] Vladimir Braverman, Gereon Frahling, Harry Lang, Christian Sohler, and Lin F Yang. Cluster- ing high dimensional dynamic data streams. arXiv preprint arXiv:1706.03887, 2017.","title":"Clustering high dimensional dynamic data streams","authors":"Vladimir Braverman, Gereon Frahling, Harry Lang, Christian Sohler, Lin F Yang","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cao et al., 2006] Feng Cao, Martin Estert, Weining Qian, and Aoying Zhou. Density-based clustering over an evolving data stream with noise. In SIAM international conference on data mining, 2006.","title":"Density-based clustering over an evolving data stream with noise","authors":"Feng Cao, Martin Estert, Weining Qian, Aoying Zhou","year":"2006","venue":"SIAM international conference on data mining","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chaudhuri and Dasgupta, 2010] Kamalika Chaudhuri and Sanjoy Dasgupta. Rates of convergence for the cluster tree. In NIPS, 2010.","title":"Rates of convergence for the cluster tree","authors":"Kamalika Chaudhuri, Sanjoy Dasgupta","year":"2010","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen and Tu, 2007] Yixin Chen and Li Tu. Density-based clus- tering for real-time stream data. In ACM SIGKDD International Conference On Knowledge Discovery And Data Mining, pages 133-142, 2007.","title":"Density-based clustering for real-time stream data","authors":"Chen, Tu ; ] Yixin Chen, Li Tu","year":"2007","venue":"ACM SIGKDD International Conference On Knowledge Discovery And Data Mining","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chen and Zhang, 2016] Di Chen and Qin Zhang. Streaming algo- rithms for robust distinct elements. In International Conference on Management of Data, 2016.","title":"Streaming algorithms for robust distinct elements","authors":"Di Chen, Qin Zhang","year":"2016","venue":"International Conference on Management of Data","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Donahue et al., 2014] Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. De- caf: A deep convolutional activation feature for generic visual recognition. In ICML, 2014.","title":"Decaf: A deep convolutional activation feature for generic visual recognition","authors":"Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, Trevor Darrell","year":"2014","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Ester et al., 1996] Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, et al. A density-based algorithm for discovering clusters in large spatial databases with noise. In KDD, volume 96, pages 226-231, 1996.","title":"A density-based algorithm for discovering clusters in large spatial databases with noise","authors":"Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu","year":"1996","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Johnson et al., 2016] Melvin Johnson, Mike Schuster, Quoc V Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fer- nanda Viégas, Martin Wattenberg, Greg Corrado, et al. Google's multilingual neural machine translation system: enabling zero- shot translation. arXiv preprint arXiv:1611.04558, 2016.","title":"Google's multilingual neural machine translation system: enabling zeroshot translation","authors":"Melvin Johnson, Mike Schuster, V Quoc, Maxim Le, Yonghui Krikun, Zhifeng Wu, Nikhil Chen, Fernanda Thorat, Martin Viégas, Greg Wattenberg, Corrado","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[King, 2009] Davis E. King. Dlib-ml: A machine learning toolkit. Journal of Machine Learning Research, 10:1755-1758, 2009.","title":"Dlib-ml: A machine learning toolkit","authors":"Davis E King","year":"2009","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Larsen et al., 2016] Kasper Green Larsen, Jelani Nelson, Huy L Nguyên, and Mikkel Thorup. Heavy hitters via cluster-preserving clustering. In Foundations of Computer Science (FOCS), 2016 IEEE 57th Annual Symposium on, pages 61-70. IEEE, 2016.","title":"Heavy hitters via cluster-preserving clustering","authors":"Jelani Kasper Green Larsen, Nelson, Mikkel Huy L Nguyên, Thorup","year":"2016","venue":"Foundations of Computer Science (FOCS)","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Manku and Motwani, 2002] Gurmeet Singh Manku and Rajeev Motwani. Approximate frequency counts over data streams. In VLDB'02: Proceedings of the 28th International Conference on Very Large Databases, pages 346-357. Elsevier, 2002.","title":"Approximate frequency counts over data streams","authors":"Motwani Manku, Singh Manku, Rajeev Motwani","year":"2002","venue":"VLDB'02: Proceedings of the 28th International Conference on Very Large Databases","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Mikolov et al., 2013] Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781, 2013.","title":"Efficient estimation of word representations in vector space","authors":"Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Newman, 2005] Mark EJ Newman. Power laws, pareto distri- butions and zipf's law. Contemporary physics, 46(5):323-351, 2005.","title":"Power laws, pareto distributions and zipf's law","authors":"Mark Ej Newman","year":"2005","venue":"Contemporary physics","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Niebles et al., 2008] Juan Carlos Niebles, Hongcheng Wang, and Li Fei-Fei. Unsupervised learning of human action categories using spatial-temporal words. IJCV, 79(3), 2008.","title":"Unsupervised learning of human action categories using spatial-temporal words","authors":"Juan Carlos Niebles, Hongcheng Wang, Li Fei-Fei","year":"2008","venue":"IJCV","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Nirjon and Stankovic, 2012] Shahriar Nirjon and John A Stankovic. Kinsight: Localizing and tracking household objects using depth-camera sensors. In Distributed Computing in Sensor Systems (DCOSS), 2012 IEEE 8th International Conference on, 2012.","title":"Kinsight: Localizing and tracking household objects using depth-camera sensors","authors":"Shahriar Nirjon, John A Stankovic","year":"2012","venue":"Distributed Computing in Sensor Systems (DCOSS)","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Otto et al., 2017] Charles Otto, Anil Jain, et al. Clustering millions of faces by identity. IEEE PAMI, 2017.","title":"Clustering millions of faces by identity","authors":"Charles Otto, Anil Jain","year":"2017","venue":"IEEE PAMI","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Pedregosa et al., 2011] F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. Scikit-learn: Ma- chine learning in Python. Journal of Machine Learning Research, 12:2825-2830, 2011.","title":"Scikit-learn: Machine learning in Python","authors":"F Pedregosa, G Varoquaux, A Gramfort, V Michel, B Thirion, O Grisel, M Blondel, P Prettenhofer, R Weiss, V Dubourg, J Vanderplas, A Passos, D Cournapeau, M Brucher, M Perrot, E Duchesnay","year":"2011","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Pinheiro et al., 2016] Pedro O Pinheiro, Tsung-Yi Lin, Ronan Col- lobert, and Piotr Dollár. Learning to refine object segments. In European Conference on Computer Vision, 2016.","title":"Learning to refine object segments","authors":"Tsung-Yi Pedro O Pinheiro, Ronan Lin, Piotr Collobert, Dollár","year":"2016","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Rituerto et al., 2016] Alejandro Rituerto, Henrik Andreasson, Ana C Murillo, Achim Lilienthal, and José Jesús Guerrero. Building an enhanced vocabulary of the robot environment with a ceiling pointing camera. Sensors, 16(4), 2016.","title":"Building an enhanced vocabulary of the robot environment with a ceiling pointing camera","authors":"Alejandro Rituerto, Henrik Andreasson, Ana C Murillo, Achim Lilienthal, José Jesús Guerrero","year":"2016","venue":"Sensors","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Rodriguez and Laio, 2014] Alex Rodriguez and Alessandro Laio. Clustering by fast search and find of density peaks. Science, 344(6191):1492-1496, 2014.","title":"Clustering by fast search and find of density peaks","authors":"Alex Rodriguez, Alessandro Laio","year":"2014","venue":"Science","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Schroff et al., 2015] Florian Schroff, Dmitry Kalenichenko, and James Philbin. Facenet: A unified embedding for face recog- nition and clustering. In CVPR, 2015.","title":"Facenet: A unified embedding for face recognition and clustering","authors":"Florian Schroff, Dmitry Kalenichenko, James Philbin","year":"2015","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Szegedy et al., 2016] Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. Rethinking the inception architecture for computer vision. In CVPR, 2016.","title":"Rethinking the inception architecture for computer vision","authors":"Szegedy","year":"2016","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Vitter, 1985] Jeffrey S Vitter. Random sampling with a reser- voir. ACM Transactions on Mathematical Software (TOMS), 11(1):37-57, 1985.","title":"Random sampling with a reservoir","authors":"S Jeffrey, Vitter","year":"1985","venue":"ACM Transactions on Mathematical Software (TOMS)","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Wan et al., 2009] Li Wan, Wee Keong Ng, Xuan Hong Dang, Philip S Yu, and Kuan Zhang. Density-based clustering of data streams at multiple resolutions. ACM Transactions on Knowledge discovery from Data (TKDD), 3(3):14, 2009.","title":"Density-based clustering of data streams at multiple resolutions","authors":"Li Wan, Keong Wee, Xuan Hong Ng, Philip S Dang, Kuan Yu, Zhang","year":"2009","venue":"ACM Transactions on Knowledge discovery from Data (TKDD)","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}