{"type":"ScholarlyArticle","title":"The Facets of Artificial Intelligence: A Framework to Track the Evolution of AI","authors":[{"name":"Fernando Martínez-Plumed","slug":"fernando-martinez-plumed","given":"Fernando","family":"Martínez-Plumed","affiliation":"Universitat Politècnica de València , Spain"},{"name":"Bao Sheng Loe","slug":"bao-sheng-loe","given":"Bao Sheng","family":"Loe","affiliation":"University of Cambridge , United Kingdom"},{"name":"Peter Flach","slug":"peter-flach","given":"Peter","family":"Flach","affiliation":"University of Bristol , United Kingdom"},{"name":"Seán Ó hÉigeartaigh","slug":"sean-o-heigeartaigh","given":"Seán Ó","family":"hÉigeartaigh","affiliation":"University of Cambridge , United Kingdom"},{"name":"Karina Vold","slug":"karina-vold","given":"Karina","family":"Vold","affiliation":"University of Cambridge , United Kingdom"},{"name":"José Hernández-Orallo","slug":"jose-hernandez-orallo","given":"José","family":"Hernández-Orallo","affiliation":"Universitat Politècnica de València , Spain"}],"abstract":"We present nine facets for the analysis of the past and future evolution of AI. Each facet has also a set of edges that can summarise different trends and contours in AI. With them, we first conduct a quantitative analysis using the information from two decades of AAAI/IJCAI conferences and around 50 years of documents from AI topics, an official database from the AAAI, illustrated by several plots. We then perform a qualitative analysis using the facets and edges, locating AI systems in the intelligence landscape and the discipline as a whole. This analytical framework provides a more structured and systematic way of looking at the shape and boundaries of AI.","doi":"10.24963/ijcai.2018/718","url":"https://ijcai.org/proceedings/2018/718","pdf":"https://ijcai.org/proceedings/2018/0718.pdf","markdown":"https://ijcai.org/proceedings/2018/718.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/718","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Evolution of the contours of AI","track":"Evolution of the contours of AI","number":718,"pages":{"first":5180,"last":5187},"keywords":["Multidisciplinary Topics and Applications: Multidisciplinary Topics and Applications"],"videos":[],"references":[{"position":1,"raw":"[Amodei et al., 2016] Dario Amodei, Chris Olah, Jacob Steinhardt, Paul Christiano, John Schulman, and Dan Mané. Concrete prob- lems in ai safety. arXiv preprint arXiv:1606.06565, 2016.","title":"Concrete problems in ai safety","authors":"Dario Amodei, Chris Olah, Jacob Steinhardt, Paul Christiano, John Schulman, Dan Mané","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Anderson et al., 1997] John R Anderson, Michael Matessa, and Christian Lebiere. Act-r: A theory of higher level cognition and its relation to visual attention. Human-Computer Interaction, 12(4):439-462, 1997.","title":"Act-r: A theory of higher level cognition and its relation to visual attention","authors":"Michael John R Anderson, Christian Matessa, Lebiere","year":"1997","venue":"Human-Computer Interaction","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Boden, 2016] Margaret A Boden. AI: Its nature and future. Oxford University Press, 2016.","title":"AI: Its nature and future","authors":"Margaret A Boden","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Brynjolfsson and Mitchell, 2017] Erik Brynjolfsson and Tom Mitchell. What can machine learning do? Workforce implica- tions. Science, 358(6370):1530-1534, 2017.","title":"What can machine learning do? Workforce implications","authors":"Mitchell ; Brynjolfsson, Erik Brynjolfsson, Tom Mitchell","year":"2017","venue":"Science","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Buchanan et al., 2013] Bruce G Buchanan, Joshua Eckroth, and Reid Smith. A virtual archive for the history of ai. AI Maga- zine, 34(2):86, 2013.","title":"A virtual archive for the history of ai","authors":"Joshua Bruce G Buchanan, Reid Eckroth, Smith","year":"2013","venue":"AI Magazine","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Buchanan, 2005] Bruce G Buchanan. A (very) brief history of ar- tificial intelligence. Ai Magazine, 26(4):53, 2005.","title":"A (very) brief history of artificial intelligence","authors":"Bruce G Buchanan","year":"2005","venue":"Ai Magazine","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Clark and Chalmers, 1998] Andy Clark and David Chalmers. The extended mind. analysis, 58(1):7-19, 1998.","title":"The extended mind","authors":"Clark, Chalmers ;, Andy Clark, David Chalmers","year":"1998","venue":"analysis","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[EU Regulation, 2016] General Data Protection EU Regulation. Regulation (EU) 2016/679 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data. Official Journal of the European Union (OJ), 59:1-88, 2016.","title":"General Data Protection EU Regulation. Regulation (EU) 2016/679 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data","authors":"Eu Regulation","year":"2016","venue":"Official Journal of the European Union (OJ)","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Fast and Horvitz, 2017] Ethan Fast and Eric Horvitz. Long-term trends in the public perception of artificial intelligence. In AAAI, pages 963-969, 2017.","title":"Long-term trends in the public perception of artificial intelligence","authors":"Horvitz Fast, Ethan Fast, Eric Horvitz","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Fetzer, 1990] James H Fetzer. What is artificial intelligence? pages 3-27, 1990.","title":"What is artificial intelligence","authors":"H James, Fetzer","year":"1990","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Ford et al., 2015] Kenneth M Ford, Patrick J Hayes, Clark Gly- mour, and James Allen. Cognitive orthoses: toward human- centered ai. AI Magazine, 36(4):5-8, 2015.","title":"Cognitive orthoses: toward humancentered ai","authors":"Patrick J Kenneth M Ford, Clark Hayes, James Glymour, Allen","year":"2015","venue":"AI Magazine","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Frey and Osborne, 2017] Carl Benedikt Frey and Michael A Os- borne. The future of employment: how susceptible are jobs to computerisation? Technological Forecasting and Social Change, 114:254-280, 2017.","title":"The future of employment: how susceptible are jobs to computerisation?","authors":"Carl Benedikt, Frey, Michael A Osborne","year":"2017","venue":"Technological Forecasting and Social Change","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Goldsmith and Burton, 2017] Judy Goldsmith and Emanuelle Bur- ton. Why teaching ethics to ai practitioners is important. In AAAI, pages 4836-4840, 2017.","title":"Judy Goldsmith and Emanuelle Burton. Why teaching ethics to ai practitioners is important","authors":"Burton Goldsmith","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Hagelbäck and Johansson, 2008] Johan Hagelbäck and Stefan J Johansson. Using multi-agent potential fields in real-time strat- egy games. In Proc. of the 7 Int. Joint Conf. on Autonomous agents and multiagent systems-Volume 2, pages 631-638, 2008.","title":"Using multi-agent potential fields in real-time strategy games","authors":"Johansson Hagelbäck, Johan Hagelbäck, Stefan J Johansson","year":"2008","venue":"Proc. of the 7 Int. Joint Conf. on Autonomous agents and multiagent systems","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Hausknecht et al., 2014] Matthew Hausknecht, Joel Lehman, Risto Miikkulainen, and Peter Stone. A neuroevolution approach to general atari game playing. IEEE Trans. on Computational Intelligence and AI in Games, 6(4):355-366, 2014.","title":"A neuroevolution approach to general atari game playing","authors":"Matthew Hausknecht, Joel Lehman, Risto Miikkulainen, Peter Stone","year":"2014","venue":"IEEE Trans. on Computational Intelligence and AI in Games","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Hernández-Orallo et al., 2017] Jose Hernández-Orallo, Marco Ba- roni, Jordi Bieger, Nader Chmait, David L Dowe, Katja Hofmann, Fernando Martínez-Plumed, Claes Strannegård, and Kristinn R Thórisson. A new ai evaluation cosmos: Ready to play the game? AI Magazine, AAAI, 38(3):66-69, 2017.","title":"A new ai evaluation cosmos: Ready to play the game? AI Magazine","authors":"Hernández-Orallo","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Hernández-Orallo, 2016] José Hernández-Orallo. The measure of all minds: evaluating natural and artificial intelligence. Cam- bridge University Press, 2016.","title":"José Hernández-Orallo. The measure of all minds: evaluating natural and artificial intelligence","authors":"Hernández-Orallo","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Hernández-Orallo, 2017] José Hernández-Orallo. Evaluation in artificial intelligence: from task-oriented to ability-oriented mea- surement. Artificial Intelligence Review, 48(3):397-447, Oct 2017.","title":"José Hernández-Orallo. Evaluation in artificial intelligence: from task-oriented to ability-oriented measurement","authors":"Hernández-Orallo","year":"2017","venue":"Artificial Intelligence Review","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Hochreiter and Schmidhuber, 1997] Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural computation, 9(8):1735-1780, 1997.","title":"Long short-term memory","authors":"Sepp Hochreiter, Jürgen Schmidhuber","year":"1997","venue":"Neural computation","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[How et al., 2008] Jonathan P How, Brett Behihke, Adrian Frank, Daniel Dale, and John Vian. Real-time indoor autonomous vehi- cle test environment. IEEE control systems, 28(2):51-64, 2008.","title":"Real-time indoor autonomous vehicle test environment","authors":"Jonathan P How, Brett Behihke, Adrian Frank, Daniel Dale, John Vian","year":"2008","venue":"IEEE control systems","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Kaelbling et al., 1998] Leslie Pack Kaelbling, Michael L Littman, and Anthony R Cassandra. Planning and acting in partially ob- servable stochastic domains. Artificial intelligence, 101(1-2):99- 134, 1998.","title":"Planning and acting in partially observable stochastic domains","authors":"Leslie Pack, Kaelbling Michael L Littman, Anthony R Cassandra","year":"1998","venue":"Artificial intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Kelly and Heywood, 2017] Stephen Kelly and Malcolm I Hey- wood. Multi-task learning in atari video games with emergent tangled program graphs. In Proceedings of the Genetic and Evo- lutionary Computation Conference, pages 195-202. ACM, 2017.","title":"Multi-task learning in atari video games with emergent tangled program graphs","authors":"Stephen Kelly, Malcolm I Heywood","year":"2017","venue":"Proceedings of the Genetic and Evolutionary Computation Conference","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Kieras and Meyer, 1997] David E. Kieras and David E. Meyer. An overview of the epic architecture for cognition and performance with application to human-computer interaction. Hum.-Comput. Interact., 12(4):391-438, 1997.","title":"An overview of the epic architecture for cognition and performance with application to human-computer interaction","authors":"David E Kieras, David E Meyer","year":"1997","venue":"Hum.-Comput. Interact","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Lake et al., 2017] Brenden M Lake, Tomer D Ullman, Joshua B Tenenbaum, and Samuel J Gershman. Building machines that learn and think like people. BBS, 40, 2017.","title":"Building machines that learn and think like people","authors":"Brenden M Lake, Joshua B Tomer D Ullman, Samuel J Tenenbaum, Gershman","year":"2017","venue":"BBS","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Legg and Hutter, 2007] Shane Legg and Marcus Hutter. A collec- tion of definitions of intelligence. Advances in Artificial General Intelligence: Concepts, Architectures and Algorithms, in Fron- tiers in Artificial Intelligence and applications, 157:17-24, 2007.","title":"A collection of definitions of intelligence","authors":"Hutter Legg, Shane Legg, Marcus Hutter","year":"2007","venue":"Advances in Artificial General Intelligence: Concepts, Architectures and Algorithms","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Lehman-Wilzig, 1981] Sam N Lehman-Wilzig. Frankenstein un- bound: towards a legal definition of artificial intelligence. Fu- tures, 13(6):442-457, 1981.","title":"Frankenstein unbound: towards a legal definition of artificial intelligence","authors":"Lehman-Wilzig ; Sam N Lehman-Wilzig","year":"1981","venue":"Futures","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Luck, 2017] Michael Luck. IJCAI-2017 Special Track on AI & Autonomy, 2017.","title":"IJCAI-2017 Special Track on AI & Autonomy","authors":"Michael Luck","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Marcus, 2018] Gary Marcus. Deep learning: A critical appraisal. arXiv preprint arXiv:1801.00631, 2018.","title":"Deep learning: A critical appraisal","authors":"Gary Marcus","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[McCarthy et al., 2006] John McCarthy, Marvin L Minsky, Nathaniel Rochester, and Claude E Shannon. A proposal for the Dartmouth summer research project on artificial intelligence, august 31, 1955. AI magazine, 27(4):12, 2006.","title":"A proposal for the Dartmouth summer research project on artificial intelligence, august 31, 1955","authors":"John Mccarthy, Marvin L Minsky, Nathaniel Rochester, Claude E Shannon","year":"2006","venue":"AI magazine","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[McCarthy, 1998] John McCarthy. What is artificial intelligence? 1998.","title":"What is artificial intelligence?","authors":"John Mccarthy","year":"1998","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[McCorduck, 2004] Pamela McCorduck. Machines who think: A personal inquiry into the history and prospects of artificial intel- ligence. AK Peters Natick, MA, 2004.","title":"Machines who think: A personal inquiry into the history and prospects of artificial intelligence","authors":"Pamela Mccorduck","year":"2004","venue":null,"doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Minsky, 1968] M. L. Minsky. Semantic information processing. 1968.","title":"Semantic information processing","authors":"M L Minsky","year":"1968","venue":null,"doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Mnih et al., 2015] Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostro- vski, et al. Human-level control through deep reinforcement learning. Nature, 518(7540):529, 2015.","title":"Human-level control through deep reinforcement learning","authors":"Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski","year":"2015","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Moor, 2006] James Moor. The Dartmouth college AI conference: The next fifty years. AI Magazine, 27(4):87, 2006.","title":"The Dartmouth college AI conference: The next fifty years","authors":"James Moor","year":"2006","venue":"AI Magazine","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Moran et al., 2014] Kelly Moran, Byron C Wallace, and Carla E Brodley. Discovering better AAAI keywords via clustering with community-sourced constraints. In AAAI, pages 1265-1271, 2014.","title":"Discovering better AAAI keywords via clustering with community-sourced constraints","authors":"Kelly Moran, Byron C Wallace, Carla E Brodley","year":"2014","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"Müller and Bostrom, ] Vincent C Müller and Nick Bostrom. Fu- ture progress in AI: A survey of expert opinion. In Fundamental issues of AI, pages=555-572, year=2016, publisher=Springer.","title":"Future progress in AI: A survey of expert opinion","authors":"Bostrom Müller, ] Vincent, C Müller, Nick Bostrom","year":"2016","venue":"Fundamental issues of AI","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Newell, 1994] Allen Newell. Unified theories of cognition. Har- vard University Press, 1994.","title":"Unified theories of cognition","authors":"Allen Newell","year":"1994","venue":null,"doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Nilsson, 2009] Nils J Nilsson. The quest for artificial intelligence. Cambridge University Press, 2009.","title":"The quest for artificial intelligence","authors":"Nils J Nilsson","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Niu et al., 2016] Jiqiang Niu, Wenwu Tang, Feng Xu, Xiaoyan Zhou, and Yanan Song. Global research on AI from 1990-2014: Spatially-explicit bibliometric analysis. ISPRS Int. Journal of Geo-Information, 5(5):66, 2016.","title":"Global research on AI from 1990-2014: Spatially-explicit bibliometric analysis","authors":"Jiqiang Niu, Wenwu Tang, Feng Xu, Xiaoyan Zhou, Yanan Song","year":"2016","venue":"ISPRS Int. Journal of Geo-Information","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Quinn and Bederson, 2011] Alexander J Quinn and Benjamin B Bederson. Human computation: a survey and taxonomy of a growing field. In SIGCHI conf. on human factors in computing systems, pages 1403-1412. ACM, 2011.","title":"Human computation: a survey and taxonomy of a growing field","authors":"J Alexander, Benjamin B Quinn, Bederson","year":"2011","venue":"SIGCHI conf. on human factors in computing systems","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Russell and Norvig, 2009] Stuart Jonathan Russell and Peter Norvig. Artificial intelligence: a modern approach, 3rd Edition. Prentice Hall, 2009.","title":"Artificial intelligence: a modern approach, 3rd Edition","authors":"Jonathan Stuart, Peter Russell, Norvig","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Russell et al., 2015] Stuart Russell, Daniel Dewey, and Max Tegmark. Research priorities for robust and beneficial artificial intelligence. Ai Magazine, 36(4):105-114, 2015.","title":"Research priorities for robust and beneficial artificial intelligence","authors":"Stuart Russell, Daniel Dewey, Max Tegmark","year":"2015","venue":"Ai Magazine","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Shah et al., 2017] Nihar B Shah, Behzad Tabibian, Krikamol Muandet, Isabelle Guyon, and Ulrike Von Luxburg. Design and analysis of the nips 2016 review process. arXiv preprint arXiv:1708.09794, 2017.","title":"Design and analysis of the nips 2016 review process","authors":"B Nihar, Behzad Shah, Krikamol Tabibian, Isabelle Muandet, Ulrike Guyon, Luxburg Von","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Solomonoff, 2017] Grace Solomonoff. Ray Solomonoff and the Dartmouth summer research project in artificial intelligence, 1956, 2017.","title":"Ray Solomonoff and the Dartmouth summer research project in artificial intelligence","authors":"Grace Solomonoff","year":"1956","venue":null,"doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Spohrer and Banavar, 2015] Jim Spohrer and Guruduth Banavar. Cognition as a service: an industry perspective. AI Magazine, 36(4):71-86, 2015.","title":"Cognition as a service: an industry perspective","authors":"Banavar Spohrer, Jim Spohrer, Guruduth Banavar","year":"2015","venue":"AI Magazine","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[White House, 2016] Executive Office of the President White House. Preparing for the Future of Artificial Intelli- gence. CreateSpace, USA, 2016.","title":"Executive Office of the President White House. Preparing for the Future of Artificial Intelligence","authors":"White House","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":47,"raw":"[Winfield, 2017] Alan FT Winfield. How intelligent is your intelli- gent robot? arXiv preprint arXiv:1712.08878, 2017.","title":"How intelligent is your intelligent robot","authors":"Alan Ft Winfield","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}