Proceedings

Conditional Restricted Boltzmann Machines for Negotiations in Highly Competitive and Complex Domains

Download BibTeX Cite

Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. Pages 69-74.

© 2013 International Joint Conferences on Artificial Intelligence

Abstract

Learning in automated negotiations, while useful, is hard because of the indirect way the target function can be observed and the limited amount of experience available to learn from. This paper proposes two novel opponent modeling techniques based on deep learning methods. Moreover, to improve the learning efficacy of negotiating agents, the second approach is also capable of transferring knowledge efficiently between negotiation tasks. Transfer is conducted by automatically mapping the source knowledge to the target in a rich feature space. Experiments show that using these techniques the proposed strategies outperform existing state-of-the-art agents in highly competitive and complex negotiation domains. Furthermore, the empirical game theoretic analysis reveals the robustness of the proposed strategies.

  1. [Ailon et al., 2008] N. Ailon, M. Charikar, and A. Newman. Ag- gregating inconsistent information: Ranking and clustering. J. ACM, 55(5), 2008.
  2. [Ali and Meilǎ, 2012] A. Ali and M. Meilǎ. Experiments with Ke- meny ranking: What works when? Mathematical Social Sci- ences, 64:28-40, 2012.
  3. [Ballester and Haeringer, 2011] M.A. Ballester and G. Haeringer. A characterization of the single-peaked domain. Social Choice and Welfare, 36(2):305-322, 2011.
  4. [Barbut, 1980] M. Barbut. Médianes, Condorcet et Kendall. Mathématiques et Sciences Humaines, 69:5-13, 1980.
  5. [Bartholdi et al., 1989] J.J. Bartholdi, C.A. Tovey, and M.A. Trick. Voting schemes for which it can be difficult to tell who won the election. Social Choice and Welfare, 6(2):157-165, 1989.
  6. [Bartholdi III and Trick, 1986] J. Bartholdi III and M. A. Trick. Stable matching with preferences derived from a psychological model. Operations Research Letters, 5(4):165 -169, 1986.
  7. [Betzler et al., 2009] N. Betzler, M.R. Fellows, J. Guo, R. Nieder- meier, and F.A. Rosamond. Fixed-parameter algorithms for Ke- meny rankings. Theor. Comput. Sci., 410(45):4554-4570, 2009.
  8. [Betzler et al., 2010] N. Betzler, R. Bredereck, and R. Niedermeier. Partial kernelization for rank aggregation: Theory and experi- ments. In IPEC, pages 26-37, 2010.
  9. [Betzler et al., 2012] N. Betzler, R. Bredereck, J. Chen, and R. Nie- dermeier. The multivariate algorithmic revolution and beyond. chapter Studies in computational aspects of voting: open prob- lems of Downey and Fellows, pages 318-363. Springer-Verlag, 2012.
  10. [Booth and Lueker, 1976] K.S. Booth and G.S. Lueker. Testing for the consecutive ones property, interval graphs, and graph pla- narity using PQ-tree algorithms. J. Comput. Syst. Sci., 13(3):335- 379, 1976.
  11. [Brandt et al., 2011] F. Brandt, M. Brill, and H.G. Seedig. On the fixed-parameter tractability of composition-consistent tour- nament solutions. In IJCAI, pages 85-90, 2011. IJCAI
  12. [Bredereck et al., 2012] R. Bredereck, J. Chen, and G. Woeginger. A characterization of the single-crossing domain. In 4th Inter- national Workshop on Computational Social Choice (COMSOC- 2012), 2012.
  13. [Conitzer et al., 2006] V. Conitzer, A.J. Davenport, and J. Kalagnanam. Improved bounds for computing Kemeny rankings. In AAAI, pages 620-626, 2006.
  14. [Conitzer, 2006] V. Conitzer. Computing Slater rankings using sim- ilarities among candidates. In AAAI, pages 613-619, 2006.
  15. [Conitzer, 2009] V. Conitzer. Eliciting single-peaked preferences using comparison queries. J. Artif. Intell. Res. (JAIR), 35:161- 191, 2009.
  16. [Cornaz et al., 2012] D. Cornaz, L. Galand, and O. Spanjaard. Bounded single-peaked width and proportional representation. In ECAI, pages 270-275, 2012.
  17. [Davenport and Kalagnanam, 2004] A.J. Davenport and J. Kalagnanam. A computational study of the Kemeny rule for preference aggregation. In AAAI, pages 697-702, 2004.
  18. [Dwork et al., 2001] C. Dwork, R. Kumar, M. Naor, and D. Sivaku- mar. Rank aggregation methods for the web. In WWW, pages 613-622, 2001.
  19. [Elkind et al., 2012] E. Elkind, P. Faliszewski, and A.M. Slinko. Clone structures in voters' preferences. In ACM Conference on Electronic Commerce, pages 496-513, 2012.
  20. [Erdélyi et al., 2012] G. Erdélyi, M. Lackner, and A. Pfandler. The complexity of nearly single-peaked consistency. In 4th Inter- national Workshop on Computational Social Choice (COMSOC- 2012), 2012.
  21. [Escoffier et al., 2008] B. Escoffier, J. Lang, and M. Öztürk. Single-peaked consistency and its complexity. In Proceedings of 18th European Conference on Artificial Intelligence (ECAI 2008), pages 366-370. IOS Press, 2008.
  22. [Faliszewski et al., 2011] P. Faliszewski, E. Hemaspaandra, and L.A. Hemaspaandra. The complexity of manipulative attacks in nearly single-peaked electorates. In TARK, pages 228-237, 2011.
  23. [Guo et al., 2004] J. Guo, F. Hüffner, and R. Niedermeier. A struc- tural view on parameterizing problems: Distance from triviality. In Proc. of the 1st International Workshop on Parameterized and Exact Computation (IWPEC 2004), volume LNCS 3162, pages 162-173, 2004.
  24. [Karpinski and Schudy, 2010] M. Karpinski and W. Schudy. Faster algorithms for feedback arc set tournament, Kemeny rank aggre- gation and betweenness tournament. In ISAAC (1), pages 3-14, 2010.
  25. [Kemeny, 1959] J. Kemeny. Mathematics without numbers. Daedalus, 88:571591, 1959.
  26. [Kenyon-Mathieu and Schudy, 2007] C. Kenyon-Mathieu and W. Schudy. How to rank with few errors. In STOC, pages 95-103, 2007.
  27. [Laffond et al., 1996] G. Laffond, J. Lain, and J.-F. Laslier. Composition-consistent tournament solutions and social choice functions. Social Choice and Welfare, 13(1):75-93, 1996.
  28. [Pennock et al., 2000] D.M. Pennock, E. Horvitz, and C.L. Giles. Social choice theory and recommender systems: Analysis of the axiomatic foundations of collaborative filtering. In AAAI/IAAI, pages 729-734, 2000.
  29. [Simjour, 2009] N. Simjour. Parameterized and exact computation. chapter Improved Parameterized Algorithms for the Kemeny Ag- gregation Problem, pages 312-323. Springer-Verlag, 2009.
  30. [Tideman, 1987] T.N. Tideman. Independence of clones as a crite- rion for voting rules. Social Choice and Welfare, 4(3):185-206, 1987.
  31. Trick, 1989
  32. M.A. Trick. Recognizing single-peaked preferences on a tree. Mathematical Social Sciences, 17(3):329-334, 1989.
  33. [van Zuylen and Williamson, 2007] A. van Zuylen and D.P. Williamson. Deterministic algorithms for rank aggregation and other ranking and clustering problems. In WAOA, pages 260-273, 2007.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards