Satisficing and Learning Cooperation in the Prisoner s Dilemma

Stimpson, Jeff L.; Goodrich, Michael A.; Walters, Lawrence C.

Satisficing and Learning Cooperation in the Prisoner s Dilemma

Jeff L. Stimpson, Michael A. Goodrich, Lawrence C. Walters

Download BibTeX Cite

Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence. Pages 535-543.

Abstract

>$UWKXU @ : %ULDQ $UWKXU 'HVLJQLQJ HFRQRPLF DJHQWV WR DFW OLNH KXPDQ DJHQWV $ EHKDYLRUDO DSSURDFK WR ERXQGHG UDWLRQDOLW\ The American Economic Review 0D\ >$[HOURG @ 50 $[HOURG The Evolution of Cooperation %DVLF %RRNV >&RQOLVN @ -RKQ &RQOLVN :K\ ERXQGHG UDWLRQDOLW\" Journal of Economic Literature >+X DQG :HOOPDQ @ -+X DQG 0 3 :HOOPDQ 0XOWLDJHQW UHLQIRUFHPHQW OHDUQLQJ 7KHRUHWLFDO IUDPHZRUN DQG DQ DOJRULWKP Proceedings of the Fifteenth International Conference on Machine Learning 6DQ )UDQFLVFR 0RUJDQ .DXIPDQ >.DUDQGLNDU et al. @ 5 .DUDQGLNDU ' 0RRNKHUMHH ' 5D\ DQG ) 9HJD5HGRQGR (YROYLQJ DVSLUDWLRQV DQG FRRSHUDWLRQ Journal of Economic Theory >/LWWPDQ @ 0LFKDHO / /LWWPDQ 0DUNRY JDPHV DV D IUDPHZRUN IRU PXOWLDJHQW UHLQIRUFHPHQW OHDUQLQJ Proceedings of the Eleventh International Conference on Machine Learning 6DQ )UDQFLVFR 0RUJDQ .DXIPDQ >6DQGKROP DQG &ULWHV @ 7XRPDV : 6DQGKROP DQG 5REHUW + &ULWHV 0XOWLDJHQW UHLQIRUFHPHQW OHDUQLQJ LQ WKH ,WHUDWHG 3ULVRQHU ¶V 'LOHPPD BioSystems >6HQ et al. @ 6 6HQ 0 6HNDUDQ DQG -+DOH /HDUQLQJ WR FRRUGLQDWH ZLWKRXW VKDULQJ LQIRUPDWLRQ Proceedings of the Twelfth National Conference on Artificial Intelligence $$$, 6HDWWOH :$ >6LPRQ @ +HUEHUW $ 6LPRQ Models of bounded rationality. 9RO Empirically grounded economic reason &DPEULGJH 0DVV 0,7 3UHVV

References were extracted automatically from the PDF and may contain errors.

Full text extracted automatically from the PDF; figures, tables and equations may differ. The PDF is the version of record.

1 Introduction

��

Figure 1: � ��
��		��
		��	��
��	��	��	��
��	��	��	��

��

��
��
��
��

��

2 Related Literature

��

3 A Satisficing Strategy For the Prisoner's Dilemma

�� et al. �� t �� At,αt� �� At �� αt �� πc87 c36 �� πc87 c37 � �� πc87 �� Ac87c14c20 � Ac87� �� πt αt ≥ A t c20 c14 A t ≠ � λ � ≤ ≤

Formula not decoded

�� λ� �� A0 �� αc19�

�� λ � �� A0 � �� αc19 � ��

Figure 2: � ��
�	��	�c87	πc87	αc87
�	�	�	�	�
�	�	�	�	��
�	�	�	�	��
�	�	�	�	��

�� Ac20 � � ��

4 Cooperation Among Satisficing Agents

��

�� Bt �� βc87 �� λ �� σ �� δ �� δ � σ � � �� σ � ��

Figure 3: ��
��		��
		��	��
��	��	�σ� σ�	��
��	��	��	�δ� δ�

Figure 4: �� c19 � �� c19 � �� σ � �� δ � �� λ � �� c19 � �� c19 � �� σ � �� δ � �� λ � �� c19 � �� c19 � �� σ � �� δ � �� λ � ��

4.1 Convergence and Stability

�� A� B�� α �� πc36 �� β �� πc37 � �� αt πt A ≤ βt πt B ≤

� �� N �� τ� �� t � τ� �� k �� Ac87c14c78 � Ac87c14c78c14c49 �� Bc87c14c78 � Bc87c14c78c14c49� � k N � � ≤ ≤

� ��

��

4.2 General Results

��

Table 1: ��
Parameter	Min. Value	Max. Value
αc19� βc19	��	��
λ	��	��
σ	��	��
δ	��	σ
A0, B0	��

��

��

4.3 Factors Leading to Cooperation

��

��
��
��
��

��

Initial Aspirations

��

Structure of the Payoff Matrix

�� σ �� δ�

�� δ �� σ �� σ �� δ �� as long as it is not difficult to discriminate� ��

Initial Actions

��

Table 2: �� c19 �� c19 ��
Initial Actions	% of Cooperation
��	��
��	��
��	��
��	��

��

Learning Rate

�� λ �� λ �� λ � � ��

5 Conclusions and Further Work

��

��
��
��
��

�� A0 = B0� σ � δ � �� λ � �� αc19 � σ� �� βc19 � σ� ��

��

Acknowledgements

��

Jeff L. Stimpson, Michael A. Goodrich, and Lawrence C. Walters. 2001. Satisficing and Learning Cooperation in the Prisoner s Dilemma. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence, IJCAI-01. IJCAI, 535–543. https://ijcai.org/proceedings/2001/75

@inproceedings{ijcai2001p75,
  title     = {Satisficing and Learning Cooperation in the Prisoner s Dilemma},
  author    = {Stimpson, Jeff L. and Goodrich, Michael A. and Walters, Lawrence C.},
  booktitle = {Proceedings of the Seventeenth International Joint Conference on
               Artificial Intelligence, {IJCAI-01}},
  publisher = {International Joint Conferences on Artificial Intelligence},
  editor    = {Bernhard Nebel},
  pages     = {535--543},
  year      = {2001},
  url       = {https://ijcai.org/proceedings/2001/75},
}

TY  - CPAPER
TI  - Satisficing and Learning Cooperation in the Prisoner s Dilemma
AU  - Stimpson, Jeff L.
AU  - Goodrich, Michael A.
AU  - Walters, Lawrence C.
T2  - Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence, IJCAI-01
PB  - International Joint Conferences on Artificial Intelligence
PY  - 2001
SP  - 535
EP  - 543
UR  - https://ijcai.org/proceedings/2001/75
ER  -

[1] >$UWKXU @ : %ULDQ $UWKXU 'HVLJQLQJ HFRQRPLF DJHQWV WR DFW OLNH KXPDQ DJHQWV $ EHKDYLRUDO DSSURDFK WR ERXQGHG UDWLRQDOLW\ The American Economic Review 0D\ >$[HOURG @ 50 $[HOURG The Evolution of Cooperation %DVLF %RRNV >&RQOLVN @ -RKQ &RQOLVN :K\ ERXQGHG UDWLRQDOLW\" Journal of Economic Literature >+X DQG :HOOPDQ @ -+X DQG 0 3 :HOOPDQ 0XOWLDJHQW UHLQIRUFHPHQW OHDUQLQJ 7KHRUHWLFDO IUDPHZRUN DQG DQ DOJRULWKP Proceedings of the Fifteenth International Conference on Machine Learning 6DQ )UDQFLVFR 0RUJDQ .DXIPDQ >.DUDQGLNDU et al. @ 5 .DUDQGLNDU ' 0RRNKHUMHH ' 5D\ DQG ) 9HJD5HGRQGR (YROYLQJ DVSLUDWLRQV DQG FRRSHUDWLRQ Journal of Economic Theory >/LWWPDQ @ 0LFKDHO / /LWWPDQ 0DUNRY JDPHV DV D IUDPHZRUN IRU PXOWLDJHQW UHLQIRUFHPHQW OHDUQLQJ Proceedings of the Eleventh International Conference on Machine Learning 6DQ )UDQFLVFR 0RUJDQ .DXIPDQ >6DQGKROP DQG &ULWHV @ 7XRPDV : 6DQGKROP DQG 5REHUW + &ULWHV 0XOWLDJHQW UHLQIRUFHPHQW OHDUQLQJ LQ WKH ,WHUDWHG 3ULVRQHU ¶V 'LOHPPD BioSystems >6HQ et al. @ 6 6HQ 0 6HNDUDQ DQG -+DOH /HDUQLQJ WR FRRUGLQDWH ZLWKRXW VKDULQJ LQIRUPDWLRQ Proceedings of the Twelfth National Conference on Artificial Intelligence $$$, 6HDWWOH :$ >6LPRQ @ +HUEHUW $ 6LPRQ Models of bounded rationality. 9RO Empirically grounded economic reason &DPEULGJH 0DVV 0,7 3UHVV