Contest Design with Uncertain Performance and Costly Participation
Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. Main track. Pages 302-309.
https://doi.org/10.24963/ijcai.2017/43
Keywords
- Agent-based and Multi-agent Systems: Economic paradigms, auctions and market-based systems
- Agent-based and Multi-agent Systems: Noncooperative Games
Abstract
This paper studies the problem of designing contests for settings where a principal seeks to optimize the quality of the best performance obtained, and potential contestants only strategize about whether to participate in the contest, as participation incurs some cost. This type of contest can be mapped to various real-life settings (e.g., an audition, a beauty pageant, technology crowdsourcing). The paper provides a comparative game-theoretic based solution to two variants of the above underlying model: parallel and sequential contest, enabling a characterization of the equilibrium strategies in each. Special emphasis is placed on the case where the contestants are homogeneous which is often the case in real-life whenever the contestants are basically alike and their ranking in the contest is mostly influenced by some probabilistic factors (e.g., luck). Here, several (somehow counter-intuitive) properties of the equilibrium are proved, in particular for the sequential contest, leading to a comprehensive characterization of the principal preference between the two.
- [Archak and Sundararajan, 2009] Nikolay Archak and Arun Sundararajan. Optimal design of crowdsourcing contests. ICIS 2009 proceedings, page 200, 2009.
- [Baarslag et al., 2013] Tim Baarslag, Katsuhide Fujita, En- rico H Gerding, Koen Hindriks, Takayuki Ito, Nicholas R Jennings, Catholijn Jonker, Sarit Kraus, Raz Lin, Valentin Robu, et al. Evaluating practical negotiating agents: Re- sults and analysis of the 2011 international competition. Artificial Intelligence, 198:73-103, 2013.
- [Baik, 1994] Kyung Hwan Baik. Effort levels in contests with two asymmetric players. Southern Economic Jour- nal, 61(2):367-378, 1994.
- [Buchanan et al., 1983] James M. Buchanan, Robert D. Tol- lison, and Gordon Tullock. Toward a theory of the rent- seeking society. Public Choice, 41(2):339-345, 1983.
- [Chawla et al., 2012] Shuchi Chawla, Jason D. Hartline, and Balasubramanian Sivan. Optimal crowdsourcing contests. In Proc. of SODA, pages 856-868, 2012.
- [Clark and Riis, 1996] Derek J. Clark and Christian Riis. A multi-winner nested rent-seeking contest. Public Choice, 87(1):177-184, 1996.
- [Clark and Riis, 1998] Derek J. Clark and Christian Riis. In- fluence and the discretionary allocation of several prizes. European J. of Political Economy, 14(4):605-625, 1998.
- [Cohen et al., 2008] Chen Cohen, Todd Kaplan, and Aner Sela. Optimal rewards in contests. RAND Journal of Eco- nomics, 39(2):434-451, 2008.
- [Dasgupta and Nti, 1998] Ani Dasgupta and Kofi O. Nti. De- signing an optimal contest. European Journal of Political Economy, 14(4):587 -603, 1998.
- [Dechenaux et al., 2014] Emmanuel Dechenaux, Dan Kovenock, and Roman Sheremeta. A survey of ex- perimental research on contests, all-pay auctions and tournaments. Experimental Economics, pages 1-61, 2014.
- [DiPalantino and Vojnovic, 2009] Dominic DiPalantino and Milan Vojnovic. Crowdsourcing and all-pay auctions. In Proc. of ACM-EC, pages 119-128, 2009.
- [Faravelli, 2011] Marco Faravelli. The important thing is not (always) winning but taking part: Funding public goods with contests. Journal of Public Economic Theory, 13(1):1-22, 2011.
- [Fu and Lu, 2012] Qiang Fu and Jingfeng Lu. The opti- mal multi-stage contest. Journal of Economic Theory, 51(2):351-382, 2012.
- [Galton, 1902] Francis Galton. The most suitable proportion between the value of first and second prizes. Biometrika, 1(4):385-399, 1902.
- [Ghosh and Hummel, 2012] Arpita Ghosh and Patrick Hum- mel. Implementing optimal outcomes in social computing: A game-theoretic approach. In Proc. of WWW, pages 539- 548, 2012.
- [Ghosh and Kleinberg, 2016] Arpita Ghosh and Robert Kleinberg. Optimal contest design for simple agents. ACM Transactions on Economic and Computation, 4(4):22:1-22:41, 2016.
- [Glazer and Hassin, 1988] A. Glazer and R. Hassin. Optimal contests. Economic Inquiry, 26(1):133-143, 1988.
- [Hazon et al., 2008] Noam Hazon, Paul E Dunne, Sarit Kraus, and Michael Wooldridge. How to rig elections and competitions. Proceedings of COMSOC, 2008.
- [Jian et al., 2016] Lian Jian, Zheng Li, and Tracy Xiao Liu. Simultaneous versus sequential all-pay auctions: an ex- perimental study. Experimental Economics, pages 1-22, 2016.
- [Lev et al., 2013] Omer Lev, Maria Polukarov, Yoram Bachrach, and Jeffrey S. Rosenschein. Mergers and col- lusion in all-pay auctions and crowdsourcing contests. In Proc. of AAMAS, pages 675-682, 2013.
- [Liu et al., 2013] Bin Liu, Jingfeng Lu, Ruqu Wang, and Jun Zhang. Prize and punishment: Optimal contest design with incomplete information. National University of Signapore Typescript, 2013.
- [Liu et al., 2014] Tracy Xiao Liu, Jiang Yang, Lada A. Adamic, and Yan Chen. Crowdsourcing with all-pay auc- tions: A field experiment on taskcn. Management Science, 60(8):2020-2037, 2014.
- [Luo et al., 2014] Tie Luo, Salil S. Kanhere, and Hwee-Pink Tan. Optimal prizes for all-pay contests in heterogeneous crowdsourcing. In Proc. of MASS, pages 136-144, 2014.
- [McMillan and Rothschild, 1994] John McMillan and Michael Rothschild. Search. In Handbook of Game Theory with Economic Applications, volume 2, pages 905 -927, 1994.
- [Moldovanu and Sela, 2001] Benny Moldovanu and Aner Sela. The optimal allocation of prizes in contests. Ameri- can Economic Review, 91(3):542-558, 2001.
- [Moldovanu and Sela, 2006] Benny Moldovanu and Aner Sela. Contest architecture. Journal of Economic Theory, 126(1):70-96, 2006.
- [Morgan, 2003] John Morgan. Sequential contests. Public Choice, 116(1):1-18, 2003.
- [Nti, 1999] Kofi O. Nti. Rent-seeking with asymmetric val- uations. Public Choice, 98(3):415-430, 1999.
- [Rosen, 1986] Sherwin Rosen. Prizes and incentives in elim- ination tournaments. The American Economic Review, 76(4):701-715, 1986.
- [Schlagwein and Bjorn-Andersen, 2014] Daniel Schlagwein and Niels Bjorn-Andersen. Organizational learning with crowdsourcing: The revelatory case of lego. J. of the As- sociation of Information Systems, 15(11):754-778, 2014.
- [Segev and Sela, 2014] Ella Segev and Aner Sela. Multi- stage sequential all-pay auctions. European Economic Re- view, 70:371-382, 2014.
- [Stracke, 2013] Rudi Stracke. Contest design and hetero- geneity. Economics Letters, 121(1):4-7, 2013.
References were extracted automatically from the PDF and may contain errors.
Full text extracted automatically from the PDF; figures, tables and equations may differ. The PDF is the version of record.
1 Introduction
Contests have been used since the dawn of man as a mechanism for inducing individual efforts. In recent years, contests are used not only as a means for determining the best contestant, but also for generating value. For example DARPA is offering Grand Challenges to promote the development of cutting-edge technologies, scientific organizations run contests to enhance research (e.g., [Baarslag et al., 2013]), firms run contests to come up with new products (such as the LEGO Ideas contests [Schlagwein and Bjorn-Andersen, 2014]) and not-for-profit organizations are organizing contests for transformative solutions that benefit mankind (as with the Hult Prize (www.hultprize.org)).
The majority of contest research deals with models where contestants can influence their performance in the contest through the effort or money they put [Baik, 1994; Moldovanu and Sela, 2006]. In various settings, however, this is not the
Igor Rochlin
School of Computer Science College of Management, Israel igor.rochlin@gmail.com
case as not only contestants have no control over their performance from the time of making their participation decision and onwards, but they are also uncertain concerning the way they will be evaluated in the contest. This holds whenever contestants are being evaluated subjectively by anonymous judges, based on the taste of the public (in case of a voting open to the public), based on criteria that are not fully disclosed to them, or simply based on luck or uncertain environment parameters (e.g., weather). For example, when an agency is posting on social media that it seeks background actors ("extras") no audition takes place. Instead, contestants submit their pre-made headshots, and the selection is made based on how applicants' headshots match some desired look (which can be completely subjective as it depends on the specific casting teammember in charge). Similarly, at the time a department chair solicits submissions from faculty members for excellence in research prize, prospective candidates cannot influence anymore the quality of the results they submit (as the research has already been carried out and published) and the way their results will be evaluated by the department chair compared to others' is somehow uncertain. This recurs also in applications such as photos contests (as photographers submit the best photos they have shot and are uncertain about voters' tastes) and graduate students applying for a post-doc (as the evaluation of their achievements by the professor offering the position is uncertain and they cannot influence the substence of their achievements at the time they apply). Common to all the above examples, that the contestants' strategy is limited to participating or not participating in the contest. This latter decision becomes non-trivial whenever participation incurs some cost (e.g., locating and uploading photos, filling in registration details, sending a CV, emotional suffer and reputational loss in case of not winning).
In this paper we study contests of the above type, i.e., the contestants' performance in the contest is beyond the control of contestants at the time of the contest and participation is costly. Unlike most prior literature, that was primarily focused on parallel contest models, in this work we consider also the option for a sequential contest. In sequential contest, only one contestant performs at a time and its performance measure is known to the following contestants. Such design is commonly used in real-life, e.g., in Olympic sports such as platform diving, pole vault and javelin throw.
Contributions. The paper provides a comprehensive gametheoretic based analysis of the parallel and sequential contest model variants of contests where contestants only strategize about participation, specifying the conditions under which different kinds of equilibria hold. The analysis enables demonstrating that the preference of the contest to be used (parallel or sequential), from the contest organizer's point of view, can frequently change as a function of the setting parameters-even a slight variation in one of the parameters can result in several alternations in preference. For the case of homogeneous contestants, however, we manage to characterize some setting classes where parallel contest dominates a sequential one and vice versa. In particular, we prove a transition in preference from parallel to sequential contest as the ratio between the participation cost and the prize awarded increases. Interestingly (and somehow counter-intuitively), we find that in sequential contest with homogeneous contestants, despite the asymmetry imposed by the sequential process, in equilibrium both the contestant's strategies and their expected profit do not depend on the number of contestants nor the position of a contestant in the sequence. The latter finding suggests that the sequential competition is just as fair as the parallel one.
2 RelatedWork
Contests are organizational structures in which contestants spend costly efforts (e.g., time, resources) to win one or more prizes [Dechenaux et al., 2014]. Contest design, i.e., the set of rules that define a contest, had focused much interest in literature [Glazer and Hassin, 1988; Dasgupta and Nti, 1998; Ghosh and Kleinberg, 2016], differing primarily in the assumptions made in the underlying contest model (e.g., offering several prizes [Galton, 1902; Cohen et al., 2008; Archak and Sundararajan, 2009] or using more than a single stage (most commonly in the form of a tournament) [Rosen, 1986; Clark and Riis, 1996; 1998; Hazon et al., 2008]) and the contest organizer's goals (e.g., maximizing overall effort, best effort, fairness) [Lev et al., 2013]. In addition to foundational work on the theory of contests, much research has been devoted to providing experimental evidence for the way people behave in contests [Dechenaux et al., 2014] as well as online crowdsourcing contests [DiPalantino and Vojnovic, 2009; Chawla et al., 2012].
Most literature in the area of contest design deals with effort-based contests, where the effort expended by contestants determines their probability of winning a prize [Nti, 1999; Moldovanu and Sela, 2006] (perhaps the most common is the Tullock contest [Buchanan et al., 1983] in which the winning probability is the ratio of the contestant's effort and the total effort exerted by all contestants). Our model, as motivated above assumes contestants cannot influence their chance of winning at the time the contest takes place and their strategy space is limited to participating or opting not to participate in the contest. Among the few works that consider this kind of contest, the most relevant ones are Ghosh and Hummel (2012) and Ghosh and Kleinberg (2016). These works however are focused on the question of how to design a multi-prize scheme and are limited to the case of parallel contest (whereas ours considers also the option for a sequential one). More importantly, their model assumes contestants learn about their performance measure in the contest prior to having to decide on participation, whereas in our model there is no certainty concerning performance at the time the participation decision is made. This latter difference is fundamental, as it results in a completely different analysis (and solution structure).
Finally, our work differs from most existing contest-design work in a way that it considers the option of using a sequential contest and provides a comparative analysis of the sequential and parallel model variants. Prior work has focused primarily in simultaneous contest. The sequential contest is not completely absent in literature [Segev and Sela, 2014; Liu et al., 2014; Jian et al., 2016], however to the best of our knowledge has been analyzed only in the context of effort-based contest [Morgan, 2003; Fu and Lu, 2012; Stracke, 2013] with very little comparative analysis of the two.
3 The Model
The model considers a contest organizer and a set A = {A1, ...,Ak} of k > 1 heterogeneous potential contestants (denoted "agents" onwards). Agents are fully-rational and self-interested. Each agent Ai can either participate in the contest, incurring some cost ci, or opt to avoid participating in the contest. The performance of an agent in the contest is a priori unknown and is being affected both by its inherent competence and various external factors (e.g., luck, weather conditions, refereeing). This is modeled by taking the performance of agent Ai to be determined according to some probabilistic function fi(x) (where Fi(x) is the corresponding cumulative distribution function).
The goal of the organizer is to maximize the expected maximum performance obtained by agents in a contest it runs. In order to encourage participation in the contest the organizer offers a prize M > 0 to the agent ranked first (performancewise) in the contest. 1 In case none of the agents choose to participate in the contest, the prize is randomly awarded to one of the agents and the performance as perceived by the organizer is set to some pre-set fallback performance v0. 2 The choice of always awarding the prize is a standard modeling assumption in contest theory [Faravelli, 2011; Liu et al., 2013] and corresponds to the case where agents can opt to expend some default minimal performance (e.g., submitting a trivial code that chooses randomly in the Netflix challenge) without incurring any cost. The goal of each agent is to maximize its own expected profit, defined as the expected prize awarded to it minus the cost incurred if participating in the contest. It is assumed that fi(x), ci and M are all common knowledge in the sense that they are known to all agents and to the organizer [Moldovanu and Sela, 2001; 2006; Luo et al., 2014].
1 Since performance is continuous, the chance of having two agents ranked first is negligible. Otherwise, a tie-breaking rule is required.
2 As otherwise the expected maximum performance is undefined. Typically this will be zero.
The analysis considers two model variants, differing in the way the contest is designed. The first is based on simultaneous participation ("parallel contest"), i.e., each agent's participation decision takes part in parallel to the others'. The second is based on sequential participation ("sequential contest"). Here, each agent in its turn (according to some pre-defined order) gets to see the results of its predecessors (whether participated, and if so also their performance) and then decides whether to participate in the contest.
4 Analysis
The analysis is divided according to the contest type (parallel and sequential).
4.1 Parallel Contest
We use {P, ¬P } to denote the actions available to each agent, where P stands for participate and ¬P for not participate. Since the game in this case is simultaneous, every agent Ai's strategy can be captured by the probability pi (0 ≤ pi ≤ 1) it chooses action P (∀Ai ∈ A).
Consider agent Ai. Given the strategy profile of all other agents {pj|Aj ∈ A ∧ Aj ̸= Ai}, the probability that the maximum performance obtained by others is equal to or less than y, denoted ¯ Fi(y), is:
The expected profit of agent Ai if participating, denoted BP i , is thus given by:
i.e., agent Ai is awarded the prize M whenever its performance y is the maximum among all agents that participate.
Similarly, the expected profit of agent Ai if not participating, denoted B¬P i , is given by:
i.e., with probability ∏Aj∈A-{Ai} (1-pj ) neither of the other k-1 agents participate and the prize M is randomly awarded to one of the k agents.
The best response strategy of every agent Ai is thus to participate if BP i > B¬P i and not participate otherwise. A Bayesian Nash Equilibrium (BNE) solution {p1, ..., pk} to the parallel contest should therefore satisfy: (a) for every agent Ai for which pi = 0, BP i ≤ B¬P i ; (b) for every agent Ai for which pi = 1, BP i ≥ B¬P i ; and (c) for every agent Ai for which 0 < pi < 1, BP i = B¬P i . It is possible that a given setting will have more than a single equilibrium solution (i.e., multi-equilibria), though the question of which of those will be used is beyond the scope of the current paper.
One specific setting where we can determine the nature of equilibrium in terms of the strategies to be used is where the agents differ only in their participation costs (e.g., in the background actors search where participants differ primarily in their costs of locating and uploading photos) as stated in the following proposition.
Proposition 1. When fi(x) = fj(x) ∀i, j, x, the BNE obtained is: (a) strictly in pure strategies such that all agents participate, whenever ciM ≤ 1k ∀i; (b) strictly in pure strategies such that all agents do not participate, whenever ciM ≥ k-1 k ∀i; and (c) in mixed or pure strategies, where different agents use different strategies, otherwise.
Proof. For case (a), since fi(x) = fj(x) ∀i, j, all participants in the contest are equally likely to win. Therefore participation results in an expected profit of at least Mk - ci ≥ 0 and hence it is the best response for the agent if the number of other participants is at least one (in which case not participating results in a zero profit). If no other agent participates then if agent Ai participates its profit is M - ci and otherwise Mk . The difference between the two is: M - ci - Mk = M(k-1) k - ci ≥ ci(k - 1) - ci ≥ 0. Hence even in this case participation is the best strategy. For case (b), any individual agent Ai has an incentive not to participate, regardless of the strategy used by the others, as otherwise its expected profit is bounded from above either by M - ci ≤ Mk in case no one else participates, or by Mk - ci < ci k-1 - ci ≤ 0 in case the number of the other participants is at least one (k > 1). In all other cases, there is an incentive for at least one agent to participate in the contest if all others opt not to participate, and similarly to opt not to participate if all others do participate.
Finally, the organizer's expected profit is given by:
where ¯ F(y) = ∏Aj∈A (pjFj(y) + (1 - pj)) is the probability that the maximum performance obtained in a contest involving k agents is less than y.
4.2 Sequential Contest
In the case of a sequential contest the (subgame perfect) BNE is fully in pure strategies, as agents have perfect information about the performance of preceding agents. An agent's strategy S is its choice of participation given the best performance obtained so far, formally captured by the function S : R ∪ ∅ → {P, ¬P}, where ∅ is the case where all former agents opted not to participate in the contest. For exposition purposes we align the agents' participation order with their index.
Consider an agent Ai when the best performance obtained so far is v and the strategies used by all other agents are given by S-i = {S1, ..., Si-1, Si+1, .., Sk}. We use the function F next i (y) to denote the probability that given that the best performance reached once Ai participates is y the maximum performance obtained by all agents participating after Ai is equal to or less than y. The expected profit of Ai if participating, whenever receiving v, denoted BP i (v), is thus:
Similarly, the expected profit of Ai if not participating, whenever receiving v, denoted B¬P i (v), is given by:
Theorem 1. The best-response strategy of any agent Ai given the strategies of the other agents S-i and the best performance obtained so far v is: (a) use a threshold ri to determine whether or not to participate in case v ̸= ∅ and there is ri satisfying:
where:
(b) not participate in case v ̸= ∅ and there is no ri satisfying (6); (c) participate if k-1 k ≥ ciM and otherwise not participate, in case v = ∅ and Sj(∅) = ¬P ∀j > i; (d) participate if ciM ≤ ∫ ∞ y=-∞ fi(y)F next i (y)dy and otherwise not participate, in case v = ∅ and ∃j > i such that Sj(∅) = P .
Proof. For the case where v ̸= ∅, participating is better than not participating if M ∫ ∞ y=v fi(y)F next i (y)dy - ci ≥ 0 (according to (4) and (5)). Since ∫ ∞ y=v fi(y)F next i (y)dy decreases in v, participating is the preferred choice for any performance v that is lesser than ri for which (6) holds. This proves part (a). If there is no ri satisfying (6) then it can either be because ∫ ∞ y=ri fi(y)F next i (y)dy is always greater than ciM or always lesser than ciM . However, the term reaches zero for ri → ∞ and therefore it is necessarily the case where the expected gain from participating is lower than the cost incurred, resulting in preferring not to participate. This proves part (b).
The case of v = ∅ is different as the agent can potentially gain from not participating if no one else will choose to participate as well. According to (4) and (5), in case Sj (∅) = ¬P ∀j > i, participating is the preferred choice if M - ci ≥ Mk and therefore the distinction between the two cases in part (c). Finally, when v = ∅ and ∃j > i such that Sj(∅) = P, the decision is based solely on the chance of winning, being the first to participate. The proof in this case is similar to the one provided for case (a), in the sense of equating gains and costs incurred, and therefore omitted.
A BNE is thus of the form ((C ∅ 1 , C ¬∅ 1 ), ..., (C ∅ k , C ¬∅ k )), where C ∅ i ∈ {P, ¬P} corresponds to the case of being reached with a performance ∅ and C ¬∅ i ∈ {P, ¬P, ri} corresponds to the case of being reached with some real performance v, satisfying the conditions specified in Theorem 1.
We now turn to calculating the expected profit of the organizer. Let Borg i (v) denote the organizer's expected profit when the current participant is Ai (with k - i + 1 more agents to go) and the maximum performance of the preceding i - 1 agents is v. The value Borg i (v) is calculated based on Ai's position in the sequence. If Ai is the last agent (i.e., i = k) and does not participate (Si(v) = ¬P) the organizer obtains the maximum between the default profit v0 and the performance v (or trivially v0 if v = ∅). In case Ai does participate (Si(v) = P) the profit relies on the maximum between v0 and the performance obtained by Ai: Borg i (v) = ∫ ∞ y=-∞ max(y, v0)fi(y)dy if v = ∅ and Borg i (v) = ∫ ∞ y=v max(y, v0)fi(y)dy+Fi(v)max(v, v0) otherwise. If Ai is not the last in the sequence (i < k) then we replace the actual performances y and v in the above by the expected profits Borg i+1 (y) and Borg i+1 (v), as the contest is to be continued with the transition to agent Ai+1, resulting in: Borg i (v) = Borg i+1 (v) for Si(v) = ¬P, Borg i (v) = ∫ ∞ y=-∞ fi(y)Borg i+1 (y)dy for Si(v) = P and v = ∅, and Borg i (v) = ∫ ∞ y=v fi(y)Borg i+1 (y)dy+Fi(v)Borg i+1 (v) otherwise. The organizer's expected profit from the contest, denoted Borg , is given by Borg = Borg 1 (∅).
5 Influencing Dynamics
The choice of the type of contest (sequential or parallel) to be used by the organizer is not trivial and the preference of type may alternate even with the slightest change in setting parameters. In this section we illustrate this by following the changes in the nature and structure of the equilibrium obtained, and consequently the organizer's preference, as the participation cost of one of the agents changes. The setting used includes three agents, where c1 = c2 = 0.16 and c3 is the independent parameter. All three agents are characterized by a uniform performance distribution function between 0 and 1 (i.e., f1(x) = f2(x) = f3(x) = 1 for 0 ≤ x ≤ 1 and zero otherwise). The prize to be awarded to the winner is M = 0.4 and the fallback performance is v0 = 0.
Figure 1 compares the organizer's expected profit in the above setting when using sequential and parallel contest, as a function of the participation cost c3 of A3 (Graph (a)). Graphs (b) and (c) depict the strategies used by the different agents in the equilibrium obtained, enabling a better understanding of the behaviors reflected in the organizer's expected profit. For exposition purposes we use (p1, p2, p3) to denote the equilibrium in the parallel case, where pi is the participation probability of agent Ai. For the sequential case we present the participation's thresholds r2 and r3.
We begin with the parallel contest. Here, there are several equilibria, and the curve used depicts the one in which A1 and A2 are using a symmetric strategy. This latter choice is made for two primary reasons: First, since A1 and A2 are symmetric, the most natural (and fair) equilibrium is the one where they use the same strategy (and gain the same profit). Second, in this example, the symmetric equilibrium is the one that maximizes the organizer's expected profit. For c3 < M/3 = 0.133 we obtain an equilibrium (0.6, 0.6, 1). Other equilibria are (1, 0, 1) and (0, 1, 1). In the interval 0.133 < c3 < 0.186 a mixed equilibrium of type (p, p, p3), which could not hold for c3 < M/3, replaces the (p, p, 1) solution which is not stable anymore. Interestingly, in the transition that takes place at c3 = 0.133 we observe another counter-intuitive phenomena according to which a decrease in the competence of one of the agents (an increase in the participation cost of A3 in this case) results in an increase in the organizer's expected profit. In the interval 0.186 < c3 ≤ M/2 = 0.2 there are three equilibria, each characterized by having two of the agents participate in the contest and the third not participating, all resulting in an expected profit of Borg = 2/3. Finally, with c3 > 0.2 we obtain the single equilibrium (1, 1, 0), resulting once again in Borg = 2/3.

With the sequential contest, we obtain a single BNE. As expected, the threshold used by A3 decreases as its participation cost increases. The decreasing competition from A3 results in an increase in the threshold used by A2. For c3 = 0.16 all three agents are homogeneous and indeed r2 = r3 = 0.6 as calculated by (11) which determines the threshold used with homogeneous agents. Once r3 becomes less than 0.6, the threshold used by A2 becomes fixed and equals 0.6. This can intuitively be explained by the fact that in the absence of A3 the threshold used by A2 is r2 = 0.6 (according to (11)). Meaning that A2's expected profit in those cases where its performance is greater than 0.6 is enough to justify participation. However adding A3 with a strategy r3 < 0.6 does not affect A2's profit whenever performing better than 0.6, as A3 opts not to participate in such cases.
Finally, when A3's participation cost becomes big enough (c3 = 2M/3 = 0.267), the BNE's nature changes to having all three agents opt not to participate (in which case the organizer's expected profit drops to zero). This is because as long as A1 and A2 do not participate, for any c3 > M- M3 not participating dominates participating for A3. In such case, if A1 is not participating then A2 gains more from not participating and receiving M3 than participating (and hence invoking also A3's participation, though with a relatively small threshold r3). Similar considerations apply to A1. Interestingly, for c3 > 0.273 these considerations do not hold anymore, as A3 becomes so incompetent that A2 actually finds it beneficial to deviate towards participating even when A1 does not participate.
As can be seen in Graph (a) of the figure, there are three transition points in the organizer's preference of the type of contest to be used. Further transitions in preference occur with different orderings of the agents in the sequential contest model, as well as changes in c1, c2 and M.
6 Homogeneous Agents
In many real-life contest settings agents are homogeneous in the sense that they share the same participation cost (ci = c, ∀i) and the probability distribution function according to which their performance is determined (fi(x) = f(x), ∀i). Meaning that the agents are a priori homogeneous-even though each of them will end up with a different performance at the contest, at the time they make their participation decision neither of them has an a priori advantage. 3 The analysis of the homogeneous case reveals several interesting properties related to the structure of the game equilibrium.
6.1 Parallel Contest
Since the agents are homogeneous we are interested in the symmetric equilibrium (i.e., pi = p ∀i), as it is the natural and fair one. When using the same p, Equations (1) and (2) can be substantially simplified and expressed as follows:
Theorem 2 provides a comprehensive characterization of the BNE in this case, as a function of the ratio cM , including a closed form solution for p.
Theorem 2. In the homogeneous parallel contest case, the BNE is: (a) fully based on pure strategies such that p = 1 (all agents participate) and p = 0 (all agents opt not to participate) when cM ≤ 1k and cM ≥ k-1 k , respectively; (b) based on mixed strategies, otherwise, where p is the solution to:
Proof. Part (a) directly derives from Proposition 1. In any other case there is necessarily one equilibrium which is based on mixed strategies that use the same p. Equating (8) to (9) results in cM = ∑k-1 j=1 (k-1 j ) 1 j+1 pj (1 - p)k-j-1 + k-1 k (1 - p)k-1 . Using the identity ( k j+1) = k j+1 (k-1 j ) and the binomial theoremwe obtain (10).
3 This is also the case in many of the applications motivating this research (e.g., in the background actors search where in the absence of concrete guidelines contestants are typically a priori alike, or in the photography contests where submissions are typically of high quality and the public taste is difficult to predict).
The derivative of the right-hand-side of (10) with respect to p is always negative, hence the value of p (and consequently the expected profit of the organizer) increases as participation cost c decreases over the interval 1k < cM < k-1 k .
6.2 Sequential Contest
Theorems 3 and 4 provide a comprehensive characterization of the BNE for the case of sequential contest with homogeneous agents as a function of the problem parameters.
Theorem 3. The equilibrium solution to the homogeneous case is: (a) have all agents not participate whenever cM ≥ k-1 k ; (b) have all agents participate whenever c = 0; (c) otherwise, have all agents use the same threshold r to determine whether or not to participate, where r satisfies:
Proof. The proof for the case where cM ≥ k-1 k is a trivial modification of the proof given for case (b) of Proposition 1. The case where c = 0 is straightforward-if not incurring a participation cost then participating dominates not participating. Therefore we only need to prove the part where 0 < cM < k-1 k . This is proved by induction: The last agent Ak uses r according to (11) based on substituting F next i (y) = 1 (according to (7)) in (6). Now assume that every agent Aj for which j > i uses rj = r according to (11). We prove that ri = r as well. Assume otherwise, e.g., ri < r. Now consider any value z such that ri < z < r. Since z > ri, not participating dominates participating if being reached with a value z (i.e., BP i (z) < 0). However according to the proof's assumption all remaining agents use r and therefore the expected profit of the agent if participating is: BP i (z) = -c+M (∫ r y=ri f(y)(F(y))k-idy +(1-F(r))). Substituting c = M(1 - F(r)) (according to (11)) in the latter term obtains BP i (z) = M ∫ r y=ri f(y)(F(y))k-idy > 0 which is a contradiction. Similarly, assume ri > r and a value z such that r < z < ri. Since z < ri participating dominates not participating if being reached with a value z (i.e., BP i (z) > 0). However if participating in the contest the expected profit of the agent is: BP i (z) = -c+M(1-F(z)) < -c + M(1 - F(r)) = 0, which leads again to contradiction.
The use of a threshold-based strategy and in particular the fact that the exact same threshold is used by all agents can be explained through similar intuitions that hold in optimal stopping problems such as those studied by McMillan and Rothschild [McMillan and Rothschild, 1994]. Here a searcher needs to decide when to stop (and exploit the current value observed) when sampling repeatedly from a distribution while the sampling is costly. Despite some inherent differences (most observable is the fact that in our model each decision is made by a different agent in a competition context) the underlying process is somehow similar in its nature, and indeed the optimal strategy for the optimal stopping problem is known to be threshold-based and uses the same threshold over each sampling period.
Theorem 4. In equilibrium, all agents gain the exact same expected profit B, regardless of their position in the sequence, depending on the nature of the equilibrium: (a) Mk if the equilibrium strategy is not to participate; (b) Mk - c if they all participate (i.e., when c = 0); and (c) otherwise:
Proof. The first two cases are trivial and result from the model definition. As for the third case, the expected profit Bi of agent Ai is given by:
where (i - 1)f(y)(F(y))i-2 is the probability distribution function of getting to Ai with a performance y and (F (z))k-i is the probability that the remaining k - i agents will fail to perform better than y. Substituting ∫ ∞ y=r f(y)dy = cM (according to (11)) and further applying several standard mathematical manipulations we obtain (12).
The implications of Theorems 3 and 4 are quite surprising and counter-intuitive: with homogeneous agents even though each agent has full information concerning the performance of those participating before it, in equilibrium all agents follow the same participation rule and that rule does not depend on the number of participants k (whenever choosing to participate) or the number of remaining agents. Furthermore, despite the fact that the chance of each agent to participate decreases (as it depends on the chance that preceding agents performed worse than r), along the agents sequence, all agents end up with the same expected profit, regardless of their position in the contest sequence.
Notice that from (11) we obtain that F(r) = M-c M and substituting it in (12) yields:
meaning that the expected profit of any of the agents can be calculated even without calculating first the threshold-based strategy. Furthermore, (M-c)k kMk-1 < Mk , meaning that the agents are better off having all of them not participate in the contest. Unfortunately, this latter solution is not stable, leading as in many other problems to the tragedy of the commons.
If none of the agents participate the organizer's expected profit is v0. Otherwise, her expected profit is given by (3), where:
In case y < r all agents obtain a value below y. In case y ≥ r there are two possible scenarios. The first is where all k agents obtain a value below their threshold r, i.e., with probability F(r)k . The second is where the contest terminates right after j agents, upon revealing a value z such that r < z < y (otherwise, if z < r the agents would decide to participate) and all former j - 1 agents obtained a value smaller than r. The probability of the latter case occurring (summing over all values of j ≤ k) can be calculated using the geometric series ∑kj=1 (F (y) - F (r))F (r)j-1 .
6.3 Methods Comparison
The analysis provided in the former section unfolds several inherent differences between the parallel and sequential contest in the homogeneous case. The most significant difference is the dependency of the equilibrium strategy on the underlying distribution function f(x) and the number of agents. From Theorem 2 we obtain that the parallel contest equilibrium strategies depend on the number of agents k however do not depend whatsoever on f(x). Intuitively, this results from the fact that the competing agents, being a priori homogeneous, are all equally likely to win. With the sequential contest we obtain the reversed phenomenon-the probability distribution function plays a key role in shaping the agents' equilibrium strategies while the number of agents has no effect at all (see Theorem 3). The independence of the agents' equilibrium strategies in the number of participating agents can once again be explained by similar intuitions as those given in optimal stopping problems for the independence of the optimal stopping strategy in the number of sampling periods available for the searcher.
From the agents' point of view, in both methods the expected profit does not depend on the underlying performance distribution. In the parallel model variant this derives from Theorem 2 according to which neither the segments defining the different equilibria types and the p used (in case (b), according to (10)) do not depend on the distribution function. In the sequential case, this derives from (13).
In the homogeneous case, we can identify some conditions for determining the type of contest that will maximize the organizer's expected profit. These are captured by Proposition 2.
Proposition 2. From the organizer's point of view (i.e., Borg - wise): (a) when c = 0 or cM ≥ k-1 k both the parallel and sequential contests result in the same expected profit; (b) when 0 < cM ≤ 1k the parallel contest dominates the sequential one; and (c) for 1k < cM < k-1 k there exists at least one alternation point where the preference shifts from parallel to sequential contest.
Proof. In case c = 0 all agents participate in the contest, as proved in Theorems 2 and 3. Therefore the expected profit is identical. Similarly, in the case cM ≥ k-1 k all agents opt not to participate in the contest (Theorems 2 and 3) hence the expected profit is zero regardless of the method used. When 0 < cM ≤ 1k all agents participate in a parallel contest (Theorem 2), while with a sequential contest it is guaranteed that only the first agent participates, however the participation of the others depend on the performance of their predecessors. Therefore the parallel contest yields a greater expected profit.
For 1k < cM < k-1 k , we already know (proved above) that when cM = 1k parallel contest dominates sequential contest, hence to prove that there is an alternation point we need to show that for cM → k-1 k the sequential contest dominates the parallel. Substituting cM → k-1 k in (8) and (9) and equating the two (to obtain the mixed strategy p) obtains:
The above can hold only when p → 0. Therefore, the expected profit is Borg → 0. With sequential contest, on the other hand, when cM → k-1 k we obtain r → F -1 ( 1k ) (according to (11)), hence there will be at least one participant, leading to an expected profit Borg > 0.
Surprisingly, with parallel contest, the effect of the increase in the number of agents over the organizer's expected profit is not that clear - while one would expect agents to become more reluctant to participate due to the increased competition, the actual result can be either an increase or decrease in p. To illustrate, consider the case where M = 0.4, v∅ = 0 and a uniform distribution function over the interval (0, 1). Here, if c = 0.15 then in the transition from k = 3 to k = 4 the value of p decreases from 0.875 to 0.634, and consequently the organizer's expected profit decreases from 0.714 to 0.687, while in the case of c = 0.25 the value of p increases from 0.125 to 0.177 and consequently the organizer's expected profit increases from 0.172 to 0.297. This cannot happen in the sequential contest (proof is omitted for space considerations).
7 Discussion and Conclusions
As demonstrated numerically, the preference of the model to be used highly varies in the setting parameters, in the general case. This is where the analysis provided in the paper becomes particularly important, as it enables a contest organizer with the appropriate mathematical tools for extracting the equilibrium in both model variants. While the model assumes (much like most existing literature) the prize is always awarded, the transition to a model where the prize is not awarded if none of the agents participates is straightforward and requires only changing the profit in case of not participating (B¬P ) to zero. Still, in this latter variant one has to consider a multi-attribute utility function for the organizer, to reflect the tradeoff between an increase in the performance achieved and the prize payments made.
The analysis of the homogeneous case unfolds several interesting properties of the equilibrium in the two models, many of which are highly counter-intuitive (especially in the case of sequential contest). In particular, an important implication of Theorem 4 is that an agent's profit does not depend on its position in the sequence of participants. This has many important social aspects from the contest design point of view, as it completely eliminates the need to compensate agents for their position in the sequence in order to maintain fairness.
We see many directions for future research extending this work. Among these are multi-prize allocation for enhancing participation, sequencing algorithms for maximizing profit in the case of sequential contest with heterogeneous agents and prize-setting algorithms for maximizing social welfare.
Acknowledgments
This research was partially supported by the ISRAEL SCIENCE FOUNDATION (grants No. 1083/13) and the ISFNSFC joint research program (grant No. 2240/15).
@inproceedings{ijcai2017p43,
title = {Contest Design with Uncertain Performance and Costly Participation},
author = {Levy, Priel and Sarne, David and Rochlin, Igor},
booktitle = {Proceedings of the Twenty-Sixth International Joint Conference on
Artificial Intelligence, {IJCAI-17}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Carles Sierra},
pages = {302--309},
year = {2017},
month = {8},
note = {Main track},
doi = {10.24963/ijcai.2017/43},
url = {https://doi.org/10.24963/ijcai.2017/43},
}
TY - CPAPER TI - Contest Design with Uncertain Performance and Costly Participation AU - Levy, Priel AU - Sarne, David AU - Rochlin, Igor T2 - Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2017 SP - 302 EP - 309 DO - 10.24963/ijcai.2017/43 UR - https://doi.org/10.24963/ijcai.2017/43 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: