Please enter the university email adress you used when signing up to the prediction markets:


SURVEY

There will be a total of 18 studies on which you can bet that a hypothesis will be supported or not. These 18 studies will be listed below, as well as a link to the abstract of each paper and a link to the replication report that contains more details on the hypothesis, the study and the replication. All replication studies have a power of at least 90%.

In each market that you participate, you will bet on a binary outcome: whether or not the replication study finds a statistically significant effect in the same direction as the original study.

By statistically significant we mean a p­value smaller than 0.05. By same direction we mean a coefficient that has the same sign as in the original study (i.e. positive or negative).

Before the prediction market opens, we ask all participants to fill out the following short survey.

For each of the 18 studies, please respond to the following questions:

1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).


Before doing this, please answer the following demographics questions (optional):


Position


Professor
Associate
Professor
Assistant
Professor

PostDoc

Lecturer
PhD
Candidate
Master
Student
Undergraduate
Student


Years in academia after obtaining PhD


Age


Gender

Male Female Other


Affiliation


Country of residence


Nationality


Core fields of research


Study 1 - Abeler et al. (AER 2011)

Reference: Abeler, Johannes, Armin Falk, Lorenz Goette, and David Huffman. 2011. “Reference Points and Effort Provision.” American Economic Review, 101(2): 470-92

Replication report: Link

Hypothesis to bet on: Subjects exert more effort (leading to higher earnings) in a real effort task if the expectations-based reference point is increased (a comparison of the average accumulated earnings in the real effort task between the LO treatment and the HI treatment).

Original p-value: 0.046

Original sample size: 120

Replication sample size: 318

Replication power: 90%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 2 - Ambrus and Greiner (AER 2012)

Reference: Ambrus, Attila, and Ben Greiner. 2012. “Imperfect Public Monitoring with Costly Punishment: An Experimental Study.” American Economic Review, 102(7): 3317-32

Replication report: Link

Hypothesis to bet on: When there is imperfect monitoring, allowing punishment reduces net earnings (i.e., earnings after punishment costs).

Original p-value: 0.057

Original sample size: 117

Replication sample size: 340

Replication power: 90%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 3 - Bartling et al. (AER 2012)

Reference: Bartling, Björn, Ernst Fehr, and Klaus M. Schmidt. 2012. “Screening, Competition, and Job Design: Economic Origins of Good Jobs.” American Economic Review, 102(2): 834-64

Replication report: Link

Hypothesis to bet on: Adding a screening opportunity (informing the employer about the effort of the worker in the past three periods) for an employer that can offer full or limited discretion contracts increases efficiency (a comparison in average per-period total surplus between the base treatment and the screening treatment).

Original p-value: 0.007

Original sample size: 216

Replication sample size: 360

Replication power: 94%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 4 - Charness and Dufwenberg (AER 2011)

Reference: Charness, Gary, and Martin Dufwenberg. 2011. “Participation.” American Economic Review, 101(4): 1211-37

Replication report: Link

Hypothesis to bet on: Communication is effective in a hidden-information game when low-talent agents can participate in a Pareto-improving outcome (a comparison of the “Low B’s Don’t rate” for the messages (M) and no messages (NM) treatments for the (5,7) hidden information game).

Original p-value: 0.01

Original sample size: 162

Replication sample size: 264

Replication power: 90%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 5 - Chen and Chen (AER 2011)

Reference: Chen, Roy, and Yan Chen. 2011. “The Potential of Social Identity for Equilibrium Selection.” American Economic Review, 101(6): 2562-89

Replication report: Link

Hypothesis to bet on: Effort in a minimum effort game is higher for subjects with a salient in-group identity than for subjects with a salient outgroup identity (a comparison of mean effort between the “Enhanced Ingroup” treatment and the “Enhanced Outgroup” treatment).

Original p-value: 0.033

Original sample size: 72

Replication sample size: 168

Replication power: 90%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 6 - de Clippel et al. (AER 2014)

Reference: de Clippel, Geoffroy, Kfir Eliaz, and Brian Knight. 2014. “On the Selection of Arbitrators.” American Economic Review, 104(11): 3434-58

Replication report: Link

Hypothesis to bet on: Efficiency (average aggregate payoff) is higher with the social choice mechanism Shortlisting (SL) than with the Veto-Rank (VR) mechanism for preference profile Pf2.

Original p-value: 0.001

Original sample size: 158

Replication sample size: 156

Replication power: 90%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 7 - Duffy and Puzzello (AER 2014)

Reference: Duffy, John, and Daniela Puzzello. 2014. “Gift Exchange versus Monetary Exchange: Theory and Evidence.” American Economic Review, 104(6): 1735-76

Replication report: Link

Hypothesis to bet on: Efficiency in the Lagos-Wright money model is higher in an environment with money than in an environment without money for a population size of 6 (comparison in efficiency ratio between the money (M6) and the no money6 (NM6) treatments).

Original p-value: 0.01

Original sample size: 54

Replication sample size: 96

Replication power: 93%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 8 - Dulleck et al. (AER 2011)

Reference: Dulleck, Uwe, Rudolf Kerschbamer, and Matthias Sutter. 2011. “The Economics of Credence Goods: An Experiment on the Role of Liability, Verifiability, Reputation, and Competition.” American Economic Review, 101(2): 526-55

Replication report: Link

Hypothesis to bet on: In a situation with verifiability, liability increases efficiency in a credence goods market (a comparison of efficiency between the B/LV treatment (liability/verifiability) and the B/V treatment (no liability/verifiability).

Original p-value: 0.0001

Original sample size: 168

Replication sample size: 128

Replication power: 92%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 9 - Fehr et al. (AER 2013)

Reference: Fehr, Ernst, Holger Herz, and Tom Wilkening. 2013. “The Lure of Authority: Motivation and Incentive Effects of Power.” American Economic Review, 103(4): 1325-59

Replication report: Link

Hypothesis to bet on: The nonpecuniary disutility of being overruled causes a reluctance to delegate authority (a comparison of the average delegation rate between the HIGH NOREC and the PHIGH25 treatments).

Original p-value: 0.011

Original sample size: 60

Replication sample size: 102

Replication power: 91%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 10 - Friedman and Oprea (AER 2012)

Reference: Friedman, Daniel, and Ryan Oprea. 2012. “A Continuous Dilemma.” American Economic Review, 102(1): 337-63

Replication report: Link

Hypothesis to bet on: Cooperation in the prisoner’s dilemma is higher in continuous time with flow payoffs over 60 seconds compared to eight equal subperiods (a comparison in the level of cooperation between the Continuous treatment and the Grid-8 treatment).

Original p-value: 4.0e-11

Original sample size: 78

Replication sample size: 40

Replication power: 99%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 11 - Fudenberg et al. (AER 2012)

Reference: Fudenberg, Drew, David G. Rand, and Anna Dreber. 2012. “Slow to Anger and Fast to Forgive: Cooperation in an Uncertain World.” American Economic Review, 102(2): 720-49

Replication report: Link

Hypothesis to bet on: Cooperation in a repeated prisoner’s dilemma with noise (a specific probability that an intended move is changed to the opposite move) is higher when there are cooperative equilibria (a comparison in the level of overall cooperation between the b/c=1.5 and the b/c=2 treatment).

Original p-value: 0.001

Original sample size: 124

Replication sample size: 120

Replication power: 90%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 12 - Huck et al. (AER 2011)

Reference: Huck, Steffen, Andrew J. Seltzer, and Brian Wallace. 2011. “Deferred Compensation in Multiperiod Labor Contracts: An Experimental Test of Lazear's Model.” American Economic Review, 101(2): 819-43

Replication report: Link

Hypothesis to bet on: The ability to pay future deferred compensation increases worker earnings (w2+w3) more when commitment is enforced (FCT) compared to non-enforcement (NCT).

Original p-value: 0.0039

Original sample size: 120

Replication sample size: 160

Replication power: 91%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 13 - Ifcher and Zarghamee (AER 2011)

Reference: Ifcher, John, and Homa Zarghamee. 2011. “Happiness and Time Preference: The Effect of Positive Affect in a Random-Assignment Experiment.” American Economic Review, 101(7): 3109-29

Replication report: Link

Hypothesis to bet on: Showing subjects a film clip inducing positive affect will increase measured patience, excluding subjects who do not discount at all (Table 3, column 5).

Original p-value: 0.031

Original sample size: 58

Replication sample size: 131 (after excluding non-discounters)

Replication power: 90%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 14 - Kessler and Roth (AER 2012)

Reference: Kessler, Judd B., and Alvin E. Roth. 2012. “Organ Allocation Policy and the Decision to Donate.” American Economic Review, 102(5): 2018-47

Replication report: Link

Hypothesis to bet on: An organ donation policy giving priority on waiting lists to those who previously registered as donors increase registered organ donors (a comparison of the fraction choosing to be a donor between the priority condition treatment and the control condition treatment in rounds 1-15 (the rounds for the between subjects comparison)).

Original p-value: 1.631e-18

Original sample size: 288

Replication sample size: 48

Replication power: 95%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 15 - Kirchler et al (AER 2012)

Reference: Kirchler, Michael, Jürgen Huber, and Thomas Stöckl. 2012. “Thar She Bursts: Reducing Confusion Reduces Bubbles.” American Economic Review, 102(2): 865-83

Replication report: Link

Hypothesis to bet on: A declining fundamental value (FV) increases mispricing in experimental asset markets (a comparison of the mean relative absolute deviation (RAD) between treatment 1 (T1) and treatment 2 (T2)).

Original p-value: 0.016

Original sample size: 120

Replication sample size: 220

Replication power: 90%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 16 - Kogan et al. (AER 2011)

Reference: Kogan, Shimon, Anthony M. Kwasnica, and Roberto A. Weber. 2011. “Coordination in the Presence of Asset Markets.” American Economic Review, 101(2): 927-47

Replication report: Link

Hypothesis to bet on: The presence of a preplay asset market lowers output in a “second-order statistic” coordination game (a comparison of group output of the insider groups in the market treatment and the control group in Experiment 2).

Original p-value: 0.000026

Original sample size: 126

Replication sample size: 90

Replication power: 94%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 17 - Kuziemko et al. (QJE 2014)

Reference: Kuziemko, Ilyana, Ryan W. Buell, Taly Reich and Michael I. Norton. 2014. “Last-Place Aversion: Evidence and Redistributive Implications.” The Quarterly Journal of Economics, 129(1): 105-149

Replication report: Link

Hypothesis to bet on: Subjects randomly placed in second-to-last place in terms of endowments are significantly less likely to allocate money to the person one rank below them in a choice of distributing $2 to the person one rank below or the person one rank above (a comparison of allocation decisions between subjects randomly ranked second-to-last and subjects randomly ranked 2-4 in the 6 person redistribution experiment).

Original p-value: 0.07

Original sample size: 42

Replication sample size: 138

Replication power: 91%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567

Study 18 - Marzilli Ericson and Fuster (QJE 2011)

Reference: Marzilli Ericson, Keith M., and Andreas Fuster. 2011. “Expectations as Endowments: Evidence on Reference-Dependent Preferences from Exchange and Valuation Experiments.” The Quarterly Journal of Economics, 126(4): 1879-1907

Replication report: Link

Hypothesis to bet on: The willingness to accept (WTA) for a mug is higher for a high probability of receiving the mug for free compared to a low probability of receiving the mug for free (a comparison of the mean WTA between the treatment MH (80% chance of receiving the mug for free at the end of the experiment) and the treatment ML (10% chance of receiving the mug for free at the end of the experiment) in Experiment 2).

Original p-value: 0.03

Original sample size: 112

Replication sample size: 250

Replication power: 90%


1A. What is the likelihood of this hypothesis to be replicated (on a scale from 0 to 100%)?

0 10 20 30 40 50 60 70 80 90 100


1B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


2A. What will be the final trading price in this market (ranging from 0 to 1 with two decimal places)?

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1


2B. Please rate the confidence of your answer on a scale from 1 (no confidence) to 7 (very high confidence).

1234567


3. Please rate your status of expertise for the replicated study on a scale from 1 (no knowledge of the topic) to 7 (very high knowledge of the topic).

1234567