We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments
Author
Suggested Citation
Download full text from publisher
Other versions of this item:
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments," GLO Discussion Paper Series 1157, Global Labor Organization (GLO).
References listed on IDEAS
- John Horton & David Rand & Richard Zeckhauser, 2011.
"The online laboratory: conducting experiments in a real labor market,"
Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
- John J. Horton & David G. Rand & Richard J. Zeckhauser, 2010. "The Online Laboratory: Conducting Experiments in a Real Labor Market," NBER Working Papers 15961, National Bureau of Economic Research, Inc.
- Horton, John Joseph & Rand, David Gertler & Zeckhauser, Richard Jay, 2010. "The Online Laboratory: Conducting Experiments in a Real Labor Market," Scholarly Articles 4448876, Harvard Kennedy School of Government.
- Horton, John J. & Rand, David G. & Zeckhauser, Richard, 2010. "The Online Laboratory: Conducting Experiments in a Real Labor Market," Working Paper Series rwp10-017, Harvard University, John F. Kennedy School of Government.
- Camerer, Colin F & Hogarth, Robin M, 1999.
"The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework,"
Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
- Camerer, Colin F. & Hogarth, Robin M., 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Working Papers 1059, California Institute of Technology, Division of the Humanities and Social Sciences.
- Francesco Guala & Luigi Mittone, 2005. "Experiments in economics: External validity and the robustness of phenomena," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(4), pages 495-515.
- Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
- Andreas Ortman & Le Zhang, 2013. "Exploring the Meaning of Significance in Experimental Economics," Discussion Papers 2013-32, School of Economics, The University of New South Wales.
- Steven D. Levitt & John A. List, 2007.
"Viewpoint: On the generalizability of lab behaviour to the field,"
Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(2), pages 347-370, May.
- Steven D. Levitt & John A. List, 2007. "Viewpoint: On the generalizability of lab behaviour to the field," Canadian Journal of Economics, Canadian Economics Association, vol. 40(2), pages 347-370, May.
- Steven Levitt & John List, 2007. "Viewpoint: On the generalizability of lab behaviour to the field," Artefactual Field Experiments 00001, The Field Experiments Website.
- Tomáš Havránek, 2015. "Measuring Intertemporal Substitution: The Importance Of Method Choices And Selective Reporting," Journal of the European Economic Association, European Economic Association, vol. 13(6), pages 1180-1204, December.
- Felix Chopra & Ingar Haaland & Christopher Roth & Andreas Stegmann, 2024.
"The Null Result Penalty,"
The Economic Journal, Royal Economic Society, vol. 134(657), pages 193-219.
- Felix Chopra & Ingar Haaland & Christopher Roth & Andreas Stegmann, 2023. "The Null Result Penalty," The Economic Journal, Royal Economic Society, vol. 134(657), pages 193-219.
- Felix Chopra & Ingar Haaland & Christopher Roth & Andreas Stegmann, 2022. "The Null Result Penalty," ECONtribute Discussion Papers Series 169, University of Bonn and University of Cologne, Germany.
- Chopra, Felix & Haaland, Ingar & Roth, Christopher & Stegmann, Andreas, 2022. "The Null Result Penalty," CEPR Discussion Papers 17331, C.E.P.R. Discussion Papers.
- Felix Chopra & Ingar K. Haaland & Christopher Roth & Andreas Stegmann, 2022. "The Null Result Penalty," CESifo Working Paper Series 9776, CESifo.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016.
"Star Wars: The Empirics Strike Back,"
American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," PSE Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," Post-Print hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," PSE-Ecole d'économie de Paris (Postprint) hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," PSE Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," AMSE Working Papers 1523, Aix-Marseille School of Economics, France, revised May 2015.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," SciencePo Working papers Main halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers 1505E, University of Ottawa, Department of Economics.
- Brodeur, Abel & Lé, Mathias & Sangnier, Marc & Zylberberg, Yanos, 2013. "Star Wars: The Empirics Strike Back," IZA Discussion Papers 7268, Institute of Labor Economics (IZA).
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," Working Papers halshs-00710122, HAL.
- Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2020.
"Simple Local Polynomial Density Estimators,"
Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1449-1455, July.
- Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2018. "Simple Local Polynomial Density Estimators," Papers 1811.11512, arXiv.org, revised Jun 2019.
- Cattaneo, Matias D & Jansson, Michael & Ma, Xinwei, 2020. "Simple Local Polynomial Density Estimators," Department of Economics, Working Paper Series qt9vt997qn, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Cattaneo, Matias D & Jansson, Michael & Ma, Xinwei, 2020. "Simple Local Polynomial Density Estimators," University of California at San Diego, Economics Working Paper Series qt9vt997qn, Department of Economics, UC San Diego.
- Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009.
"Risk attitudes, randomization to treatment, and self-selection into experiments,"
Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
- Glenn Harrison & Morten Lau & Elisabet Rutstrom, 2005. "Risk attitudes, randomization to treatment, and self-selection into experiments," Artefactual Field Experiments 00061, The Field Experiments Website.
- Erik Snowberg & Leeat Yariv, 2021. "Testing the Waters: Behavior across Participant Pools," American Economic Review, American Economic Association, vol. 111(2), pages 687-719, February.
- Stefano DellaVigna & Elizabeth Linos, 2022.
"RCTs to Scale: Comprehensive Evidence From Two Nudge Units,"
Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
- Stefano DellaVigna & Elizabeth Linos, 2020. "RCTs to Scale: Comprehensive Evidence from Two Nudge Units," NBER Working Papers 27594, National Bureau of Economic Research, Inc.
- David Johnson & John Barry Ryan, 2020.
"Amazon Mechanical Turk workers can provide consistent and economically meaningful data,"
Southern Economic Journal, John Wiley & Sons, vol. 87(1), pages 369-385, July.
- Johnson, David & Ryan, John, 2018. "Amazon Mechanical Turk Workers Can Provide Consistent and Economically Meaningful Data," MPRA Paper 88450, University Library of Munich, Germany.
- repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
- Isaiah Andrews & Maximilian Kasy, 2019.
"Identification of and Correction for Publication Bias,"
American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and correction for publication bias," Papers 1711.10527, arXiv.org.
- Kasy, Maximilian & Andrews, Isaiah, 2018. "Identification of and correction for publication bias," MetaArXiv 49yst, Center for Open Science.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and Correction for Publication Bias," NBER Working Papers 23298, National Bureau of Economic Research, Inc.
- Ziliak, Stephen T. & McCloskey, Deirdre N., 2004.
"Size matters: the standard error of regressions in the American Economic Review,"
Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 527-546, November.
- Stephen T. Ziliak & Deirdre N. McCloskey, 2004. "Size Matters: The Standard Error of Regressions in the American Economic Review," Econ Journal Watch, Econ Journal Watch, vol. 1(2), pages 331-358, August.
- Eva Vivalt, 2019. "Specification Searching and Significance Inflation Across Time, Methods and Disciplines," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 81(4), pages 797-816, August.
- Antonio A. Arechar & Gordon T. Kraft-Todd & David G. Rand, 2017. "Turking overtime: how participant characteristics and behavior vary over time and day on Amazon Mechanical Turk," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 3(1), pages 1-11, July.
- Nicholas Swanson & Garret Christensen & Rebecca Littman & David Birke & Edward Miguel & Elizabeth Levy Paluck & Zenan Wang, 2020. "Research Transparency Is on the Rise in Economics," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 61-65, May.
- Armin Falk & Stephan Meier & Christian Zehnder, 2013. "Do Lab Experiments Misrepresent Social Preferences? The Case Of Self-Selected Student Samples," Journal of the European Economic Association, European Economic Association, vol. 11(4), pages 839-852, August.
- Megan L Head & Luke Holman & Rob Lanfear & Andrew T Kahn & Michael D Jennions, 2015. "The Extent and Consequences of P-Hacking in Science," PLOS Biology, Public Library of Science, vol. 13(3), pages 1-15, March.
- Ben Gillen & Erik Snowberg & Leeat Yariv, 2019. "Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1826-1863.
- Coppock, Alexander, 2019. "Generalizing from Survey Experiments Conducted on Mechanical Turk: A Replication Approach," Political Science Research and Methods, Cambridge University Press, vol. 7(3), pages 613-628, July.
- Yun Shin Lee & Yong Won Seo & Enno Siemsen, 2018. "Running Behavioral Operations Experiments Using Amazon's Mechanical Turk," Production and Operations Management, Production and Operations Management Society, vol. 27(5), pages 973-989, May.
- Berinsky, Adam J. & Huber, Gregory A. & Lenz, Gabriel S., 2012. "Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk," Political Analysis, Cambridge University Press, vol. 20(3), pages 351-368, July.
- Chris Doucouliagos & T.D. Stanley, 2013. "Are All Economic Facts Greatly Exaggerated? Theory Competition And Selectivity," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 316-339, April.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023.
"Do economists replicate?,"
Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
- Fiala, Nathan & Neubauer, Florian & Peters, Jörg, 2022. "Do economists replicate?," Ruhr Economic Papers 939, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do Economists Replicate?," I4R Discussion Paper Series 13, The Institute for Replication (I4R).
- Tobias Thomas & Dominik Straub & Fabian Tatai & Megan Shene & Tümer Tosik & Kristian Kersting & Constantin A. Rothkopf, 2024. "Modelling dataset bias in machine-learned theories of economic decision-making," Nature Human Behaviour, Nature, vol. 8(4), pages 679-691, April.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Abel Brodeur, Nikolai M. Cook, Anthony Heyes, 2022.
"We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments,"
LCERPA Working Papers
am0133, Laurier Centre for Economic Research and Policy Analysis.
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments," MetaArXiv a9vhr, Center for Open Science.
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments," IZA Discussion Papers 15478, Institute of Labor Economics (IZA).
- Abel Brodeur & Nikolai Cook & Carina Neisser, 2024.
"p-Hacking, Data type and Data-Sharing Policy,"
The Economic Journal, Royal Economic Society, vol. 134(659), pages 985-1018.
- Abel Brodeur & Nikolai Cook & Carina Neisser, 2022. "P-Hacking, Data Type and Data-Sharing Policy," ECONtribute Discussion Papers Series 200, University of Bonn and University of Cologne, Germany.
- Brodeur, Abel & Cook, Nikolai & Neisser, Carina, 2022. "P-Hacking, Data Type and Data-Sharing Policy," IZA Discussion Papers 15586, Institute of Labor Economics (IZA).
- Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023.
"Unpacking P-hacking and Publication Bias,"
American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
- Brodeur, Abel & Carrell, Scott & Figlio, David & Lusher, Lester, 2023. "Unpacking P-Hacking and Publication Bias," I4R Discussion Paper Series 52, The Institute for Replication (I4R).
- Abel Brodeur & Scott E. Carrell & David N. Figlio & Lester R. Lusher, 2023. "Unpacking P-Hacking and Publication Bias," NBER Working Papers 31548, National Bureau of Economic Research, Inc.
- Brodeur, Abel & Carrell, Scott E. & Figlio, David N. & Lusher, Lester, 2023. "Unpacking P-Hacking and Publication Bias," IZA Discussion Papers 16369, Institute of Labor Economics (IZA).
- Brodeur, Abel & Cook, Nikolai & Hartley, Jonathan & Heyes, Anthony, 2022.
"Do Pre-Registration and Pre-analysis Plans Reduce p-Hacking and Publication Bias?,"
MetaArXiv
uxf39, Center for Open Science.
- Brodeur, Abel & Cook, Nikolai M. & Hartley, Jonathan S. & Heyes, Anthony, 2022. "Do Pre-Registration and Pre-analysis Plans Reduce p-Hacking and Publication Bias?," GLO Discussion Paper Series 1147, Global Labor Organization (GLO).
- Brodeur, Abel & Cook, Nikolai & Hartley, Jonathan S. & Heyes, Anthony, 2022. "Do Pre-registration and Pre-analysis Plans Reduce P-Hacking and Publication Bias?," IZA Discussion Papers 15476, Institute of Labor Economics (IZA).
- Abel Brodeur, Nikolai M. Cook, Jonathan S. Hartley, Anthony Heyes, 2022. "Do Pre-Registration and Pre-analysis Plans Reduce p-Hacking and Publication Bias?," LCERPA Working Papers am0132, Laurier Centre for Economic Research and Policy Analysis.
- Graham Elliott & Nikolay Kudrin & Kaspar Wüthrich, 2022.
"Detecting p‐Hacking,"
Econometrica, Econometric Society, vol. 90(2), pages 887-906, March.
- Graham Elliott & Nikolay Kudrin & Kaspar Wuthrich, 2019. "Detecting p-hacking," Papers 1906.06711, arXiv.org, revised May 2021.
- Elliott, Graham & Kudrin, Nikolay & Wüthrich, Kaspar, 2022. "Detecting p‐Hacking," University of California at San Diego, Economics Working Paper Series qt2p04s3dr, Department of Economics, UC San Diego.
- Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019.
"The Dozen Things Experimental Economists Should Do (More of),"
Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
- Eszter Czibor & David Jimenez-Gomez & John List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Artefactual Field Experiments 00648, The Field Experiments Website.
- Eszter Czibor & David Jimenez-Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," NBER Working Papers 25451, National Bureau of Economic Research, Inc.
- Graham Elliott & Nikolay Kudrin & Kaspar Wuthrich, 2022. "The Power of Tests for Detecting $p$-Hacking," Papers 2205.07950, arXiv.org, revised Apr 2024.
- Johannes G. Jaspersen & Marc A. Ragin & Justin R. Sydnor, 2022. "Insurance demand experiments: Comparing crowdworking to the lab," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 89(4), pages 1077-1107, December.
- Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
- Abel Brodeur & Nikolai M. Cook & Jonathan S. Hartley & Anthony Heyes, 2024.
"Do Preregistration and Preanalysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement,"
Journal of Political Economy Microeconomics, University of Chicago Press, vol. 2(3), pages 527-561.
- Brodeur, Abel & Cook, Nikolai M. & Hartley, Jonathan S. & Heyes, Anthony, 2023. "Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias?: Evidence from 15,992 Test Statistics and Suggestions for Improvement," GLO Discussion Paper Series 1147 [pre.], Global Labor Organization (GLO).
- Brodeur, Abel & Cook, Nikolai M. & Hartley, Jonathan S. & Heyes, Anthony, 2024. "Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement," I4R Discussion Paper Series 101, The Institute for Replication (I4R).
- Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023.
"When Does Monetary Policy Sway House Prices? A Meta-Analysis,"
IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
- Havranek, Tomas & Kolcunova, Dominika & Bajzik, Josef, 2021. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," CEPR Discussion Papers 16196, C.E.P.R. Discussion Papers.
- Josef Bajzik & Dominika Ehrenbergerova & Tomas Havranek, 2021. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," Working Papers IES 2021/17, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised May 2021.
- Ehrenbergerova, Dominika & Bajzik, Josef & Havranek, Tomas, 2021. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," EconStor Preprints 234126, ZBW - Leibniz Information Centre for Economics.
- Cristina Blanco-Perez & Abel Brodeur, 2020.
"Publication Bias and Editorial Statement on Negative Findings,"
The Economic Journal, Royal Economic Society, vol. 130(629), pages 1226-1247.
- Brodeur, Abel & Blanco-Perez, Cristina, 2017. "Publication Bias and Editorial Statement on Negative Findings," MetaArXiv xq9nt, Center for Open Science.
- Cristina Blanco-Perez & Abel Brodeur, 2019. "Publication Bias and Editorial Statement on Negative Findings," Working Papers 190001, Canadian Centre for Health Economics.
- Cristina Blanco-Perez & Abel Brodeur, 2019. "Publication Bias and Editorial Statement on Negative Findings," Working Papers 1907E, University of Ottawa, Department of Economics.
- Blanco-Perez, Cristina & Brodeur, Abel, 2019. "Publication Bias and Editorial Statement on Negative Findings," IZA Discussion Papers 12493, Institute of Labor Economics (IZA).
- Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
- Doucouliagos, Hristos & Hinz, Thomas & Zigova, Katarina, 2022.
"Bias and careers: Evidence from the aid effectiveness literature,"
European Journal of Political Economy, Elsevier, vol. 71(C).
- Doucouliagos, Chris & Hinz, Thomas & Zigova, Katarina, 2020. "Bias and Careers: Evidence from the Aid Effectiveness Literature," IZA Discussion Papers 13287, Institute of Labor Economics (IZA).
- Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2020.
"Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought,"
Working Papers IES
2020/29, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
- Havranek, Tomas & Irsova, Zuzana & Laslopova, Lubica & Zeynalova, Olesia, 2021. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," CEPR Discussion Papers 15724, C.E.P.R. Discussion Papers.
- Havranek, Tomas & Irsova, Zuzana & Laslopova, Lubica & Zeynalova, Olesia, 2020. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," EconStor Preprints 223060, ZBW - Leibniz Information Centre for Economics.
- Alexander L. Brown & Taisuke Imai & Ferdinand M. Vieider & Colin F. Camerer, 2024.
"Meta-analysis of Empirical Estimates of Loss Aversion,"
Journal of Economic Literature, American Economic Association, vol. 62(2), pages 485-516, June.
- Brown, Alexander L. & Imai, Taisuke & Vieider, Ferdinand & Camerer, Colin, 2020. "Meta-Analysis of Empirical Estimates of Loss-Aversion," MetaArXiv hnefr, Center for Open Science.
- Alexander, L. Brown & Taisuke Imai & Ferdinand M. Vieider & Colin Camerer, 2021. "Meta-Analysis of Empirical Estimates of Loss-Aversion," CESifo Working Paper Series 8848, CESifo.
- Brown, Alexander L. & Imai, Taisuke & Vieider, Ferdinand M. & Camerer, Colin F., 2021. "Meta-Analysis of Empirical Estimates of Loss-Aversion," Rationality and Competition Discussion Paper Series 275, CRC TRR 190 Rationality and Competition.
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2018.
"Methods Matter: P-Hacking and Causal Inference in Economics,"
IZA Discussion Papers
11796, Institute of Labor Economics (IZA).
- Abel Brodeur & Nikolai Cook & Anthony Heyes, 2018. "Methods Matter: P-Hacking and Causal Inference in Economics," Working Papers 1809E, University of Ottawa, Department of Economics.
- Matteo Picchio & Michele Ubaldi, 2024.
"Unemployment and health: A meta‐analysis,"
Journal of Economic Surveys, Wiley Blackwell, vol. 38(4), pages 1437-1472, September.
- Picchio, Matteo & Ubaldi, Michele, 2022. "Unemployment and Health: A Meta-Analysis," GLO Discussion Paper Series 1128, Global Labor Organization (GLO).
- Matteo Picchio & Michele Ubaldi, 2022. "Unemployment And Health: A Meta-Analysis," Working Papers 467, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
- Picchio, Matteo & Ubaldi, Michele, 2022. "Unemployment and Health: A Meta-Analysis," IZA Discussion Papers 15433, Institute of Labor Economics (IZA).
- Cazachevici, Alina & Havranek, Tomas & Horvath, Roman, 2020.
"Remittances and economic growth: A meta-analysis,"
World Development, Elsevier, vol. 134(C).
- Alina Cazachevici & Tomas Havranek & Roman Horvath, 2019. "Remittances and Economic Growth: A Meta-Analysis," Working Papers IES 2019/35, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Oct 2019.
- Anna Dreber & Magnus Johannesson & Yifan Yang, 2024.
"Selective reporting of placebo tests in top economics journals,"
Economic Inquiry, Western Economic Association International, vol. 62(3), pages 921-932, July.
- Dreber, Anna & Johannesson, Magnus & Yang, Yifan, 2023. "Selective Reporting of Placebo Tests in Top Economics Journals," I4R Discussion Paper Series 31, The Institute for Replication (I4R).
More about this item
Keywords
online crowd-sourcing platforms; Amazon Mechanical Turk; p-hacking; publication bias; statistical power; research credibility;All these keywords.
JEL classification:
- B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
- C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
- C40 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - General
- C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
NEP fields
This paper has been announced in the following NEP Reports:- NEP-EXP-2022-12-05 (Experimental Economics)
- NEP-SOG-2022-12-05 (Sociology of Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:i4rdps:8. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://www.i4replication.org/ .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.