[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/21143.html
   My bibliography  Save this paper

Above a Swamp: A Theory of High-Quality Scientific Production

Author

Listed:
  • Bralind Kiri
  • Nicola Lacetera
  • Lorenzo Zirulia
Abstract
We elaborate a model of the incentives of scientists to perform activities of control and criticism when these activities, just like the production of novel findings, are costly, and we study the strategic interaction between these incentives. We then use the model to assess policies meant to enhance the reliability of scientific knowledge. We show that a certain fraction of low-quality science characterizes all the equilibria in the basic model. In fact, the absence of detected low-quality research can be interpreted as the lack of verification activities and thus as a potential limitation to the reliability of a field. Incentivizing incremental research and verification activities improves the expected quality of research; this effect, however, is contrasted by the incentives to free ride on performing verification if many scientists are involved, and may discourage scientists to undertake new research in the first place. Finally, softening incentives to publish does not enhance quality, although it increases the fraction of detected low-quality papers. We also advance empirical predictions and discuss the insights for firms and investors as they "scout" the scientific landscape.

Suggested Citation

  • Bralind Kiri & Nicola Lacetera & Lorenzo Zirulia, 2015. "Above a Swamp: A Theory of High-Quality Scientific Production," NBER Working Papers 21143, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:21143
    Note: PR
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w21143.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Emeric Henry, 2009. "Strategic Disclosure of Research Results: The Cost of Proving Your Honesty," Economic Journal, Royal Economic Society, vol. 119(539), pages 1036-1064, July.
    2. Philip Abelson, 1990. "Mechanisms for evaluating scientific information and the role of peer review," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 41(3), pages 216-222, April.
    3. George J. Borjas & Kirk B. Doran, 2021. "The Collapse Of The Soviet Union And The Productivity Of American Mathematicians," World Scientific Book Chapters, in: Foundational Essays in Immigration Economics, chapter 11, pages 313-373, World Scientific Publishing Co. Pte. Ltd..
    4. Uri Gneezy & Stephan Meier & Pedro Rey-Biel, 2011. "When and Why Incentives (Don't) Work to Modify Behavior," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 191-210, Fall.
    5. Mueller-Langer, Frank & Andreoli-Versbach, Patrick, 2018. "Open access to research data: Strategic delay and the ambiguous welfare effects of mandatory data disclosure," Information Economics and Policy, Elsevier, vol. 42(C), pages 20-34.
    6. Macho-Stadler, Inés & Pérez-Castrillo, David, 2010. "Incentives in university technology transfers," International Journal of Industrial Organization, Elsevier, vol. 28(4), pages 362-367, July.
    7. Emeric Henry & Marco Ottaviani, 2019. "Research and the Approval Process: The Organization of Persuasion," American Economic Review, American Economic Association, vol. 109(3), pages 911-955, March.
    8. Albert Banal‐Estañol & Inés Macho‐Stadler, 2010. "Scientific and Commercial Incentives in R&D: Research versus Development?," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 19(1), pages 185-221, March.
    9. Petra Moser & Alessandra Voena & Fabian Waldinger, 2014. "German Jewish ?migr?s and US Invention," American Economic Review, American Economic Association, vol. 104(10), pages 3222-3255, October.
    10. Philippe Aghion & Mathias Dewatripont & Jeremy C. Stein, 2008. "Academic freedom, private‐sector focus, and the process of innovation," RAND Journal of Economics, RAND Corporation, vol. 39(3), pages 617-635, September.
    11. Graetz, Michael J & Reinganum, Jennifer F & Wilde, Louis L, 1986. "The Tax Compliance Game: Toward an Interactive Theory of Law Enforcement," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 2(1), pages 1-32, Spring.
    12. Nicola Lacetera & Lorenzo Zirulia, 2011. "The Economics of Scientific Misconduct," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 27(3), pages 568-603.
    13. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
    14. Baum, Joel A. C. & Silverman, Brian S., 2004. "Picking winners or building them? Alliance, intellectual, and human capital as selection criteria in venture financing and performance of biotechnology startups," Journal of Business Venturing, Elsevier, vol. 19(3), pages 411-436, May.
    15. Daniel S. Hamermesh, 2007. "Replication in Economics," NBER Working Papers 13026, National Bureau of Economic Research, Inc.
    16. Azoulay, Pierre & Bonatti, Alessandro & Krieger, Joshua L., 2017. "The career effects of scandal: Evidence from scientific retractions," Research Policy, Elsevier, vol. 46(9), pages 1552-1569.
    17. Brian Erard & Jonathan S. Feinstein, 1994. "Honesty and Evasion in the Tax Compliance Game," RAND Journal of Economics, The RAND Corporation, vol. 25(1), pages 1-19, Spring.
    18. John P A Ioannidis, 2014. "How to Make More Published Research True," PLOS Medicine, Public Library of Science, vol. 11(10), pages 1-6, October.
    19. repec:hal:wpspec:info:hdl:2441/eu4vqp9ompqllr09iatr74eao is not listed on IDEAS
    20. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    21. Raj Chetty & Emmanuel Saez & Laszlo Sandor, 2014. "What Policies Increase Prosocial Behavior? An Experiment with Referees at the Journal of Public Economics," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 169-188, Summer.
    22. Reinganum, Jennifer F & Wilde, Louis L, 1986. "Equilibrium Verification and Reporting Policies in a Model of Tax Compliance," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 27(3), pages 739-760, October.
    23. Henry Sauermann & Paula Stephan, 2013. "Conflicting Logics? A Multidimensional View of Industrial and Academic Science," Organization Science, INFORMS, vol. 24(3), pages 889-909, June.
    24. John P. A. Ioannidis, 2011. "Fund people not projects," Nature, Nature, vol. 477(7366), pages 529-531, September.
    25. Scott Stern, 2004. "Do Scientists Pay to Be Scientists?," Management Science, INFORMS, vol. 50(6), pages 835-853, June.
    26. Partha, Dasgupta & David, Paul A., 1994. "Toward a new economics of science," Research Policy, Elsevier, vol. 23(5), pages 487-521, September.
    27. Engers, Maxim & Gans, Joshua S, 1998. "Why Referees Are Not Paid (Enough)," American Economic Review, American Economic Association, vol. 88(5), pages 1341-1349, December.
    28. Glenn Ellison, 2002. "Evolving Standards for Academic Publishing: A q-r Theory," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 994-1034, October.
    29. Daniel S. Hamermesh & Gerard A. Pfann, 2012. "Reputation And Earnings: The Roles Of Quality And Quantity In Academe," Economic Inquiry, Western Economic Association International, vol. 50(1), pages 1-16, January.
    30. Marie Thursby & Richard Jensen, 2001. "Proofs and Prototypes for Sale: The Licensing of University Inventions," American Economic Review, American Economic Association, vol. 91(1), pages 240-259, March.
    31. Thomas Gall & John P A Ioannidis & Zacharias Maniadis, 2017. "The credibility crisis in research: Can economics tools help?," PLOS Biology, Public Library of Science, vol. 15(4), pages 1-13, April.
    32. David B. Allison & Andrew W. Brown & Brandon J. George & Kathryn A. Kaiser, 2016. "Reproducibility: A tragedy of errors," Nature, Nature, vol. 530(7588), pages 27-29, February.
    33. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    34. Lacetera, Nicola & Zirulia, Lorenzo, 2012. "Individual preferences, organization, and competition in a model of R&D incentive provision," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 550-570.
    35. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    36. C. Glenn Begley & Lee M. Ellis, 2012. "Raise standards for preclinical cancer research," Nature, Nature, vol. 483(7391), pages 531-533, March.
    37. Leonard P Freedman & Iain M Cockburn & Timothy S Simcoe, 2015. "The Economics of Reproducibility in Preclinical Research," PLOS Biology, Public Library of Science, vol. 13(6), pages 1-9, June.
    38. Kealey, Terence & Ricketts, Martin, 2014. "Modelling science as a contribution good," Research Policy, Elsevier, vol. 43(6), pages 1014-1024.
    39. Romer, Paul M, 1990. "Endogenous Technological Change," Journal of Political Economy, University of Chicago Press, vol. 98(5), pages 71-102, October.
    40. Roach, Michael & Sauermann, Henry, 2010. "A taste for science? PhD scientists' academic orientation and self-selection into research careers in industry," Research Policy, Elsevier, vol. 39(3), pages 422-434, April.
    41. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    42. repec:hal:spmain:info:hdl:2441/eu4vqp9ompqllr09iatr74eao is not listed on IDEAS
    43. Wible James, 1998. "THE ECONOMICS OF SCIENCE, METHODOLOGY AND EPISTEMOLOGY AS IF ECONOMICS REALLY MATTER: Compte rendu de lecture par Emmanuel Martin," Journal des Economistes et des Etudes Humaines, De Gruyter, vol. 8(4), pages 555-572, December.
    44. Haeussler, Carolin & Jiang, Lin & Thursby, Jerry & Thursby, Marie, 2014. "Specific and general information sharing among competing academic researchers," Research Policy, Elsevier, vol. 43(3), pages 465-475.
    45. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
    46. Emeric Henry, 2009. "Disclosure of research results: the cost of proving your honesty," Post-Print hal-01023670, HAL.
    47. Scott E. Masten, 2006. "Authority and Commitment: Why Universities, Like Legislatures, Are Not Organized as Firms," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 15(3), pages 649-684, September.
    48. Lakhani, Karim R. & von Hippel, Eric, 2003. "How open source software works: "free" user-to-user assistance," Research Policy, Elsevier, vol. 32(6), pages 923-943, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 48(1), pages 62-83.
    2. Hussinger, Katrin & Pellens, Maikel, 2019. "Guilt by association: How scientific misconduct harms prior collaborators," Research Policy, Elsevier, vol. 48(2), pages 516-530.
    3. Gall, Thomas & Maniadis, Zacharias, 2019. "Evaluating solutions to the problem of false positives," Research Policy, Elsevier, vol. 48(2), pages 506-515.
    4. Le Maux, Benoît & Necker, Sarah & Rocaboy, Yvon, 2019. "Cheat or perish? A theory of scientific customs," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    5. Khezr, Peyman & Mohan, Vijay, 2022. "The vexing but persistent problem of authorship misconduct in research," Research Policy, Elsevier, vol. 51(3).
    6. Mohan, Vijay, 2019. "On the use of blockchain-based mechanisms to tackle academic misconduct," Research Policy, Elsevier, vol. 48(9), pages 1-1.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," Research Policy, Elsevier, vol. 48(1), pages 62-83.
    2. Hussinger, Katrin & Pellens, Maikel, 2019. "Guilt by association: How scientific misconduct harms prior collaborators," Research Policy, Elsevier, vol. 48(2), pages 516-530.
    3. Andreoli-Versbach, Patrick & Mueller-Langer, Frank, 2014. "Open access to data: An ideal professed but not practised," Research Policy, Elsevier, vol. 43(9), pages 1621-1633.
    4. Henry Sauermann & Michael Roach, 2011. "Not All Scientists pay to be Scientists:," DRUID Working Papers 11-03, DRUID, Copenhagen Business School, Department of Industrial Economics and Strategy/Aalborg University, Department of Business Studies.
    5. Felgenhauer, Mike, 2021. "Experimentation and manipulation with preregistration," Games and Economic Behavior, Elsevier, vol. 130(C), pages 400-408.
    6. Salandra, Rossella, 2018. "Knowledge dissemination in clinical trials: Exploring influences of institutional support and type of innovation on selective reporting," Research Policy, Elsevier, vol. 47(7), pages 1215-1228.
    7. Bergemann, Dirk & Ottaviani, Marco, 2021. "Information Markets and Nonmarkets," CEPR Discussion Papers 16459, C.E.P.R. Discussion Papers.
    8. Mark J. McCabe & Frank Mueller-Langer, 2019. "Does Data Disclosure Increase Citations? Empirical Evidence from a Natural Experiment in Leading Economics Journals," JRC Working Papers on Digital Economy 2019-02, Joint Research Centre.
    9. Sam Arts & Reinhilde Veugelers, 2020. "Taste for science, academic boundary spanning, and inventive performance of scientists and engineers in industry," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 29(4), pages 917-933.
    10. Sauermann, Henry & Roach, Michael, 2014. "Not all scientists pay to be scientists: PhDs’ preferences for publishing in industrial employment," Research Policy, Elsevier, vol. 43(1), pages 32-47.
    11. Horton, Joanne & Krishna Kumar, Dhanya & Wood, Anthony, 2020. "Detecting academic fraud using Benford law: The case of Professor James Hunton," Research Policy, Elsevier, vol. 49(8).
    12. Mueller-Langer, Frank & Andreoli-Versbach, Patrick, 2018. "Open access to research data: Strategic delay and the ambiguous welfare effects of mandatory data disclosure," Information Economics and Policy, Elsevier, vol. 42(C), pages 20-34.
    13. Gans, Joshua S. & Murray, Fiona E. & Stern, Scott, 2017. "Contracting over the disclosure of scientific knowledge: Intellectual property and academic publication," Research Policy, Elsevier, vol. 46(4), pages 820-835.
    14. Simeth, Markus & Raffo, Julio D., 2013. "What makes companies pursue an Open Science strategy?," Research Policy, Elsevier, vol. 42(9), pages 1531-1543.
    15. Simeth, Markus & Lhuillery, Stephane, 2015. "How do firms develop capabilities for scientific disclosure?," Research Policy, Elsevier, vol. 44(7), pages 1283-1295.
    16. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    17. Liu, Christopher C. & Stuart, Toby, 2014. "Positions and rewards: The allocation of resources within a science-based entrepreneurial firm," Research Policy, Elsevier, vol. 43(7), pages 1134-1143.
    18. Michaël Bikard, 2018. "Made in Academia: The Effect of Institutional Origin on Inventors’ Attention to Science," Organization Science, INFORMS, vol. 29(5), pages 818-836, October.
    19. Catalina Martínez & Sarah Parlane, 2018. "On the firms’ decision to hire academic scientists," Working Papers 1801, Instituto de Políticas y Bienes Públicos (IPP), CSIC.
    20. Mike Felgenhauer & Fangya Xu, 2021. "The Face Value Of Arguments With And Without Manipulation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 62(1), pages 277-293, February.

    More about this item

    JEL classification:

    • L31 - Industrial Organization - - Nonprofit Organizations and Public Enterprise - - - Nonprofit Institutions; NGOs; Social Entrepreneurship
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:21143. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.