[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/feb/natura/00754.html
   My bibliography  Save this paper

The Economics of Content Moderation: Theory and Experimental Evidence from Hate Speech on Twitter

Author

Listed:
  • Rafael Jimenez-Duran
Abstract
Social media platforms ban users and remove posts to moderate their content. This "speech policing" remains controversial because little is known about its consequences and the costs and benefits for different individuals. I conduct two field experiments on Twitter to examine the effect of moderating hate speech on user behavior and welfare. Randomly reporting posts for violating the rules against hateful conduct increases the likelihood that Twitter removes them. Reporting does not affect the activity on the platform of the posts' authors or their likelihood of reposting hate, but it does increase the activity of those attacked by the posts. These results are consistent with a model in which content moderation is a quality decision for platforms that increases user engagement and hence advertising revenue. The second experiment shows that changing users' perceived content removal does not change their willingness to pause using social media, a measure of consumer surplus. My results imply that content moderation does not necessarily moderate users, but it marginally increases advertising revenue. It can be consistent with both profit- and welfare-maximization if out-of-platform externalities are small

Suggested Citation

  • Rafael Jimenez-Duran, 2021. "The Economics of Content Moderation: Theory and Experimental Evidence from Hate Speech on Twitter," Natural Field Experiments 00754, The Field Experiments Website.
    • Handle: RePEc:feb:natura:00754
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00754.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Leonardo Bursztyn & Ingar Haaland & Aakaash Rao & Christopher Roth, 2020. "Disguising Prejudice: Popular Rationales as Excuses for Intolerant Expression," Working Papers 2020-73, Becker Friedman Institute for Research In Economics.
    2. Steven Berry & Amit Gandhi & Philip Haile, 2013. "Connected Substitutes and Invertibility of Demand," Econometrica, Econometric Society, vol. 81(5), pages 2087-2111, September.
    3. Gary S. Becker & Kevin M. Murphy, 1993. "A Simple Theory of Advertising as a Good or Bad," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(4), pages 941-964.
    4. Leonardo Bursztyn & Georgy Egorov & Ruben Enikolopov & Maria Petrova, 2019. "Social Media and Xenophobia: Evidence from Russia," NBER Working Papers 26567, National Bureau of Economic Research, Inc.
    5. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    6. Hobbs, William R. & Roberts, Margaret E., 2018. "How Sudden Censorship Can Increase Access to Information," American Political Science Review, Cambridge University Press, vol. 112(3), pages 621-636, August.
    7. David Y. Yang & Leonardo Bursztyn, 2022. "Misperceptions About Others," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 425-452, August.
    8. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    9. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    10. Matthew Gentzkow, 2007. "Valuing New Goods in a Model with Complementarity: Online Newspapers," American Economic Review, American Economic Association, vol. 97(3), pages 713-744, June.
    11. Munger, Kevin, 2021. "Don’t @ Me: Experimentally Reducing Partisan Incivility on Twitter," Journal of Experimental Political Science, Cambridge University Press, vol. 8(2), pages 102-116, July.
    12. Hunt Allcott & Judd B. Kessler, 2019. "The Welfare Effects of Nudges: A Case Study of Energy Use Social Comparisons," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 236-276, January.
    13. E. Glen Weyl, 2010. "A Price Theory of Multi-sided Platforms," American Economic Review, American Economic Association, vol. 100(4), pages 1642-1672, September.
    14. Matthew Gentzkow & Bryan Kelly & Matt Taddy, 2019. "Text as Data," Journal of Economic Literature, American Economic Association, vol. 57(3), pages 535-574, September.
    15. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2024. "The Effect of Social Media on Elections: Evidence from The United States," Journal of the European Economic Association, European Economic Association, vol. 22(3), pages 1495-1539.
    16. Joao Correia‐da‐Silva & Bruno Jullien & Yassine Lefouili & Joana Pinho, 2019. "Horizontal mergers between multisided platforms: Insights from Cournot competition," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 28(1), pages 109-124, January.
    17. Ruben Enikolopov & Alexey Makarin & Maria Petrova, 2020. "Social Media and Protest Participation: Evidence From Russia," Econometrica, Econometric Society, vol. 88(4), pages 1479-1514, July.
    18. Roberto Mosquera & Mofioluwasademi Odunowo & Trent McNamara & Xiongfei Guo & Ragan Petrie, 2020. "The economic effects of Facebook," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 575-602, June.
    19. Siegel, Alexandra A. & Badaan, Vivienne, 2020. "#No2Sectarianism: Experimental Approaches to Reducing Sectarian Hate Speech Online," American Political Science Review, Cambridge University Press, vol. 114(3), pages 837-855, August.
    20. Leonardo Bursztyn & Alessandra L. González & David Yanagizawa-Drott, 2020. "Misperceived Social Norms: Women Working Outside the Home in Saudi Arabia," American Economic Review, American Economic Association, vol. 110(10), pages 2997-3029, October.
    21. Hunt Allcott & Luca Braghieri & Sarah Eichmeyer & Matthew Gentzkow, 2020. "The Welfare Effects of Social Media," American Economic Review, American Economic Association, vol. 110(3), pages 629-676, March.
    22. Amalia Álvarez & Fabian Winter, 2018. "Normative change and culture of hate: An experiment in online environments," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2018_03, Max Planck Institute for Research on Collective Goods.
    23. Guofu Tan & Junjie Zhou, 2021. "The Effects of Competition and Entry in Multi-sided Markets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(2), pages 1002-1030.
    24. Yuyu Chen & David Y. Yang, 2019. "The Impact of Media Censorship: 1984 or Brave New World?," American Economic Review, American Economic Association, vol. 109(6), pages 2294-2332, June.
    25. Ro'ee Levy, 2021. "Social Media, News Consumption, and Polarization: Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 111(3), pages 831-870, March.
    26. A. Michael Spence, 1975. "Monopoly, Quality, and Regulation," Bell Journal of Economics, The RAND Corporation, vol. 6(2), pages 417-429, Autumn.
    27. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, September.
    28. José Luis Montiel Olea & Mikkel Plagborg‐Møller, 2019. "Simultaneous confidence bands: Theory, implementation, and an application to SVARs," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(1), pages 1-17, January.
    29. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiménez-Durán, Rafael, 2022. "The economics of content moderation: Theory and experimental evidence from hate speech on Twitter," Working Papers 324, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    2. Luca Braghieri & Ro'ee Levy & Alexey Makarin, 2022. "Social Media and Mental Health," American Economic Review, American Economic Association, vol. 112(11), pages 3660-3693, November.
    3. Nicolás Ajzenman & Bruno Ferman & Pedro C. Sant’Anna, 2023. "Rooting for the Same Team: On the Interplay between Political and Social Identities in the Formation of Social Ties," Working Papers 231, Red Nacional de Investigadores en Economía (RedNIE).
    4. Ek, Claes & Samahita, Margaret, 2023. "Too much commitment? An online experiment with tempting YouTube content," Journal of Economic Behavior & Organization, Elsevier, vol. 208(C), pages 21-38.
    5. Rezaee, Arman & Hirshleifer, Sarojini & Naseem, Mustafa & Raza, Agha Ali, 2023. "The Spread of (Mis)information: A Social Media Experiment in Pakistan," Institute on Global Conflict and Cooperation, Working Paper Series qt53n4q35z, Institute on Global Conflict and Cooperation, University of California.
    6. Geraci, Andrea & Nardotto, Mattia & Reggiani, Tommaso & Sabatini, Fabio, 2022. "Broadband Internet and social capital," Journal of Public Economics, Elsevier, vol. 206(C).
    7. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2024. "The Effect of Social Media on Elections: Evidence from The United States," Journal of the European Economic Association, European Economic Association, vol. 22(3), pages 1495-1539.
    8. Garz, Marcel & Szucs, Ferenc, 2023. "Algorithmic selection and supply of political news on Facebook," Information Economics and Policy, Elsevier, vol. 62(C).
    9. Marco Grotteria & Max Miller & S.Lakshmi Naaraayanan, 2024. "Foreign influence in US politics," Discussion Papers 2024-12, Nottingham Interdisciplinary Centre for Economic and Political Research (NICEP).
    10. Eugenio Levi & Michael Bayerlein & Gianluca Grimalda & Tommaso Reggiani, 2023. "Narratives on migration and political polarization: How the emphasis in narratives can drive us apart," MUNI ECON Working Papers 2023-07, Masaryk University.
    11. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    12. Ekaterina Zhuravskaya & Maria Petrova & Ruben Enikolopov, 2020. "Political Effects of the Internet and Social Media," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 415-438, August.
    13. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2021. "Studying Information Acquisition in the Field: A Practical Guide and Review," CEBI working paper series 21-15, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    14. Andrea Tesei & Filipe Campante & Ruben Durante, 2022. "Media and Social Capital," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 69-91, August.
    15. Eugen Dimant, 2020. "Hate Trumps Love: The Impact of Political Polarization on Social Preferences," ECONtribute Discussion Papers Series 029, University of Bonn and University of Cologne, Germany.
    16. Ronak Jain & Vatsal Khandelwal, 2024. "Silent networks: The role of inaccurate beliefs in reducing useful social interactions," CSAE Working Paper Series 2024-06, Centre for the Study of African Economies, University of Oxford.
    17. Leonardo Bursztyn & Ingar Haaland & Aakaash Rao & Christopher Roth, 2020. "Disguising Prejudice: Popular Rationales as Excuses for Intolerant Expression," Working Papers 2020-73, Becker Friedman Institute for Research In Economics.
    18. Gisli Gylfason, 2023. "From Tweets to the Streets: Twitter and Extremist Protests in the United States," PSE Working Papers halshs-04188189, HAL.
    19. Artís, Annalí Casanueva & Avetian, Vladimir & Sardoschau, Sulin & Saxena, Kavya, 2022. "Social Media and the Broadening of Social Movements: Evidence from Black Lives Matter," IZA Discussion Papers 15812, Institute of Labor Economics (IZA).
    20. Jesper Akesson & Robert W. Hahn & Robert D. Metcalfe & Itzhak Rasooly, 2022. "Race and Redistribution in the United States: An Experimental Analysis," NBER Working Papers 30426, National Bureau of Economic Research, Inc.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:natura:00754. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesca Pagnotta (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.