[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v106y2023ics2214804323000745.html
   My bibliography  Save this article

The adventure of running experiments with teenagers

Author

Listed:
  • Alfonso, Antonio
  • Brañas-Garza, Pablo
  • Jorrat, Diego
  • Lomas, Pablo
  • Prissé, Benjamin
  • Vasco, Mónica
  • Vázquez-De Francisco, María J.
Abstract
Economists are increasingly interested in how to conduct experiments with teenagers. This paper evaluates whether different methodological factors impact the answers of teenagers to standard experimental tasks on measuring time preferences, risk preferences and cognitive abilities, among others. Results show: (i) the recruitment process matters. When the school includes the experiment as an institutional activity, the dropout rate is observed to be significantly reduced; (ii) hypothetical payments elicit similar results to monetary payments; (iii) adding visual elements to the experiment’s interface improves the quality of answers; and iv) although the type of device has no effect on the results, who administers the experiment does have an effect. We conclude by giving three suggestions to researchers interested in conducting experiments with teenagers: first, run the experiment as a school-programmed activity; second, the use of actual payments is not necessary, which increases the cost and complicates the recruitment; and third, integrate visual components to the task.

Suggested Citation

  • Alfonso, Antonio & Brañas-Garza, Pablo & Jorrat, Diego & Lomas, Pablo & Prissé, Benjamin & Vasco, Mónica & Vázquez-De Francisco, María J., 2023. "The adventure of running experiments with teenagers," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 106(C).
    • Handle: RePEc:eee:soceco:v:106:y:2023:i:c:s2214804323000745
    DOI: 10.1016/j.socec.2023.102048
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804323000745
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socec.2023.102048?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Brocas, Isabelle & Carrillo, Juan D. & Combs, T. Dalton & Kodaverdian, Niree, 2019. "The development of consistent decision-making across economic domains," Games and Economic Behavior, Elsevier, vol. 116(C), pages 217-240.
    2. Brañas-Garza, Pablo & Estepa-Mohedano, Lorenzo & Jorrat, Diego & Orozco, Victor & Rascón-Ramírez, Ericka, 2021. "To pay or not to pay: Measuring risk preferences in lab and field," Judgment and Decision Making, Cambridge University Press, vol. 16(5), pages 1290-1313, September.
    3. Andreoni, James & Kuhn, Michael A. & List, John A. & Samek, Anya & Sokal, Kevin & Sprenger, Charles, 2019. "Toward an understanding of the development of time preferences: Evidence from field experiments," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    4. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    5. Matthias Sutter & Martin G. Kocher & Daniela Glätzle-Rützler & Stefan T. Trautmann, 2013. "Impatience and Uncertainty: Experimental Decisions Predict Adolescents' Field Behavior," American Economic Review, American Economic Association, vol. 103(1), pages 510-531, February.
    6. Alberto Abadie & Guido W. Imbens, 2016. "Matching on the Estimated Propensity Score," Econometrica, Econometric Society, vol. 84, pages 781-807, March.
    7. Jørgensen, Lotte Kofoed & Piovesan, Marco & Willadsen, Helene, 2022. "Gender differences in competitiveness: Friends matter," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 101(C).
    8. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    9. Isabelle Brocas & Juan D. Carrillo, 2022. "The development of randomization and deceptive behavior in mixed strategy games," Quantitative Economics, Econometric Society, vol. 13(2), pages 825-862, May.
    10. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    11. Brocas, Isabelle & Carrillo, Juan D., 2020. "The evolution of choice and learning in the two-person beauty contest game from kindergarten to adulthood," Games and Economic Behavior, Elsevier, vol. 120(C), pages 132-143.
    12. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    13. repec:cup:judgdm:v:11:y:2016:i:1:p:99-113 is not listed on IDEAS
    14. Andreoni, James & Di Girolamo, Amalia & List, John A. & Mackevicius, Claire & Samek, Anya, 2020. "Risk preferences of children and adolescents in relation to gender, cognitive skills, soft skills, and executive functions," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 729-742.
    15. William T. Harbaugh & Kate Krause & Timothy R. Berry, 2001. "GARP for Kids: On the Development of Rational Choice Behavior," American Economic Review, American Economic Association, vol. 91(5), pages 1539-1545, December.
    16. Brocas, Isabelle & Carrillo, Juan D., 2020. "The development of social strategic ignorance and other regarding behavior from childhood to adulthood," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 85(C).
    17. Glenn W. Harrison & E. Elisabet Rutström, 2008. "Risk Aversion in the Laboratory," Research in Experimental Economics, in: Risk Aversion in Experiments, pages 41-196, Emerald Group Publishing Limited.
    18. James Andreoni & Charles Sprenger, 2012. "Risk Preferences Are Not Time Preferences," American Economic Review, American Economic Association, vol. 102(7), pages 3357-3376, December.
    19. Brocas, Isabelle & Carrillo, Juan D., 2021. "Self-serving, altruistic and spiteful lying in the schoolyard," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 159-175.
    20. Stoklosa, Michal & Shuval, Kerem & Drope, Jeffrey & Tchernis, Rusty & Pachucki, Mark & Yaroch, Amy & Harding, Matthew, 2018. "The intergenerational transmission of obesity: The role of time preferences and self-control," Economics & Human Biology, Elsevier, vol. 28(C), pages 92-106.
    21. Castillo, Marco & Jordan, Jeffrey L. & Petrie, Ragan, 2018. "Children’s rationality, risk attitudes and field behavior," European Economic Review, Elsevier, vol. 102(C), pages 62-81.
    22. Samek, Anya & Gray, Andre & Datar, Ashlesha & Nicosia, Nancy, 2021. "Adolescent time and risk preferences: Measurement, determinants and field consequences," Journal of Economic Behavior & Organization, Elsevier, vol. 184(C), pages 460-488.
    23. Pablo Brañas-Garza & Diego Jorrat & Antonio M. Espín & Angel Sánchez, 2023. "Paid and hypothetical time preferences are the same: lab, field and online evidence," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 412-434, April.
    24. Castillo, Marco & Ferraro, Paul J. & Jordan, Jeffrey L. & Petrie, Ragan, 2011. "The today and tomorrow of kids: Time preferences and educational outcomes of children," Journal of Public Economics, Elsevier, vol. 95(11), pages 1377-1385.
    25. Melanie Lührmann & Marta Serra-Garcia & Joachim Winter, 2018. "The Impact of Financial Education on Adolescents' Intertemporal Choices," American Economic Journal: Economic Policy, American Economic Association, vol. 10(3), pages 309-332, August.
    26. Mograbi, Eli, 2022. "Decision-makers are more impulsive on smartphones than on computers," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    27. Isabelle Brocas & Juan D. Carrillo, 2021. "Steps of Reasoning in Children and Adolescents," Journal of Political Economy, University of Chicago Press, vol. 129(7), pages 2067-2111.
    28. Brocas, Isabelle & Carrillo, Juan D., 2020. "Introduction to special issue “Understanding Cognition and Decision Making by Children.” Studying decision-making in children: Challenges and opportunities," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 777-783.
    29. Christopher Chabris & David Laibson & Carrie Morris & Jonathon Schuldt & Dmitry Taubinsky, 2008. "Individual laboratory-measured discount rates predict field behavior," Journal of Risk and Uncertainty, Springer, vol. 37(2), pages 237-269, December.
    30. Prissé, Benjamin & Jorrat, Diego, 2022. "Lab vs online experiments: No differences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    31. Jorrat, Diego, 2021. "Recruiting experimental subjects using WhatsApp," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    32. Adeline Delavande & Hans-Peter Kohler, 2009. "Subjective expectations in the context of HIV/AIDS in Malawi," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 20(31), pages 817-875.
    33. Marco Castillo & Jeffrey L Jordan & Ragan Petrie, 2019. "Discount Rates of Children and High School Graduation," The Economic Journal, Royal Economic Society, vol. 129(619), pages 1153-1181.
    34. Tymula, Agnieszka, 2019. "An experimental study of adolescent behavior under peer observation: Adolescents are more impatient and inconsistent, not more risk-taking, when observed by peers," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 735-750.
    35. Bettinger, Eric & Slonim, Robert, 2007. "Patience among children," Journal of Public Economics, Elsevier, vol. 91(1-2), pages 343-363, February.
    36. Sutter, Matthias & Zoller, Claudia & Glätzle-Rützler, Daniela, 2019. "Economic behavior of children and adolescents – A first survey of experimental economics results," European Economic Review, Elsevier, vol. 111(C), pages 98-121.
    37. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    38. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    39. Sule Alan & Seda Ertac, 2018. "Fostering Patience in the Classroom: Results from Randomized Educational Intervention," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 1865-1911.
    40. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    41. Catherine Eckel & Philip Grossman & Cathleen Johnson & Angela Oliveira & Christian Rojas & Rick Wilson, 2012. "School environment and risk preferences: Experimental evidence," Journal of Risk and Uncertainty, Springer, vol. 45(3), pages 265-292, December.
    42. repec:cup:judgdm:v:16:y:2021:i:5:p:1290-1313 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. No title
      by maximorossi in NEP-LTV blog on 2023-02-27 18:50:57

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Caserta, Maurizio & Distefano, Rosaria & Ferrante, Livio & Reito, Francesco, 2023. "The Good of Rules: A pilot study on prosocial behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    2. Antonio Alfonso & Pablo Brañas-Garza & Diego Jorrat & Benjamín Prissé & María José Vázquez-De Francisco, 2024. "The Baking of Preferences throughout the High School," Working Papers 316, Red Nacional de Investigadores en Economía (RedNIE).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antonio Alfonso & Pablo Brañas-Garza & Diego Jorrat & Benjamín Prissé & María José Vázquez-De Francisco, 2024. "The Baking of Preferences throughout the High School," Working Papers 316, Red Nacional de Investigadores en Economía (RedNIE).
    2. Pablo Brañas-Garza & Diego Jorrat & Antonio M. Espín & Angel Sánchez, 2023. "Paid and hypothetical time preferences are the same: lab, field and online evidence," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 412-434, April.
    3. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    4. Islam, Asad & Lee, Wang-Sheng & Nicholas, Aaron, 2021. "The Effects of Chess Instruction on Academic and Non-cognitive Outcomes: Field Experimental Evidence from a Developing Country," Journal of Development Economics, Elsevier, vol. 150(C).
    5. Backes-Gellner, Uschi & Herz, Holger & Kosfeld, Michael & Oswald, Yvonne, 2021. "Do preferences and biases predict life outcomes? Evidence from education and labor market entry decisions," European Economic Review, Elsevier, vol. 134(C).
    6. Samek, Anya & Gray, Andre & Datar, Ashlesha & Nicosia, Nancy, 2021. "Adolescent time and risk preferences: Measurement, determinants and field consequences," Journal of Economic Behavior & Organization, Elsevier, vol. 184(C), pages 460-488.
    7. Marco Castillo & John A. List & Ragan Petrie & Anya Samek, 2020. "Detecting Drivers of Behavior at an Early Age: Evidence from a Longitudinal Field Experiment," NBER Working Papers 28288, National Bureau of Economic Research, Inc.
    8. Datar, Ashlesha & Nicosia, Nancy & Samek, Anya, 2023. "Heterogeneity in place effects on health: The case of time preferences and adolescent obesity," Economics & Human Biology, Elsevier, vol. 49(C).
    9. Zimmermann, Klaus F. & Chowdhury, Shyamal & Sutter, Matthias, 2020. "Economic preferences across generations and family clusters: A large-scale experiment," CEPR Discussion Papers 14998, C.E.P.R. Discussion Papers.
    10. Andreoni, James & Di Girolamo, Amalia & List, John A. & Mackevicius, Claire & Samek, Anya, 2020. "Risk preferences of children and adolescents in relation to gender, cognitive skills, soft skills, and executive functions," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 729-742.
    11. Andreoni, James & Kuhn, Michael A. & List, John A. & Samek, Anya & Sokal, Kevin & Sprenger, Charles, 2019. "Toward an understanding of the development of time preferences: Evidence from field experiments," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    12. Daniel Horn & Hubert Janos Kiss, 2018. "Which preferences associate with school performance?—Lessons from an exploratory study with university students," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-32, February.
    13. Thomas, Ranjeeta & Galizzi, Matteo M. & Moorhouse, Louisa & Nyamukapa, Constance & Hallett, Timothy B., 2024. "Do risk, time and prosocial preferences predict risky sexual behaviour of youths in a low-income, high-risk setting?," Journal of Health Economics, Elsevier, vol. 93(C).
    14. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    15. Sutter, Matthias & Zoller, Claudia & Glätzle-Rützler, Daniela, 2019. "Economic behavior of children and adolescents – A first survey of experimental economics results," European Economic Review, Elsevier, vol. 111(C), pages 98-121.
    16. Lena Detlefsen & Andreas Friedl & Katharina Lima Miranda & Ulrich Schmidt & Matthias Sutter, 2024. "Are economic preferences shaped by the family context? The relation of birth order and siblings’ gender composition to economic preferences," Journal of Risk and Uncertainty, Springer, vol. 69(1), pages 1-31, August.
    17. Non, Arjan & Tempelaar, Dirk, 2016. "Time preferences, study effort, and academic performance," Economics of Education Review, Elsevier, vol. 54(C), pages 36-61.
    18. Etienne Dagorn & David Masclet & Thierry Penard, 2022. "The Behavioral Determinants of School Achievement: A Lab in the Field Experiment in Middle School," Economics Working Paper Archive (University of Rennes & University of Caen) 2022-05, Center for Research in Economics and Management (CREM), University of Rennes, University of Caen and CNRS.
    19. Chowdhury, Shyamal & Sutter, Matthias & Zimmermann, Klaus F., 2018. "Evaluating intergenerational persistence of economic preferences: A large scale experiment with families in Bangladesh," MERIT Working Papers 2018-008, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    20. Angerer, Silvia & Bolvashenkova, Jana & Glätzle-Rützler, Daniela & Lergetporer, Philipp & Sutter, Matthias, 2023. "Children’s patience and school-track choices several years later: Linking experimental and field data," Journal of Public Economics, Elsevier, vol. 220(C).

    More about this item

    Keywords

    Developmental decision-making; Field experiments; Economic preferences; Teenagers;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:106:y:2023:i:c:s2214804323000745. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.