[go: up one dir, main page]

IDEAS home Printed from https://ideas.repec.org/p/xrs/sfbmaa/08-46.html
   My bibliography  Save this paper

Selection and Mode Effects in Risk Preference Elicitation Experiments

Author

Listed:
  • von Gaudecker, Martin

    (Free University Amsterdam)

  • van Soest, Arthur

    (Tilburg University)

  • Wengström, Erik

    (University of Copenhagen)

Abstract
We combine data from a risk preference elicitation experiment conducted on a representative sample via the Internet with laboratory data on students for the same experiment to investigate effects of implementation mode and of subject pool selection. We find that the frequency of errors in the lab experiment ist drastically below that of the representative sample in the Internet experiment, and average risk aversion is also lower. Considering the student-like subsample of the Internet subjects and comparing a tradtitional lab design with an Internet-like design in the lab gives two ways to decompose these differences into differences due to subject pool selection and differences due to implementation mode. Both lead to the conclusion that the differences are due to selection and not implementation mode. An analysis of the various steps leading to participation or non-participation in the Internet survey shows that these processes are selective in selecting subjects who make fewer errors, but do not lead to biased conclusions on risk preferences. These findings point a the usefulness of the Internet survey as an alternative to a student pool in the laboratory if the ambition is to use the experiments to draw inference on a broad population.

Suggested Citation

  • von Gaudecker, Martin & van Soest, Arthur & Wengström, Erik, 2008. "Selection and Mode Effects in Risk Preference Elicitation Experiments," Sonderforschungsbereich 504 Publications 08-46, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
  • Handle: RePEc:xrs:sfbmaa:08-46
    Note: Financial support from the Deutsche Forschungsgemeinschaft, SFB 504, at the University of Mannheim, is gratefully acknowledged by Hans-Martin von Gaudecker.
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Syngjoo Choi & Shachar Kariv & Wieland M?ller & Dan Silverman, 2014. "Who Is (More) Rational?," American Economic Review, American Economic Association, vol. 104(6), pages 1518-1550, June.
    2. Loomes, Graham & Moffatt, Peter G & Sugden, Robert, 2002. "A Microeconometric Test of Alternative Stochastic Theories of Risky Choice," Journal of Risk and Uncertainty, Springer, vol. 24(2), pages 103-130, March.
    3. repec:feb:framed:0074 is not listed on IDEAS
    4. Donkers, Bas & Melenberg, Bertrand & Van Soest, Arthur, 2001. "Estimating Risk Attitudes Using Lotteries: A Large Sample Approach," Journal of Risk and Uncertainty, Springer, vol. 22(2), pages 165-195, March.
    5. David Revelt and Kenneth Train., 2000. "Customer-Specific Taste Parameters and Mixed Logit: Households' Choice of Electricity Supplier," Economics Working Papers E00-274, University of California at Berkeley.
    6. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    7. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
    8. Armin Falk & James J. Heckman, 2009. "Lab Experiments are a Major Source of Knowledge in the Social Sciences," Working Papers 200935, Geary Institute, University College Dublin.
    9. Hans P. Binswanger, 1980. "Attitudes Toward Risk: Experimental Measurement in Rural India," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(3), pages 395-407.
    10. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    11. W. Viscusi & Joel Huber & Jason Bell, 2008. "The Economic Value of Water Quality," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 41(2), pages 169-187, October.
    12. Lisa Anderson & Jennifer Mellor, 2009. "Are risk preferences stable? Comparing an experimental measure with a validated survey-based measure," Journal of Risk and Uncertainty, Springer, vol. 39(2), pages 137-160, October.
    13. Shlomo Benartzi & Richard H. Thaler, 1995. "Myopic Loss Aversion and the Equity Premium Puzzle," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(1), pages 73-92.
    14. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, May.
    15. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    16. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    17. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    18. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    19. Charles Bellemare & Sabine Kröger & Arthur van Soest, 2008. "Measuring Inequity Aversion in a Heterogeneous Population Using Experimental Decisions and Subjective Probabilities," Econometrica, Econometric Society, vol. 76(4), pages 815-839, July.
    20. Werner Güth & Carsten Schmidt & Matthias Sutter, 2007. "Bargaining outside the lab - a newspaper experiment of a three-person ultimatum game," Economic Journal, Royal Economic Society, vol. 117(518), pages 449-469, March.
    21. Steffen Huck & Wieland Müller, 2012. "Allais for all: Revisiting the paradox in a large representative sample," Journal of Risk and Uncertainty, Springer, vol. 44(3), pages 261-293, June.
    22. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2005. "Individual Risk Attitudes: New Evidence from a Large, Representative, Experimentally-Validated Survey," Discussion Papers of DIW Berlin 511, DIW Berlin, German Institute for Economic Research.
    23. Nicolas de Roos & Yianis Sarafidis, 2010. "Decision making under risk in Deal or No Deal," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(6), pages 987-1027.
    24. Han Bleichrodt & Jose Luis Pinto & Peter P. Wakker, 2001. "Making Descriptive Use of Prospect Theory to Improve the Prescriptive Use of Expected Utility," Management Science, INFORMS, vol. 47(11), pages 1498-1514, November.
    25. Hans-Martin von Gaudecker & Arthur van Soest & Erik Wengstrom, 2011. "Heterogeneity in Risky Choice Behavior in a Broad Population," American Economic Review, American Economic Association, vol. 101(2), pages 664-694, April.
    26. Ernst Fehr & Urs Fischbacher & Bernhard von Rosenbladt & J�rgen Schupp & Gert G. Wagner, "undated". "A Nation-Wide Laboratory: Examining trust and trustworthiness by integrating behavioral experiments into representative surveys," IEW - Working Papers 141, Institute for Empirical Research in Economics - University of Zurich.
    27. Glenn W. Harrison & Morten I. Lau & Melonie B. Williams, 2002. "Estimating Individual Discount Rates in Denmark: A Field Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1606-1617, December.
    28. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, E. Elisabet, 2010. "Preference heterogeneity in experiments: Comparing the field and laboratory," Journal of Economic Behavior & Organization, Elsevier, vol. 73(2), pages 209-224, February.
    29. Steffen Andersen & Glenn Harrison & Morten Lau & Elisabet Rutstrom, 2004. "Preference heterogeneity in experiments: Comparing the field and lab," Artefactual Field Experiments 00004, The Field Experiments Website.
    30. Glenn W Harrison & John A List & Charles Towe, 2007. "Naturally Occurring Preferences and Exogenous Laboratory Experiments: A Case Study of Risk Aversion," Econometrica, Econometric Society, vol. 75(2), pages 433-458, March.
    31. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    32. Harless, David W & Camerer, Colin F, 1994. "The Predictive Utility of Generalized Expected Utility Theories," Econometrica, Econometric Society, vol. 62(6), pages 1251-1289, November.
    33. Steffen Andersen & Glenn Harrison & Morten Lau & E. Rutström, 2009. "Elicitation using multiple price list formats," Experimental Economics, Springer;Economic Science Association, vol. 12(3), pages 365-366, September.
    34. Tomomi Tanaka & Colin F. Camerer & Quang Nguyen, 2010. "Risk and Time Preferences: Linking Experimental and Household Survey Data from Vietnam," American Economic Review, American Economic Association, vol. 100(1), pages 557-571, March.
    35. Ulrich Schmidt & Tibor Neugebauer, 2007. "Testing expected utility in the presence of errors," Economic Journal, Royal Economic Society, vol. 117(518), pages 470-485, March.
    36. Glenn W. Harrison & John A. List, 2008. "Naturally Occurring Markets and Exogenous Laboratory Experiments: A Case Study of the Winner's Curse," Economic Journal, Royal Economic Society, vol. 118(528), pages 822-843, April.
    37. John D. Hey, 2018. "Experimental investigations of errors in decision making under risk," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 17, pages 381-388, World Scientific Publishing Co. Pte. Ltd..
    38. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    39. Chris Starmer, 2000. "Developments in Non-expected Utility Theory: The Hunt for a Descriptive Theory of Choice under Risk," Journal of Economic Literature, American Economic Association, vol. 38(2), pages 332-382, June.
    40. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1149-1187.
    41. David Lucking-Reiley, 1999. "Using Field Experiments to Test Equivalence between Auction Formats: Magic on the Internet," American Economic Review, American Economic Association, vol. 89(5), pages 1063-1080, December.
    42. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency, Heterogeneity, and Granularity of Individual Behavior under Uncertainty," Economics Working Papers 0076, Institute for Advanced Study, School of Social Science.
    43. Alessie, Rob & Hochguertel, Stefan & van Soest, Arthur, 2006. "Non-take-up of tax-favored savings plans: Evidence from Dutch employees," Journal of Economic Psychology, Elsevier, vol. 27(4), pages 483-501, August.
    44. Quang Nguyen & Colin Camerer & Tomomi Tanaka, 2010. "Risk and Time Preferences Linking Experimental and Household Data from Vietnam," Post-Print halshs-00547090, HAL.
    45. von Gaudecker, H.M. & van Soest, A.H.O. & Wengstrom, E., 2008. "Selection and Mode Effects in Risk Preference Elicitation Experiments," Discussion Paper 2008-11, Tilburg University, Center for Economic Research.
    46. Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
    47. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    48. Graham Loomes, 2005. "Modelling the Stochastic Component of Behaviour in Experiments: Some Issues for the Interpretation of Data," Experimental Economics, Springer;Economic Science Association, vol. 8(4), pages 301-323, December.
    49. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency and Heterogeneity of Individual Behavior under Uncertainty," American Economic Review, American Economic Association, vol. 97(5), pages 1921-1938, December.
    50. Heckman, James J, 1974. "Shadow Prices, Market Wages, and Labor Supply," Econometrica, Econometric Society, vol. 42(4), pages 679-694, July.
    51. Kobberling, Veronika & Wakker, Peter P., 2005. "An index of loss aversion," Journal of Economic Theory, Elsevier, vol. 122(1), pages 119-131, May.
    52. Keith Coble & Jayson Lusk, 2010. "At the nexus of risk and time preferences: An experimental investigation," Journal of Risk and Uncertainty, Springer, vol. 41(1), pages 67-79, August.
    53. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    54. Kreps, David M & Porteus, Evan L, 1978. "Temporal Resolution of Uncertainty and Dynamic Choice Theory," Econometrica, Econometric Society, vol. 46(1), pages 185-200, January.
    55. Pavlo Blavatskyy, 2009. "Betting on own knowledge: Experimental test of overconfidence," Journal of Risk and Uncertainty, Springer, vol. 38(1), pages 39-49, February.
    56. Chetan Dave & Catherine Eckel & Cathleen Johnson & Christian Rojas, 2010. "Eliciting risk preferences: When is simple better?," Journal of Risk and Uncertainty, Springer, vol. 41(3), pages 219-243, December.
    57. Sarah Jacobson & Ragan Petrie, 2009. "Learning from mistakes: What do inconsistent choices over risk tell us?," Journal of Risk and Uncertainty, Springer, vol. 38(2), pages 143-158, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hans-Martin von Gaudecker & Arthur van Soest & Erik Wengstrom, 2011. "Heterogeneity in Risky Choice Behavior in a Broad Population," American Economic Review, American Economic Association, vol. 101(2), pages 664-694, April.
    2. Tamás Csermely & Alexander Rabas, 2016. "How to reveal people’s preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 107-136, December.
    3. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    4. Hans-Martin von Gaudecker & Arthur van Soest & Erik Wengstrom, 2011. "Heterogeneity in Risky Choice Behavior in a Broad Population," American Economic Review, American Economic Association, vol. 101(2), pages 664-694, April.
    5. Ferdinand M. Vieider & Peter Martinsson & Pham Khanh Nam & Nghi Truong, 2019. "Risk preferences and development revisited," Theory and Decision, Springer, vol. 86(1), pages 1-21, February.
    6. Holzmeister, Felix & Stefan, Matthias, 2019. "The Risk Elicitation Puzzle Revisited: Across-Methods (In)consistency?," OSF Preprints pj9u2, Center for Open Science.
    7. Adam Booij & Bernard Praag & Gijs Kuilen, 2010. "A parametric analysis of prospect theory’s functionals for the general population," Theory and Decision, Springer, vol. 68(1), pages 115-148, February.
    8. Ola Andersson & Håkan J. Holm & Jean-Robert Tyran & Erik Wengström, 2020. "Robust inference in risk elicitation tasks," Journal of Risk and Uncertainty, Springer, vol. 61(3), pages 195-209, December.
    9. Felix Holzmeister & Matthias Stefan, 2019. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Working Papers 2019-19, Faculty of Economics and Statistics, Universität Innsbruck.
    10. Felix Holzmeister & Matthias Stefan, 2021. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 593-616, June.
    11. Vieider, Ferdinand M. & Truong, Nghi & Martinsson, Peter & Pham Khanh Nam & Martinsson, Peter, 2013. "Risk preferences and development revisited: A field experiment in Vietnam," Discussion Papers, WZB Junior Research Group Risk and Development SP II 2013-403, WZB Berlin Social Science Center.
    12. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, Elisabet E., 2010. "Behavioral econometrics for psychologists," Journal of Economic Psychology, Elsevier, vol. 31(4), pages 553-576, August.
    13. Michele Garagnani, 2023. "The predictive power of risk elicitation tasks," Journal of Risk and Uncertainty, Springer, vol. 67(2), pages 165-192, October.
    14. Gary Charness & Thomas Garcia & Theo Offerman & Marie Claire Villeval, 2020. "Do measures of risk attitude in the laboratory predict behavior under risk in and outside of the laboratory?," Journal of Risk and Uncertainty, Springer, vol. 60(2), pages 99-123, April.
    15. Galizzi, Matteo M. & Miraldo, Marisa & Stavropoulou, Charitini & van der Pol, Marjon, 2016. "Doctor–patient differences in risk and time preferences: A field experiment," Journal of Health Economics, Elsevier, vol. 50(C), pages 171-182.
    16. Andersson, Ola & Tyran, Jean-Robert & Wengström, Erik & Holm, Håkan J., 2013. "Risk Aversion Relates to Cognitive Ability: Fact or Fiction?," Working Paper Series 964, Research Institute of Industrial Economics.
    17. Arianna Galliera & E. Elisabet Rutström, 2021. "Crowded out: Heterogeneity in risk attitudes among poor households in the US," Journal of Risk and Uncertainty, Springer, vol. 63(2), pages 103-132, October.
    18. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    19. Golo-Friedrich Bauermeister & Daniel Hermann & Oliver Musshoff, 2018. "Consistency of determined risk attitudes and probability weightings across different elicitation methods," Theory and Decision, Springer, vol. 84(4), pages 627-644, June.
    20. Kerri Brick & Martine Visser & Justine Burns, 2012. "Risk Aversion: Experimental Evidence from South African Fishing Communities," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 94(1), pages 133-152.

    More about this item

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:xrs:sfbmaa:08-46. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Carsten Schmidt (email available below). General contact details of provider: https://edirc.repec.org/data/sfmande.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.