[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp13789.html
   My bibliography  Save this paper

Assessing Selection Bias in Non-Experimental Estimates of the Returns to Workplace Training

Author

Listed:
  • Sauermann, Jan

    (IFAU)

  • Stenberg, Anders

    (SOFI, Stockholm University)

Abstract
We assess selection bias in estimated returns to workplace training by exploiting a field experiment with random assignment of workers to a one-week training program. We compare experimental estimates of this program with non-experimental estimates that are estimated by using a sample of agents who were selected by management not to participate in the experiment. Our results show that non-experimental estimates are biased, yielding returns about twice as large as the causal effect. When controlling for pre-treatment performance or individual fixed effects, only about one tenth of this bias remains and is even further reduced when applying common support restrictions.

Suggested Citation

  • Sauermann, Jan & Stenberg, Anders, 2020. "Assessing Selection Bias in Non-Experimental Estimates of the Returns to Workplace Training," IZA Discussion Papers 13789, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp13789
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp13789.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Alison L. Booth & Marco Francesconi & Gylfi Zoega, 2003. "Unions, Work-Related Training, and Wages: Evidence for British Men," ILR Review, Cornell University, ILR School, vol. 57(1), pages 68-91, October.
    2. Carla Haelermans & Lex Borghans, 2012. "Wage Effects of On-the-Job Training: A Meta-Analysis," British Journal of Industrial Relations, London School of Economics, vol. 50(3), pages 502-528, September.
    3. Anna Vignoles & Fernando Galindo‐Rueda & Leon Feinstein, 2004. "The Labour Market Impact of Adult Education and Training: A Cohort Analysis," Scottish Journal of Political Economy, Scottish Economic Society, vol. 51(2), pages 266-280, May.
    4. Loewenstein, Mark A & Spletzer, James R, 1998. "Dividing the Costs and Returns to General Training," Journal of Labor Economics, University of Chicago Press, vol. 16(1), pages 142-171, January.
    5. Booth, Alison L, 1991. "Job-Related Formal Training: Who Receives It and What Is It Worth?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 53(3), pages 281-294, August.
    6. Andries De Grip & Jan Sauermann, 2012. "The Effects of Training on Own and Co‐worker Productivity: Evidence from a Field Experiment," Economic Journal, Royal Economic Society, vol. 122(560), pages 376-399, May.
    7. Jörn-Steffen Pischke, 2001. "Continuous training in Germany," Journal of Population Economics, Springer;European Society for Population Economics, vol. 14(3), pages 523-548.
    8. Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023. "When Should You Adjust Standard Errors for Clustering?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
    9. Lorraine Dearden & Howard Reed & John Van Reenen, 2006. "The Impact of Training on Productivity and Wages: Evidence from British Panel Data," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 68(4), pages 397-421, August.
    10. Daron Acemoglu & Jörn-Steffen Pischke, 1998. "Why Do Firms Train? Theory and Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 113(1), pages 79-119.
    11. Brown, James N, 1989. "Why Do Wages Increase with Tenure? On-the-Job Training and Life-Cycle Wage Growth Observed within Firms," American Economic Review, American Economic Association, vol. 79(5), pages 971-991, December.
    12. Dave E. Marcotte, 2000. "Continuing Education, Job Training, and the Growth of Earnings Inequality," ILR Review, Cornell University, ILR School, vol. 53(4), pages 602-623, July.
    13. Nava Ashraf & NatalieBau & Corinne Low & Kathleen McGinn, 2020. "Negotiating a Better Future: How Interpersonal Skills Facilitate Intergenerational Investment [“Ever Failed, Try Again, Succeed Better: Results from a Randomized Educational Intervention on Grit”]," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(2), pages 1095-1151.
    14. De Grip, Andries & Sauermann, Jan & Sieben, Inge, 2016. "The role of peers in estimating tenure-performance profiles: Evidence from personnel data," Journal of Economic Behavior & Organization, Elsevier, vol. 126(PA), pages 39-54.
    15. Giorgio Brunello & Pietro Garibaldi & Etienne Wasmer, 2007. "Education and training in Europe," SciencePo Working papers Main hal-03415950, HAL.
    16. Livia Alfonsi & Oriana Bandiera & Vittorio Bassi & Robin Burgess & Imran Rasul & Munshi Sulaiman & Anna Vitali, 2020. "Tackling Youth Unemployment: Evidence From a Labor Market Experiment in Uganda," Econometrica, Econometric Society, vol. 88(6), pages 2369-2414, November.
    17. Jozef Konings & Stijn Vanormelingen, 2015. "The Impact of Training on Productivity and Wages: Firm-Level Evidence," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 485-497, May.
    18. David McKenzie & John Gibson & Steven Stillman, 2010. "How Important Is Selection? Experimental vs. Non-Experimental Measures of the Income Gains from Migration," Journal of the European Economic Association, MIT Press, vol. 8(4), pages 913-945, June.
    19. Parent, Daniel, 1999. "Wages and Mobility: The Impact of Employer-Provided Training," Journal of Labor Economics, University of Chicago Press, vol. 17(2), pages 298-317, April.
    20. Wiji Narendranathan Arulampalam & Alison L. Booth, 2001. "Learning and Earning: Do Multiple Training Events Pay? A Decade of Evidence from a Cohort of Young British Men," Economica, London School of Economics and Political Science, vol. 68(271), pages 379-400, August.
    21. Krueger, Alan & Rouse, Cecilia, 1998. "The Effect of Workplace Education on Earnings, Turnover, and Job Performance," Journal of Labor Economics, University of Chicago Press, vol. 16(1), pages 61-94, January.
    22. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    23. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    24. Kenneth A. Couch & Robert Bifulco, 2012. "Can Nonexperimental Estimates Replicate Estimates Based on Random Assignment in Evaluations of School Choice? A Within‐Study Comparison," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(3), pages 729-751, June.
    25. Roberto Agodini & Mark Dynarski, "undated". "Are Experiments the Only Option? A Look at Dropout Prevention Programs," Mathematica Policy Research Reports 51241adbf9fa4a26add6d54c5, Mathematica Policy Research.
    26. Acemoglu, Daron & Autor, David, 2011. "Skills, Tasks and Technologies: Implications for Employment and Earnings," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 12, pages 1043-1171, Elsevier.
    27. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    28. Juan Jose Diaz & Sudhanshu Handa, 2006. "An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator: Evidence from Mexico’s PROGRESA Program," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
    29. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    30. Nagesh N. Murthy & Goutam N. Challagalla & Leslie H. Vincent & Tasadduq A. Shervani, 2008. "The Impact of Simulation Training on Call Center Agent Performance: A Field-Based Investigation," Management Science, INFORMS, vol. 54(2), pages 384-399, February.
    31. Paloma Acevedo & Guillermo Cruces & Paul Gertler & Sebastian Martinez, 2017. "Living Up to Expectations: How Job Training Made Women Better Off and Men Worse Off," NBER Working Papers 23264, National Bureau of Economic Research, Inc.
    32. Andrew S. Griffen & Petra E. Todd, 2017. "Assessing the Performance of Nonexperimental Estimators for Evaluating Head Start," Journal of Labor Economics, University of Chicago Press, vol. 35(S1), pages 7-63.
    33. Inge Sieben & Andries De Grip & Jessica Longen & Ole Sørensen, 2009. "Technology, Selection, and Training in Call Centers," ILR Review, Cornell University, ILR School, vol. 62(4), pages 553-572, July.
    34. Bartel, Ann P, 1995. "Training, Wage Growth, and Job Performance: Evidence from a Company Database," Journal of Labor Economics, University of Chicago Press, vol. 13(3), pages 401-425, July.
    35. repec:ecj:econjl:v:122:y:2012:i::p:376-399 is not listed on IDEAS
    36. Prada, María Fernanda & Rucci, Graciana & Urzúa, Sergio, 2019. "Training, Soft Skills and Productivity: Evidence from a Field Experiment in Retail," IDB Publications (Working Papers) 9647, Inter-American Development Bank.
    37. Salas-Velasco, Manuel, 2009. "Beyond lectures and tutorials: Formal on-the-job training received by young European university graduates," Research in Economics, Elsevier, vol. 63(3), pages 200-211, September.
    38. Roberto Agodini & Mark Dynarski, 2004. "Are Experiments the Only Option? A Look at Dropout Prevention Programs," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 180-194, February.
    39. Barron, John M & Berger, Mark C & Black, Dan A, 1997. "How Well Do We Measure Training?," Journal of Labor Economics, University of Chicago Press, vol. 15(3), pages 507-528, July.
    40. Groh, Matthew & Krishnan, Nandini & McKenzie, David & Vishwanath, Tara, 2012. "Soft skills or hard cash ? the impact of training and wage subsidy programs on female youth employment in Jordan," Policy Research Working Paper Series 6141, The World Bank.
    41. Alison L. Booth & Mark L. Bryan, 2005. "Testing Some Predictions of Human Capital Theory: New Training Evidence from Britain," The Review of Economics and Statistics, MIT Press, vol. 87(2), pages 391-394, May.
    42. David M. Blau & Philip K. Robins, 1987. "Training Programs and Wages: A General Equilibrium Analysis of the Effects of Program Size," Journal of Human Resources, University of Wisconsin Press, vol. 22(1), pages 113-125.
    43. De Beyer, Joy, 1990. "The incidence and impact on earnings of formal training provided by enterprises in Kenya and Tanzania," Economics of Education Review, Elsevier, vol. 9(4), pages 321-330, December.
    44. Prada, Maria & Rucci, Graciana & Urzua, Sergio, 2019. "Training, Soft Skills and Productivity: Evidence from a Field Experiment," IZA Discussion Papers 12447, Institute of Labor Economics (IZA).
    45. Lynch, Lisa M, 1992. "Private-Sector Training and the Earnings of Young Workers," American Economic Review, American Economic Association, vol. 82(1), pages 299-312, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dan A. Black & Lars Skipper & Jeffrey A. Smith & Jeffrey Andrew Smith, 2023. "Firm Training," CESifo Working Paper Series 10268, CESifo.
    2. Henrik Hansen & S. Kanay De & John Rand & Neda Trifković, 2023. "Wage returns to workplace training in Myanmar," Development Policy Review, Overseas Development Institute, vol. 41(2), March.
    3. Henrik Hansen & S Kanayade & John Rand & Neda Trifkovic, 2021. "Workplace training in Myanmar: Determinants and wage returns," DERG working paper series 21-10, University of Copenhagen. Department of Economics. Development Economics Research Group (DERG).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dan A. Black & Lars Skipper & Jeffrey A. Smith & Jeffrey Andrew Smith, 2023. "Firm Training," CESifo Working Paper Series 10268, CESifo.
    2. Carla Haelermans & Lex Borghans, 2012. "Wage Effects of On-the-Job Training: A Meta-Analysis," British Journal of Industrial Relations, London School of Economics, vol. 50(3), pages 502-528, September.
    3. Jozef Konings & Stijn Vanormelingen, 2015. "The Impact of Training on Productivity and Wages: Firm-Level Evidence," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 485-497, May.
    4. Grit Muehler & Michael Beckmann & Bernd Schauenberg, 2007. "The returns to continuous training in Germany: new evidence from propensity score matching estimators," Review of Managerial Science, Springer, vol. 1(3), pages 209-235, November.
    5. Oliver Cassagneau-Francis & Robert Gary-Bobo & Julie Pernaudet & Jean-Marc Robin, 2022. "A Nonparametric Finite Mixture Approach to Difference-in-Difference Estimation, with an Application to On-the-job Training and Wages," Working Papers hal-03869547, HAL.
    6. Cecilia ALBERT & Carlos GARCÍA-SERRANO & Virginia HERNANZ, 2010. "On-the-job training in Europe: Determinants and wage returns," International Labour Review, International Labour Organization, vol. 149(3), pages 315-341, September.
    7. Anna Ruzik-Sierdzinska & Claudia Villosio & Michele Belloni & Maciej Lis & Monika Potoczna, 2013. "Age and productivity. Human Capital Accumulation and Depreciation," CASE Network Reports 0114, CASE-Center for Social and Economic Research.
    8. Yao, Yao & Liu, Gordon G. & Cui, Yujie, 2020. "Job training and organizational performance: Analyses from medical institutions in China," China Economic Review, Elsevier, vol. 60(C).
    9. Yanick Labrie & Claude Montmarquette, 2005. "La formation qualifiante et transférable en milieu de travail," CIRANO Project Reports 2005rp-04, CIRANO.
    10. Jens Ruhose & Stephan L. Thomsen & Insa Weilage, 2018. "The Wider Benefits of Adult Learning: Work-Related Training and Social Capital," CESifo Working Paper Series 7268, CESifo.
    11. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
    12. Vilhuber, Lars, 2001. "La spécificité de la formation en milieu de travail : un survol des contributions théoriques et empiriques récentes," L'Actualité Economique, Société Canadienne de Science Economique, vol. 77(1), pages 133-167, mars.
    13. Jens Ruhose & Stephan L. Thomsen & Insa Weilage, 2018. "The Wider Benefits of Adult Learning: Work-Related Training and Social Capital," SOEPpapers on Multidisciplinary Panel Data Research 1004, DIW Berlin, The German Socio-Economic Panel (SOEP).
    14. Christophe Muller & Christophe J. Nordman, 2017. "Wages and on-the-job training in Tunisia," Middle East Development Journal, Taylor & Francis Journals, vol. 9(2), pages 294-318, July.
    15. Julia Lang, 2012. "The Aims of Lifelong Learning: Age-Related Effects of Training on Wages and Job Security," SOEPpapers on Multidisciplinary Panel Data Research 478, DIW Berlin, The German Socio-Economic Panel (SOEP).
    16. Anthony Terriau, 2018. "Occupational mobility and vocational training over the life cycle," Working Papers halshs-01878925, HAL.
    17. Zenou, Yves & Lindquist, Matthew & Sauermann, Jan, 2015. "Network Effects on Worker Productivity," CEPR Discussion Papers 10928, C.E.P.R. Discussion Papers.
    18. Katja Görlitz, 2010. "Continuous Training and Wages – An Empirical Analysis Using a Comparison-group Approach," Ruhr Economic Papers 0197, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    19. repec:zbw:rwirep:0197 is not listed on IDEAS
    20. Bassanini, Andrea & Booth, Alison L. & Brunello, Giorgio & De Paola, Maria & Leuven, Edwin, 2005. "Workplace Training in Europe," IZA Discussion Papers 1640, Institute of Labor Economics (IZA).
    21. Görlitz, Katja, 2011. "Continuous training and wages: An empirical analysis using a comparison-group approach," Economics of Education Review, Elsevier, vol. 30(4), pages 691-701, August.

    More about this item

    Keywords

    selection bias; returns to training; field experiment;
    All these keywords.

    JEL classification:

    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • M53 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Training

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp13789. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.