[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/19529.html
   My bibliography  Save this paper

Incentives, Selection, and Teacher Performance: Evidence from IMPACT

Author

Listed:
  • Thomas Dee
  • James Wyckoff
Abstract
Teachers in the United States are compensated largely on the basis of fixed schedules that reward experience and credentials. However, there is a growing interest in whether performance-based incentives based on rigorous teacher evaluations can improve teacher retention and performance. The evidence available to date has been mixed at best. This study presents novel evidence on this topic based on IMPACT, the controversial teacher-evaluation system introduced in the District of Columbia Public Schools by then-Chancellor Michelle Rhee. IMPACT implemented uniquely high-powered incentives linked to multiple measures of teacher performance (i.e., several structured observational measures as well as test performance). We present regression-discontinuity (RD) estimates that compare the retention and performance outcomes among low-performing teachers whose ratings placed them near the threshold that implied a strong dismissal threat. We also compare outcomes among high-performing teachers whose rating placed them near a threshold that implied an unusually large financial incentive. Our RD results indicate that dismissal threats increased the voluntary attrition of low-performing teachers by 11 percentage points (i.e., more than 50 percent) and improved the performance of teachers who remained by 0.27 of a teacher-level standard deviation. We also find evidence that financial incentives further improved the performance of high-performing teachers (effect size = 0.24).

Suggested Citation

  • Thomas Dee & James Wyckoff, 2013. "Incentives, Selection, and Teacher Performance: Evidence from IMPACT," NBER Working Papers 19529, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:19529
    Note: ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w19529.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. David S. Lee & Thomas Lemieux, 2009. "Regression Discontinuity Designs In Economics," Working Papers 1118, Princeton University, Department of Economics, Industrial Relations Section..
    2. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    3. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    4. Roland Fryer & Steven Levitt & John List & Sally Sadoff, 2012. "Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment," Framed Field Experiments 00591, The Field Experiments Website.
    5. Clotfelter, Charles & Glennie, Elizabeth & Ladd, Helen & Vigdor, Jacob, 2008. "Would higher salaries keep teachers in high-poverty schools? Evidence from a policy intervention in North Carolina," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1352-1370, June.
    6. repec:mpr:mprres:6683 is not listed on IDEAS
    7. Eric A. Hanushek & John F. Kain & Steven G. Rivkin & Daniel M. O'Brien, 2005. "The Market for Teacher Quality," Discussion Papers 04-025, Stanford Institute for Economic Policy Research.
    8. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    9. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    10. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2011. "The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood," NBER Working Papers 17699, National Bureau of Economic Research, Inc.
    11. Steven Glazerman & Daniel Mayer & Paul Decker, 2006. "Alternative routes to teaching: The impacts of Teach for America on student achievement and other outcomes," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 25(1), pages 75-96.
    12. repec:mpr:mprres:7080 is not listed on IDEAS
    13. Thomas S. Dee & Benjamin J. Keys, 2004. "Does merit pay reward good teachers? Evidence from a randomized experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 471-488.
    14. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2006. "Teacher-Student Matching and the Assessment of Teacher Effectiveness," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    15. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    16. Eric S. Taylor & John H. Tyler, 2012. "The Effect of Evaluation on Teacher Performance," American Economic Review, American Economic Association, vol. 102(7), pages 3628-3651, December.
    17. Roland G. Fryer, 2013. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 373-407.
    18. repec:mpr:mprres:7391 is not listed on IDEAS
    19. Murnane, Richard J & Olsen, Randall J, 1989. "Will There Be Enough Teachers?," American Economic Review, American Economic Association, vol. 79(2), pages 242-246, May.
    20. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    21. repec:mpr:mprres:4761 is not listed on IDEAS
    22. Don Boyd & Hamp Lankford & Susanna Loeb & Matthew Ronfeldt & Jim Wyckoff, 2011. "The role of teacher quality in retention and hiring: Using applications to transfer to uncover preferences of teachers and schools," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(1), pages 88-110, December.
    23. P. Schochet & T. Cook & J. Deke & G. Imbens & J.R. Lockwood & J. Porter & J. Smith, "undated". "Standards for Regression Discontinuity Designs," Mathematica Policy Research Reports e5d6da12fbe441b88cb04013d, Mathematica Policy Research.
    24. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    25. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    26. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    27. repec:mpr:mprres:6811 is not listed on IDEAS
    28. Murnane, Richard J, 1984. "Selection and Survival in the Teacher Labor Market," The Review of Economics and Statistics, MIT Press, vol. 66(3), pages 513-518, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sean Corcoran & Dan Goldhaber, 2013. "Value Added and Its Uses: Where You Stand Depends on Where You Sit," Education Finance and Policy, MIT Press, vol. 8(3), pages 418-434, July.
    2. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    3. Dan Goldhaber & Cyrus Grout & Nick Huntington-Klein, 2017. "Screen Twice, Cut Once: Assessing the Predictive Validity of Applicant Selection Tools," Education Finance and Policy, MIT Press, vol. 12(2), pages 197-223, Spring.
    4. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    5. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    6. Helen F. Ladd & Lucy C. Sorensen, 2017. "Returns to Teacher Experience: Student Achievement and Motivation in Middle School," Education Finance and Policy, MIT Press, vol. 12(2), pages 241-279, Spring.
    7. Cook, Jason B. & Mansfield, Richard K., 2016. "Task-specific experience and task-specific talent: Decomposing the productivity of high school teachers," Journal of Public Economics, Elsevier, vol. 140(C), pages 51-72.
    8. Jesse Rothstein, 2007. "Do Value-Added Models Add Value? Tracking, Fixed Effects, and Causal Inference," Working Papers 1036, Princeton University, Department of Economics, Center for Economic Policy Studies..
    9. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    10. Goldhaber, Dan & Cowan, James & Walch, Joe, 2013. "Is a good elementary teacher always good? Assessing teacher performance estimates across subjects," Economics of Education Review, Elsevier, vol. 36(C), pages 216-228.
    11. Richard K. Mansfield, 2015. "Teacher Quality and Student Inequality," Journal of Labor Economics, University of Chicago Press, vol. 33(3), pages 751-788.
    12. repec:hal:spmain:info:hdl:2441/1jgbspo1909q48svne93o55rca is not listed on IDEAS
    13. repec:pri:cepsud:159rothstein is not listed on IDEAS
    14. Alexis Le Chapelain, 2014. "Market for education and student achievement [Marché de l’éducation et réussite scolaire]," SciencePo Working papers tel-03510563, HAL.
    15. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    16. Susanna Loeb & Demetra Kalogrides & Tara Béteille, 2011. "Effective Schools: Teacher Hiring, Assignment, Development, and Retention," NBER Working Papers 17177, National Bureau of Economic Research, Inc.
    17. Antecol, Heather & Eren, Ozkan & Ozbeklik, Serkan, 2013. "The effect of Teach for America on the distribution of student achievement in primary school: Evidence from a randomized experiment," Economics of Education Review, Elsevier, vol. 37(C), pages 113-125.
    18. Alexis Le Chapelain, 2014. "Market for education and student achievement [Marché de l’éducation et réussite scolaire]," SciencePo Working papers Main tel-03510563, HAL.
    19. Brehm, Margaret & Imberman, Scott A. & Lovenheim, Michael F., 2017. "Achievement effects of individual performance incentives in a teacher merit pay tournament," Labour Economics, Elsevier, vol. 44(C), pages 133-150.
    20. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    21. Melinda Adnot & Thomas Dee & Veronica Katz & James Wyckoff, 2016. "Teacher Turnover, Teacher Quality, and Student Achievement in DCPS," NBER Working Papers 21922, National Bureau of Economic Research, Inc.
    22. Jesse Rothstein, 2007. "Do Value-Added Models Add Value? Tracking, Fixed Effects, and Causal Inference," Working Papers 1036, Princeton University, Department of Economics, Center for Economic Policy Studies..

    More about this item

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education
    • J45 - Labor and Demographic Economics - - Particular Labor Markets - - - Public Sector Labor Markets

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:19529. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.