[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/taf/jnlbes/v39y2021i3p816-832.html
   My bibliography  Save this article

Nonparametric Tests for Treatment Effect Heterogeneity With Duration Outcomes

Author

Listed:
  • Pedro H. C. Sant’Anna
Abstract
This article proposes different tests for treatment effect heterogeneity when the outcome of interest, typically a duration variable, may be right-censored. The proposed tests study whether a policy (1) has zero distributional (average) effect for all subpopulations defined by covariate values, and (2) has homogeneous average effect across different subpopulations. The proposed tests are based on two-step Kaplan–Meier integrals and do not rely on parametric distributional assumptions, shape restrictions, or on restricting the potential treatment effect heterogeneity across different subpopulations. Our framework is suitable not only to exogenous treatment allocation but can also account for treatment noncompliance—an important feature in many applications. The proposed tests are consistent against fixed alternatives, and can detect nonparametric alternatives converging to the null at the parametric n−1/2-rate, n being the sample size. Critical values are computed with the assistance of a multiplier bootstrap. The finite sample properties of the proposed tests are examined by means of a Monte Carlo study and an application about the effect of labor market programs on unemployment duration. Open-source software is available for implementing all proposed tests.

Suggested Citation

  • Pedro H. C. Sant’Anna, 2021. "Nonparametric Tests for Treatment Effect Heterogeneity With Duration Outcomes," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(3), pages 816-832, July.
    • Handle: RePEc:taf:jnlbes:v:39:y:2021:i:3:p:816-832
    DOI: 10.1080/07350015.2020.1737080
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/07350015.2020.1737080
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/07350015.2020.1737080?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sokbae Lee & Ryo Okui & Yoon†Jae Whang, 2017. "Doubly robust uniform confidence band for the conditional average treatment effect function," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(7), pages 1207-1225, November.
    2. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    3. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2008. "Nonparametric Tests for Treatment Effect Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 389-405, August.
    4. Minsu Chang & Sokbae Lee & Yoon‐Jae Whang, 2015. "Nonparametric tests of conditional treatment effects with an application to single‐sex schooling on academic achievements," Econometrics Journal, Royal Economic Society, vol. 18(3), pages 307-346, October.
    5. Woodbury, Stephen A & Spiegelman, Robert G, 1987. "Bonuses to Workers and Employers to Reduce Unemployment: Randomized Trials in Illinois," American Economic Review, American Economic Association, vol. 77(4), pages 513-530, September.
    6. Herman J. Bierens & Werner Ploberger, 1997. "Asymptotic Theory of Integrated Conditional Moment Tests," Econometrica, Econometric Society, vol. 65(5), pages 1129-1152, September.
    7. Blundell, Richard & Powell, James L., 2007. "Censored regression quantiles with endogenous regressors," Journal of Econometrics, Elsevier, vol. 141(1), pages 65-83, November.
    8. Stute, W., 1993. "Consistent Estimation Under Random Censorship When Covariables Are Present," Journal of Multivariate Analysis, Elsevier, vol. 45(1), pages 89-103, April.
    9. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    10. Bijwaard, Govert E. & Ridder, Geert, 2005. "Correcting for selective compliance in a re-employment bonus experiment," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 77-111.
    11. Fan, Yanqin & Li, Qi, 1996. "Consistent Model Specification Tests: Omitted Variables and Semiparametric Functional Forms," Econometrica, Econometric Society, vol. 64(4), pages 865-890, July.
    12. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    13. Meyer, Bruce D, 1996. "What Have We Learned from the Illinois Reemployment Bonus Experiment?," Journal of Labor Economics, University of Chicago Press, vol. 14(1), pages 26-51, January.
    14. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    15. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    16. Anna, Petrenko, 2016. "Мaркування готової продукції як складова частина інформаційного забезпечення маркетингової діяльності підприємств овочепродуктового підкомплексу," Agricultural and Resource Economics: International Scientific E-Journal, Agricultural and Resource Economics: International Scientific E-Journal, vol. 2(1), March.
    17. Myoung‐jae Lee & Sang‐jun Lee, 2005. "Analysis of job‐training effects on Korean women," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(4), pages 549-562, May.
    18. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    19. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    20. Honore, Bo & Khan, Shakeeb & Powell, James L., 2002. "Quantile regression under random censoring," Journal of Econometrics, Elsevier, vol. 109(1), pages 67-105, July.
    21. Stinchcombe, Maxwell B. & White, Halbert, 1998. "Consistent Specification Testing With Nuisance Parameters Present Only Under The Alternative," Econometric Theory, Cambridge University Press, vol. 14(3), pages 295-325, June.
    22. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    23. Beare, Brendan K. & Moon, Jong-Myun, 2015. "Nonparametric Tests Of Density Ratio Ordering," Econometric Theory, Cambridge University Press, vol. 31(3), pages 471-492, June.
    24. Myoung‐jae Lee, 2009. "Non‐parametric tests for distributional treatment effect for randomly censored responses," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(1), pages 243-264, January.
    25. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2008. "Distributional impacts of the Self-Sufficiency Project," Journal of Public Economics, Elsevier, vol. 92(3-4), pages 748-765, April.
    26. Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
    27. Bierens, Herman J., 1982. "Consistent model specification tests," Journal of Econometrics, Elsevier, vol. 20(1), pages 105-134, October.
    28. Kevin J. Anstrom & Anastasios A. Tsiatis, 2001. "Utilizing Propensity Scores to Estimate Causal Treatment Effects with Censored Time-Lagged Data," Biometrics, The International Biometric Society, vol. 57(4), pages 1207-1218, December.
    29. Miguel A. Delgado & Juan Carlos Escanciano, 2013. "Conditional Stochastic Dominance Testing," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 16-28, January.
    30. Ma, Shuangge & Kosorok, Michael R., 2005. "Robust semiparametric M-estimation and the weighted bootstrap," Journal of Multivariate Analysis, Elsevier, vol. 96(1), pages 190-217, September.
    31. Escanciano, J. Carlos, 2006. "Goodness-of-Fit Tests for Linear and Nonlinear Time Series Models," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 531-541, June.
    32. Yu‐Chin Hsu, 2017. "Consistent tests for conditional treatment effects," Econometrics Journal, Royal Economic Society, vol. 20(1), pages 1-22, February.
    33. Brigham R. Frandsen, 2015. "Treatment Effects With Censoring and Endogeneity," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1745-1752, December.
    34. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pedro H. C. Sant'Anna, 2016. "Program Evaluation with Right-Censored Data," Papers 1604.02642, arXiv.org.
    2. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Wei Huang & Oliver Linton & Zheng Zhang, 2021. "A Unified Framework for Specification Tests of Continuous Treatment Effect Models," Papers 2102.08063, arXiv.org, revised Sep 2021.
    5. Sant’Anna, Pedro H.C. & Song, Xiaojun, 2019. "Specification tests for the propensity score," Journal of Econometrics, Elsevier, vol. 210(2), pages 379-404.
    6. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    7. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    8. Shengfang Tang & Zongwu Cai & Ying Fang & Ming Lin, 2019. "Testing Unconfoundedness Assumption Using Auxiliary Variables," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201905, University of Kansas, Department of Economics, revised Mar 2019.
    9. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    10. Sungwon Lee & Joon H. Ro, 2020. "Nonparametric Tests for Conditional Quantile Independence with Duration Outcomes," Working Papers 2013, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy).
    11. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    12. Zhou, Niwen & Guo, Xu & Zhu, Lixing, 2024. "Significance test for semiparametric conditional average treatment effects and other structural functions," Computational Statistics & Data Analysis, Elsevier, vol. 189(C).
    13. Słoczyński, Tymon, 2012. "New Evidence on Linear Regression and Treatment Effect Heterogeneity," MPRA Paper 39524, University Library of Munich, Germany.
    14. Ferraro, Paul J. & Miranda, Juan José, 2013. "Heterogeneous treatment effects and mechanisms in information-based environmental policies: Evidence from a large-scale field experiment," Resource and Energy Economics, Elsevier, vol. 35(3), pages 356-379.
    15. Brantly Callaway & Pedro H. C. Sant'Anna, 2018. "Difference-in-Differences with Multiple Time Periods and an Application on the Minimum Wage and Employment," DETU Working Papers 1804, Department of Economics, Temple University.
    16. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2008. "Nonparametric Tests for Treatment Effect Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 389-405, August.
    17. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    18. Maier, Michael, 2011. "Tests for distributional treatment effects under unconfoundedness," Economics Letters, Elsevier, vol. 110(1), pages 49-51, January.
    19. Imbens, Guido W., 2014. "Instrumental Variables: An Econometrician's Perspective," IZA Discussion Papers 8048, Institute of Labor Economics (IZA).
    20. Zongwu Cai & Ying Fang & Ming Lin & Shengfang Tang, 2020. "Testing Unconfoundedness Assumption Using Auxiliary Variables," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202004, University of Kansas, Department of Economics, revised Feb 2020.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlbes:v:39:y:2021:i:3:p:816-832. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UBES20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.