[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2302.05404.html
   My bibliography  Save this paper

Minimax Instrumental Variable Regression and $L_2$ Convergence Guarantees without Identification or Closedness

Author

Listed:
  • Andrew Bennett
  • Nathan Kallus
  • Xiaojie Mao
  • Whitney Newey
  • Vasilis Syrgkanis
  • Masatoshi Uehara
Abstract
In this paper, we study nonparametric estimation of instrumental variable (IV) regressions. Recently, many flexible machine learning methods have been developed for instrumental variable estimation. However, these methods have at least one of the following limitations: (1) restricting the IV regression to be uniquely identified; (2) only obtaining estimation error rates in terms of pseudometrics (\emph{e.g.,} projected norm) rather than valid metrics (\emph{e.g.,} $L_2$ norm); or (3) imposing the so-called closedness condition that requires a certain conditional expectation operator to be sufficiently smooth. In this paper, we present the first method and analysis that can avoid all three limitations, while still permitting general function approximation. Specifically, we propose a new penalized minimax estimator that can converge to a fixed IV solution even when there are multiple solutions, and we derive a strong $L_2$ error rate for our estimator under lax conditions. Notably, this guarantee only needs a widely-used source condition and realizability assumptions, but not the so-called closedness condition. We argue that the source condition and the closedness condition are inherently conflicting, so relaxing the latter significantly improves upon the existing literature that requires both conditions. Our estimator can achieve this improvement because it builds on a novel formulation of the IV estimation problem as a constrained optimization problem.

Suggested Citation

  • Andrew Bennett & Nathan Kallus & Xiaojie Mao & Whitney Newey & Vasilis Syrgkanis & Masatoshi Uehara, 2023. "Minimax Instrumental Variable Regression and $L_2$ Convergence Guarantees without Identification or Closedness," Papers 2302.05404, arXiv.org.
    • Handle: RePEc:arx:papers:2302.05404
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2302.05404
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Escanciano, Juan Carlos & Hoderlein, Stefan & Lewbel, Arthur & Linton, Oliver & Srisuma, Sorawoot, 2021. "Nonparametric Euler Equation Identification And Estimation," Econometric Theory, Cambridge University Press, vol. 37(5), pages 851-891, October.
    2. Chen, Xiaohong & Reiss, Markus, 2011. "On Rate Optimality For Ill-Posed Inverse Problems In Econometrics," Econometric Theory, Cambridge University Press, vol. 27(3), pages 497-521, June.
    3. Donald W.K. Andrews & James H. Stock, 2005. "Inference with Weak Instruments," Cowles Foundation Discussion Papers 1530, Cowles Foundation for Research in Economics, Yale University.
    4. S. Darolles & Y. Fan & J. P. Florens & E. Renault, 2011. "Nonparametric Instrumental Regression," Econometrica, Econometric Society, vol. 79(5), pages 1541-1565, September.
    5. Timothy M. Christensen, 2017. "Nonparametric Stochastic Discount Factor Decomposition," Econometrica, Econometric Society, vol. 85, pages 1501-1536, September.
    6. Florens, Jean-Pierre & Johannes, Jan & Van Bellegem, Sébastien, 2011. "Identification And Estimation By Penalization In Nonparametric Instrumental Regression," Econometric Theory, Cambridge University Press, vol. 27(3), pages 472-496, June.
    7. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    8. Richard Blundell & Xiaohong Chen & Dennis Kristensen, 2007. "Semi-Nonparametric IV Estimation of Shape-Invariant Engel Curves," Econometrica, Econometric Society, vol. 75(6), pages 1613-1669, November.
    9. Krikamol Muandet & Arash Mehrjou & Si Kai Lee & Anant Raj, 2019. "Dual Instrumental Variable Regression," Papers 1910.12358, arXiv.org, revised Oct 2020.
    10. Xiaohong Chen & Demian Pouzo, 2012. "Estimation of Nonparametric Conditional Moment Models With Possibly Nonsmooth Generalized Residuals," Econometrica, Econometric Society, vol. 80(1), pages 277-321, January.
    11. Andrews, Donald W.K., 2017. "Examples of L2-complete and boundedly-complete distributions," Journal of Econometrics, Elsevier, vol. 199(2), pages 213-220.
    12. Santos, Andres, 2011. "Instrumental variable methods for recovering continuous linear functionals," Journal of Econometrics, Elsevier, vol. 161(2), pages 129-146, April.
    13. Xiaohong Chen & Victor Chernozhukov & Sokbae Lee & Whitney K. Newey, 2014. "Local Identification of Nonparametric and Semiparametric Models," Econometrica, Econometric Society, vol. 82(2), pages 785-809, March.
    14. repec:mpr:mprres:8160 is not listed on IDEAS
    15. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    16. Andrew Bennett & Nathan Kallus & Xiaojie Mao & Whitney Newey & Vasilis Syrgkanis & Masatoshi Uehara, 2022. "Inference on Strongly Identified Functionals of Weakly Identified Functions," Papers 2208.08291, arXiv.org, revised Jun 2023.
    17. Kalouptsidi, Myrto & Scott, Paul T. & Souza-Rodrigues, Eduardo, 2021. "Linear IV regression estimators for structural dynamic discrete choice models," Journal of Econometrics, Elsevier, vol. 222(1), pages 778-804.
    18. Timothy Christensen, 2014. "Nonparametric Stochastic Discount Factor Decomposition," Papers 1412.4428, arXiv.org, revised May 2017.
    19. Joel L. Horowitz, 2007. "Asymptotic Normality Of A Nonparametric Instrumental Variables Estimator," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1329-1349, November.
    20. Chen, Qihui, 2021. "Robust and optimal estimation for partially linear instrumental variables models with partial identification," Journal of Econometrics, Elsevier, vol. 221(2), pages 368-380.
    21. Florens, Jean-Pierre & Johannes, Jan & Van Bellegem, Sebastien, 2011. "Identification and estimation by penalization in Nonparametric Instrumental Regression," LIDAM Reprints ISBA 2011046, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    22. Carrasco, Marine & Florens, Jean-Pierre & Renault, Eric, 2007. "Linear Inverse Problems in Structural Econometrics Estimation Based on Spectral Decomposition and Regularization," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 77, Elsevier.
    23. Chunrong Ai & Xiaohong Chen, 2003. "Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions," Econometrica, Econometric Society, vol. 71(6), pages 1795-1843, November.
    24. Isaiah Andrews & James H. Stock & Liyang Sun, 2019. "Weak Instruments in Instrumental Variables Regression: Theory and Practice," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 727-753, August.
    25. FLORENS, Jean-Pierre & JOHANNES, Jan & VAN BELLEGEM, Sébastien, 2011. "Identification and estimation by penalization in nonparametric instrumental regression," LIDAM Reprints CORE 2320, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    26. Whitney K. Newey & James L. Powell, 2003. "Instrumental Variable Estimation of Nonparametric Models," Econometrica, Econometric Society, vol. 71(5), pages 1565-1578, September.
    27. Whitney K. Newey, 2013. "Nonparametric Instrumental Variables Estimation," American Economic Review, American Economic Association, vol. 103(3), pages 550-556, May.
    28. Joel L. Horowitz, 2011. "Applied Nonparametric Instrumental Variables Estimation," Econometrica, Econometric Society, vol. 79(2), pages 347-394, March.
    29. Greg Lewis & Vasilis Syrgkanis, 2018. "Adversarial Generalized Method of Moments," Papers 1803.07164, arXiv.org, revised Apr 2018.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew Bennett & Nathan Kallus & Xiaojie Mao & Whitney Newey & Vasilis Syrgkanis & Masatoshi Uehara, 2022. "Inference on Strongly Identified Functionals of Weakly Identified Functions," Papers 2208.08291, arXiv.org, revised Jun 2023.
    2. Andrew Bennett & Nathan Kallus & Xiaojie Mao & Whitney Newey & Vasilis Syrgkanis & Masatoshi Uehara, 2023. "Source Condition Double Robust Inference on Functionals of Inverse Problems," Papers 2307.13793, arXiv.org.
    3. Xiaohong Chen & Victor Chernozhukov & Sokbae Lee & Whitney K. Newey, 2014. "Local Identification of Nonparametric and Semiparametric Models," Econometrica, Econometric Society, vol. 82(2), pages 785-809, March.
    4. Xiaohong Chen & Demian Pouzo, 2015. "Sieve Wald and QLR Inferences on Semi/Nonparametric Conditional Moment Models," Econometrica, Econometric Society, vol. 83(3), pages 1013-1079, May.
    5. Escanciano, Juan Carlos & Li, Wei, 2021. "Optimal Linear Instrumental Variables Approximations," Journal of Econometrics, Elsevier, vol. 221(1), pages 223-246.
    6. Zihao Li & Hui Lan & Vasilis Syrgkanis & Mengdi Wang & Masatoshi Uehara, 2024. "Regularized DeepIV with Model Selection," Papers 2403.04236, arXiv.org.
    7. Centorrino, Samuele & Florens, Jean-Pierre, 2021. "Nonparametric Instrumental Variable Estimation of Binary Response Models with Continuous Endogenous Regressors," Econometrics and Statistics, Elsevier, vol. 17(C), pages 35-63.
    8. Jad Beyhum & Elia Lapenta & Pascal Lavergne, 2023. "One-step smoothing splines instrumental regression," Papers 2307.14867, arXiv.org, revised Dec 2024.
    9. Beyhum, Jad & Lapenta, Elia & Lavergne, Pascal, 2023. "One-step nonparametric instrumental regression using smoothing splines," TSE Working Papers 23-1467, Toulouse School of Economics (TSE).
    10. Fabian Dunker, 2015. "Adaptive estimation for some nonparametric instrumental variable models," Papers 1511.03977, arXiv.org, revised Aug 2021.
    11. Liao, Yuan & Jiang, Wenxin, 2011. "Posterior consistency of nonparametric conditional moment restricted models," MPRA Paper 38700, University Library of Munich, Germany.
    12. Joel L. Horowitz, 2013. "Ill-posed inverse problems in economics," CeMMAP working papers 37/13, Institute for Fiscal Studies.
    13. Fève, Frédérique & Florens, Jean-Pierre, 2014. "Non parametric analysis of panel data models with endogenous variables," Journal of Econometrics, Elsevier, vol. 181(2), pages 151-164.
    14. Xiaohong Chen & Demian Pouzo, 2014. "Sieve Wald and QLR Inferences on Semi/nonparametric Conditional Moment Models," CeMMAP working papers 38/14, Institute for Fiscal Studies.
    15. Asin, Nicolas & Johannes, Jan, 2016. "Adaptive non-parametric instrumental regression in the presence of dependence," LIDAM Discussion Papers ISBA 2016015, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    16. Joel L. Horowitz, 2013. "Ill-posed inverse problems in economics," CeMMAP working papers CWP37/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Xiaohong Chen & Timothy M. Christensen, 2015. "Optimal sup-norm rates, adaptivity and inference in nonparametric instrumental variables estimation," CeMMAP working papers 32/15, Institute for Fiscal Studies.
    18. Xiaohong Chen & Timothy Christensen, 2013. "Optimal Sup-norm Rates, Adaptivity and Inference in Nonparametric Instrumental Variables Estimation," Cowles Foundation Discussion Papers 1923R, Cowles Foundation for Research in Economics, Yale University, revised Apr 2015.
    19. Centorrino Samuele & Feve Frederique & Florens Jean-Pierre, 2017. "Additive Nonparametric Instrumental Regressions: A Guide to Implementation," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-25, January.
    20. Jean-Jacques Forneron, 2019. "A Sieve-SMM Estimator for Dynamic Models," Papers 1902.01456, arXiv.org, revised Jan 2023.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2302.05404. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.