[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2020-13.html
   My bibliography  Save this paper

Most Powerful Test against High Dimensional Free Alternatives

Author

Listed:
  • Yi He
  • Sombut Jaidee
  • Jiti Gao
Abstract
We propose a powerful quadratic test for the overall significance of many weak exogenous variables in a dense autoregressive model. By shrinking the classical weighting matrix on the sample moments to be identity, the test is asymptotically correct in high dimensions even when the number of coefficients is larger than the sample size. Our theory allows a non-parametric error distribution and estimation of the autoregressive coefficients. Using random matrix theory, we show that the test has the optimal asymptotic testing power among a large class of competitors against local dense alternatives whose direction is free in the eigenbasis of the sample covariance matrix among regressors. The asymptotic results are adaptive to the predictors' cross-sectional and temporal dependence structure, and do not require a limiting spectral law of their sample covariance matrix. The method extends beyond autoregressive models, and allows more general nuisance parameters. Monte Carlo studies suggest a good power performance of our proposed test against high dimensional dense alternative for various data generating processes. We apply our tests to detect the overall significance of over one hundred exogenous variables in the latest FRED-MD database for predicting the monthly growth in the US industrial production index.

Suggested Citation

  • Yi He & Sombut Jaidee & Jiti Gao, 2020. "Most Powerful Test against High Dimensional Free Alternatives," Monash Econometrics and Business Statistics Working Papers 13/20, Monash University, Department of Econometrics and Business Statistics.
    • Handle: RePEc:msh:ebswps:2020-13
    as

    Download full text from publisher

    File URL: https://www.monash.edu/business/ebs/research/publications/ebs/wp13-2020.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    2. Jelle J. Goeman & Sara A. Van De Geer & Hans C. Van Houwelingen, 2006. "Testing against a high dimensional alternative," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 477-493, June.
    3. Zhong, Ping-Shou & Chen, Song Xi, 2011. "Tests for High-Dimensional Regression Coefficients With Factorial Designs," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 260-274.
    4. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    5. Peter C. B. Phillips & Sainan Jin, 2014. "Testing the Martingale Hypothesis," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(4), pages 537-554, October.
    6. Jin, Baisuo & Wang, Cheng & Miao, Baiqi & Lo Huang, Mong-Na, 2009. "Limiting spectral distribution of large-dimensional sample covariance matrices generated by VARMA," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2112-2125, October.
    7. Alexander Chudik & M. Hashem Pesaran & Elisa Tosetti, 2011. "Weak and strong cross‐section dependence and estimation of large panels," Econometrics Journal, Royal Economic Society, vol. 14(1), pages 45-90, February.
    8. Victor Chernozhukov & Denis Chetverikov & Kengo Kato & Aureo de Paula, 2019. "Inference on Causal and Structural Parameters using Many Moment Inequalities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(5), pages 1867-1900.
    9. Guangming Pan & Jiti Gao & Yanrong Yang, 2014. "Testing Independence Among a Large Number of High-Dimensional Random Vectors," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 600-612, June.
    10. Onatski, Alexei, 2012. "Asymptotics of the principal components estimator of large factor models with weakly influential factors," Journal of Econometrics, Elsevier, vol. 168(2), pages 244-258.
    11. Wu, Wei Biao & Shao, Xiaofeng, 2007. "A Limit Theorem For Quadratic Forms And Its Applications," Econometric Theory, Cambridge University Press, vol. 23(5), pages 930-951, October.
    12. Jianqing Fan & Yuan Liao & Jiawei Yao, 2015. "Power Enhancement in High‐Dimensional Cross‐Sectional Tests," Econometrica, Econometric Society, vol. 83(4), pages 1497-1541, July.
    13. Yinchu Zhu & Jelena Bradic, 2018. "Linear Hypothesis Testing in Dense High-Dimensional Linear Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1583-1600, October.
    14. Bin Guo & Song Xi Chen, 2016. "Tests for high dimensional generalized linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(5), pages 1079-1102, November.
    15. Jianqing Fan & Shaojun Guo & Ning Hao, 2012. "Variance estimation using refitted cross‐validation in ultrahigh dimensional regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(1), pages 37-65, January.
    16. Anders Bredahl Kock & David Preinerstorfer, 2019. "Power in High‐Dimensional Testing Problems," Econometrica, Econometric Society, vol. 87(3), pages 1055-1069, May.
    17. Jelle J. Goeman & Hans C. van Houwelingen & Livio Finos, 2011. "Testing against a high-dimensional alternative in the generalized linear model: asymptotic type I error control," Biometrika, Biometrika Trust, vol. 98(2), pages 381-390.
    18. Yin, Y. Q., 1986. "Limiting spectral distribution for a class of random matrices," Journal of Multivariate Analysis, Elsevier, vol. 20(1), pages 50-68, October.
    19. Lee H. Dicker, 2014. "Variance estimation in high-dimensional linear models," Biometrika, Biometrika Trust, vol. 101(2), pages 269-284.
    20. Silverstein, J. W., 1995. "Strong Convergence of the Empirical Distribution of Eigenvalues of Large Dimensional Random Matrices," Journal of Multivariate Analysis, Elsevier, vol. 55(2), pages 331-339, November.
    21. Silverstein, J. W. & Bai, Z. D., 1995. "On the Empirical Distribution of Eigenvalues of a Class of Large Dimensional Random Matrices," Journal of Multivariate Analysis, Elsevier, vol. 54(2), pages 175-192, August.
    22. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. He, Yi & Jaidee, Sombut & Gao, Jiti, 2023. "Most powerful test against a sequence of high dimensional local alternatives," Journal of Econometrics, Elsevier, vol. 234(1), pages 151-177.
    2. Natalia Bailey & George Kapetanios & M. Hashem Pesaran, 2021. "Measurement of factor strength: Theory and practice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 587-613, August.
    3. Jianqing Fan & Kunpeng Li & Yuan Liao, 2020. "Recent Developments on Factor Models and its Applications in Econometric Learning," Papers 2009.10103, arXiv.org.
    4. Liu, Yang & Sun, Wei & Hsu, Li & He, Qianchuan, 2022. "Statistical inference for high-dimensional pathway analysis with multiple responses," Computational Statistics & Data Analysis, Elsevier, vol. 169(C).
    5. Merlevède, F. & Peligrad, M., 2016. "On the empirical spectral distribution for matrices with long memory and independent rows," Stochastic Processes and their Applications, Elsevier, vol. 126(9), pages 2734-2760.
    6. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    7. Hyungsik Roger Moon & Martin Weidner, 2015. "Linear Regression for Panel With Unknown Number of Factors as Interactive Fixed Effects," Econometrica, Econometric Society, vol. 83(4), pages 1543-1579, July.
    8. Xiong, Ruoxuan & Pelger, Markus, 2023. "Large dimensional latent factor modeling with missing observations and applications to causal inference," Journal of Econometrics, Elsevier, vol. 233(1), pages 271-301.
    9. Pan, Guangming, 2010. "Strong convergence of the empirical distribution of eigenvalues of sample covariance matrices with a perturbation matrix," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1330-1338, July.
    10. Yuan Liao & Xinjie Ma & Andreas Neuhierl & Zhentao Shi, 2023. "Economic Forecasts Using Many Noises," Papers 2312.05593, arXiv.org, revised Dec 2023.
    11. Chen, Zhao & Cheng, Vivian Xinyi & Liu, Xu, 2024. "Reprint: Hypothesis testing on high dimensional quantile regression," Journal of Econometrics, Elsevier, vol. 239(2).
    12. Jamshid Namdari & Debashis Paul & Lili Wang, 2021. "High-Dimensional Linear Models: A Random Matrix Perspective," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(2), pages 645-695, August.
    13. Hyungsik Roger Roger Moon & Martin Weidner, 2013. "Linear regression for panel with unknown number of factors as interactive fixed effects," CeMMAP working papers 49/13, Institute for Fiscal Studies.
    14. Bai, Z.D. & Miao, Baiqi & Jin, Baisuo, 2007. "On limit theorem for the eigenvalues of product of two random matrices," Journal of Multivariate Analysis, Elsevier, vol. 98(1), pages 76-101, January.
    15. Robert F. Engle & Olivier Ledoit & Michael Wolf, 2019. "Large Dynamic Covariance Matrices," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 363-375, April.
    16. Jin, Baisuo & Wang, Cheng & Miao, Baiqi & Lo Huang, Mong-Na, 2009. "Limiting spectral distribution of large-dimensional sample covariance matrices generated by VARMA," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2112-2125, October.
    17. Xinghua Zheng & Yingying Li, 2010. "On the estimation of integrated covariance matrices of high dimensional diffusion processes," Papers 1005.1862, arXiv.org, revised Mar 2012.
    18. Freyaldenhoven, Simon, 2022. "Factor models with local factors — Determining the number of relevant factors," Journal of Econometrics, Elsevier, vol. 229(1), pages 80-102.
    19. Matteo Barigozzi & Christian Brownlees, 2019. "NETS: Network estimation for time series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(3), pages 347-364, April.
    20. Olivier Ledoit & Sandrine P�ch�, 2009. "Eigenvectors of some large sample covariance matrices ensembles," IEW - Working Papers 407, Institute for Empirical Research in Economics - University of Zurich.

    More about this item

    Keywords

    high-dimensional linear model; null hypothesis; uniformly power test;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2020-13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.