(This abstract was borrowed from another version of this item.)"> (This abstract was borrowed from another version of this item.)">
[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/ajf/louvlf/2020006.html
   My bibliography  Save this paper

Optimal and robust combination of forecasts via constrained optimization and shrinkage

Author

Listed:
  • Roccazzella, Francesco
  • Gambetti, Paolo
  • Vrins, Frédéric
Abstract
We introduce various methods that combine forecasts using constrained optimization with penalty. A non-negativity constraint is imposed on the weights, and several penalties are considered, taking the form of a divergence from a reference combination scheme. In contrast with most of the existing approaches, our framework performs forecast selection and combination in one step, allowing for potentially sparse combining schemes. Moreover, by exploiting the analogy between forecasts combination and portfolio optimization, we provide the analytical expression of the optimal penalty strength when penalizing with the L2-divergence from the equally-weighted scheme. An extensive simulation study and two empirical applications allow us to investigate the impact of the divergence function, the reference scheme, and the non-negativity constraint on the predictive performance. Our results suggest that the proposed models outperform those considered in previous studies.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Roccazzella, Francesco & Gambetti, Paolo & Vrins, Frédéric, 2020. "Optimal and robust combination of forecasts via constrained optimization and shrinkage," LIDAM Discussion Papers LFIN 2020006, Université catholique de Louvain, Louvain Finance (LFIN).
    • Handle: RePEc:ajf:louvlf:2020006
    as

    Download full text from publisher

    File URL: https://dial.uclouvain.be/pr/boreal/fr/object/boreal%3A229061/datastream/PDF_03/view
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    2. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    3. Victor DeMiguel & Lorenzo Garlappi & Francisco J. Nogales & Raman Uppal, 2009. "A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms," Management Science, INFORMS, vol. 55(5), pages 798-812, May.
    4. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    5. Claeskens, Gerda & Magnus, Jan R. & Vasnev, Andrey L. & Wang, Wendun, 2016. "The forecast combination puzzle: A simple theoretical explanation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 754-762.
    6. Tu, Jun & Zhou, Guofu, 2011. "Markowitz meets Talmud: A combination of sophisticated and naive diversification strategies," Journal of Financial Economics, Elsevier, vol. 99(1), pages 204-215, January.
    7. Sydney C. Ludvigson & Sai Ma & Serena Ng, 2021. "Uncertainty and Business Cycles: Exogenous Impulse or Endogenous Response?," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(4), pages 369-410, October.
    8. Diebold, Francis X. & Pauly, Peter, 1990. "The use of prior information in forecast combination," International Journal of Forecasting, Elsevier, vol. 6(4), pages 503-508, December.
    9. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    10. Bunn, Derek W., 1985. "Statistical efficiency in the linear combination of forecasts," International Journal of Forecasting, Elsevier, vol. 1(2), pages 151-163.
    11. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    12. Behr, Patrick & Guettler, Andre & Miebs, Felix, 2013. "On portfolio optimization: Imposing the right constraints," Journal of Banking & Finance, Elsevier, vol. 37(4), pages 1232-1242.
    13. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    14. Conflitti, Cristina & De Mol, Christine & Giannone, Domenico, 2015. "Optimal combination of survey forecasts," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1096-1103.
    15. Harrison, David Jr. & Rubinfeld, Daniel L., 1978. "Hedonic housing prices and the demand for clean air," Journal of Environmental Economics and Management, Elsevier, vol. 5(1), pages 81-102, March.
    16. Park, Trevor & Casella, George, 2008. "The Bayesian Lasso," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 681-686, June.
    17. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    18. Marco Aiolfi & Carlo Ambrogio Favero, "undated". "Model Uncertainty, Thick Modelling and the predictability of Stock Returns," Working Papers 221, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    19. Green, Richard C & Hollifield, Burton, 1992. "When Will Mean-Variance Efficient Portfolios Be Well Diversified?," Journal of Finance, American Finance Association, vol. 47(5), pages 1785-1809, December.
    20. Amendola, Alessandra & Braione, Manuela & Candila, Vincenzo & Storti, Giuseppe, 2020. "A Model Confidence Set approach to the combination of multivariate volatility forecasts," International Journal of Forecasting, Elsevier, vol. 36(3), pages 873-891.
    21. Cade Massey & George Wu, 2005. "Detecting Regime Shifts: The Causes of Under- and Overreaction," Management Science, INFORMS, vol. 51(6), pages 932-947, June.
    22. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    23. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    24. Olivier Ledoit & Michael Wolf, 2017. "Nonlinear Shrinkage of the Covariance Matrix for Portfolio Selection: Markowitz Meets Goldilocks," The Review of Financial Studies, Society for Financial Studies, vol. 30(12), pages 4349-4388.
    25. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    26. repec:bla:jfinan:v:58:y:2003:i:4:p:1651-1684 is not listed on IDEAS
    27. Samuels, Jon D. & Sekkel, Rodrigo M., 2017. "Model Confidence Sets and forecast combination," International Journal of Forecasting, Elsevier, vol. 33(1), pages 48-60.
    28. Taylor, James W., 2020. "Forecast combinations for value at risk and expected shortfall," International Journal of Forecasting, Elsevier, vol. 36(2), pages 428-441.
    29. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    30. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    31. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    32. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    33. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    34. Ryan T. Ball & Eric Ghysels, 2018. "Automated Earnings Forecasts: Beat Analysts or Combine and Conquer?," Management Science, INFORMS, vol. 64(10), pages 4936-4952, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yun Feng & Weijie Hou & Yuping Song, 2024. "Tail risk forecasting and its application to margin requirements in the commodity futures market," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(5), pages 1513-1529, August.
    2. Feng, Yun & Hou, Weijie & Song, Yuping, 2023. "Tail risk in the Chinese stock market: An AEV model on the maximal drawdowns," Finance Research Letters, Elsevier, vol. 58(PA).
    3. Nikita Dmitrievich Senchilo & Denis Anatolievich Ustinov, 2021. "Method for Determining the Optimal Capacity of Energy Storage Systems with a Long-Term Forecast of Power Consumption," Energies, MDPI, vol. 14(21), pages 1-25, October.
    4. Paolo Gambetti & Francesco Roccazzella & Frédéric Vrins, 2022. "Meta-Learning Approaches for Recovery Rate Prediction," Risks, MDPI, vol. 10(6), pages 1-29, June.
    5. Roccazzella, Francesco & Candelon, Bertrand, 2022. "Should we care about ECB inflation expectations?," LIDAM Discussion Papers LFIN 2022004, Université catholique de Louvain, Louvain Finance (LFIN).
    6. Thompson, Ryan & Qian, Yilin & Vasnev, Andrey L., 2024. "Flexible global forecast combinations," Omega, Elsevier, vol. 126(C).
    7. Radchenko, Peter & Vasnev, Andrey L. & Wang, Wendun, 2023. "Too similar to combine? On negative weights in forecast combination," International Journal of Forecasting, Elsevier, vol. 39(1), pages 18-38.
    8. Distaso, Walter & Roccazzella, Francesco & Vrins, Frédéric, 2023. "Business cycle and realized losses in the consumer credit industry," LIDAM Discussion Papers LFIN 2023007, Université catholique de Louvain, Louvain Finance (LFIN).
    9. Zhentao Shi & Liangjun Su & Tian Xie, 2020. "L2-Relaxation: With Applications to Forecast Combination and Portfolio Analysis," Papers 2010.09477, arXiv.org, revised Aug 2022.
    10. Roccazzella, Francesco & Gambetti, Paolo & Vrins, Frédéric, 2022. "Correction to: Optimal and robust combination of forecasts via constrained optimization and shrinkage," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1050-1050.
    11. Xu, Peng, 2024. "Testing out-of-sample portfolio performance using second-order stochastic dominance constrained optimization approach," International Review of Financial Analysis, Elsevier, vol. 95(PA).
    12. Qian, Yilin & Thompson, Ryan & Vasnev, Andrey L, 2022. "Global combinations of expert forecasts," Working Papers BAWP-2022-02, University of Sydney Business School, Discipline of Business Analytics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel Borup & Jonas N. Eriksen & Mads M. Kjær & Martin Thyrsgaard, 2024. "Predicting Bond Return Predictability," Management Science, INFORMS, vol. 70(2), pages 931-951, February.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    4. Wang, Yudong & Hao, Xianfeng, 2023. "Forecasting the real prices of crude oil: What is the role of parameter instability?," Energy Economics, Elsevier, vol. 117(C).
    5. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    6. Füss, Roland & Miebs, Felix & Trübenbach, Fabian, 2014. "A jackknife-type estimator for portfolio revision," Journal of Banking & Finance, Elsevier, vol. 43(C), pages 14-28.
    7. Tae-Hwy Lee & Ekaterina Seregina, 2020. "Learning from Forecast Errors: A New Approach to Forecast Combination," Working Papers 202024, University of California at Riverside, Department of Economics.
    8. Zhentao Shi & Liangjun Su & Tian Xie, 2020. "L2-Relaxation: With Applications to Forecast Combination and Portfolio Analysis," Papers 2010.09477, arXiv.org, revised Aug 2022.
    9. Bollerslev, Tim & Patton, Andrew J. & Quaedvlieg, Rogier, 2018. "Modeling and forecasting (un)reliable realized covariances for more reliable financial decisions," Journal of Econometrics, Elsevier, vol. 207(1), pages 71-91.
    10. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    11. Tu, Xueyong & Li, Bin, 2024. "Robust portfolio selection with smart return prediction," Economic Modelling, Elsevier, vol. 135(C).
    12. Mörstedt, Torsten & Lutz, Bernhard & Neumann, Dirk, 2024. "Cross validation based transfer learning for cross-sectional non-linear shrinkage: A data-driven approach in portfolio optimization," European Journal of Operational Research, Elsevier, vol. 318(2), pages 670-685.
    13. Dai, Zhifeng & Wen, Fenghua, 2018. "Some improved sparse and stable portfolio optimization problems," Finance Research Letters, Elsevier, vol. 27(C), pages 46-52.
    14. Behr, Patrick & Guettler, Andre & Miebs, Felix, 2013. "On portfolio optimization: Imposing the right constraints," Journal of Banking & Finance, Elsevier, vol. 37(4), pages 1232-1242.
    15. Jiun-Hua Su, 2021. "No-Regret Forecasting with Egalitarian Committees," Papers 2109.13801, arXiv.org.
    16. Caner, Mehmet & Medeiros, Marcelo & Vasconcelos, Gabriel F.R., 2023. "Sharpe Ratio analysis in high dimensions: Residual-based nodewise regression in factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 393-417.
    17. Li, Jiahan & Chen, Weiye, 2014. "Forecasting macroeconomic time series: LASSO-based approaches and their forecast combinations with dynamic factor models," International Journal of Forecasting, Elsevier, vol. 30(4), pages 996-1015.
    18. Yen, Yu-Min & Yen, Tso-Jung, 2014. "Solving norm constrained portfolio optimization via coordinate-wise descent algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 737-759.
    19. Michael Curran & Patrick O'Sullivan & Ryan Zalla, 2020. "Can Volatility Solve the Naive Portfolio Puzzle?," Papers 2005.03204, arXiv.org, revised Feb 2022.
    20. Gibbs, Christopher G. & Vasnev, Andrey L., 2024. "Conditionally optimal weights and forward-looking approaches to combining forecasts," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1734-1751.

    More about this item

    Keywords

    forecasts combination ; robust methods ; optimal combination ; machine learning;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ajf:louvlf:2020006. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Séverine De Visscher (email available below). General contact details of provider: https://edirc.repec.org/data/lfuclbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.