[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/ptu/wpaper/w201120.html
   My bibliography  Save this paper

International organisations’ vs. private analysts’ forecasts: an evaluation

Author

Listed:
  • Ildeberta Abreu
Abstract
This paper evaluates the performance of the macroeconomic forecasts disclosed by three leading international organisations - the IMF, the European Commission and the OECD - and compares it with that of the mean forecasts of two surveys of private analysts - the Consensus Economics and The Economist. The publication of forecasts twice a year by international organisations always receives a great deal of public attention but the timely forecasts disclosed monthly by private institutions have been gaining increased visibility. The aim of this work is to help forecast users in answering the question of how much (little) confidence they should place in the alternative forecasts that are available at each moment. The evaluation covers real GDP growth and inflation projections for nine main advanced economies, over the period 1991-2009. Several evaluation criteria are used. The quantitative accuracy of forecasts is assessed and their unbiasedness and efficiency is tested. The directional accuracy of forecasts and the ability to predict economic recessions are also examined. The results suggest that the forecasting performance of the international organisations is broadly similar to that of the surveys of private analysts. By and large, current-year forecasts present desirable features and clearly outperform year-ahead forecasts for which evidence is more mixed both in terms of quantitative and qualitative accuracy.

Suggested Citation

  • Ildeberta Abreu, 2011. "International organisations’ vs. private analysts’ forecasts: an evaluation," Working Papers w201120, Banco de Portugal, Economics and Research Department.
    • Handle: RePEc:ptu:wpaper:w201120
    as

    Download full text from publisher

    File URL: https://www.bportugal.pt/sites/default/files/anexos/papers/wp201120.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Masahiro Ashiya, 2003. "The directional accuracy of 15-months-ahead forecasts made by the IMF," Applied Economics Letters, Taylor & Francis Journals, vol. 10(6), pages 331-333.
    2. Victor Zarnowitz & Phillip Braun, 1993. "Twenty-two Years of the NBER-ASA Quarterly Economic Outlook Surveys: Aspects and Comparisons of Forecasting Performance," NBER Chapters, in: Business Cycles, Indicators, and Forecasting, pages 11-94, National Bureau of Economic Research, Inc.
    3. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    4. Filip Keereman, 1999. "The track record of the Commission forecasts," European Economy - Economic Papers 2008 - 2015 137, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    5. Loungani, Prakash & Stekler, Herman & Tamirisa, Natalia, 2013. "Information rigidity in growth forecasts: Some cross-country evidence," International Journal of Forecasting, Elsevier, vol. 29(4), pages 605-621.
    6. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    7. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    8. Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
    9. Stephen K. McNees, 1992. "How large are economic forecast errors?," New England Economic Review, Federal Reserve Bank of Boston, issue Jul, pages 25-42.
    10. Jef Vuchelen & Maria-Isabel Gutierrez, 2005. "Do the OECD 24 month horizon growth forecasts for the G7-countries contain information?," Applied Economics, Taylor & Francis Journals, vol. 37(8), pages 855-862.
    11. James H. Stock & Mark W. Watson, 1993. "Business Cycles, Indicators, and Forecasting," NBER Books, National Bureau of Economic Research, Inc, number stoc93-1.
    12. Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
    13. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-259, April.
    14. Vassiliki Koutsogeorgopoulou, 2000. "A Post-Mortem on Economic Outlook Projections," OECD Economics Department Working Papers 274, OECD Publishing.
    15. Ash, J. C. K. & Smyth, D. J. & Heravi, S. M., 1998. "Are OECD forecasts rational and useful?: a directional analysis," International Journal of Forecasting, Elsevier, vol. 14(3), pages 381-391, September.
    16. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    17. Nicolas Carnot & Vincent Koen & Bruno Tissot, 2005. "Economic Forecasting," Palgrave Macmillan Books, Palgrave Macmillan, number 978-0-230-00581-5, March.
    18. Stock, James H. & Watson, Mark W. (ed.), 1993. "Business Cycles, Indicators, and Forecasting," National Bureau of Economic Research Books, University of Chicago Press, edition 1, number 9780226774886, September.
    19. Lukas Vogel, 2007. "How do the OECD Growth Projections for the G7 Economies Perform?: A Post-Mortem," OECD Economics Department Working Papers 573, OECD Publishing.
    20. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    21. A. Melander & G. Sismanidis & D. Grenouilleau, 2007. "The track record of the Commission's forecasts - an update," European Economy - Economic Papers 2008 - 2015 291, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. El-Shagi, Makram & Giesen, Sebastian & Jung, Alexander, 2012. "Does Central Bank Staff Beat Private Forecasters?," IWH Discussion Papers 5/2012, Halle Institute for Economic Research (IWH).
    2. Jung, Alexander & El-Shagi, Makram & Giesen, Sebastian, 2014. "Does the federal reserve staff still beat private forecasters?," Working Paper Series 1635, European Central Bank.
    3. Maritta Paloviita & Pasi Ikonen, 2018. "Real-time uncertainty in budget planning: evidence from euro area countries," Journal of Economic Policy Reform, Taylor and Francis Journals, vol. 21(4), pages 281-300, October.
    4. Simionescu, Mihaela, 2015. "A Comparative Analysis Of Macroeconomic Forecasts Accuracy In Spain And Romania," UTMS Journal of Economics, University of Tourism and Management, Skopje, Macedonia, vol. 6(1), pages 67-74.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    2. Harvey, David I. & Newbold, Paul, 2003. "The non-normality of some macroeconomic forecast errors," International Journal of Forecasting, Elsevier, vol. 19(4), pages 635-653.
    3. Mills, Terence C. & Pepper, Gordon T., 1999. "Assessing the forecasters: an analysis of the forecasting records of the Treasury, the London Business School and the National Institute," International Journal of Forecasting, Elsevier, vol. 15(3), pages 247-257, July.
    4. Moser, Gabriel & Rumler, Fabio & Scharler, Johann, 2007. "Forecasting Austrian inflation," Economic Modelling, Elsevier, vol. 24(3), pages 470-480, May.
    5. Liu, Dandan & Jansen, Dennis W., 2007. "Macroeconomic forecasting using structural factor analysis," International Journal of Forecasting, Elsevier, vol. 23(4), pages 655-677.
    6. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    7. repec:lan:wpaper:470 is not listed on IDEAS
    8. Rianne Legerstee & Philip Hans Franses, 2015. "Does Disagreement Amongst Forecasters Have Predictive Value?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 34(4), pages 290-302, July.
    9. Rua, António, 2017. "A wavelet-based multivariate multiscale approach for forecasting," International Journal of Forecasting, Elsevier, vol. 33(3), pages 581-590.
    10. Gavin, William T. & Mandal, Rachel J., 2003. "Evaluating FOMC forecasts," International Journal of Forecasting, Elsevier, vol. 19(4), pages 655-667.
    11. Bourmpoula, Evangelia. & Wieser, Christina., 2014. "An accuracy assessment of the global employment trends' unemployment rate forecasts," Global Employment Trends Reports 994888903402676, International Labour Office, Economic and Labour Market Analysis Department.
    12. Jalles, João Tovar, 2017. "On the rationality and efficiency of inflation forecasts: Evidence from advanced and emerging market economies," Research in International Business and Finance, Elsevier, vol. 40(C), pages 175-189.
    13. William T. Gavin, 2003. "FOMC forecast: is all the information in the central tendency?," Review, Federal Reserve Bank of St. Louis, vol. 85(May), pages 27-46.
    14. Carlos Fonseca Marinheiro, 2010. "Fiscal sustainability and the accuracy of macroeconomic forecasts: do supranational forecasts rather than government forecasts make a difference?," GEMF Working Papers 2010-07, GEMF, Faculty of Economics, University of Coimbra.
    15. Daniel Grenouilleau, 2006. "The Stacked Leading Indicators Dynamic Factor Model: A Sensitivity Analysis of Forecast Accuracy using Bootstrapping," European Economy - Economic Papers 2008 - 2015 249, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    16. repec:ilo:ilowps:488890 is not listed on IDEAS
    17. Francis X. Diebold & Glenn D. Rudebusch, 2001. "Five questions about business cycles," Economic Review, Federal Reserve Bank of San Francisco, pages 1-15.
    18. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    19. Guillaume Chevillon, 2007. "Direct Multi‐Step Estimation And Forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 21(4), pages 746-785, September.
    20. repec:onb:oenbwp:y::i:91:b:1 is not listed on IDEAS
    21. Hamid Baghestani, 2011. "A directional analysis of Federal Reserve predictions of growth in unit labor costs and productivity," International Review of Applied Economics, Taylor & Francis Journals, vol. 25(3), pages 303-311.
    22. João Valle e Azevedo & João Tovar Jalles, 2011. "Rational vs. Professional Forecasts," Working Papers w201114, Banco de Portugal, Economics and Research Department.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ptu:wpaper:w201120. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: DEE-NTD (email available below). General contact details of provider: https://edirc.repec.org/data/bdpgvpt.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.