[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/fip/fedgfe/2009-10.html
   My bibliography  Save this paper

A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model

Author

Abstract
This paper considers the \"real-time\" forecast performance of the Federal Reserve staff, time-series models, and an estimated dynamic stochastic general equilibrium (DSGE) model--the Federal Reserve Board's new Estimated, Dynamic, Optimization-based (Edo) model. We evaluate forecast performance using out-of-sample predictions from 1996 through 2005, thereby examining over 70 forecasts presented to the Federal Open Market Committee (FOMC). Our analysis builds on previous real-time forecasting exercises along two dimensions. First, we consider time-series models, a structural DSGE model that has been employed to answer policy questions quite different from forecasting, and the forecasts produced by the staff at the Federal Reserve Board. In addition, we examine forecasting performance of our DSGE model at a relatively detailed level by separately considering the forecasts for various components of consumer expenditures and private investment. The results provide significant support to the notion that richly specified DSGE models belong in the forecasting toolbox of a central bank.

Suggested Citation

  • Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2009. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Finance and Economics Discussion Series 2009-10, Board of Governors of the Federal Reserve System (U.S.).
    • Handle: RePEc:fip:fedgfe:2009-10
    as

    Download full text from publisher

    File URL: http://www.federalreserve.gov/pubs/feds/2009/200910/200910abs.html
    Download Restriction: no
    File URL: http://www.federalreserve.gov/pubs/feds/2009/200910/200910pap.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Brayton, Flint & Levin, Andrew & Lyon, Ralph & Williams, John C., 1997. "The evolution of macro models at the Federal Reserve Board," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 47(1), pages 43-81, December.
    2. Athanasios Orphanides & Simon van Norden, 2002. "The Unreliability of Output-Gap Estimates in Real Time," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 569-583, November.
    3. Michael T. Kiley, 2007. "A Quantitative Comparison of Sticky-Price and Sticky-Information Models of Price Setting," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 101-125, February.
    4. Greenwood, Jeremy & Hercowitz, Zvi & Krusell, Per, 2000. "The role of investment-specific technological change in the business cycle," European Economic Review, Elsevier, vol. 44(1), pages 91-115, January.
    5. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2008. "The new area-wide model of the euro area: a micro-founded open-economy model for forecasting and policy analysis," Working Paper Series 944, European Central Bank.
    6. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    7. Christopher J. Erceg & Luca Guerrieri & Christopher Gust, 2006. "SIGMA: A New Open Economy Model for Policy Analysis," International Journal of Central Banking, International Journal of Central Banking, vol. 2(1), March.
    8. Sims, Christopher A., 2008. "Improving monetary policy models," Journal of Economic Dynamics and Control, Elsevier, vol. 32(8), pages 2460-2475, August.
    9. Jean-Philippe Laforte, 2007. "Pricing Models: A Bayesian DSGE Approach for the U.S. Economy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 127-154, February.
    10. Malin Adolfson & Michael K. Andersson & Jesper Lindé & Mattias Villani & Anders Vredin, 2007. "Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks," International Journal of Central Banking, International Journal of Central Banking, vol. 3(4), pages 111-144, December.
    11. Antonello D'Agostino & Domenico Giannone & Paolo Surico, 2005. "(Un)Predictability and Macroeconomic Stability," Macroeconomics 0510024, University Library of Munich, Germany.
    12. David Altig & Lawrence Christiano & Martin Eichenbaum & Jesper Linde, 2011. "Firm-Specific Capital, Nominal Rigidities and the Business Cycle," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 14(2), pages 225-247, April.
    13. Mark Gertler & Luca Sala & Antonella Trigari, 2008. "An Estimated Monetary DSGE Model with Unemployment and Staggered Nominal Wage Bargaining," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(8), pages 1713-1764, December.
    14. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    15. Jordi Galí & Mark Gertler, 2007. "Macroeconomic Modeling for Monetary Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 21(4), pages 25-46, Fall.
    16. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    17. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    18. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    19. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    20. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    21. Anne B. Koehler & Emily S. Murphree, 1988. "A Comparison of the Akaike and Schwarz Criteria for Selecting Model Order," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 37(2), pages 187-195, June.
    22. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    23. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2007. "Documentation of the Research and Statistics Division’s estimated DSGE model of the U.S. economy: 2006 version," Finance and Economics Discussion Series 2007-53, Board of Governors of the Federal Reserve System (U.S.).
    24. Whelan, Karl, 2003. "A Two-Sector Approach to Modeling U.S. NIPA Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 35(4), pages 627-656, August.
    25. Mattias Villani & Malin Adolfson & Jesper Linde, 2005. "Forecasting Performance of an Open Economy Dynamic Stochastic General Equilibrium Model," Money Macro and Finance (MMF) Research Group Conference 2005 32, Money Macro and Finance Research Group.
    26. Jeremy Rudd & Karl Whelan, 2007. "Modeling Inflation Dynamics: A Critical Review of Recent Research," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 155-170, February.
    27. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    28. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    29. David Altig & Lawrence Christiano & Martin Eichenbaum & Jesper Linde, 2011. "Firm-Specific Capital, Nominal Rigidities and the Business Cycle," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 14(2), pages 225-247, April.
    30. David L. Reifschneider & Peter Tulip, 2007. "Gauging the uncertainty of the economic outlook from historical forecasting errors," Finance and Economics Discussion Series 2007-60, Board of Governors of the Federal Reserve System (U.S.).
    31. Kirdan Lees & Troy Matheson & Christie Smith, 2007. "Open economy DSGE-VAR forecasting and policy analysis - head to head with the RBNZ published forecasts," Reserve Bank of New Zealand Discussion Paper Series DP2007/01, Reserve Bank of New Zealand.
    32. Marta Bańbura, 2008. "Large Bayesian VARs," 2008 Meeting Papers 334, Society for Economic Dynamics.
    33. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    34. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    35. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    36. Kydland, Finn E & Prescott, Edward C, 1982. "Time to Build and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 50(6), pages 1345-1370, November.
    37. Reifschneider, David L. & Stockton, David J. & Wilcox, David W., 1997. "Econometric models and the monetary policy process," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 47(1), pages 1-37, December.
    38. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    39. Robert J. Gordon, 1998. "Foundations of the Goldilocks Economy: Supply Shocks and the Time-Varying NAIRU," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 29(2), pages 297-346.
    40. Mr. Tamim Bayoumi & Mr. Hamid Faruqee & Mr. Douglas Laxton & Mr. Philippe D Karam & Mr. Alessandro Rebucci & Mr. Jaewoo Lee & Mr. Benjamin L Hunt & Mr. Ivan Tchakarov, 2004. "GEM: A New International Macroeconomic Model," IMF Occasional Papers 2004/010, International Monetary Fund.
    41. Kadiyala, K Rao & Karlsson, Sune, 1997. "Numerical Methods for Estimation and Inference in Bayesian VAR-Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 12(2), pages 99-132, March-Apr.
    42. Edge, Rochelle M. & Kiley, Michael T. & Laforte, Jean-Philippe, 2008. "Natural rate measures in an estimated DSGE model of the U.S. economy," Journal of Economic Dynamics and Control, Elsevier, vol. 32(8), pages 2512-2535, August.
    43. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2005. "An estimated DSGE model of the US economy with an application to natural rate measures," Proceedings, Board of Governors of the Federal Reserve System (U.S.).
    44. Peter Tulip, 2005. "Has output become more predictable? changes in Greenbook forecast accuracy," Finance and Economics Discussion Series 2005-31, Board of Governors of the Federal Reserve System (U.S.).
    45. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    46. Fernandez-Villaverde, Jesus & Francisco Rubio-Ramirez, Juan, 2004. "Comparing dynamic equilibrium models to data: a Bayesian approach," Journal of Econometrics, Elsevier, vol. 123(1), pages 153-187, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2009. "A comparision of forecast, simple reduced-form models, and a DSGE model," CAMA Working Papers 2009-03, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    2. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    3. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    4. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    5. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    6. Alessia Paccagnini, 2012. "Comparing Hybrid DSGE Models," Working Papers 228, University of Milano-Bicocca, Department of Economics, revised Dec 2012.
    7. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    8. Stelios Bekiros & Alessia Paccagnini, 2013. "On the predictability of time-varying VAR and DSGE models," Empirical Economics, Springer, vol. 45(1), pages 635-664, August.
    9. Thorvardur Tjörvi Ólafsson, 2006. "The New Keynesian Phillips Curve: In Search of Improvements and Adaptation to the Open Economy," Economics wp31_tjorvi, Department of Economics, Central bank of Iceland.
    10. Rochelle M. Edge & Refet S. Gurkaynak, 2010. "How Useful Are Estimated DSGE Model Forecasts for Central Bankers?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 41(2 (Fall)), pages 209-259.
    11. Michael T. Kiley & Jean-Philippe Laforte & Rochelle M. Edge, 2008. "The Sources of Fluctuations in Residential Investment: A View from a Policy-Oriented DSGE Model of the U.S. Economic," 2008 Meeting Papers 990, Society for Economic Dynamics.
    12. Del Negro, Marco & Schorfheide, Frank, 2008. "Forming priors for DSGE models (and how it affects the assessment of nominal rigidities)," Journal of Monetary Economics, Elsevier, vol. 55(7), pages 1191-1208, October.
    13. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    14. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Common Drifting Volatility in Large Bayesian VARs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 375-390, July.
    15. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    16. Leeper, Eric M. & Plante, Michael & Traum, Nora, 2010. "Dynamics of fiscal financing in the United States," Journal of Econometrics, Elsevier, vol. 156(2), pages 304-321, June.
    17. Jesús Fernández-Villaverde, 2010. "The econometrics of DSGE models," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 3-49, March.
    18. Tovar, Camilo Ernesto, 2009. "DSGE Models and Central Banks," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 3, pages 1-31.
    19. Rusnák, Marek, 2016. "Nowcasting Czech GDP in real time," Economic Modelling, Elsevier, vol. 54(C), pages 26-39.
    20. Rochelle M. Edge & Refet S. Gürkaynak, 2011. "How useful are estimated DSGE model forecasts?," Finance and Economics Discussion Series 2011-11, Board of Governors of the Federal Reserve System (U.S.).

    More about this item

    Keywords

    Economic forecasting; time series analysis; Macroeconomics;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:2009-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.