[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/fip/fedgif/377.html
   My bibliography  Save this paper

Evaluating the predictive performance of trade-account models

Author

Abstract
This paper evaluates the distributional properties of forecasts from six econometric models of the U.S. trade account. Using stochastic (Monte Carlo) simulation, we derive confidence intervals and forecast-based test statistics which account for uncertainty from future disturbances and from coefficient estimation. Empirically, the confidence intervals of the trade-account forecasts are very wide, and are generally (but not necessarily) increasing with the forecast horizon. Even with such a large degree of uncertainty, some models exhibit \"predictive failure\" when tested. To evaluate forecasts across models, we generalize Chong and Hendry's (1986) forecast-encompassing test statistic to allow for model nonlinearity and to account for uncertainty arising from estimation. All models are rejected by this test, i.e., the data are highly informative. Although both the calculated forecast uncertainty and the test failures temper the role of these models in formulating policy, the failures imply the potential for improved model specification with narrower confidence bands.

Suggested Citation

  • Neil R. Ericsson & Jaime R. Marquez, 1990. "Evaluating the predictive performance of trade-account models," International Finance Discussion Papers 377, Board of Governors of the Federal Reserve System (U.S.).
    • Handle: RePEc:fip:fedgif:377
    as

    Download full text from publisher

    File URL: http://www.federalreserve.gov/pubs/ifdp/1990/377/default.htm
    Download Restriction: no
    File URL: http://www.federalreserve.gov/pubs/ifdp/1990/377/ifdp377.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Edison, Hali J. & Marquez, Jaime R. & Tryon, Ralph W., 1987. "The structure and properties of the Federal Reserve Board Multicountry Model," Economic Modelling, Elsevier, vol. 4(2), pages 115-315, April.
    2. Magnus, Jan R. & Pesaran, Bahram, 1989. "The exact multi-period mean-square forecast error for the first-order autoregressive model with an intercept," Journal of Econometrics, Elsevier, vol. 42(2), pages 157-179, October.
    3. Calzolari, Giorgio, 1979. "Antithetic variates to estimate the simulation bias in non-linear models," Economics Letters, Elsevier, vol. 4(4), pages 323-328.
    4. Morris Goldstein & Mohsin S. Khan, 2017. "Income and Price Effects in Foreign Trade," World Scientific Book Chapters, in: TRADE CURRENCIES AND FINANCE, chapter 1, pages 3-81, World Scientific Publishing Co. Pte. Ltd..
    5. David F. Hendry & Neil R. Ericsson, 1999. "Encompassing and rational expectations: How sequential corroboration can imply refutation," Empirical Economics, Springer, vol. 24(1), pages 1-21.
    6. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    7. Peter Hooper & Catherine L. Mann, 1989. "Exchange Rate Pass-through in the 1980s: The Case of U.S. Imports of Manufactures," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 20(1), pages 297-337.
    8. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    9. Baldwin, Richard, 1988. "Hyteresis in Import Prices: The Beachhead Effect," American Economic Review, American Economic Association, vol. 78(4), pages 773-785, September.
    10. D. F. Hendry & P. K. Trivedi, 1972. "Maximum Likelihood Estimation of Difference Equations with Moving Average Errors: A Simulation Study," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 39(2), pages 117-145.
    11. Pagan, Adrian, 1989. "On the role of simulation in the statistical evaluation of econometric models," Journal of Econometrics, Elsevier, vol. 40(1), pages 125-139, January.
    12. Helliwell, John F, 1989. "Reducing International Imbalances: Evidence from Multicountry Models," American Economic Review, American Economic Association, vol. 79(2), pages 258-263, May.
    13. Hendry, David F., 1984. "Monte carlo experimentation in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 16, pages 937-976, Elsevier.
    14. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    15. Orcutt, Guy H & Winokur, Herbert S, Jr, 1969. "First Order Autoregression: Inference, Estimation, and Prediction," Econometrica, Econometric Society, vol. 37(1), pages 1-14, January.
    16. Hoque, Asraul & Magnus, Jan R. & Pesaran, Bahram, 1988. "The exact multi-period mean-square forecast error for the first-order autoregressive model," Journal of Econometrics, Elsevier, vol. 39(3), pages 327-346, November.
    17. Brown, Bryan W. & Mariano, Roberto S., 1989. "Predictors in Dynamic Nonlinear Models: Large-Sample Behavior," Econometric Theory, Cambridge University Press, vol. 5(3), pages 430-452, December.
    18. Neil R. Ericsson & Jaime R. Marquez, 1989. "Exact and approximate multi-period mean-square forecast errors for dynamic econometric models," International Finance Discussion Papers 348, Board of Governors of the Federal Reserve System (U.S.).
    19. Fair, Ray C., 1986. "Evaluating the predictive accuracy of models," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 3, chapter 33, pages 1979-1995, Elsevier.
    20. Ray C. Fair, 1988. "Sources of Economic Fluctuations in the United States," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 103(2), pages 313-332.
    21. Brown, Bryan W & Mariano, Roberto S, 1984. "Residual-Based Procedures for Prediction and Estimation in a Nonlinear Simultaneous System," Econometrica, Econometric Society, vol. 52(2), pages 321-343, March.
    22. Cline, William R, 1989. "Macroeconomic Influences on Trade Policy," American Economic Review, American Economic Association, vol. 79(2), pages 123-127, May.
    23. Schmidt, Peter, 1974. "The Asymptotic Distribution of Forecasts in the Dynamic Simulation of an Econometric Model," Econometrica, Econometric Society, vol. 42(2), pages 303-309, March.
    24. Peter Hooper, 1989. "Exchange rates and U.S. external adjustment in the short run and the long run," International Finance Discussion Papers 346, Board of Governors of the Federal Reserve System (U.S.).
    25. Fisher, Paul & Salmon, Mark, 1986. "On Evaluating the Importance of Nonlinearity in Large Macroeconometric Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 27(3), pages 625-646, October.
    26. Ellen E. Meade, 1988. "Exchange rates, adjustment, and the J-curve," Federal Reserve Bulletin, Board of Governors of the Federal Reserve System (U.S.), issue Oct, pages 633-644.
    27. Mariano, Roberto S & Brown, Bryan W, 1983. "Asymptotic Behavior of Predictors in a Nonlinear Simultaneous System," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 24(3), pages 523-536, October.
    28. Paul R. Krugman & Richard E. Baldwin, 1987. "The Persistence of the U.S. Trade Deficit," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 18(1), pages 1-56.
    29. Houthakker, Hendrik S & Magee, Stephen P, 1969. "Income and Price Elasticities in World Trade," The Review of Economics and Statistics, MIT Press, vol. 51(2), pages 111-125, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ian Marsh & Stephen Tokarick, 1996. "An assessment of three measures of competitiveness," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 132(4), pages 700-722, December.
    2. Amano, Robert A. & van Norden, Simon, 1995. "Terms of trade and real exchange rates: the Canadian evidence," Journal of International Money and Finance, Elsevier, vol. 14(1), pages 83-104, February.
    3. Andrew M. Warner, 1992. "Did the Debt Crisis Cause the Investment Crisis?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(4), pages 1161-1186.
    4. Ellen E. Meade & Charles P. Thomas, 1991. "Using external sustainability to forecast the dollar," International Finance Discussion Papers 398, Board of Governors of the Federal Reserve System (U.S.).
    5. Jaime R. Marquez, 1992. "Real exchange rates: measurement and implications for predicting U.S. external imbalances," International Finance Discussion Papers 427, Board of Governors of the Federal Reserve System (U.S.).
    6. Catherine L. Mann, 1990. "Prospects for sustained improvement in U.S. external balance: structural change versus policy change," International Finance Discussion Papers 373, Board of Governors of the Federal Reserve System (U.S.).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Calzolari, Giorgio, 1987. "La varianza delle previsioni nei modelli econometrici [Forecast variance in econometric models]," MPRA Paper 23866, University Library of Munich, Germany.
    2. Carone, Giuseppe, 1996. "Modeling the U.S. demand for imports through cointegration and error correction," Journal of Policy Modeling, Elsevier, vol. 18(1), pages 1-48, February.
    3. Gajda, Jan B. & Markowski, Aleksander, 1998. "Model Evaluation Using Stochastic Simulations: The Case of the Econometric Model KOSMOS," Working Papers 61, National Institute of Economic Research.
    4. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
    5. Ayoub Yousefi, 2000. "Merchandise Trade Balances of Less Developed Countries and Exchange Rate of the U.S. Dollar: Cases of Iran, Venezuela & Saudi Arabia," Working Papers 00002, University of Waterloo, Department of Economics, revised Feb 2000.
    6. Catherine L. Mann, 1991. "Structural Change And Prospects For Sustained Improvement In U.S. External Balance," Contemporary Economic Policy, Western Economic Association International, vol. 9(2), pages 50-58, April.
    7. Bianchi, Carlo & Calzolari, Giorgio & Brillet, Jean-Louis, 1987. "Measuring forecast uncertainty : A review with evaluation based on a macro model of the French economy," International Journal of Forecasting, Elsevier, vol. 3(2), pages 211-227.
    8. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    9. David F. Hendry & Michael P. Clements, 1994. "Can Econometrics Improve Economic Forecasting?," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 130(III), pages 267-298, September.
    10. Dag Kolsrud, 2008. "Stochastic Ceteris Paribus Simulations," Computational Economics, Springer;Society for Computational Economics, vol. 31(1), pages 21-43, February.
    11. Neil R. Ericsson, 2000. "Predictable uncertainty in economic forecasting," International Finance Discussion Papers 695, Board of Governors of the Federal Reserve System (U.S.).
    12. Hernán Rincón & Édgar Caicedo & Norberto Rodríguez, 2007. "Exchange rate pass-through effects: a disaggregate analysis of Colombian imports of manufactured goods," Revista ESPE - Ensayos sobre Política Económica, Banco de la Republica de Colombia, vol. 25(54), pages 90-121, June.
    13. Jaime R. Marquez, 1992. "Real exchange rates: measurement and implications for predicting U.S. external imbalances," International Finance Discussion Papers 427, Board of Governors of the Federal Reserve System (U.S.).
    14. Calzolari, Giorgio & Panattoni, Lorenzo, 1990. "Mode predictors in nonlinear systems with identities," International Journal of Forecasting, Elsevier, vol. 6(3), pages 317-326, October.
    15. Hendry, David F., 1984. "Monte carlo experimentation in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 16, pages 937-976, Elsevier.
    16. Catherine L. Mann, 1990. "Prospects for sustained improvement in U.S. external balance: structural change versus policy change," International Finance Discussion Papers 373, Board of Governors of the Federal Reserve System (U.S.).
    17. Andrew M. Warner, 1992. "Import demand and supply with relatively few theoretical or empirical puzzles," International Finance Discussion Papers 433, Board of Governors of the Federal Reserve System (U.S.).
    18. Brillet, Jean-Louis & Calzolari, Giorgio & Panattoni, Lorenzo, 1986. "Coherent optimal prediction with large nonlinear systems: an example based on a French model," MPRA Paper 29057, University Library of Munich, Germany.
    19. Han, Sung-Shin & Suh, Seoung Hwan, 1996. "Exchange rate pass-through and the J-curve: An analysis of the Korean case," Journal of Policy Modeling, Elsevier, vol. 18(1), pages 69-86, February.
    20. Yousefi, Ayoub & Wirjanto, Tony S., 2003. "Exchange rate of the US dollar and the J curve: the case of oil exporting countries," Energy Economics, Elsevier, vol. 25(6), pages 741-765, November.

    More about this item

    Keywords

    Forecasting; Econometric models;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgif:377. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.