[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/bca/bocawp/16-18.html
   My bibliography  Save this paper

A General Approach to Recovering Market Expectations from Futures Prices with an Application to Crude Oil

Author

Listed:
  • Christiane Baumeister
  • Lutz Kilian
Abstract
Futures markets are a potentially valuable source of information about price expectations. Exploiting this information has proved difficult in practice, because time-varying risk premia often render the futures price a poor measure of the market expectation of the price of the underlying asset. Although this expectation in principle may be recovered by adjusting the futures price by the estimated risk premium, a common problem is that there are as many measures of the market expectation as there are estimates of the risk premium. We propose a general solution to this problem that allows us to select the most accurate estimate of the expectation for any set of risk premium estimates. We illustrate this approach by solving the long-standing problem of how to estimate the market expectation of the price of crude oil. We provide a new measure of oil price expectations that is substantially more accurate than the alternatives and more economically plausible. Our analysis has implications for the estimation of economic models of energy-intensive durables, for oil price forecasting and for the measurement of oil price shocks.

Suggested Citation

  • Christiane Baumeister & Lutz Kilian, 2016. "A General Approach to Recovering Market Expectations from Futures Prices with an Application to Crude Oil," Staff Working Papers 16-18, Bank of Canada.
    • Handle: RePEc:bca:bocawp:16-18
    as

    Download full text from publisher

    File URL: https://www.bankofcanada.ca/wp-content/uploads/2016/04/swp2016-18.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kilian, Lutz & Lee, Thomas K., 2014. "Quantifying the speculative component in the real price of oil: The role of global oil inventories," Journal of International Money and Finance, Elsevier, vol. 42(C), pages 71-87.
    2. Ron Alquist & Lutz Kilian, 2010. "What do we learn from the price of crude oil futures?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 539-573.
    3. Alquist, Ron & Kilian, Lutz & Vigfusson, Robert J., 2013. "Forecasting the Price of Oil," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 427-507, Elsevier.
    4. Bassam Fattouh, Lutz Kilian, and Lavan Mahadeva, 2013. "The Role of Speculation in Oil Markets: What Have We Learned So Far?," The Energy Journal, International Association for Energy Economics, vol. 0(Number 3).
    5. Erkko Etula, 2013. "Broker-Dealer Risk Appetite and Commodity Returns," Journal of Financial Econometrics, Oxford University Press, vol. 11(3), pages 486-521, June.
    6. Bessembinder, Hendrik & Seguin, Paul J., 1993. "Price Volatility, Trading Volume, and Market Depth: Evidence from Futures Markets," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 28(1), pages 21-39, March.
    7. Piazzesi, Monika & Swanson, Eric T., 2008. "Futures prices as risk-adjusted forecasts of monetary policy," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 677-691, May.
    8. Ryan Kellogg, 2014. "The Effect of Uncertainty on Investment: Evidence from Texas Oil Drilling," American Economic Review, American Economic Association, vol. 104(6), pages 1698-1734, June.
    9. Christiane Baumeister & Lutz Kilian, 2015. "Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 338-351, July.
    10. Apostolos Serletis, 2007. "Rational Expectations, Risk, and Efficiency in Energy Futures Markets," World Scientific Book Chapters, in: Quantitative And Empirical Analysis Of Energy Markets, chapter 2, pages 15-22, World Scientific Publishing Co. Pte. Ltd..
    11. Allan G. Timmermann, 1993. "How Learning in Financial Markets Generates Excess Volatility and Predictability in Stock Prices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(4), pages 1135-1145.
    12. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    13. Sadorsky, Perry, 2002. "Time-varying risk premiums in petroleum futures prices," Energy Economics, Elsevier, vol. 24(6), pages 539-556, November.
    14. Eugene F. Fama & Kenneth R. French, 2015. "Commodity Futures Prices: Some Evidence on Forecast Power, Premiums, and the Theory of Storage," World Scientific Book Chapters, in: Anastasios G Malliaris & William T Ziemba (ed.), THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 4, pages 79-102, World Scientific Publishing Co. Pte. Ltd..
    15. Soren T. Anderson & Ryan Kellogg & James M. Sallee & Richard T. Curtin, 2011. "Forecasting Gasoline Prices Using Consumer Surveys," American Economic Review, American Economic Association, vol. 101(3), pages 110-114, May.
    16. Ang, Andrew & Piazzesi, Monika, 2003. "A no-arbitrage vector autoregression of term structure dynamics with macroeconomic and latent variables," Journal of Monetary Economics, Elsevier, vol. 50(4), pages 745-787, May.
    17. Bessembinder, Hendrik & Chan, Kalok, 1992. "Time-varying risk premia and forecastable returns in futures markets," Journal of Financial Economics, Elsevier, vol. 32(2), pages 169-193, October.
    18. Baumeister, Christiane & Kilian, Lutz & Lee, Thomas K., 2014. "Are there gains from pooling real-time oil price forecasts?," Energy Economics, Elsevier, vol. 46(S1), pages 33-43.
    19. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809.
    20. Granger, C. W. J. & Newbold, Paul, 1986. "Forecasting Economic Time Series," Elsevier Monographs, Elsevier, edition 2, number 9780122951831 edited by Shell, Karl.
    21. Pesaran, M. Hashem & Timmermann, Allan, 2009. "Testing Dependence Among Serially Correlated Multicategory Variables," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 325-337.
    22. Lutz Kilian & Daniel P. Murphy, 2014. "The Role Of Inventories And Speculative Trading In The Global Market For Crude Oil," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(3), pages 454-478, April.
    23. Pagano Patrizio & Pisani Massimiliano, 2009. "Risk-Adjusted Forecasts of Oil Prices," The B.E. Journal of Macroeconomics, De Gruyter, vol. 9(1), pages 1-28, June.
    24. Acharya, Viral V. & Lochstoer, Lars A. & Ramadorai, Tarun, 2013. "Limits to arbitrage and hedging: Evidence from commodity markets," Journal of Financial Economics, Elsevier, vol. 109(2), pages 441-465.
    25. Frans A. De Roon & Theo E. Nijman & Chris Veld, 2000. "Hedging Pressure Effects in Futures Markets," Journal of Finance, American Finance Association, vol. 55(3), pages 1437-1456, June.
    26. Robert S. Pindyck, 2001. "The Dynamics of Commodity Spot and Futures Markets: A Primer," The Energy Journal, , vol. 22(3), pages 1-29, July.
    27. Hamilton, James D. & Wu, Jing Cynthia, 2014. "Risk premia in crude oil futures prices," Journal of International Money and Finance, Elsevier, vol. 42(C), pages 9-37.
    28. Hunt Allcott & Nathan Wozny, 2014. "Gasoline Prices, Fuel Economy, and the Energy Paradox," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 779-795, December.
    29. Hong, Harrison & Yogo, Motohiro, 2012. "What does futures market interest tell us about the macroeconomy and asset prices?," Journal of Financial Economics, Elsevier, vol. 105(3), pages 473-490.
    30. Meghan R. Busse & Christopher R. Knittel & Florian Zettelmeyer, 2013. "Are Consumers Myopic? Evidence from New and Used Car Purchases," American Economic Review, American Economic Association, vol. 103(1), pages 220-256, February.
    31. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    32. Kenneth J. Singleton, 2014. "Investor Flows and the 2008 Boom/Bust in Oil Prices," Management Science, INFORMS, vol. 60(2), pages 300-318, February.
    33. James A. Kahn, 1986. "Gasoline Prices and the Used Automobile Market: A Rational Expectations Asset Price Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 101(2), pages 323-339.
    34. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    35. Bessembinder, Hendrik, 1992. "Systematic Risk, Hedging Pressure, and Risk Premiums in Futures Markets," The Review of Financial Studies, Society for Financial Studies, vol. 5(4), pages 637-667.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Baumeister, Christiane, 2021. "Measuring Market Expectations," CEPR Discussion Papers 16520, C.E.P.R. Discussion Papers.
    2. Maryam Movahedifar & Hossein Hassani & Masoud Yarmohammadi & Mahdi Kalantari & Rangan Gupta, 2021. "A robust approach for outlier imputation: Singular Spectrum Decomposition," Working Papers 202164, University of Pretoria, Department of Economics.
    3. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    4. Valenti, Daniele & Manera, Matteo & Sbuelz, Alessandro, 2020. "Interpreting the oil risk premium: Do oil price shocks matter?," Energy Economics, Elsevier, vol. 91(C).
    5. Bredin, Don & O'Sullivan, Conall & Spencer, Simon, 2021. "Forecasting WTI crude oil futures returns: Does the term structure help?," Energy Economics, Elsevier, vol. 100(C).
    6. Christiane Baumeister & Lutz Kilian & Thomas K. Lee, 2017. "Inside the Crystal Ball: New Approaches to Predicting the Gasoline Price at the Pump," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 275-295, March.
    7. Cotter, John & Eyiah-Donkor, Emmanuel & Potì, Valerio, 2023. "Commodity futures return predictability and intertemporal asset pricing," Journal of Commodity Markets, Elsevier, vol. 31(C).
    8. Efthymios G. Pavlidis & Ivan Paya & David A. Peel, 2018. "Using Market Expectations to Test for Speculative Bubbles in the Crude Oil Market," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 50(5), pages 833-856, August.
    9. Baumeister, Christiane & Guérin, Pierre & Kilian, Lutz, 2015. "Do high-frequency financial data help forecast oil prices? The MIDAS touch at work," International Journal of Forecasting, Elsevier, vol. 31(2), pages 238-252.
    10. Yannick Le Pen & Benoît Sévi, 2013. "Futures Trading and the Excess Comovement of Commodity Prices," Working Papers halshs-00793724, HAL.
    11. Ing-Haw Cheng & Wei Xiong, 2014. "Financialization of Commodity Markets," Annual Review of Financial Economics, Annual Reviews, vol. 6(1), pages 419-441, December.
    12. Sung Je Byun, 2017. "Speculation in Commodity Futures Markets, Inventories and the Price of Crude Oil," The Energy Journal, International Association for Energy Economics, vol. 0(Number 5).
    13. Yao, Wei & Alexiou, Constantinos, 2024. "On the transmission mechanism between the inventory arbitrage activity, speculative activity and the commodity price under the US QE policy: Evidence from a TVP-VAR model," International Review of Economics & Finance, Elsevier, vol. 89(PA), pages 1054-1072.
    14. James D. Hamilton & Jing Cynthia Wu, 2015. "Effects Of Index‐Fund Investing On Commodity Futures Prices," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(1), pages 187-205, February.
    15. Degiannakis, Stavros & Filis, George, 2018. "Forecasting oil prices: High-frequency financial data are indeed useful," Energy Economics, Elsevier, vol. 76(C), pages 388-402.
    16. Remzi Uctum & Georges Prat, 2021. "Modeling ex-ante risk premia in the oil market," Post-Print hal-03513121, HAL.
    17. Hollstein, Fabian & Prokopczuk, Marcel & Tharann, Björn & Wese Simen, Chardin, 2021. "Predictability in commodity markets: Evidence from more than a century," Journal of Commodity Markets, Elsevier, vol. 24(C).
    18. Wang, Yudong & Liu, Li & Wu, Chongfeng, 2017. "Forecasting the real prices of crude oil using forecast combinations over time-varying parameter models," Energy Economics, Elsevier, vol. 66(C), pages 337-348.
    19. Mayer, Herbert & Rathgeber, Andreas & Wanner, Markus, 2017. "Financialization of metal markets: Does futures trading influence spot prices and volatility?," Resources Policy, Elsevier, vol. 53(C), pages 300-316.
    20. Jacopo Piana & Daniele Bianchi, 2017. "Expected Spot Prices and the Dynamics of Commodity Risk Premia," 2017 Meeting Papers 1149, Society for Economic Dynamics.

    More about this item

    Keywords

    Econometric and statistical methods; International topics;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • D84 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Expectations; Speculations
    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading
    • Q43 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy and the Macroeconomy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bca:bocawp:16-18. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bocgvca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.