[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2308.00913.html
   My bibliography  Save this paper

The Bayesian Context Trees State Space Model for time series modelling and forecasting

Author

Listed:
  • Ioannis Papageorgiou
  • Ioannis Kontoyiannis
Abstract
A hierarchical Bayesian framework is introduced for developing rich mixture models for real-valued time series, partly motivated by important applications in financial time series analysis. At the top level, meaningful discrete states are identified as appropriately quantised values of some of the most recent samples. These observable states are described as a discrete context-tree model. At the bottom level, a different, arbitrary model for real-valued time series -- a base model -- is associated with each state. This defines a very general framework that can be used in conjunction with any existing model class to build flexible and interpretable mixture models. We call this the Bayesian Context Trees State Space Model, or the BCT-X framework. Efficient algorithms are introduced that allow for effective, exact Bayesian inference and learning in this setting; in particular, the maximum a posteriori probability (MAP) context-tree model can be identified. These algorithms can be updated sequentially, facilitating efficient online forecasting. The utility of the general framework is illustrated in two particular instances: When autoregressive (AR) models are used as base models, resulting in a nonlinear AR mixture model, and when conditional heteroscedastic (ARCH) models are used, resulting in a mixture model that offers a powerful and systematic way of modelling the well-known volatility asymmetries in financial data. In forecasting, the BCT-X methods are found to outperform state-of-the-art techniques on simulated and real-world data, both in terms of accuracy and computational requirements. In modelling, the BCT-X structure finds natural structure present in the data. In particular, the BCT-ARCH model reveals a novel, important feature of stock market index data, in the form of an enhanced leverage effect.

Suggested Citation

  • Ioannis Papageorgiou & Ioannis Kontoyiannis, 2023. "The Bayesian Context Trees State Space Model for time series modelling and forecasting," Papers 2308.00913, arXiv.org, revised Oct 2023.
    • Handle: RePEc:arx:papers:2308.00913
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2308.00913
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ioannis Kontoyiannis & Lambros Mertzanis & Athina Panotopoulou & Ioannis Papageorgiou & Maria Skoularidou, 2022. "Bayesian context trees: Modelling and exact inference for discrete time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1287-1323, September.
    2. Francesco Audrino & Peter Bühlmann, 2001. "Tree‐structured generalized autoregressive conditional heteroscedastic models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(4), pages 727-744.
    3. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    4. Vrontos, I D & Dellaportas, P & Politis, D N, 2000. "Full Bayesian Inference for GARCH and EGARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(2), pages 187-198, April.
    5. Markus Haas, 2004. "A New Approach to Markov-Switching GARCH Models," Journal of Financial Econometrics, Oxford University Press, vol. 2(4), pages 493-530.
    6. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    7. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    8. Audrone Virbickaite & M. Concepción Ausín & Pedro Galeano, 2015. "Bayesian Inference Methods For Univariate And Multivariate Garch Models: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 29(1), pages 76-96, February.
    9. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    10. Potter, Simon M, 1995. "A Nonlinear Approach to US GNP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(2), pages 109-125, April-Jun.
    11. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    12. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    13. N. Friel & A. N. Pettitt, 2008. "Marginal likelihood estimation via power posteriors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(3), pages 589-607, July.
    14. Wei-Yin Loh, 2014. "Fifty Years of Classification and Regression Trees," International Statistical Review, International Statistical Institute, vol. 82(3), pages 329-348, December.
    15. Koop, Gary & Potter, Simon M, 1999. "Dynamic Asymmetries in U.S. Unemployment," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(3), pages 298-312, July.
    16. Philip Rothman, 1998. "Forecasting Asymmetric Unemployment Rates," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 164-168, February.
    17. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    18. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    19. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    20. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    21. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    22. Zakoian, Jean-Michel, 1994. "Threshold heteroskedastic models," Journal of Economic Dynamics and Control, Elsevier, vol. 18(5), pages 931-955, September.
    23. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
    24. I. D. Vrontos & P. Dellaportas & D. N. Politis, 2003. "A full-factor multivariate GARCH model," Econometrics Journal, Royal Economic Society, vol. 6(2), pages 312-334, December.
    25. Darjus Hosszejni & Gregor Kastner, 2019. "Modeling Univariate and Multivariate Stochastic Volatility in R with stochvol and factorstochvol," Papers 1906.12123, arXiv.org, revised Feb 2021.
    26. Spyros Makridakis & Evangelos Spiliotis & Vassilios Assimakopoulos, 2018. "Statistical and Machine Learning forecasting methods: Concerns and ways forward," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-26, March.
    27. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    28. P. Dellaportas & I. D. Vrontos, 2007. "Modelling volatility asymmetries: a Bayesian analysis of a class of tree structured multivariate GARCH models," Econometrics Journal, Royal Economic Society, vol. 10(3), pages 503-520, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Audrone Virbickaite & M. Concepción Ausín & Pedro Galeano, 2015. "Bayesian Inference Methods For Univariate And Multivariate Garch Models: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 29(1), pages 76-96, February.
    3. BAUWENS, Luc & HAFNER, Christian & LAURENT, Sébastien, 2011. "Volatility models," LIDAM Discussion Papers CORE 2011058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
      • Bauwens, L. & Hafner, C. & Laurent, S., 2012. "Volatility Models," LIDAM Reprints ISBA 2012028, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
      • Bauwens, L. & Hafner C. & Laurent, S., 2011. "Volatility Models," LIDAM Discussion Papers ISBA 2011044, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    4. Yuzhi Cai, 2021. "Estimating expected shortfall using a quantile function model," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 4332-4360, July.
    5. Oscar V. De la Torre-Torres & Evaristo Galeana-Figueroa & José Álvarez-García, 2019. "A Test of Using Markov-Switching GARCH Models in Oil and Natural Gas Trading," Energies, MDPI, vol. 13(1), pages 1-24, December.
    6. Ataurima Arellano, Miguel & Rodríguez, Gabriel, 2020. "Empirical modeling of high-income and emerging stock and Forex market return volatility using Markov-switching GARCH models," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    7. Sébastien Laurent & Luc Bauwens & Jeroen V. K. Rombouts, 2006. "Multivariate GARCH models: a survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 79-109.
    8. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107034723, September.
    9. Martinez Oscar & Olmo Jose, 2012. "A Nonlinear Threshold Model for the Dependence of Extremes of Stationary Sequences," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 16(3), pages 1-39, September.
    10. Pedro Nielsen Rotta & Pedro L. Valls Pereira, 2016. "Analysis of contagion from the dynamic conditional correlation model with Markov Regime switching," Applied Economics, Taylor & Francis Journals, vol. 48(25), pages 2367-2382, May.
    11. Sebastián Cano-Berlanga & José-Manuel Giménez-Gómez, 2018. "On Chinese stock markets: How have they evolved over time?," Annals of Operations Research, Springer, vol. 266(1), pages 499-510, July.
    12. Floros, Ch., 2005. "Forecasting the UK Unemployment Rate: Model Comparisons," International Journal of Applied Econometrics and Quantitative Studies, Euro-American Association of Economic Development, vol. 2(4), pages 57-72.
    13. Ardia, David & Bluteau, Keven & Boudt, Kris & Catania, Leopoldo, 2018. "Forecasting risk with Markov-switching GARCH models:A large-scale performance study," International Journal of Forecasting, Elsevier, vol. 34(4), pages 733-747.
    14. Caldeira, João F & Moura, Guilherme Valle & Santos, André Alves Portela, 2013. "Seleção de carteiras utilizando o modelo Fama-French-Carhart," Revista Brasileira de Economia - RBE, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil), vol. 67(1), April.
    15. Carl H. Korkpoe & Peterson Owusu Junior, 2018. "Behaviour of Johannesburg Stock Exchange All Share Index Returns - An Asymmetric GARCH and News Impact Effects Approach," SPOUDAI Journal of Economics and Business, SPOUDAI Journal of Economics and Business, University of Piraeus, vol. 68(1), pages 26-42, January-M.
    16. Qiang Xia & Heung Wong & Jinshan Liu & Rubing Liang, 2017. "Bayesian Analysis of Power-Transformed and Threshold GARCH Models: A Griddy-Gibbs Sampler Approach," Computational Economics, Springer;Society for Computational Economics, vol. 50(3), pages 353-372, October.
    17. Haas, Markus & Krause, Jochen & Paolella, Marc S. & Steude, Sven C., 2013. "Time-varying mixture GARCH models and asymmetric volatility," The North American Journal of Economics and Finance, Elsevier, vol. 26(C), pages 602-623.
    18. Semenoglou, Artemios-Anargyros & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2021. "Investigating the accuracy of cross-learning time series forecasting methods," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1072-1084.
    19. Franses,Philip Hans & Dijk,Dick van & Opschoor,Anne, 2014. "Time Series Models for Business and Economic Forecasting," Cambridge Books, Cambridge University Press, number 9780521520911, September.
    20. Oscar V. De la Torre-Torres & Evaristo Galeana-Figueroa & María de la Cruz Del Río-Rama & José Álvarez-García, 2022. "Using Markov-Switching Models in US Stocks Optimal Portfolio Selection in a Black–Litterman Context (Part 1)," Mathematics, MDPI, vol. 10(8), pages 1-28, April.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2308.00913. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.