[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20200052.html
   My bibliography  Save this paper

Bellman filtering for state-space models

Author

Listed:
  • Rutger Jan Lange

    (Erasmus School of Economics)

Abstract
This article presents a filter for state-space models based on Bellman's dynamic programming principle applied to the mode estimator. The proposed Bellman filter generalises the Kalman filter including its extended and iterated versions, while remaining equally inexpensive computationally. The Bellman filter is also (unlike the Kalman filter) robust under heavy-tailed observation noise and applicable to a wider range of (nonlinear and non-Gaussian) models, involving e.g. count, intensity, duration, volatility and dependence. The Bellman-filtered states are shown to be convergent, in quadratic mean, towards a small region around the true state. (Hyper)parameters are estimated by numerically maximising a filter-implied log-likelihood decomposition, which is an alternative to the classic prediction-error decomposition for linear Gaussian models. Simulation studies reveal that the Bellman filter performs on par with (or even outperforms) state-of-the-art simulation-based techniques, e.g. particle filters and importance samplers, while requiring a fraction (e.g. 1%) of the computational cost, being straightforward to implement and offering full scalability to higher dimensional state spaces.

Suggested Citation

  • Rutger Jan Lange, 2020. "Bellman filtering for state-space models," Tinbergen Institute Discussion Papers 20-052/III, Tinbergen Institute, revised 19 May 2021.
    • Handle: RePEc:tin:wpaper:20200052
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/20052.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Godsill, Simon J. & Doucet, Arnaud & West, Mike, 2004. "Monte Carlo Smoothing for Nonlinear Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 156-168, January.
    2. Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 2002. "Bayesian Analysis of Stochastic Volatility Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 69-87, January.
    3. Andrew Harvey & Alessandra Luati, 2014. "Filtering With Heavy Tails," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1112-1122, September.
    4. Luc Bauwens & Nikolaus Hautsch, 2006. "Stochastic Conditional Intensity Processes," Journal of Financial Econometrics, Oxford University Press, vol. 4(3), pages 450-493.
    5. Harvey,Andrew C., 1991. "Forecasting, Structural Time Series Models and the Kalman Filter," Cambridge Books, Cambridge University Press, number 9780521405737, September.
    6. Sylvia FrüHwirth-Schnatter & Helga Wagner, 2006. "Auxiliary mixture sampling for parameter-driven models of time series of counts with applications to state space modelling," Biometrika, Biometrika Trust, vol. 93(4), pages 827-841, December.
    7. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    8. Pieralberto Guarniero & Adam M. Johansen & Anthony Lee, 2017. "The Iterated Auxiliary Particle Filter," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1636-1647, October.
    9. Pete Bunch & Simon Godsill, 2016. "Approximations of the Optimal Importance Density Using Gaussian Particle Flow Importance Sampling," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 748-762, April.
    10. BAUWENS, Luc & VEREDAS, David, 1999. "The stochastic conditional duration model: a latent factor model for the analysis of financial durations," LIDAM Discussion Papers CORE 1999058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    11. de Valpine P., 2004. "Monte Carlo State-Space Likelihoods by Weighted Posterior Kernel Density Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 523-536, January.
    12. Scott S. L., 2002. "Bayesian Methods for Hidden Markov Models: Recursive Computing in the 21st Century," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 337-351, March.
    13. Rong Chen & Jun S. Liu, 2000. "Mixture Kalman filters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(3), pages 493-508.
    14. Bauwens, Luc & Veredas, David, 2004. "The stochastic conditional duration model: a latent variable model for the analysis of financial durations," Journal of Econometrics, Elsevier, vol. 119(2), pages 381-412, April.
    15. Tauchen, George E & Pitts, Mark, 1983. "The Price Variability-Volume Relationship on Speculative Markets," Econometrica, Econometric Society, vol. 51(2), pages 485-505, March.
    16. Paul Fearnhead & Peter Clifford, 2003. "On‐line inference for hidden Markov models via particle filters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(4), pages 887-899, November.
    17. Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(2), pages 247-264.
    18. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    19. Sardy, Sylvain & Tseng, Paul, 2004. "On the Statistical Analysis of Smoothing by Maximizing Dirty Markov Random Field Posterior Distributions," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 191-204, January.
    20. Borus Jungbacker & Siem Jan Koopman, 2007. "Monte Carlo Estimation for Nonlinear Non-Gaussian State Space Models," Biometrika, Biometrika Trust, vol. 94(4), pages 827-839.
    21. Jean-Francois Richard, 2007. "Efficient High-Dimensional Importance Sampling," Working Paper 321, Department of Economics, University of Pittsburgh, revised Jan 2007.
    22. Christian M. Hafner & Hans Manner, 2012. "Dynamic stochastic copula models: estimation, inference and applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(2), pages 269-295, March.
    23. Ruiz, Esther, 1994. "Quasi-maximum likelihood estimation of stochastic volatility models," Journal of Econometrics, Elsevier, vol. 63(1), pages 289-306, July.
    24. Jonghyun Yun & Fan Yang & Yuguo Chen, 2017. "Augmented Particle Filters," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 300-313, January.
    25. Siem Jan Koopman & André Lucas & Marcel Scharth, 2015. "Numerically Accelerated Importance Sampling for Nonlinear Non-Gaussian State-Space Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 114-127, January.
    26. Richard, Jean-Francois & Zhang, Wei, 2007. "Efficient high-dimensional importance sampling," Journal of Econometrics, Elsevier, vol. 141(2), pages 1385-1411, December.
    27. L. Fahrmeir & H. Kaufmann, 1991. "On kalman filtering, posterior mode estimation and fisher scoring in dynamic exponential family regression," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 38(1), pages 37-60, December.
    28. Nicholas G. Polson & Jonathan R. Stroud & Peter Müller, 2008. "Practical filtering with sequential parameter learning," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(2), pages 413-428, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lange, Rutger-Jan, 2024. "Bellman filtering and smoothing for state–space models," Journal of Econometrics, Elsevier, vol. 238(2).
    2. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    3. Monteiro, André A., 2009. "The econometrics of randomly spaced financial data: a survey," DES - Working Papers. Statistics and Econometrics. WS ws097924, Universidad Carlos III de Madrid. Departamento de Estadística.
    4. Siem Jan Koopman & André Lucas & Marcel Scharth, 2015. "Numerically Accelerated Importance Sampling for Nonlinear Non-Gaussian State-Space Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 114-127, January.
    5. Tsyplakov, Alexander, 2010. "Revealing the arcane: an introduction to the art of stochastic volatility models," MPRA Paper 25511, University Library of Munich, Germany.
    6. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    7. Smith, Michael Stanley & Maneesoonthorn, Worapree, 2018. "Inversion copulas from nonlinear state space models with an application to inflation forecasting," International Journal of Forecasting, Elsevier, vol. 34(3), pages 389-407.
    8. Hautsch, Nikolaus, 2008. "Capturing common components in high-frequency financial time series: A multivariate stochastic multiplicative error model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(12), pages 3978-4015, December.
    9. McCausland, William J., 2012. "The HESSIAN method: Highly efficient simulation smoothing, in a nutshell," Journal of Econometrics, Elsevier, vol. 168(2), pages 189-206.
    10. Bauwens, L. & Galli, F., 2009. "Efficient importance sampling for ML estimation of SCD models," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 1974-1992, April.
    11. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107034723, September.
    12. Calvet, Laurent-Emmanuel & Czellar , Veronika, 2011. "state-observation sampling and the econometrics of learning models," HEC Research Papers Series 947, HEC Paris.
    13. André A. Monteiro, 2008. "Parameter Driven Multi-state Duration Models: Simulated vs. Approximate Maximum Likelihood Estimation," Tinbergen Institute Discussion Papers 08-021/2, Tinbergen Institute.
    14. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    15. repec:bgu:wpaper:0603 is not listed on IDEAS
    16. Galli, Fausto, 2014. "Stochastic conditonal range, a latent variable model for financial volatility," MPRA Paper 54841, University Library of Munich, Germany.
    17. Pagan, Adrian, 1996. "The econometrics of financial markets," Journal of Empirical Finance, Elsevier, vol. 3(1), pages 15-102, May.
    18. BAUWENS, Luc & HAFNER, Christian & LAURENT, Sébastien, 2011. "Volatility models," LIDAM Discussion Papers CORE 2011058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
      • Bauwens, L. & Hafner, C. & Laurent, S., 2012. "Volatility Models," LIDAM Reprints ISBA 2012028, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
      • Bauwens, L. & Hafner C. & Laurent, S., 2011. "Volatility Models," LIDAM Discussion Papers ISBA 2011044, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    19. repec:cte:wsrepe:ws142618 is not listed on IDEAS
    20. Rub'en Loaiza-Maya & Didier Nibbering, 2022. "Efficient variational approximations for state space models," Papers 2210.11010, arXiv.org, revised Jun 2023.
    21. PREMINGER, Arie & HAFNER, Christian, 2006. "Deciding between GARCH and stochastic volatility via strong decision rules," LIDAM Discussion Papers CORE 2006042, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    22. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.

    More about this item

    Keywords

    dynamic programming; continuous sampling importance resampling; curse of dimensionality; implicit stochastic gradient descent; numerically accelerated importance sampling; Kalman filter; maximum a posteriori (MAP) estimate; particle filter; prediction-error decomposition; posterior mode; stochastic proximal point algorithm; Viterbi algorithm;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20200052. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.