[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2009-8.html
   My bibliography  Save this paper

Nonparametric time series forecasting with dynamic updating

Author

Listed:
  • Han Lin Shang
  • Rob J Hyndman
Abstract
We present a nonparametric method to forecast a seasonal univariate time series, and propose four dynamic updating methods to improve point forecast accuracy. Our methods consider a seasonal univariate time series as a functional time series. We propose first to reduce the dimensionality by applying functional principal component analysis to the historical observations, and then to use univariate time series forecasting and functional principal component regression techniques. When data in the most recent year are partially observed, we improve point forecast accuracy using dynamic updating methods. We also introduce a nonparametric approach to construct prediction intervals of updated forecasts, and compare the empirical coverage probability with an existing parametric method. Our approaches are data-driven and computationally fast, and hence they are feasible to be applied in real time high frequency dynamic updating. The methods are demonstrated using monthly sea surface temperatures from 1950 to 2008.

Suggested Citation

  • Han Lin Shang & Rob J Hyndman, 2009. "Nonparametric time series forecasting with dynamic updating," Monash Econometrics and Business Statistics Working Papers 8/09, Monash University, Department of Econometrics and Business Statistics.
    • Handle: RePEc:msh:ebswps:2009-8
    as

    Download full text from publisher

    File URL: http://www.buseco.monash.edu.au/ebs/pubs/wpapers/2009/wp8-09.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Shang, Han Lin & Hyndman, Rob.J., 2011. "Nonparametric time series forecasting with dynamic updating," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 81(7), pages 1310-1324.
    2. Hyndman, Rob J. & Koehler, Anne B. & Snyder, Ralph D. & Grose, Simone, 2002. "A state space framework for automatic forecasting using exponential smoothing methods," International Journal of Forecasting, Elsevier, vol. 18(3), pages 439-454.
    3. Preda, C. & Saporta, G., 2005. "Clusterwise PLS regression on a stochastic process," Computational Statistics & Data Analysis, Elsevier, vol. 49(1), pages 99-108, April.
    4. Chatfield, Chris, 1993. "Calculating Interval Forecasts: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 143-144, April.
    5. Harvey,Andrew C., 1991. "Forecasting, Structural Time Series Models and the Kalman Filter," Cambridge Books, Cambridge University Press, number 9780521405737, September.
    6. Chatfield, Chris, 1993. "Calculating Interval Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 121-135, April.
    7. Hyndman, Rob J. & Booth, Heather, 2008. "Stochastic population forecasts using functional data models for mortality, fertility and migration," International Journal of Forecasting, Elsevier, vol. 24(3), pages 323-342.
    8. Preda, C. & Saporta, G., 2005. "PLS regression on a stochastic process," Computational Statistics & Data Analysis, Elsevier, vol. 48(1), pages 149-158, January.
    9. Hyndman, Rob J. & Shahid Ullah, Md., 2007. "Robust forecasting of mortality and fertility rates: A functional data approach," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4942-4956, June.
    10. Rob J. Hyndman & Han Lin Shang, 2008. "Rainbow plots, Bagplots and Boxplots for Functional Data," Monash Econometrics and Business Statistics Working Papers 9/08, Monash University, Department of Econometrics and Business Statistics.
    11. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    12. Philippe C. Besse & Herve Cardot & David B. Stephenson, 2000. "Autoregressive Forecasting of Some Functional Climatic Variations," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 27(4), pages 673-687, December.
    13. Dauxois, J. & Pousse, A. & Romain, Y., 1982. "Asymptotic theory for the principal component analysis of a vector random function: Some applications to statistical inference," Journal of Multivariate Analysis, Elsevier, vol. 12(1), pages 136-154, March.
    14. Aneiros-Pérez, Germán & Vieu, Philippe, 2008. "Nonparametric time series prediction: A semi-functional partial linear modeling," Journal of Multivariate Analysis, Elsevier, vol. 99(5), pages 834-857, May.
    15. Reiss, Philip T. & Ogden, R. Todd, 2007. "Functional Principal Component Regression and Functional Partial Least Squares," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 984-996, September.
    16. Peter Hall & Mohammad Hosseini‐Nasab, 2006. "On properties of functional principal components analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 109-126, February.
    17. Antoniadis, Anestis & Sapatinas, Theofanis, 2003. "Wavelet methods for continuous-time prediction using Hilbert-valued autoregressive processes," Journal of Multivariate Analysis, Elsevier, vol. 87(1), pages 133-158, October.
    18. Haipeng Shen & Jianhua Z. Huang, 2008. "Interday Forecasting and Intraday Updating of Call Center Arrivals," Manufacturing & Service Operations Management, INFORMS, vol. 10(3), pages 391-410, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shang, Han Lin & Hyndman, Rob.J., 2011. "Nonparametric time series forecasting with dynamic updating," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 81(7), pages 1310-1324.
    2. Han Lin Shang & Yang Yang, 2021. "Forecasting Australian subnational age-specific mortality rates," Journal of Population Research, Springer, vol. 38(1), pages 1-24, March.
    3. Han Lin Shang & Rob J Hyndman, 2016. "Grouped functional time series forecasting: An application to age-specific mortality rates," Monash Econometrics and Business Statistics Working Papers 4/16, Monash University, Department of Econometrics and Business Statistics.
    4. Yang, Yang & Yang, Yanrong & Shang, Han Lin, 2022. "Feature extraction for functional time series: Theory and application to NIR spectroscopy data," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    5. Elías, Antonio & Jiménez, Raúl & Shang, Han Lin, 2022. "On projection methods for functional time series forecasting," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    6. repec:cte:wsrepe:24606 is not listed on IDEAS
    7. Han Lin Shang & Yang Yang & Fearghal Kearney, 2019. "Intraday forecasts of a volatility index: functional time series methods with dynamic updating," Annals of Operations Research, Springer, vol. 282(1), pages 331-354, November.
    8. Shang, Han Lin, 2013. "Bayesian bandwidth estimation for a nonparametric functional regression model with unknown error density," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 185-198.
    9. Acal, C. & Aguilera, A.M. & Alonso, F.J. & Ruiz-Castro, J.E. & Roldán, J.B., 2024. "Different PCA approaches for vector functional time series with applications to resistive switching processes," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 223(C), pages 288-298.
    10. Antoniadis, Anestis & Brossat, Xavier & Cugliari, Jairo & Poggi, Jean-Michel, 2016. "A prediction interval for a function-valued forecast model: Application to load forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 939-947.
    11. Kokoszka, Piotr & Miao, Hong & Petersen, Alexander & Shang, Han Lin, 2019. "Forecasting of density functions with an application to cross-sectional and intraday returns," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1304-1317.
    12. J. Derek Tucker & Drew Yarger, 2024. "Elastic functional changepoint detection of climate impacts from localized sources," Environmetrics, John Wiley & Sons, Ltd., vol. 35(1), February.
    13. Paul Ghelasi & Florian Ziel, 2023. "Hierarchical forecasting for aggregated curves with an application to day-ahead electricity price auctions," Papers 2305.16255, arXiv.org.
    14. Han Shang, 2014. "A survey of functional principal component analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 121-142, April.
    15. Ghelasi, Paul & Ziel, Florian, 2024. "Hierarchical forecasting for aggregated curves with an application to day-ahead electricity price auctions," International Journal of Forecasting, Elsevier, vol. 40(2), pages 581-596.
    16. Trevor Harris & Bo Li & J. Derek Tucker, 2022. "Scalable multiple changepoint detection for functional data sequences," Environmetrics, John Wiley & Sons, Ltd., vol. 33(2), March.
    17. Cees Diks & Bram Wouters, 2023. "Noise reduction for functional time series," Papers 2307.02154, arXiv.org.
    18. Shang, Han Lin, 2017. "Functional time series forecasting with dynamic updating: An application to intraday particulate matter concentration," Econometrics and Statistics, Elsevier, vol. 1(C), pages 184-200.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Han Shang, 2014. "A survey of functional principal component analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 121-142, April.
    2. Shang, Han Lin, 2017. "Functional time series forecasting with dynamic updating: An application to intraday particulate matter concentration," Econometrics and Statistics, Elsevier, vol. 1(C), pages 184-200.
    3. Han Lin Shang & Yang Yang & Fearghal Kearney, 2019. "Intraday forecasts of a volatility index: functional time series methods with dynamic updating," Annals of Operations Research, Springer, vol. 282(1), pages 331-354, November.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Han Lin Shang & Yang Yang, 2021. "Forecasting Australian subnational age-specific mortality rates," Journal of Population Research, Springer, vol. 38(1), pages 1-24, March.
    6. Manuel Febrero-Bande & Pedro Galeano & Wenceslao González-Manteiga, 2017. "Functional Principal Component Regression and Functional Partial Least-squares Regression: An Overview and a Comparative Study," International Statistical Review, International Statistical Institute, vol. 85(1), pages 61-83, April.
    7. Christian Acal & Manuel Escabias & Ana M. Aguilera & Mariano J. Valderrama, 2021. "COVID-19 Data Imputation by Multiple Function-on-Function Principal Component Regression," Mathematics, MDPI, vol. 9(11), pages 1-23, May.
    8. Ana M. Aguilera, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 23-26, March.
    9. Kim, Jae H. & Wong, Kevin & Athanasopoulos, George & Liu, Shen, 2011. "Beyond point forecasting: Evaluation of alternative prediction intervals for tourist arrivals," International Journal of Forecasting, Elsevier, vol. 27(3), pages 887-901.
    10. Ana Aguilera, 2016. "Comments on: Probability enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 23-26, March.
    11. Han Lin Shang, 2010. "Nonparametric modeling and forecasting electricity demand: an empirical study," Monash Econometrics and Business Statistics Working Papers 19/10, Monash University, Department of Econometrics and Business Statistics.
    12. Cardot, Hervé & Johannes, Jan, 2010. "Thresholding projection estimators in functional linear models," Journal of Multivariate Analysis, Elsevier, vol. 101(2), pages 395-408, February.
    13. Silvia Novo & Germán Aneiros & Philippe Vieu, 2021. "Sparse semiparametric regression when predictors are mixture of functional and high-dimensional variables," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(2), pages 481-504, June.
    14. Rob Hyndman & Heather Booth & Farah Yasmeen, 2013. "Coherent Mortality Forecasting: The Product-Ratio Method With Functional Time Series Models," Demography, Springer;Population Association of America (PAA), vol. 50(1), pages 261-283, February.
    15. Basellini, Ugofilippo & Camarda, Carlo Giovanni & Booth, Heather, 2023. "Thirty years on: A review of the Lee–Carter method for forecasting mortality," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1033-1049.
    16. Shang, Han Lin, 2013. "Bayesian bandwidth estimation for a nonparametric functional regression model with unknown error density," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 185-198.
    17. Shaokang Wang & Han Lin Shang & Leonie Tickle & Han Li, 2024. "Forecasting Age- and Sex-Specific Survival Functions: Application to Annuity Pricing," Risks, MDPI, vol. 12(7), pages 1-15, July.
    18. Lakraj, Gamage Pemantha & Ruymgaart, Frits, 2017. "Some asymptotic theory for Silverman’s smoothed functional principal components in an abstract Hilbert space," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 122-132.
    19. Yuan Gao & Han Lin Shang, 2017. "Multivariate Functional Time Series Forecasting: Application to Age-Specific Mortality Rates," Risks, MDPI, vol. 5(2), pages 1-18, March.
    20. Alexander Aue & Diogo Dubart Norinho & Siegfried Hörmann, 2015. "On the Prediction of Stationary Functional Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 378-392, March.

    More about this item

    Keywords

    Functional time series; Functional principal component analysis; Ordinary least squares; Penalized least squares; Ridge regression; Sea surface temperatures; Seasonal time series.;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2009-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.