Interpolating Value Functions in Discrete Choice Dynamic Programming Models
Paul Sullivan
MPRA Paper from University Library of Munich, Germany
Abstract:
Structural discrete choice dynamic programming models have been shown to be a valuable tool for analyzing a wide range of economic behavior. A major limitation on the complexity and applicability of these models is the computational burden associated with computing the high dimensional integrals that typically characterize an agent's decision rules. This paper develops a regression based approach to interpolating value functions during the solution of dynamic programming models that alleviates this burden. This approach is suitable for use in models that incorporate unobserved state variables that are serially correlated across time and correlated across choices within a time period. The key assumption is that one unobserved state variable, or error term, in the model is distributed extreme value. Additional error terms that allow for correlation between unobservables across time or across choices within a given time period may be freely incorporated in the model. Value functions are simulated at a fraction of the state space and interpolated at the remaining points using a new regression function based on the extreme value closed form solution for the expected maxima of the value function. This regression function is well suited for use in models with large choice sets and complicated error structures. The performance of the interpolation method appears to be excellent, and it greatly reduces the computational burden of estimating the parameters of a dynamic programming model.
Keywords: dynamic programming models; interpolation; simulation methods; estimation of dynamic programming models (search for similar items in EconPapers)
JEL-codes: C15 C50 (search for similar items in EconPapers)
Date: 2006-10
New Economics Papers: this item is included in nep-dcm and nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4) Track citations by RSS feed
Downloads: (external link)
https://mpra.ub.uni-muenchen.de/864/1/MPRA_paper_864.pdf original version (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:pra:mprapa:864
Access Statistics for this paper
More papers in MPRA Paper from University Library of Munich, Germany Ludwigstraße 33, D-80539 Munich, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Joachim Winter ().