Optimum design for ill-conditioned models: K–optimality and stable parameterizations

Belmiro P.M. Duarte, Anthony C. Atkinson and Nuno M.C. Oliveira

LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library

Abstract: Nonlinear regression is frequently used to fit nonlinear relations between response variables and regressors, for process data. The procedure involves the minimization of the square norm of the residuals with respect to the model parameters. Nonlinear least squares may lead to parametric collinearity, multiple optima and computational inefficiency. One of the strategies to handle collinearity is model reparameterization, i.e. the replacement of the original set of parameters by another with increased orthogonality properties. In this paper we propose a systematic strategy for model reparameterization based on the response surface generated from a carefully chosen set of points. This is illustrated with the support points of locally K-optimal experimental designs, to generate a set of analytical equations that allow the construction of a transformation to a set of parameters with better orthogonality properties. Recognizing the difficulties in the generalization of the technique to complex models, we propose a related alternative approach based on first-order Taylor approximation of the model. Our approach is tested both with linear and nonlinear models. The Variance Inflation Factor and the condition number as well as the orientation and eccentricity of the parametric confidence region are used for comparisons.

Keywords: K-optimal design of experiments; model reparameterization; nonlinear regression; semidefinite programming; support points (search for similar items in EconPapers)
JEL-codes: C1 (search for similar items in EconPapers)
Pages: 15 pages
Date: 2023-08-15
New Economics Papers: this item is included in nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published in Chemometrics and Intelligent Laboratory Systems, 15, August, 2023, 239. ISSN: 0169-7439

Downloads: (external link)
http://eprints.lse.ac.uk/122986/ Open access version. (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ehl:lserod:122986

Access Statistics for this paper

More papers in LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library LSE Library Portugal Street London, WC2A 2HD, U.K.. Contact information at EDIRC.
Bibliographic data for series maintained by LSERO Manager ().