[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2011.10252.html
   My bibliography  Save this paper

A Semi-Parametric Bayesian Generalized Least Squares Estimator

Author

Listed:
  • Ruochen Wu
  • Melvyn Weeks
Abstract
In this paper we propose a semi-parametric Bayesian Generalized Least Squares estimator. In a generic setting where each error is a vector, the parametric Generalized Least Square estimator maintains the assumption that each error vector has the same distributional parameters. In reality, however, errors are likely to be heterogeneous regarding their distributions. To cope with such heterogeneity, a Dirichlet process prior is introduced for the distributional parameters of the errors, leading to the error distribution being a mixture of a variable number of normal distributions. Our method let the number of normal components be data driven. Semi-parametric Bayesian estimators for two specific cases are then presented: the Seemingly Unrelated Regression for equation systems and the Random Effects Model for panel data. We design a series of simulation experiments to explore the performance of our estimators. The results demonstrate that our estimators obtain smaller posterior standard deviations and mean squared errors than the Bayesian estimators using a parametric mixture of normal distributions or a normal distribution. We then apply our semi-parametric Bayesian estimators for equation systems and panel data models to empirical data.

Suggested Citation

  • Ruochen Wu & Melvyn Weeks, 2020. "A Semi-Parametric Bayesian Generalized Least Squares Estimator," Papers 2011.10252, arXiv.org, revised Jan 2023.
    • Handle: RePEc:arx:papers:2011.10252
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2011.10252
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    2. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
    3. Li, Mingliang & Tobias, Justin L., 2011. "Bayesian inference in a correlated random coefficients model: Modeling causal effect heterogeneity with an application to heterogeneous returns to schooling," Journal of Econometrics, Elsevier, vol. 162(2), pages 345-361, June.
    4. Kleibergen, Frank & van Dijk, Herman K., 1998. "Bayesian Simultaneous Equations Analysis Using Reduced Rank Structures," Econometric Theory, Cambridge University Press, vol. 14(6), pages 701-743, December.
    5. Hiroaki Chigira & Tsunemasa Shiba, 2012. "Dirichlet Prior for Estimating Unknown Regression Error Heteroscedasticity," Global COE Hi-Stat Discussion Paper Series gd12-248, Institute of Economic Research, Hitotsubashi University.
    6. Manuel Wiesenfarth & Carlos Matías Hisgen & Thomas Kneib & Carmen Cadarso-Suarez, 2014. "Bayesian Nonparametric Instrumental Variables Regression Based on Penalized Splines and Dirichlet Process Mixtures," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(3), pages 468-482, July.
    7. Jeffrey M. Wooldridge, 2003. "Cluster-Sample Methods in Applied Econometrics," American Economic Review, American Economic Association, vol. 93(2), pages 133-138, May.
    8. Geweke, J, 1993. "Bayesian Treatment of the Independent Student- t Linear Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 19-40, Suppl. De.
    9. Chao, J. C. & Phillips, P. C. B., 1998. "Posterior distributions in limited information analysis of the simultaneous equations model using the Jeffreys prior," Journal of Econometrics, Elsevier, vol. 87(1), pages 49-86, August.
    10. Diewert, W E, 1971. "An Application of the Shephard Duality Theorem: A Generalized Leontief Production Function," Journal of Political Economy, University of Chicago Press, vol. 79(3), pages 481-507, May-June.
    11. Geweke, John, 1996. "Bayesian reduced rank regression in econometrics," Journal of Econometrics, Elsevier, vol. 75(1), pages 121-146, November.
    12. Guohua Feng & Apostolos Serletis, 2009. "Efficiency and productivity of the US banking industry, 1998-2005: evidence from the Fourier cost function satisfying global regularity conditions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(1), pages 105-138.
    13. Emir Malikov & Subal C. Kumbhakar & Mike G. Tsionas, 2016. "A Cost System Approach to the Stochastic Directional Technology Distance Function with Undesirable Outputs: The Case of us Banks in 2001–2010," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1407-1429, November.
    14. Subal C. Kumbhakar & Efthymios G. Tsionas, 2011. "Stochastic error specification in primal and dual production systems," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(2), pages 270-297, March.
    15. Conley, Timothy G. & Hansen, Christian B. & McCulloch, Robert E. & Rossi, Peter E., 2008. "A semi-parametric Bayesian approach to the instrumental variable problem," Journal of Econometrics, Elsevier, vol. 144(1), pages 276-305, May.
    16. Chen Li & George Casella & Malay Ghosh, 2018. "Estimation of regression vectors in linear mixed models with Dirichlet process random effects," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 47(16), pages 3935-3954, August.
    17. Jeffrey M. Wooldridge, 2005. "Fixed-Effects and Related Estimators for Correlated Random-Coefficient and Treatment-Effect Panel Data Models," The Review of Economics and Statistics, MIT Press, vol. 87(2), pages 385-390, May.
    18. Christensen, Laurits R & Greene, William H, 1976. "Economies of Scale in U.S. Electric Power Generation," Journal of Political Economy, University of Chicago Press, vol. 84(4), pages 655-676, August.
    19. Murtazashvili, Irina & Wooldridge, Jeffrey M., 2008. "Fixed effects instrumental variables estimation in correlated random coefficient panel data models," Journal of Econometrics, Elsevier, vol. 142(1), pages 539-552, January.
    20. Cornwell, Christopher & Rupert, Peter, 1988. "Efficient Estimation with Panel Data: An Empirical Comparison of Instrumental Variables Estimators," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 3(2), pages 149-155, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hoogerheide, Lennart & Kleibergen, Frank & van Dijk, Herman K., 2007. "Natural conjugate priors for the instrumental variables regression model applied to the Angrist-Krueger data," Journal of Econometrics, Elsevier, vol. 138(1), pages 63-103, May.
    2. Gary Koop & Rodney Strachan & Herman van Dijk & Mattias Villani, 2004. "Bayesian Approaches to Cointegration," Discussion Papers in Economics 04/27, Division of Economics, School of Business, University of Leicester.
    3. Chuanming Gao & Kajal Lahiri, 2019. "A Comparison of Some Bayesian and Classical Procedures for Simultaneous Equation Models with Weak Instruments," Econometrics, MDPI, vol. 7(3), pages 1-28, July.
    4. Kleibergen, Frank & Paap, Richard, 2002. "Priors, posteriors and bayes factors for a Bayesian analysis of cointegration," Journal of Econometrics, Elsevier, vol. 111(2), pages 223-249, December.
    5. Villani, Mattias, 2006. "Bayesian point estimation of the cointegration space," Journal of Econometrics, Elsevier, vol. 134(2), pages 645-664, October.
    6. Chuanming Gao & Kajal Lahiri, 2000. "A Comparison of Some Recent Bayesian and Classical Procedures for Simultaneous Equation Models with Weak Instruments," Econometric Society World Congress 2000 Contributed Papers 0230, Econometric Society.
    7. Radchenko, Stanislav & Tsurumi, Hiroki, 2006. "Limited information Bayesian analysis of a simultaneous equation with an autocorrelated error term and its application to the U.S. gasoline market," Journal of Econometrics, Elsevier, vol. 133(1), pages 31-49, July.
    8. Villani, Mattias, 2003. "Bayes Estimators of the Cointegration Space," Working Paper Series 150, Sveriges Riksbank (Central Bank of Sweden).
    9. Mike G. Tsionas, 2017. "“When, Where, and How” of Efficiency Estimation: Improved Procedures for Stochastic Frontier Modeling," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 948-965, July.
    10. Gael Martin, 2001. "Bayesian Analysis Of A Fractional Cointegration Model," Econometric Reviews, Taylor & Francis Journals, vol. 20(2), pages 217-234.
    11. Andros Kourtellos & Alex Lenkoski & Kyriakos Petrou, 2017. "Measuring the Strength of the Theories of Government Size," University of Cyprus Working Papers in Economics 11-2017, University of Cyprus Department of Economics.
    12. Chao, John C. & Phillips, Peter C. B., 2002. "Jeffreys prior analysis of the simultaneous equations model in the case with n+1 endogenous variables," Journal of Econometrics, Elsevier, vol. 111(2), pages 251-283, December.
    13. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    14. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    15. Tsionas, Mike G. & Andrikopoulos, Athanasios, 2020. "On a High-Dimensional Model Representation method based on Copulas," European Journal of Operational Research, Elsevier, vol. 284(3), pages 967-979.
    16. Dyevre, Arthur & Lampach, Nicolas, 2018. "The origins of regional integration: Untangling the effect of trade on judicial cooperation," International Review of Law and Economics, Elsevier, vol. 56(C), pages 122-133.
    17. van Dijk, H.K., 2002. "On Bayesian structural inference in a simultaneous equation model," Econometric Institute Research Papers EI 2002-10, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    18. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2013. "Historical Developments in Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 13-191/III, Tinbergen Institute.
    19. Conley, Timothy G. & Hansen, Christian B. & McCulloch, Robert E. & Rossi, Peter E., 2008. "A semi-parametric Bayesian approach to the instrumental variable problem," Journal of Econometrics, Elsevier, vol. 144(1), pages 276-305, May.
    20. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2011.10252. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.