Accounting for Individual-Specific Reliability of Self-Assessed Measures of Economic Preferences and Personality Traits

Thomas Dohmen and Tomáš Jagelka

No 224, ECONtribute Discussion Papers Series from University of Bonn and University of Cologne, Germany

Abstract: Measures based on self-assessments, which are increasingly important in empirical economic research, are plagued by measurement error. This paper presents the first attempt at measuring both revealed and self-reported reliability of individuals’ answers on self-reports of latent characteristics. We show that measurement error on self-reports relevant to economists is heterogeneous across individuals and can be reasonably approximated by a distribution with two unobserved types. We propose a straightforward survey question which allows to distinguish individuals who give highly reliable answers from those who do not, using cross-sectional data. We demonstrate that it predicts revealed individual reliability over and above all measured characteristics, survey conditions, and experimental treatments. We show how our simple self-reported reliability measure can be used to cost-effectively reduce attenuation bias in estimates of cognitive and non-cognitive determinants of high school GPA, college graduation, unemployment, and life satisfaction. Without requiring panel data, the achieved correction is similar to some of the most effective reduced-form theory-based approaches in the existing literature. Finally, we clarify the role of effort and self-knowledge in generating measurement error and propose a simple model which rationalizes our findings.

Keywords: Reliability; measurement error; personality traits; economic preferences; self-assessments (search for similar items in EconPapers)
JEL-codes: C81 C83 D90 (search for similar items in EconPapers)
Pages: 53 pages
Date: 2023-03
New Economics Papers: this item is included in nep-cbe and nep-hrm
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.econtribute.de/RePEc/ajk/ajkdps/ECONtribute_224_2023.pdf First version, 2023 (application/pdf)

Related works:
Journal Article: Accounting for Individual-Specific Reliability of Self-Assessed Measures of Economic Preferences and Personality Traits (2024)
Working Paper: Accounting for Individual-Specific Reliability of Self-Assessed Measures of Economic Preferences and Personality Traits (2023)
Working Paper: Accounting For Individual-Specific Reliability of Self-Assessed Measures of Economic Preferences and Personality Traits (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ajk:ajkdps:224

Access Statistics for this paper

More papers in ECONtribute Discussion Papers Series from University of Bonn and University of Cologne, Germany Niebuhrstrasse 5, 53113 Bonn, Germany.
Bibliographic data for series maintained by ECONtribute Office ().