[go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/cen/wpaper/24-60.html
   My bibliography  Save this paper

Nonresponse and Coverage Bias in the Household Pulse Survey: Evidence from Administrative Data

Author

Listed:
  • Jonathan Eggleston
  • Carl Lieberman
Abstract
The Household Pulse Survey (HPS) conducted by the U.S. Census Bureau is a unique survey that provided timely data on the effects of the COVID-19 Pandemic on American households and continues to provide data on other emergent social and economic issues. Because the survey has a response rate in the single digits and only has an online response mode, there are concerns about nonresponse and coverage bias. In this paper, we match administrative data from government agencies and third-party data to HPS respondents to examine how representative they are of the U.S. population. For comparison, we create a benchmark of American Community Survey (ACS) respondents and nonrespondents and include the ACS respondents as another point of reference. Overall, we find that the HPS is less representative of the U.S. population than the ACS. However, performance varies across administrative variables, and the existing weighting adjustments appear to greatly improve the representativeness of the HPS. Additionally, we look at household characteristics by their email domain to examine the effects on coverage from limiting email messages in 2023 to addresses from the contact frame with at least 90% deliverability rates, finding no clear change in the representativeness of the HPS afterwards.

Suggested Citation

  • Jonathan Eggleston & Carl Lieberman, 2024. "Nonresponse and Coverage Bias in the Household Pulse Survey: Evidence from Administrative Data," Working Papers 24-60, Center for Economic Studies, U.S. Census Bureau.
    • Handle: RePEc:cen:wpaper:24-60
    as

    Download full text from publisher

    File URL: https://www2.census.gov/library/working-papers/2024/adrm/ces/CES-WP-24-60.pdf
    File Function: First version, 2024
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Valerie C. Bradley & Shiro Kuriwaki & Michael Isakov & Dino Sejdinovic & Xiao-Li Meng & Seth Flaxman, 2021. "Unrepresentative big surveys significantly overestimated US vaccine uptake," Nature, Nature, vol. 600(7890), pages 695-700, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bussemakers, Carlijn & van Dijk, Mart & Dima, Alexandra L. & de Bruin, Marijn, 2023. "How well do surveys on adherence to pandemic policies assess actual behaviour: Measurement properties of the Dutch COVID-19 adherence to prevention advice survey (CAPAS)," Social Science & Medicine, Elsevier, vol. 339(C).
    2. Gazmararian, Alexander F., 2024. "Fossil fuel communities support climate policy coupled with just transition assistance," Energy Policy, Elsevier, vol. 184(C).
    3. He, Xin & Mao, Xiaojun & Wang, Zhonglei, 2024. "Nonparametric augmented probability weighting with sparsity," Computational Statistics & Data Analysis, Elsevier, vol. 191(C).
    4. Cameron Deal & Shea Greenberg & Gilbert Gonzales, 2024. "Sexual identity, poverty, and utilization of government services," Journal of Population Economics, Springer;European Society for Population Economics, vol. 37(2), pages 1-31, June.
    5. Tesary Lin & Avner Strulov-Shlain, 2023. "Choice Architecture, Privacy Valuations, and Selection Bias in Consumer Data," Papers 2308.13496, arXiv.org.
    6. Avinash Collis & Kiran Garimella & Alex Moehring & M. Amin Rahimian & Stella Babalola & Nina H. Gobat & Dominick Shattuck & Jeni Stolow & Sinan Aral & Dean Eckles, 2022. "Global survey on COVID-19 beliefs, behaviours and norms," Nature Human Behaviour, Nature, vol. 6(9), pages 1310-1317, September.
    7. Camilla Salvatore, 2023. "Inference with non-probability samples and survey data integration: a science mapping study," METRON, Springer;Sapienza Università di Roma, vol. 81(1), pages 83-107, April.
    8. Stoler, Justin & Klofstad, Casey A. & Enders, Adam M. & Uscinski, Joseph E., 2022. "Sociopolitical and psychological correlates of COVID-19 vaccine hesitancy in the United States during summer 2021," Social Science & Medicine, Elsevier, vol. 306(C).
    9. Nelson, Victoria & Bashyal, Bidhan & Tan, Pang-Ning & Argyris, Young Anna, 2024. "Vaccine rhetoric on social media and COVID-19 vaccine uptake rates: A triangulation using self-reported vaccine acceptance," Social Science & Medicine, Elsevier, vol. 348(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cen:wpaper:24-60. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dawn Anderson (email available below). General contact details of provider: https://edirc.repec.org/data/cesgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.