Representativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa

The COVID-19 pandemic has created urgent demand for timely data, leading to a surge in mobile phone surveys for tracking the impacts of and responses to the pandemic. Using data from national phone surveys implemented in Ethiopia, Malawi, Nigeria and Uganda during the pandemic and the pre-COVID-19 n...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Joshua Brubaker, Talip Kilic, Philip Wollburg
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2021
Materias:
R
Q
Acceso en línea:https://doaj.org/article/d54ac15f65644662acdaa9eef191947a
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:d54ac15f65644662acdaa9eef191947a
record_format dspace
spelling oai:doaj.org-article:d54ac15f65644662acdaa9eef191947a2021-11-25T06:13:53ZRepresentativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa1932-6203https://doaj.org/article/d54ac15f65644662acdaa9eef191947a2021-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC8598049/?tool=EBIhttps://doaj.org/toc/1932-6203The COVID-19 pandemic has created urgent demand for timely data, leading to a surge in mobile phone surveys for tracking the impacts of and responses to the pandemic. Using data from national phone surveys implemented in Ethiopia, Malawi, Nigeria and Uganda during the pandemic and the pre-COVID-19 national face-to-face surveys that served as the sampling frames for the phone surveys, this paper documents selection the biases in individual-level analyses based on phone survey data. In most cases, individual-level data are available only for phone survey respondents, who we find are more likely to be household heads or their spouses and non-farm enterprise owners, and on average, are older and better educated vis-a-vis the general adult population. These differences are the result of uneven access to mobile phones in the population and the way that phone survey respondents are selected. To improve the representativeness of individual-level analysis using phone survey data, we recalibrate the phone survey sampling weights based on propensity score adjustments that are derived from a model of an individual’s likelihood of being interviewed as a function of individual- and household-level attributes. We find that reweighting improves the representativeness of the estimates for phone survey respondents, moving them closer to those of the general adult population. This holds for both women and men and for a range of demographic, education, and labor market outcomes. However, reweighting increases the variance of the estimates and, in most cases, fails to overcome selection biases. This indicates limitations to deriving representative individual-level estimates from phone survey data. Obtaining reliable data on men and women through future phone surveys will require random selection of adult interviewees within sampled households.Joshua BrubakerTalip KilicPhilip WollburgPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 16, Iss 11 (2021)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Joshua Brubaker
Talip Kilic
Philip Wollburg
Representativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa
description The COVID-19 pandemic has created urgent demand for timely data, leading to a surge in mobile phone surveys for tracking the impacts of and responses to the pandemic. Using data from national phone surveys implemented in Ethiopia, Malawi, Nigeria and Uganda during the pandemic and the pre-COVID-19 national face-to-face surveys that served as the sampling frames for the phone surveys, this paper documents selection the biases in individual-level analyses based on phone survey data. In most cases, individual-level data are available only for phone survey respondents, who we find are more likely to be household heads or their spouses and non-farm enterprise owners, and on average, are older and better educated vis-a-vis the general adult population. These differences are the result of uneven access to mobile phones in the population and the way that phone survey respondents are selected. To improve the representativeness of individual-level analysis using phone survey data, we recalibrate the phone survey sampling weights based on propensity score adjustments that are derived from a model of an individual’s likelihood of being interviewed as a function of individual- and household-level attributes. We find that reweighting improves the representativeness of the estimates for phone survey respondents, moving them closer to those of the general adult population. This holds for both women and men and for a range of demographic, education, and labor market outcomes. However, reweighting increases the variance of the estimates and, in most cases, fails to overcome selection biases. This indicates limitations to deriving representative individual-level estimates from phone survey data. Obtaining reliable data on men and women through future phone surveys will require random selection of adult interviewees within sampled households.
format article
author Joshua Brubaker
Talip Kilic
Philip Wollburg
author_facet Joshua Brubaker
Talip Kilic
Philip Wollburg
author_sort Joshua Brubaker
title Representativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa
title_short Representativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa
title_full Representativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa
title_fullStr Representativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa
title_full_unstemmed Representativeness of individual-level data in COVID-19 phone surveys: Findings from Sub-Saharan Africa
title_sort representativeness of individual-level data in covid-19 phone surveys: findings from sub-saharan africa
publisher Public Library of Science (PLoS)
publishDate 2021
url https://doaj.org/article/d54ac15f65644662acdaa9eef191947a
work_keys_str_mv AT joshuabrubaker representativenessofindividualleveldataincovid19phonesurveysfindingsfromsubsaharanafrica
AT talipkilic representativenessofindividualleveldataincovid19phonesurveysfindingsfromsubsaharanafrica
AT philipwollburg representativenessofindividualleveldataincovid19phonesurveysfindingsfromsubsaharanafrica
_version_ 1718414012740272128