Non-response bias

A bias that occurs due to systematic differences between responders and non-responders

Background

Non-response (or late-response) bias occurs when non-responders from a sample differ in a meaningful way to responders (or early responders). This bias is common in descriptive, analytic and experimental research and it has been demonstrated to be a serious concern in survey studies.  Participants who do not respond may differ from those who do in their exposures or outcomes. This can then result in mistakes in estimating population characteristics based on the underrepresentation of these phenomena due to non-response 

One framework for assessing non-respondent bias is the Continuum of Resistance model, which postulates that the willingness to participate in an invited survey varies linearly within the sample. It, therefore, follows that late-responders are expected to be similar to non-respondents on the measures of interest (Kypri et al 2011).

Example

A study which aimed to investigate the potential effects of non-respondent bias on prevalence estimates of self-reported health behaviours and well-being demonstrated a strong and consistent effect of non-response on all health estimates, as well as considerable effects on the distribution of demographic characteristics. Non-response was determined to contribute to underestimated health risks.

Impact

In a community cardiovascular follow-up study, females, older individuals, and those with higher levels of education are more likely to participate in postal surveys. However, non-response may also occur as a result of the actual outcome variables of interest.  Those with poorer health tend to avoid taking part in health surveys and those who do take part report better health status and behaviours (Cheung KL, 2017)

Preventive steps

A number of steps can be taken during the design, implementation and analysis of the study to reduce or mitigate the risk of non-respondent bias.

Sources

 Understanding The Decision to Participate in a Survey. Public Opin Q [Internet]. 1992 [cited 2019 Nov 13];56(4):475. Available from: https://academic.oup.com/poq/article-lookup/doi/10.1086/269338

The impact of non-response bias due to sampling in public health studies: A comparison of voluntary versus mandatory recruitment in a Dutch national survey on adolescent health. BMC Public Health. 2017 Mar 23;17(1):276. doi: 10.1186/s12889-017-4189-8.

American Association for Public Opinion Research Using Survey Participants to Estimate the Impact of Nonparticipation. Vol. 59, Source: The Public Opinion Quarterly. 1995.

Kypri K, Samaranayaka A, Connor J, Langley JD, Maclennan B. Non-response bias in a web-based health behaviour survey of New Zealand tertiary students. Prev Med (Baltim). 2011 Oct;53(4–5):274–7.

Jooste PL, Yach D, Steenkamp HJ, Botha JL, Rossouw JE. Drop-out and newcomer bias in a community cardiovascular follow-up study. Int J Epidemiol. 1990 Jun;19(2):284–9.

Mathematical Population Studies. An International Journal of Mathematical Demography Dealing with nonresponse: Strategies to increase participation and methods for postsurvey adjustments. 2017


PubMed feed

View more →

Leave a Reply

Your email address will not be published. Required fields are marked *