Bias enters health studies at all stages and often influences the magnitude and direction of results. To obtain the least biased information, researchers must acknowledge the potential presence of biases and take steps to avoid and minimise their effects. Equally, in assessing the results of studies, we must be aware of the different types of biases, their potential impact and how this affects interpretation and use of evidence in healthcare decision making.
To better understand the persistent presence, diversity, and impact of biases, we are compiling a Catalogue of Bias, stemming from original work by David Sackett. The entries are a work in progress and describe a wide range of biases – outlining their potential impact in research studies.
Sackett recognised the importance of bias in research. His 1979 paper “Bias in Analytic Research”, published in the Journal of Chronic Diseases, reported the first draft of a ‘catalog of biases which may distort the design, execution, analysis, and interpretation of research.’ Sackett catalogued 35 biases that arise in sampling and measurement, in the context of clinical trials, and listed 56 biases potentially affecting case-control and cohort studies.
He proposed the continued development of an annotated catalogue of bias as a priority for research.
Sackett DL. Bias in Analytical Research. Chron Dis 1979;32:51-63
He stated that each citation should include a useful definition, a referenced example illustrating the magnitude and direction of its effects, and a description of the appropriate preventive measures, if any.
The Catalogue of Bias Collaboration started in June 2017 with a meeting at the Harbour Hotel, Bristol. The first pages were posted in December 2017, and a launch event was held in Oxford at the Practice of Evidence-Based Healthcare module on the 17th January 2018. In 2019 we moved our away day meetings to Ettington Park, in Stratford.
We continue to welcome further ideas for content, contributions and collaborations to continually refine and update this resource.
Catalogue of Bias Collaboration:
The Collaboration meets regularly to develop and refine the contents of the Catalogue and in between work on updating content.
Editors: Nunan D1, Heneghan C1
Current Associate Editors: Aronson JK1, Badenoch D2, Brassey JA4, Chalmers I1, Davis R1, Friedemann-Smith C1, Lach J1, Mahtani K1, McFadden E1, Nadonovsky P5, Nunan D1, Onakpoya I, Pluddemann A1, Richards G1, Spencer EA1, Pires dos Santos AP5
Previous Associate Editors: Banerjee A, Bankhead C, McCall M, O’Sullivan J, Turk A.
Correspondence to: Dr David Nunan firstname.lastname@example.org; Professor Carl Heneghan email@example.com
1 Centre for Evidence-Based Medicine, Nuffield Department of Primary Care Health Sciences, University of Oxford
2 Minervation Ltd. www.minervation.com
3 Institute of Health Informatics, Faculty of Pop Health Sciences, University College London.
4 Trip Database Ltd.
5 State University of Rio de Janeiro
The Catalogue of Bias would not have been possible without the funding from the McCall MacBain Foundation, which supported the development of the Catalogue of Bias. Meetings are part funded by an NIHR Senior Investigator award to Carl Heneghan.