Surveying general practitioners: does a low response rate matter?

Abstract

Background: Primary care has long been of interest to policy research. Recently, there is evidence to suggest that it is becoming more difficult to encourage GPs (general practitioners) to participate in surveys. As low response rates can introduce bias into survey results, it is important to study the effects of non-response.

Aim: To assess the validity of a response rate of 44% obtained in a national postal study of GPs surveyed about their work with alcohol-misusing patients by assessing the extent of any non-response bias.

Method: A telephone survey of 148 GPs who had not responded to repeated mailings of a postal questionnaire was undertaken. In addition to personal and practice structure characteristics, the GPs were asked three questions taken from the original questionnaire about their work with alcohol-misusing patients.

Results: Of the 148 GPs telephoned, 64 responded to the telephone questionnaire in full; all had previously failed to respond to the postal questionnaire. Younger GPs were more likely to respond to both the national postal and telephone surveys, but more so to the latter. Telephone responders were more likely to be GPs in a single-handed practice. The work of GPs with alcohol-misusing patients highlighted differences between the two response groups. Male telephone responders were found to be identifying a significantly higher average of alcohol misusers than male postal responders. Telephone responders were more likely to feel trained in treating alcohol misuse and to feel better supported to deal with this patient group.

Conclusion: Some significant differences were identified, indicating the presence of non-response bias. A low response rate need not affect the validity of the data collected, but it is still necessary to test for non-response effects and make corrections to the original data in order to maximize validity.