Shortening a survey and using alternative forms of prenotification: Impact on response rate and quality

Timothy J. Beebe, Enrique Rey, Jeanette Y. Ziegenfuss, Sarah Jenkins, Kandace Lackore, Nicholas J. Talley, Richard G. Locke

Research output: Contribution to journalArticle

22 Citations (Scopus)

Abstract

Background. Evidence suggests that survey response rates are decreasing and that the level of survey response can be influenced by questionnaire length and the use of pre-notification. The goal of the present investigation was determine the effect of questionnaire length and pre-notification type (letter vs. postcard) on measures of survey quality, including response rates, response times (days to return the survey), and item nonresponse. Methods. In July 2008, the authors randomized 900 residents of Olmsted County, Minnesota aged 25-65 years to one of two versions of the Talley Bowel Disease Questionnaire, a survey designed to assess the prevalence of functional gastrointestinal disorders (FGID). One version was two pages long and the other 4 pages. Using a 2 × 2 factorial design, respondents were randomized to survey length and one of two pre-notification types, letter or postcard; 780 residents ultimately received a survey, after excluding those who had moved outside the county or passed away. Results. Overall, the response rates (RR) did not vary by length of survey (RR = 44.6% for the 2-page survey and 48.4% for the 4-page) or pre-notification type (RR = 46.3% for the letter and 46.8% for the postcard). Differences in response rates by questionnaire length were seen among younger adults who were more likely to respond to the 4-page than the 2-page questionnaire (RR = 39.0% compared to 21.8% for individuals in their 20s and RR = 49.0% compared to 32.3% for those in their 30s). There were no differences across conditions with respect to item non-response or time (days after mailing) to survey response. Conclusion. This study suggests that the shortest survey does not necessarily provide the best option for increased response rates and survey quality. Pre-notification type (letter or postcard) did not impact response rate suggesting that postcards may be more beneficial due to the lower associated costs of this method of contact.

Original languageEnglish (US)
Article number50
JournalBMC Medical Research Methodology
Volume10
DOIs
StatePublished - 2010

Fingerprint

Surveys and Questionnaires
Gastrointestinal Diseases
Reaction Time
Young Adult
Postcards
Costs and Cost Analysis

ASJC Scopus subject areas

  • Epidemiology
  • Health Informatics

Cite this

Beebe, T. J., Rey, E., Ziegenfuss, J. Y., Jenkins, S., Lackore, K., Talley, N. J., & Locke, R. G. (2010). Shortening a survey and using alternative forms of prenotification: Impact on response rate and quality. BMC Medical Research Methodology, 10, [50]. https://doi.org/10.1186/1471-2288-10-50

Shortening a survey and using alternative forms of prenotification : Impact on response rate and quality. / Beebe, Timothy J.; Rey, Enrique; Ziegenfuss, Jeanette Y.; Jenkins, Sarah; Lackore, Kandace; Talley, Nicholas J.; Locke, Richard G.

In: BMC Medical Research Methodology, Vol. 10, 50, 2010.

Research output: Contribution to journalArticle

Beebe, Timothy J. ; Rey, Enrique ; Ziegenfuss, Jeanette Y. ; Jenkins, Sarah ; Lackore, Kandace ; Talley, Nicholas J. ; Locke, Richard G. / Shortening a survey and using alternative forms of prenotification : Impact on response rate and quality. In: BMC Medical Research Methodology. 2010 ; Vol. 10.
@article{59cc7c848f724ef0b669015e7893493c,
title = "Shortening a survey and using alternative forms of prenotification: Impact on response rate and quality",
abstract = "Background. Evidence suggests that survey response rates are decreasing and that the level of survey response can be influenced by questionnaire length and the use of pre-notification. The goal of the present investigation was determine the effect of questionnaire length and pre-notification type (letter vs. postcard) on measures of survey quality, including response rates, response times (days to return the survey), and item nonresponse. Methods. In July 2008, the authors randomized 900 residents of Olmsted County, Minnesota aged 25-65 years to one of two versions of the Talley Bowel Disease Questionnaire, a survey designed to assess the prevalence of functional gastrointestinal disorders (FGID). One version was two pages long and the other 4 pages. Using a 2 × 2 factorial design, respondents were randomized to survey length and one of two pre-notification types, letter or postcard; 780 residents ultimately received a survey, after excluding those who had moved outside the county or passed away. Results. Overall, the response rates (RR) did not vary by length of survey (RR = 44.6{\%} for the 2-page survey and 48.4{\%} for the 4-page) or pre-notification type (RR = 46.3{\%} for the letter and 46.8{\%} for the postcard). Differences in response rates by questionnaire length were seen among younger adults who were more likely to respond to the 4-page than the 2-page questionnaire (RR = 39.0{\%} compared to 21.8{\%} for individuals in their 20s and RR = 49.0{\%} compared to 32.3{\%} for those in their 30s). There were no differences across conditions with respect to item non-response or time (days after mailing) to survey response. Conclusion. This study suggests that the shortest survey does not necessarily provide the best option for increased response rates and survey quality. Pre-notification type (letter or postcard) did not impact response rate suggesting that postcards may be more beneficial due to the lower associated costs of this method of contact.",
author = "Beebe, {Timothy J.} and Enrique Rey and Ziegenfuss, {Jeanette Y.} and Sarah Jenkins and Kandace Lackore and Talley, {Nicholas J.} and Locke, {Richard G.}",
year = "2010",
doi = "10.1186/1471-2288-10-50",
language = "English (US)",
volume = "10",
journal = "BMC Medical Research Methodology",
issn = "1471-2288",
publisher = "BioMed Central",

}

TY - JOUR

T1 - Shortening a survey and using alternative forms of prenotification

T2 - Impact on response rate and quality

AU - Beebe, Timothy J.

AU - Rey, Enrique

AU - Ziegenfuss, Jeanette Y.

AU - Jenkins, Sarah

AU - Lackore, Kandace

AU - Talley, Nicholas J.

AU - Locke, Richard G.

PY - 2010

Y1 - 2010

N2 - Background. Evidence suggests that survey response rates are decreasing and that the level of survey response can be influenced by questionnaire length and the use of pre-notification. The goal of the present investigation was determine the effect of questionnaire length and pre-notification type (letter vs. postcard) on measures of survey quality, including response rates, response times (days to return the survey), and item nonresponse. Methods. In July 2008, the authors randomized 900 residents of Olmsted County, Minnesota aged 25-65 years to one of two versions of the Talley Bowel Disease Questionnaire, a survey designed to assess the prevalence of functional gastrointestinal disorders (FGID). One version was two pages long and the other 4 pages. Using a 2 × 2 factorial design, respondents were randomized to survey length and one of two pre-notification types, letter or postcard; 780 residents ultimately received a survey, after excluding those who had moved outside the county or passed away. Results. Overall, the response rates (RR) did not vary by length of survey (RR = 44.6% for the 2-page survey and 48.4% for the 4-page) or pre-notification type (RR = 46.3% for the letter and 46.8% for the postcard). Differences in response rates by questionnaire length were seen among younger adults who were more likely to respond to the 4-page than the 2-page questionnaire (RR = 39.0% compared to 21.8% for individuals in their 20s and RR = 49.0% compared to 32.3% for those in their 30s). There were no differences across conditions with respect to item non-response or time (days after mailing) to survey response. Conclusion. This study suggests that the shortest survey does not necessarily provide the best option for increased response rates and survey quality. Pre-notification type (letter or postcard) did not impact response rate suggesting that postcards may be more beneficial due to the lower associated costs of this method of contact.

AB - Background. Evidence suggests that survey response rates are decreasing and that the level of survey response can be influenced by questionnaire length and the use of pre-notification. The goal of the present investigation was determine the effect of questionnaire length and pre-notification type (letter vs. postcard) on measures of survey quality, including response rates, response times (days to return the survey), and item nonresponse. Methods. In July 2008, the authors randomized 900 residents of Olmsted County, Minnesota aged 25-65 years to one of two versions of the Talley Bowel Disease Questionnaire, a survey designed to assess the prevalence of functional gastrointestinal disorders (FGID). One version was two pages long and the other 4 pages. Using a 2 × 2 factorial design, respondents were randomized to survey length and one of two pre-notification types, letter or postcard; 780 residents ultimately received a survey, after excluding those who had moved outside the county or passed away. Results. Overall, the response rates (RR) did not vary by length of survey (RR = 44.6% for the 2-page survey and 48.4% for the 4-page) or pre-notification type (RR = 46.3% for the letter and 46.8% for the postcard). Differences in response rates by questionnaire length were seen among younger adults who were more likely to respond to the 4-page than the 2-page questionnaire (RR = 39.0% compared to 21.8% for individuals in their 20s and RR = 49.0% compared to 32.3% for those in their 30s). There were no differences across conditions with respect to item non-response or time (days after mailing) to survey response. Conclusion. This study suggests that the shortest survey does not necessarily provide the best option for increased response rates and survey quality. Pre-notification type (letter or postcard) did not impact response rate suggesting that postcards may be more beneficial due to the lower associated costs of this method of contact.

UR - http://www.scopus.com/inward/record.url?scp=77953126289&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77953126289&partnerID=8YFLogxK

U2 - 10.1186/1471-2288-10-50

DO - 10.1186/1471-2288-10-50

M3 - Article

C2 - 20529365

AN - SCOPUS:77953126289

VL - 10

JO - BMC Medical Research Methodology

JF - BMC Medical Research Methodology

SN - 1471-2288

M1 - 50

ER -