Do incentives, reminders or reduced burden improve healthcare professional response rates in postal questionnaires? two randomised controlled trials

Monetary Incentives in Clinician Surveys: An Analysis and Systematic Review With a Focus on Establishing Best Practices

Surveys involving health care providers continue to be characterized by low and declining response rates (RRs), and researchers have utilized various strategies to increase survey participation. An important approach is to employ monetary incentives to improve survey response. Using a systematic review and analyses of 100 randomized comparisons (published in 48 papers) between monetary incentives and a non-incentive condition, this paper seeks to advance the understanding of best practices for using monetary incentives in clinician surveys. These analyses show even small incentives (≤$2) to be effective in improving clinician response relative to non-incentive subgroups, with diminished returns associated with serial incremental increases above that amount up to amounts greater than $25, at which point there is an appreciable improvement, supporting the use of higher incentives in this population. Cash and direct cash equivalents (e.g., cash cards and checks) produced greater odds of survey participation compared to vouchers, lotteries and charitable contributions, with lotteries and charities being the least effective forms of monetary incentive. Survey mode, timing and ethical considerations are also addressed. Noting the challenges associated with surveying clinicians, researchers must make every effort to improve access to this difficult-to-reach population by implementing appropriate incentive-based strategies designed to improve participation rates.

Pushing the envelope: the feasibility of using a mailed contrast sensitivity test to prioritise cataract waiting lists

BACKGROUND

Cataract waiting lists are growing globally. Pragmatic, cost-effective methods are required to prioritise the most urgent cases. Here we investigate the feasibility of using a third-party pen-and-paper contrast sensitivity, CS, test (SpotChecksTM), delivered by mail, and performed by patients at home unsupervised, to flag eyes requiring surgery.

METHODS

Pen-and-paper CS tests were mailed to 233 people waiting for a cataract assessment, along with a prepaid return envelope (cross-sectional study). Response rates were tabulated (stratified by age, sex and socioeconomic status), and test scores analysed to see how well the home tests predicted which eyes were listed subsequently for surgery. A subset of patients (N = 39) also underwent in-person follow-up testing, to confirm the accuracy of the home data.

RESULTS

Forty-six percent of patients responded (216 eyes). No gross differences were observed between respondents and non-respondents, either in terms of age, sex, socioeconomic status, or geographic location (all P > 0.05). The home-test CS scores predicted which eyes were subsequently listed for surgery, with an AUROC {±CI95%} of 0.69 {0.61-0.76}. Predictive performance was further-improved when machine learning was used to combine CS scores with letter acuity, extracted from patients' medical records (AUROC {±CI95%} = 0.77 {0.70-0.83}). Among 39 patients who underwent follow-up testing, home CS scores were correlated with various measures made in clinic: biometry signal-to-noise (P = 0.032), LogMAR acuity, Pelli-Robson CS and SpotChecks CS (all P < 0.001).

CONCLUSIONS

Mailing patients pen-and-paper CS tests may be a feasible, 'low-tech' way of prioritising patients on cataract waiting lists.

Supportive periodontal care in dental practice: Part 2 - perceptions of locally referring UK general dental practitioners

Background Supportive periodontal care (SPC) is important in maintaining periodontal treatment outcomes. Hospital services provide specialist periodontal care at high costs. On completion of treatment, patients are discharged back to the general dental practitioner (GDP) to provide SPC. This project aimed to evaluate the change in GDPs' understanding of SPC over more than 20 years.Method A validated questionnaire about SPC was sent to GDPs during 1996 (397) and 2020 (300), with a response rate of 74% and 52%, respectively. The anonymous data were entered on a Microsoft Excel spreadsheet for analysis.Results In total, 98.5% of the GDPs in 1996 and 97% in 2020 perceived SPC to be highly important. Additionally, 49% in 2020 had a better understanding of SPC when compared to 1996 (42%). Finally, 70-74% (1996, 2020) of the GDPs indicated that they were responsible for SPC; however, 13-16% said that they were not.Conclusion and clinical relevance Notwithstanding the lower response rate in 2020, there has been an improvement in understanding and awareness of responsibility of SPC among GDPs. Reported challenges of provision were related to education and funding. If GDPs are to effectively deliver SPC, education and current funding should be addressed to prevent compromised treatment outcomes for patients.

Does usage of monetary incentive impact the involvement in surveys? A systematic review and meta-analysis of 46 randomized controlled trials

BACKGROUND

Surveys are an effective method for collecting a large quantity of data. However, incomplete responses to these surveys can affect the validity of the studies and introduce bias. Recent studies have suggested that monetary incentives may increase survey response rates. We intended to perform a systematic review and meta-analysis of randomized controlled trials (RCTs) to evaluate the effect of monetary incentives on survey participation.

METHODS

A systematic search of electronic databases was conducted to collect studies assessing the impact of monetary incentives on survey participation. The primary outcome of interest was the response rates to incentives: money, lottery, and voucher. We used the Cochrane Collaboration tool to assess the risk of bias in randomized trials. We calculated the rate ratio (RR) with its 95% confidence interval (95% CI) using Review Manager Software (version 5.3). We used random-effects analysis and considered the data statistically significant with a P-value <0.05.

RESULTS

Forty-six RCTs were included. A total of 109,648 participants from 14 countries were involved. The mean age of participants ranged from 15 to more than 60 years, with 27.5% being males, 16.7% being females, and the other 55.8% not reported. Our analysis showed a significant increase in response rate in the incentive group compared to the control group, irrespective of the incentive methods. Money was the most efficient way to increase the response rate (RR: 1.25; 95% CI: 1.16,1.35; P = < 0.00001) compared to voucher (RR: 1.19; 95% CI: 1.08,1.31; P = < 0.0005) and lottery (RR: 1.12; 95% CI: 1.03,1.22; P = < 0.009).

CONCLUSION

Monetary incentives encourage the response rate in surveys. Money was more effective than vouchers or lotteries. Therefore, researchers may include money as an incentive to improve the response rate while conducting surveys.

Randomized experiment on the effect of incentives and mailing strategy on response rates in a mail survey of dentists

OBJECTIVES

Response rates for mail surveys of dentists and other health care providers have declined appreciably over the past several decades. The objective of this study was to update evidence about the impact use of incentives and different mail strategies on response rates in a mail survey of dentists.

METHODS

We randomized private practice dentists in Iowa (N = 1267) into six study groups to test the effects of incentives and mail strategy on response rate. Survey incentives included either a $2 bill or a customized pen/stylus; a control group with no incentive was included. Mail strategies included bulk mail or first-class stamps.

RESULTS

The overall survey response rate was 43%. A $2 bill incentive was associated with significantly higher likelihood of returning a survey compared to the control group with no incentive (48% response rate vs. 40%, respectively). A non-monetary incentive was not significantly associated with likelihood of response. Use of first-class stamps compared to bulk mail did not significantly affect response rate.

CONCLUSIONS

This study demonstrated the effectiveness of a $2 incentive to increase response rate in a mail survey of dentists. Given the background trend of declining survey participation rates, researchers should consider use of monetary incentives and explore new strategies to increase participation among dentists and other health care providers.

A High-Sensitivity International Knee Documentation Committee Survey Index From the PROMIS System: The Next-Generation Patient-Reported Outcome for a Knee Injury Population

BACKGROUND

Patient-reported outcomes (PROs) measure progression and quality of care. While legacy PROs such as the International Knee Documentation Committee (IKDC) survey are well-validated, a lengthy PRO creates a time burden on patients, decreasing adherence. In recent years, PROs such as the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function and Pain Interference surveys were developed as computer adaptive tests, reducing time to completion. Previous studies have examined correlation between legacy PROs and PROMIS; however, no studies have developed effective prediction models utilizing PROMIS to create an IKDC index. While the IKDC is the standard knee PRO, computer adaptive PROs offer numerous practical advantages.

PURPOSE

To develop a nonlinear predictive model utilizing PROMIS Physical Function and Pain Interference to estimate IKDC survey scores and examine algorithm sensitivity and validity.

STUDY DESIGN

Cohort study (diagnosis); Level of evidence, 3.

METHODS

The MOTION (Military Orthopaedics Tracking Injuries and Outcomes Network) database is a prospectively collected repository of PROs and intraoperative variables. Patients undergoing knee surgery completed the IKDC and PROMIS surveys at varying time points. Nonlinear multivariable predictive models using Gaussian and beta distributions were created to establish an IKDC index score, which was then validated using leave-one-out techniques and minimal clinically important difference analysis.

RESULTS

A total of 1011 patients completed the IKDC and PROMIS Physical Function and Pain Interference, providing 1618 complete observations. The algorithms for the Gaussian and beta distribution were validated to predict the IKDC (Pearson = 0.84-0.86; R² = 0.71-0.74; root mean square error = 9.3-10.0).

CONCLUSION

The publicly available predictive models can approximate the IKDC score. The results can be used to compare PROMIS Physical Function and Pain Interference against historical IKDC scores by creating an IKDC index score. Serial use of the IKDC index allows for a lower minimal clinically important difference than the conventional IKDC. PROMIS can be substituted to reduce patient burden, increase completion rates, and produce orthopaedic-specific survey analogs.

Generating the American Shoulder and Elbow Surgeons Score Using Multivariable Predictive Models and Computer Adaptive Testing to Reduce Survey Burden

BACKGROUND

The preferred patient-reported outcome measure for the assessment of shoulder conditions continues to evolve. Previous studies correlating the Patient-Reported Outcomes Measurement Information System (PROMIS) computer adaptive tests (CATs) to the American Shoulder and Elbow Surgeons (ASES) score have focused on a singular domain (pain or physical function) but have not evaluated the combined domains of pain and physical function that compose the ASES score. Additionally, previous studies have not provided a multivariable prediction tool to convert PROMIS scores to more familiar legacy scores.

PURPOSE

To establish a valid predictive model of ASES scores using a nonlinear combination of PROMIS domains for physical function and pain.

STUDY DESIGN

Cohort study (Diagnosis); Level of evidence, 3.

METHODS

The Military Orthopaedics Tracking Injuries and Outcomes Network (MOTION) database is a prospectively collected repository of patient-reported outcomes and intraoperative variables. Patients in MOTION research who underwent shoulder surgery and completed the ASES, PROMIS Physical Function, and PROMIS Pain Interference at varying time points were included in the present analysis. Nonlinear multivariable predictive models were created to establish an ASES index score and then validated using "leave 1 out" techniques and minimal clinically important difference /substantial clinical benefit (MCID/SCB) analysis.

RESULTS

A total of 909 patients completed the ASES, PROMIS Physical Function, and PROMIS Pain Interference at presurgery, 6 weeks, 6 months, and 1 year after surgery, providing 1502 complete observations. The PROMIS CAT predictive model was strongly validated to predict the ASES (Pearson coefficient = 0.76-0.78; R² = 0.57-0.62; root mean square error = 13.3-14.1). The MCID/SCB for the ASES was 21.7, and the best ASES index MCID/SCB was 19.4, suggesting that the derived ASES index is effective and can reliably re-create ASES scores.

CONCLUSION

The PROMIS CAT predictive models are able to approximate the ASES score within 13 to 14 points, which is 7 points more accurate than the ASES MCID/SCB derived from the sample. Our ASES index algorithm, which is freely available online (https://osf.io/ctmnd/), has a lower MCID/SCB than the ASES itself. This algorithm can be used to decrease patient survey burden by 11 questions and provide a reliable ASES analog to clinicians.

Does Duration of Pain at Baseline Influence Longer-term Clinical Outcomes of Low Back Pain Patients Managed on an Evidence-Based Pathway?

STUDY DESIGN

Nonrandomized longitudinal observational study.

OBJECTIVE

The aim of this study was to evaluate the association between baseline pain duration and medium-to-long term clinical outcomes, in low back pain (LBP) patients enrolled on the North East of England Regional Back Pain and Radicular Pain Pathway (NERBPP).

SUMMARY OF BACKGROUND DATA

The NERBPP is based upon National Institute for Health and Care Excellence (NICE) guidelines. These guidelines no longer differentiate management of LBP patients based on pain duration. Medium-to-long term data from the NERBPP is lacking.

METHODS

Between May 2015 and December 2019, 786 and 552 LBP patients from the NERBPP returned 6-month and 12-month follow-up outcome measures, respectively. Outcomes included pain (Numerical rating scale), function (Oswestry Disability Index) and quality-of-life (EuroQol five-dimension, five-level questionnaire), analyzed using a series of covariate-adjusted models. Patients were categorized into four groups based upon baseline pain duration: <3 months, ≥3 to <6 months, ≥6 months to <12 months, ≥12 months.

RESULTS

Patients with <3 months duration demonstrated clinically important improvements on all outcomes, at both follow-ups. The improvements in outcomes from this group were larger than those in the ≥12 month's duration group (P < 0.05), these group differences in change, in some cases surpassed our threshold for clinical relevance. Functional improvements in those with ≥12 month's duration were not clinically relevant at either follow-up. All patients, regardless of baseline pain duration, reported similar levels of readiness to self-manage at the 12-month follow-up.

CONCLUSION

Baseline pain duration would appear to be of clinical importance. Patients with shorter baseline pain duration demonstrated better outcomes. Those with ≥12 month's duration of pain may need additional support during their management to achieve clinically relevant functional improvements in the medium-to-long term. These findings raise questions about the decision by NICE to move away from duration of pain to differentiate management of LBP patients.Level of Evidence: 3.

Assessing Social Connectedness Among Persons with Schizophrenia: Psychometric Evaluation of the Perceived Social Connectedness Scale

The purpose of this study was a psychometric evaluation of the 4-item perceived social connectedness (PSC) scale. The study analyzed secondary data from a project that assessed physical, behavioral, and social health characteristics of adults with serious mental illness receiving integrated services at community mental health centers (CMHs). The current sample comprised those diagnosed with schizophrenia attending these CMHs (N = 146). Most participants were African-American males who receive disability benefits with Medicaid as health insurance. The sample self-reported low-to-moderate levels of social connectedness, daily functioning, and symptom severity. Factor analysis of the PSC scale revealed one dimension, accounting for 66% of total variance, with strong item loadings. Reliability coefficients indicated sufficient scale internal consistency. Construct validity was suggested via the PSC scale's directional, significant convergence with daily functioning and symptom severity. Implications include the application of the PSC scale for this socioeconomically disadvantaged population that customarily lacks meaningful social networks.

Dental services provided by dentists in Australia

OBJECTIVES

To examine the efect of age and gender on dental services provided by dentists in Australia, and compare with previous estimates across the period 1983-1984 to 2013-2014.

METHODS

Data were collected by mailed survey from a random sample of Australian dentists. Private sector dentists were the focus of the analysis. Data were weighted to the age and sex distribution of Australian practising dentists.

RESULTS

The analysis was based on service logs collected from n = 211 dentists. Adjusted results (rate ratio, 95% CI) showed male dentists had higher endodontic rates (1.7, 1.0-2.9) than female dentists. Dentists aged 40-49 years had higher restorative rates (1.6, 1.1-2.2) but lower preventive rates (0.5, 0.3-0.9) than those aged 20-29 years. Diagnostic services were lower for dentists aged 40-49 to 60+ years (0.8, 0.6-0.9), while denture services were higher for dentists aged 40-49 (11.1, 2.5-48.5) to 60+ years (6.4, 1.2-33.3). Crowns were higher for dentists aged 40-49 (2.4, 1.0-5.6) and 50-59 years (2.9, 1.3-6.6). Diagnostic and preventive services were consistently higher across 1983-1984 to 2013-2014.

CONCLUSIONS

Younger dentists provided higher rates of diagnostic and preventive services. Over a 30-year period, there was a consistent trend towards higher provision of diagnostic and preventive services.

Therapeutic alternatives for supporting GPs to deprescribe opioids: a cross-sectional survey

Background

GPs are central to opioid strategy in chronic non-cancer pain (CNCP). Lack of treatment alternatives and providers are common reasons cited for not deprescribing opioids. There are limited data about availability of multidisciplinary healthcare providers (MHCPs), such as psychologists, physiotherapists, or dietitians, who can provide broader treatments.

Aim

To explore availability of MHCPs, and the association with GP opioid deprescribing and transition to therapeutic alternatives for CNCP.

Design & setting

Cross-sectional survey of all practising GPs (N = 1480) in one mixed urban and regional Australian primary health network.

Method

A self-report mailed questionnaire assessed the availability of MHCPs and management of their most recent patient on long-term opioids for CNCP.

Results

Six hundred and eighty-one (46%) valid responses were received. Most GPs (71%) had access to a pain specialist and MHCPs within 50 km. GPs' previous referral for specialist support was significantly associated with access to a greater number of MHCPs (P = 0.001). Employment of a nurse increased the rate ratio of available MHCPs by 12.5% (incidence rate ratio [IRR] 1.125, 95% confidence interval [CI] = 1.001 to 1.264). Only one-third (32%) of GPs reported willingness to deprescribe and shift to broader CNCP treatments. Availability of MHCPs was not significantly associated with deprescribing decisions.

Conclusion

Lack of geographical access to known MHCPs does not appear to be a major barrier to opioid deprescribing and shifting toward non-pharmacological treatments for CNCP. Considerable opportunity remains to encourage GPs' decision to deprescribe, with employment of a practice nurse appearing to play a role.

General practitioners and management of chronic noncancer pain: a cross-sectional survey of influences on opioid deprescribing

Background

General practitioners’ (GPs) views about deprescribing prescription opioid analgesics (POAs) may influence the care provided for patients experiencing chronic noncancer pain (CNCP). There are limited data addressing GPs’ beliefs about deprescribing, including their decisions to deprescribe different types of POAs.

Aim

To determine the proportion of GPs who hold attitudes congruent with local pain stewardship, describe their deprescribing decisions, and determine whether type of POA influences deprescribing.

Design and setting

In 2016, a cross-sectional survey of all GPs (n=1,570) in one mixed urban and regional primary health network (PHN) in Australia was undertaken.

Methods

A mailed self-report questionnaire assessed agreement with local guidelines for treating CNCP; influences on deprescribing POAs and likelihood of deprescribing in a hypothetical case involving either oral codeine or oxycodone.

Results

A response rate of 46% was achieved. Approximately half (54%) of GPs agreed POAs should be reserved for people with acute, cancer pain or palliative care and a third (32%) did not agree that a medication focus has limited benefits for peoples’ long-term quality of life and function. Most (77%) GPs were less likely to deprescribe when effective alternate treatments were lacking, while various patient factors (eg, fear of weaning) were reported to decrease the likelihood of deprescribing for 25% of GPs. A significantly higher proportion of GPs reported being very likely to deprescribe codeine compared to the equivalent opioid dose of oxycodone for a hypothetical patient.

Conclusions

Many GPs in the PHN hold attitudes at odds with local guidance that opioids are a nonsuperior treatment for CNCP. Attitudinal barriers to deprescribing include: a lack of consistent approach to deprescribing opioids as a class of drugs, perceived lack of effective treatment alternatives and patient fear of deprescribing. Therefore, the next step in this target population is to appropriately train and support GPs in how to apply the evidence in practice and how to support patients appropriately.

Hours worked and patient visits provided by dentists in Australia

BACKGROUND

The aim was to examine the numbers of hours worked and patient visits provided by age and gender of dentists in Australia, and compare with previous estimates to describe trends.

METHODS

Data were collected from a random sample (N = 2961) of Australian dentists. Private sector dentists working in clinical practise were included in the analysis.

RESULTS

The response rate was 49% (N = 1345 dentists). Hours per year worked and number of patient visits per year were lower for dentists aged 65 years and older compared with younger dentists, and were higher for male compared with female dentists aged 35-45 to 55-64 years. Hours per year worked were lower in 2013-2014 than reported in 2009-2010, but the number of patient visits in 2013-2014 was similar to the previously reported estimate from 2009-2010.

CONCLUSIONS

Hours worked and visits provided were only lower among older dentists aged 65 years or more. Male dentists tend to work more hours per year and provide more patient visits per year than female dentists. Over the last decade, Australian dentists maintained a stable output of visits per year despite a trend towards fewer hours worked per year.

A pragmatic multicentre randomised controlled trial comparing stapled haemorrhoidopexy with traditional excisional surgery for haemorrhoidal disease: the eTHoS study

BACKGROUND

Haemorrhoids are a benign anorectal condition and are highly prevalent in the UK population. Treatments involve clinic-based procedures and surgery. The surgical procedures available include stapled haemorrhoidopexy (SH) and traditional haemorrhoidectomy (TH), and over 25,000 operations are performed for haemorrhoids annually in the UK. The disease is therefore important both to patients and to health service commissioners. Debate remains as to which of these surgical procedures is the most clinically effective and cost-effective.

OBJECTIVE

The aim of this study was to compare the clinical effectiveness and cost-effectiveness of SH with that of TH.

DESIGN

A large, open two-arm parallel-group pragmatic multicentre randomised controlled trial involving 32 UK hospitals and a within-trial cost-benefit analysis. A discrete choice experiment was conducted to estimate benefits (willingness to pay).

PARTICIPANTS

Patients with grades II-IV haemorrhoids who had not previously undergone SH or TH were included in the study.

INTERVENTIONS

Participants were randomised to receive either SH or TH. Randomisation was minimised at 1 : 1, in accordance with baseline EuroQol-5 Dimensions, three-level version (EQ-5D-3L) score, haemorrhoid grade, sex and centre, via an automated system.

MAIN OUTCOME MEASURES

The primary outcome was area under the quality-of-life curve measured using the EQ-5D-3L descriptive system over 24 months, and the primary economic outcome was the incremental cost-effectiveness ratio. Secondary outcomes included disease-specific quality of life, recurrence, complications, further interventions and costs.

RESULTS

Between January 2011 and August 2014, 777 patients were randomised (389 to receive SH and 388 to receive TH). There were 774 participants included in the analysis as a result of one post-randomisation exclusion in the SH arm and two in the TH arm. SH was less painful than TH in the short term. Surgical complications were similar in both arms. EQ-5D-3L score was higher for the SH arm in the first 6 weeks after surgery, but over 24 months the TH group had significantly better EQ-5D-3L scores (-0.073, 95% confidence interval -0.140 to -0.006; p = 0.0342). Symptoms and further interventions were significantly fewer in the TH arm at 24 months. Continence was better in the TH arm and tenesmus occurred less frequently. The number of serious adverse events reported was 24 out of 337 (7.1%) for participants who received SH and 33 out of 352 (9.4%) for those who received TH. There were two deaths in the SH arm, both unrelated to the eTHoS (either Traditional Haemorrhoidectomy or Stapled haemorrhoidopexy for haemorrhoidal disease) study. Patient preference did not seem to influence the treatment difference. SH was dominated by TH as it cost more and was less effective. The net benefit for the TH arm was higher than that for the SH arm.

LIMITATIONS

Neither the participants nor the assessors were masked to treatment assignment and final recruitment was slightly short of the total target of 800. There were also substantial missing follow-up data.

CONCLUSIONS

While patients who received SH had less short-term pain, after 6 weeks, recurrence rates, symptoms, re-interventions and quality-of-life measures all favoured TH. In addition, TH is cheaper. As part of a tailored management plan for haemorrhoids, TH should be considered over SH as the surgical treatment of choice for haemorrhoids refractory to clinic-based interventions.

FUTURE WORK

Perform an updated meta-analysis incorporating recently conducted European trials [eTHoS, HubBLe (haemorrhoidal artery ligation versus rubber band ligation for the management of symptomatic second-degree and third-degree haemorrhoids) and LingaLongo (Cost-effectiveness of New Surgical Treatments for Haemorrhoidal Disease)].

TRIAL REGISTRATION

Current Controlled Trials ISRCTN80061723.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 70. See the NIHR Journals Library website for further project information.

Factors influencing healthcare provider respondent fatigue answering a globally administered in-app survey

Background

Respondent fatigue, also known as survey fatigue, is a common problem in the collection of survey data. Factors that are known to influence respondent fatigue include survey length, survey topic, question complexity, and open-ended question type. There is a great deal of interest in understanding the drivers of physician survey responsiveness due to the value of information received from these practitioners. With the recent explosion of mobile smartphone technology, it has been possible to obtain survey data from users of mobile applications (apps) on a question-by-question basis. The author obtained basic demographic survey data as well as survey data related to an anesthesiology-specific drug called sugammadex and leveraged nonresponse rates to examine factors that influenced respondent fatigue.

Methods

Primary data were collected between December 2015 and February 2017. Surveys and in-app analytics were collected from global users of a mobile anesthesia calculator app. Key independent variables were user country, healthcare provider role, rating of importance of the app to personal practice, length of time in practice, and frequency of app use. Key dependent variable was the metric of respondent fatigue.

Results

Provider role and World Bank country income level were predictive of the rate of respondent fatigue for this in-app survey. Importance of the app to the provider and length of time in practice were moderately associated with fatigue. Frequency of app use was not associated. This study focused on a survey with a topic closely related to the subject area of the app. Respondent fatigue rates will likely change dramatically if the topic does not align closely.

Discussion

Although apps may serve as powerful platforms for data collection, responses rates to in-app surveys may differ on the basis of important respondent characteristics. Studies should be carefully designed to mitigate fatigue as well as powered with the understanding of the respondent characteristics that may have higher rates of respondent fatigue.

The effect of using social pressure in cover letters to improve retention in a longitudinal health study: an embedded randomised controlled retention trial

Background

Retention of participants in cohort studies is important for validity. One way to promote retention is by sending a persuasive cover letter with surveys. The study aimed to compare the effectiveness of a covering letter containing social pressure with a standard covering letter on retention in a health cohort study. Social pressure involves persuading people to behave in a certain way by the promise that their actions will be made know to others. We implemented a mild form of social pressure, where the recipient was told that information about whether they responded to the current survey would be noted by the research team and printed on future correspondence from the research team to the recipient.

Methods

The design was an embedded randomised controlled retention trial, conducted between July 2015 and April 2016 in Salford, UK. Participants in the host health cohort study were eligible. They received either: (1) a covering letter with two consecutive surveys (sent six and twelve months after recruitment), containing a social pressure intervention; or (2) a matching letter without the social pressure text. The primary outcome was retention in the host study, defined as return of both surveys. Randomisation was computer-generated, with stratification by household size. Participants were blinded to group assignment. Researchers were blinded for outcome ascertainment.

Results

Adults (n = 4447) aged over 65 years, with a long-term condition and enrolled in the host study, were randomly allocated to receive a social pressure covering letter (n = 2223) or control (n = 2224). All 4447 participants were included in the analysis. Both questionnaires were returned by 1577 participants (71%) sent the social pressure letters and 1511 (68%) sent control letters, a risk difference of 3 percentage points (adjusted odds ratio = 1.16 (95% confidence interval = 1.02–1.33)).

Conclusion

A mild form of social pressure made a small but significant improvement in retention of older adults in a health cohort study. Investigation of social pressure across other research contexts and stronger social pressure messages is warranted.

Trial registration

The host cohort study, the Comprehensive Longitudinal Assessment of Salford Integrated Care (CLASSIC) study is associated with the CLASSIC PROTECTs trial, which is registered on the ISRCTN registry. Trial registration number: ISRCTN12286422. Date of registration 19 June 2014.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-017-2090-5) contains supplementary material, which is available to authorized users.

Differences in disinfection protocols for root canal treatments between general dentists and endodontists: A Web-based survey

BACKGROUND

The purpose of this study was to determine whether differences exist in disinfection protocols between endodontists and general dentists.

METHODS

The authors sent an invitation to participate in a Web-based survey to 950 dentists affiliated with the Spanish Board of Dentistry. Participants responded to 9 questions about irrigation protocols and other factors related to disinfection during root canal therapy.

RESULTS

A total of 238 (25.05%) study participants successfully completed and returned the surveys. Among these participants, 50% were general dentists and 50% were endodontists. The authors found no statistically significant differences in respondents' first choice of an irrigant solution (that is, sodium hypochlorite), but they noted statistically significant differences in the protocols used by general dentists and by endodontists in relation to the concentration of sodium hypochlorite (P = .0003), the use and type of irrigant used to remove the smear layer (P = 5.39 × 10(-10)), the use of adjuncts to irrigation (P = 5.98 × 10(-8)), the enlargement of the apical preparation when shaping a necrotic tooth (P = .001), and the maintenance of apical patency throughout the debridement and shaping procedure (P = .04).

CONCLUSIONS

General dentists and endodontists embrace different disinfection protocols. The results of the survey demonstrated that endodontists keep up to date with protocols published in the literature, whereas general dentists use protocols learned during their dental training. Both groups of clinicians should be aware of the importance of disinfection techniques and their relationship to treatment outcomes.

PRACTICAL IMPLICATIONS

Controlling microorganisms during a root canal treatment, especially in cases with necrotic pulp, is essential to improve treatment outcomes. Clinicians should update their protocols and also consider referring patients to a specialist when their protocols are based on traditional techniques, especially in those cases with necrotic pulp.

Assessment and Determinants of Spinal Pain in the Course of Disc Disorders Treated Surgically

Background

Intervertebral disc disease is defined as a complex of structural changes in the aftermath of disorders of mutual elements, the structure of which form the discus intervertebralis and the spinal canal. The present work assessed pain in patients who were surgically treated due to spinal discopathy and analyzed factors that determine the condition.

Material/Methods

The research was carried on a group of 187 patients diagnosed with discopathy of the lumbosacral and cervical segment. The data are discussed in the context of medical records and the Visual Analogue Scale used for pain assessment. We used a prospective study plan with a 3-time assessment.

Results

The pain level observed among patients prior to the procedure (M=6.52) was higher than after 7 days (M=3.15) and 6 months from the operation (M= 3.45). The highest level of pain (M=6.88), with a relatively high consistency among the patients (SD=2.25), was observed in the case of left-side hernia (H=7.31; p=0.023). The influence of the analyzed factors on pain experience markedly increased by the third assessment (R2=0.14), and was strongly associated with the type of work performed by the patient.

Conclusions

Surgical operation significantly reduces pain in patients with disc disorders. The level of pain is predominantly affected by the location of the hernia and the type of work performed by the patient.

Maximising follow-up participation rates in a large scale 45 and Up Study in Australia

BACKGROUND

The issue of poor response rates to population surveys has existed for some decades, but few studies have explored methods to improve the response rate in follow-up population cohort studies.

METHODS

A sample of 100,000 adults from the 45 and Up Study, a large population cohort in Australia, were followed up 3.5 years after the baseline cohort was assembled. A pilot mail-out of 5000 surveys produced a response rate of only 41.7 %. This study tested methods of enhancing response rate, with three groups of 1000 each allocated to (1) receiving an advance notice postcard followed by a questionnaire, (2) receiving a questionnaire and then follow-up reminder letter, and (3) both these strategies.

RESULTS

The enhanced strategies all produced an improved response rate compared to the pilot, with a resulting mean response rate of 53.7 %. Highest response was found when both the postcard and questionnaire reminder were used (56.4 %) but this was only significantly higher when compared to postcard alone (50.5 %) but not reminder alone (54.1 %). The combined approach was used for recruitment among the remaining 92,000 participants, with a resultant further increased response rate of 61.6 %.

CONCLUSIONS

Survey prompting with a postcard and a reminder follow-up questionnaire, applied separately or combined can enhance follow-up rates in large scale survey-based epidemiological studies.

Strategies to Maximize Data Collection Response Rates in a Randomized Control Trial Focused on Children with Medical Complexity

INTRODUCTION

Obtaining complete and timely subject data is key to the success of clinical trials, particularly for studies requiring data collected from subjects at home or other remote sites. A multifaceted strategy for data collection in a randomized controlled trial (RCT) focused on care coordination for children with medical complexity is described. The influences of data collection mode, incentives, and study group membership on subject response patterns are analyzed. Data collection included monthly healthcare service utilization (HCSU) calendars and annual surveys focused on care coordination outcomes.

MATERIALS AND METHODS

One hundred sixty-three families were enrolled in the 30-month TeleFamilies RCT. Subjects were 2-15 years of age at enrollment. HCSU data were collected by parent/guardian self-report using mail, e-mail, telephone, or texting. Surveys were collected by mail. Incentives were provided for completed surveys after 8 months to improve collection returns. Outcome measures were the number of HCSU calendars and surveys returned, the return interval, data collection mode, and incentive impact.

RESULTS

Return rates of 90% for HCSU calendars and 82% for annual surveys were achieved. Mean return intervals were 72 and 65 days for HCSU and surveys, respectively. Survey response increased from 55% to 95% after introduction of a gift card and added research staff.

CONCLUSIONS

High return rates for HCSU calendars and health-related surveys are attainable but required a flexible and personnel-intensive approach to collection methods. Family preference for data collection approach should be obtained at enrollment, should be modified as needed, and requires flexible options, training, intensive staff/family interaction, and patience.

Allowing Physicians to Choose the Value of Compensation for Participation in a Web-Based Survey: Randomized Controlled Trial

Background

Survey response rates among physicians are declining, and determining an appropriate level of compensation to motivate participation poses a major challenge.

Objective

To estimate the effect of permitting intensive care physicians to select their preferred level of compensation for completing a short Web-based survey on physician (1) response rate, (2) survey completion rate, (3) time to response, and (4) time spent completing the survey.

Methods

A total of 1850 US intensivists from an existing database were randomized to receive a survey invitation email with or without an Amazon.com incentive available to the first 100 respondents. The incentive could be instantly redeemed for an amount chosen by the respondent, up to a maximum of US $50.

Results

The overall response rate was 35.90% (630/1755). Among the 35.4% (111/314) of eligible participants choosing the incentive, 80.2% (89/111) selected the maximum value. Among intensivists offered an incentive, the response was 6.0% higher (95% CI 1.5-10.5, P=.01), survey completion was marginally greater (807/859, 94.0% vs 892/991, 90.0%; P=.06), and the median number of days to survey response was shorter (0.8, interquartile range [IQR] 0.2-14.4 vs 6.6, IQR 0.3-22.3; P=.001), with no difference in time spent completing the survey.

Conclusions

Permitting intensive care physicians to determine compensation level for completing a short Web-based survey modestly increased response rate and substantially decreased response time without decreasing the time spent on survey completion.

Tracking workforce diversity in dentistry: importance, methods, and challenges

OBJECTIVES

The objectives of this paper are to describe sources of data on underrepresented minority (URM) dental providers and to perform a structured critique of primary survey research on African American (AA), Hispanic/Latino (HL), and American Indian/Alaska Native (AI/AN) dentists.

METHODS

A national sample survey was conducted between October 2012 and March 2013, and secondary datasets were assessed for comparability. The survey used 21 sampling frames, with censuses of AI/AN and nonurban dentists, and assessed demographics, education, practice history, patient population, volunteerism, experiences with discrimination, and opinions on issues in dentistry. The survey was developed with constituent input, pilot-tested, and distributed online and through US mail with three reminder postcards, phone, and email follow-up. Continuing education credit and entry to a prize drawing were provided for participation.

RESULTS

Existing data sources cannot answer critical research questions about URM dentists. Using best practices, the survey received a 34 percent adjusted response rate. Selection likelihood and measurable response bias were adjusted for using base and poststratification weights.

CONCLUSIONS

The survey design was consistent with best practices, and our response analytics provide high confidence that the survey produced data representative of the URM dentist population. Enhanced study design, content, and response rates of existing survey efforts would be needed to provide a more robust body of knowledge on URM providers, perspectives, and practices.

Direct access in the UK: what do dentists really think?

OBJECTIVE

To investigate dentists' views on the likely impact of direct access (DA), the clinical competence of hygienists and therapists to work autonomously and possible predictors of such views.

DESIGN

Random survey of registered dentists.

SETTING

UK, 2014.

SUBJECTS AND METHODS

A random sample of UK-based dentists registered with the General Dental Council (GDC). A unique-access online questionnaire was developed, with a paper alternative. Email and postal reminders were sent.

MAIN OUTCOME MEASURES

Measures of positive/negative views regarding the impact of DA and clinical competence of hygienists and therapists to work without a dentist's prescription.

RESULTS

One hundred and fifty-nine responded (response rate: 27%), 78 (49.1%) of whom were female. No significant sources of response bias were identified. While 122 (77%) had not undergone joint training with dental hygienists or therapists at the undergraduate level, 98 (62.4%) currently worked with a hygienist and 33 (21.0%) with a therapist. Eighty-three (53.2%) disagreed with the GDC decision regarding DA for hygienists, and 94 (59.1%) felt the same regarding therapists. Concern was greatest in respect to diagnosis, treatment planning and restorations. Comments were predominantly negative and reflected concerns over patient safety, what was seen as hygienists' and therapists' inadequate training or expertise, the undermining of the dentist's role, service delivery, the reform being poorly planned, implemented or being a cost-cutting exercise. Experience of teamwork was not predictive of positive/negative views.

CONCLUSIONS

Response was low, thus posing a potential threat to the study's representativeness. Many dentists had concerns and reservations about DA which were unrelated to teamwork experience. The dissemination of information on curricula and scope of practice may help allay such concerns, as may a greater emphasis on joint training at both the undergraduate level and within continuing professional development programmes.

Perceptions of single-visit and multiple-visit endodontic treatment: a survey of endodontic specialists and general dentists in Hong Kong

AIM

To study the preference of practice for single- and multiple-visit endodontic treatment by Hong Kong endodontists and general dental practitioners (GDPs), and to investigate their reasons for choosing single- or multiple-visit treatment in their practice.

METHOD

An anonymous questionnaire was mailed to all 16 registered endodontists and 800 randomly selected GDPs in Hong Kong to explore their preference and reasons for selecting single- or multiple-visit endodontic treatment for their patients. Information on the use of magnifying loupes, microscopes and the number of years they have been in dental practice was also collected.

RESULTS

Eight endodontists and 429 GDPs returned their questionnaires and the response rate was 50% and 53.6% respectively. Among the GDPs, 404 (94.2%) undertook endodontic treatment in their practices. For those performing endodontic treatment, the mean number of years of practice was 23.6 ± 4.8 for endodontists and 15.3 ± 9.1 for GDPs. Seven endodontists (87.5%) used a surgical microscope. For GDPs, only 25 (6.2%) used a surgical microscope and 123 (30.4%) used magnifying loupes during endodontic treatment. Seven endodontists (87.5%) and 375 GDPs (92.8%) predominantly performed multiple-visit treatment. The commonest reasons for choosing multiple-visit treatment for both endodontists and GDPs were the positive effects of interappointment medications (n = 3, 37.5%) and that the tooth to be treated had doubtful prognosis (n = 103, 25.5%). The commonest reason for choosing single-visit treatment for both endodontists and general dentists was that treatment could be completed in one visit (n = 4, 50%) and (n = 127, 31.4%).

CONCLUSION

Most Hong Kong endodontists and GDPs preferred offering multiple-visit endodontic treatment.

Maximising response from GPs to questionnaire surveys: do length or incentives make a difference?

Background

General Practitioners (GPs) respond poorly to postal surveys. Consequently there is potential for reduced data quality and bias in the findings. In general population surveys, response to postal questionnaires may be improved by reducing their length and offering incentives. The aim of this study was to investigate whether questionnaire length and/or the offer of an incentive improves the response of GPs to a postal questionnaire survey.

Methods

A postal questionnaire survey was sent to 800 UK GPs randomly selected from Binley’s database; a database containing contact details of professionals working in UK general practices. The random sample of GPs was assigned to one of four groups of 200, each receiving a different questionnaire, either a standard (eight sides of A4) or an abbreviated (four sides of A4) questionnaire, with or without the offer of an incentive (a prize draw entry for a £100 voucher) for completion. The effects of questionnaire length and offer of incentive on response were calculated.

Results

Of 800 mailed questionnaires, 19 GPs did not meet inclusion criteria and 172 (adjusted response 22.0%) completed questionnaires were received. Among the four groups, response ranged from 20.1% (standard questionnaire with no incentive and abbreviated questionnaire with incentive) through 21.8% (standard questionnaire with incentive), to 26.0% (abbreviated questionnaire with no incentive). There were no significant differences in response between the four groups (p = 0.447), between the groups receiving the standard versus the abbreviated questionnaire (% difference -2.1% (95% confidence interval (CI) -7.9, 3.7)) or the groups offered an incentive versus no incentive (% difference -2.1% (95% CI -7.9, 3.7).

Conclusions

Strategies known to improve response to postal questionnaire surveys in the general population do not significantly improve the response to postal questionnaire surveys among GPs. Further refinements to these strategies, or more novel strategies, aimed at increasing response specifically among GPs need to be identified in order to maximise data quality and generalisability of research results.

Electronic supplementary material

The online version of this article (doi:10.1186/1471-2288-15-3) contains supplementary material, which is available to authorized users.

Post-approval evaluation of effectiveness of risk minimisation: methods, challenges and interpretation

Evaluation of the effectiveness of drug risk-minimisation measures is mandatory for both risk evaluation and mitigation strategies (REMS) in the United States and risk management plans in the European Union (EU-RMPs). Such evaluations aim to assess the impact of risk-minimisation measures on the knowledge, attitudes or behaviours of healthcare professionals or patients, the incidence of safety concerns, and their impact on the overall benefit-risk balance. Although many effectiveness evaluation models and methods are available, regulatory guidance and policy are still evolving. This paper considers evaluation strategies, challenges in evaluating risk minimisation post-authorisation, possible outcome measures and their interpretation, and potential emerging regulatory policy issues. Particular challenges include appropriate data collection, perceived and real burdens of performing evaluation on clinical practice, lack of comparators and benchmarking, and uncertainty about the best outcome measures.

Medical specialists' views on the impact of reducing alcohol consumption on prognosis of, and risk of, hospital admission due to specific medical conditions: results from a Delphi survey

RATIONALE, AIMS AND OBJECTIVES

To find consensus, or lack thereof, on the impact of reducing alcohol consumption on prognosis and the risk of hospital admissions for a number of alcohol-attributable disorders.

METHODS

A modified two-round Delphi survey utilizing web-based questionnaires to collect quantitative and qualitative data was used. Alcohol treatment experts from cardiology, emergency medicine, gastroenterology and oncology in the United Kingdom were invited to participate. The main outcomes were median impact ratings (on a scale of 1-9) and consensus (unanimous, strong, moderate, weak or no consensus).

RESULTS

Of 192 experts invited to participate, 59 completed first questionnaires. The overall retention rate to the second questionnaires was about 51% (30/59). There was strong support that reducing alcohol consumption could result in improvement in prognosis for gastroenterology and emergency medicine patients; but uncertainty on the benefits for cardiology and oncology patients. Overall, the responses from the expert panel did not reflect the assumption that reducing alcohol consumption would result in benefits on hospital admissions for any of the specialties. The specialists viewed the severity of disorders as important when considering the impact of reducing alcohol consumption.

CONCLUSIONS

The highest impact of treatment for problem drinking in hospitals is considered to be for alcohol-related disorders associated with gastroenterology and emergency medicine. At policy level, if targeted screening for alcohol problems by presenting disease or condition is the strategy of choice, it would be logical to implement screening and easily accessible interventions or addiction specialists within these areas where alcohol treatment is considered as having a high impact.