Does the feedback of blood results in observational studies influence response and consent? A randomised study of the Understanding Society Innovation Panel

Abstract

Background

While medical studies generally provide health feedback to participants, in observational studies this is not always the case due to logistical and financial difficulties, or concerns about changing observed behaviours. However, evidence suggests that lack of feedback may deter participants from providing biological samples. This paper investigates the effect of offering feedback of blood results on participation in biomeasure sample collection.

Methods

Participants aged 16 and over from a longitudinal study – the Understanding Society Innovation Panel—were randomised to three arms – nurse interviewer, interviewer, web survey – and invited to participate in biomeasures data collection. Within each arm they were randomised to receive feedback of their blood results or not. For those interviewed by a nurse both venous and dried blood samples (DBS) were taken in the interview. For the other two arms, they were asked if they would be willing to take a sample, and if they agreed a DBS kit was left or sent to them so the participant could take their own sample and return it. Blood samples were analysed and, if in the feedback arms, participants were sent their total cholesterol and HbA1c results.

Response rates for feedback and non-feedback groups were compared: overall; in each arm of the study; by socio-demographic and health characteristics; and by previous study participation. Logistic regression models of providing a blood sample by feedback group and data collection approach controlling for confounders were calculated.

Results

Overall 2162 (80.3% of individuals in responding households) took part in the survey; of those 1053 (48.7%) consented to provide a blood sample. Being offered feedback had little effect on overall participation but did increase consent to provide a blood sample (unadjusted OR 1.38; CI: 1.16–1.64). Controlling for participant characteristics, the effect of feedback was highest among web participants (1.55; 1.11–2.17), followed by interview participants (1.35; 0.99 –1.84) and then nurse interview participants (1.30; 0.89–1.92).

Conclusions

Offering feedback of blood results increased willingness to give samples, especially for those taking part in a web survey.

Background

It is good practice to feedback clinically relevant findings to study participants where the benefit outweighs any potential harm [1]. Moreover, it is increasingly recognised that even when results may not have clinical significance, participants may wish to know them to understand more about themselves [2]. In a number of empirical studies about why people take part in longitudinal health studies, among both existing participants and the general public, a key motivator is the provision of personalised health information [3,4,5]. When study participants themselves have been asked if they wish to receive feedback, the vast majority do. For example, in a qualitative follow up study of patients with diabetes who had received feedback as part of a trial, 99% said they wished to receive it [6]. In a general population cohort study, 95% of participants requested feedback when it was offered to them [7]. Equally, participants cite not receiving feedback as the reason they will not provide biological samples. In a previous wave of Understanding Society, which collected blood samples for storage and future measurement only, 12% of participants stated that their reason for not giving a blood sample was not receiving feedback, and the study had a lower rate of providing a blood sample than similar studies [8].

However, providing participants with their individual health results is challenging and costly to do well [1, 2]. There are sensitivities about feeding back clinically relevant data: participants can see it as a ‘free health check’ [7, 9], misunderstanding the nature of data being collected, which is generally analysed to research only standards and may not meet clinical standards [9]. If not understood by participants, this may lead to inappropriate decisions about their health in the future. Giving individual feedback, therefore, needs to be based on high quality and timely lab processes, should only be given if the medical benefit outweighs harm, should be done in ways that ensure participants do not over-interpret them, and ensures participants can seek appropriate advice if they are concerned [1, 2]. Ensuring such standards are achieved places considerable demands on the study team during data collection. In addition, for longitudinal observational studies, feeding back findings may change people’s behaviour [3, 4] altering the trajectories of measures over time [10].

What we do not know, however, is how feeding back clinically relevant findings may affect participation in longitudinal studies [11], although participants in one qualitative study said feedback would make them more likely to take part in future studies [6].

This paper investigates whether offering feedback from blood samples as part of an ongoing longitudinal study influenced participants’ willingness to give blood samples and to take part in the study overall, both at the wave the samples are taken and in the subsequent follow up wave. Secondly, it investigates whether feedback had a differential impact on consent to a blood sample in the different modes (web v interviewer v nurse interview) and based on the length of time a participant had been in the study. Finally, the paper explores whether different social and demographic groups respond differently to the offer of feedback.

Methods and Data

The Understanding Society Innovation Panel (IP) was set up in 2008, as an annual household survey, designed for experimental and methodological research relevant to longitudinal studies [12]. The initial sample was a stratified clustered sample of households in Great Britain south of the Caledonian Canal designed to be representative of the general population. Participants aged 16 and over who have not died, moved out of Great Britain or withdrawn from the study are invited to take part annually. To maintain a reasonable sample size, refreshment samples, selected in a similar way, were added at waves 4, 7, 10 and 11 [12]. The 12^th wave (IP12), conducted in 2019, focused on the collection of biomeasures [13]. A full protocol is set out here [14], but in brief, households eligible for IP12 (N = 2,401) were randomly allocated to three equal sized arms (mode): nurse interview, interviewer and web survey. Within each arm, households were randomly allocated into two equal groups to receive feedback or not. All household members aged 16 years or older were eligible for interview, and initially sent an advance letter inviting them to take part in the mode to which their household was allocated. Information about feedback was included in the participant information sheet, sent in advance of the interviews and identical for each mode of invitation: ‘During the interview we will ask you if you would like us to send you feedback on a couple of the lab results we will have obtained for you. If you would like feedback, we will provide this information once the labs have processed your sample’ [15].

Informed consent was obtained at two stages of the data collection process. Participants were sent information leaflets about the study with the invitation letter and invited to complete online or in person. Consent was assumed if they complete the online survey or took part in the in-person interviews. For blood samples, written consent forms were provided and signed copies were returned with the blood samples.

After six weeks, those allocated to a web survey but who had not taken part were followed up by an interviewer. After 15 weeks those allocated to the nurse, and after 12.5 weeks those allocated to an interviewer, who had not taken part, were offered a web survey (some opted for this earlier) and were also issued to interviewers to offer a final telephone interview. The telephone protocol was based on the web survey. Fieldwork took place between 11^th July and 24^th November 2019. Most feedback letters were sent in December 2019. However, some batches were not due to be sent until 2020 and then the laboratories closed due to the pandemic. However, all feedback was sent by July 2020 before the start of the next wave. The subsequent wave of the IP (Wave 13) took place between 14th July and 11th November 2020; given the COVID-19 pandemic this wave was conducted by web or telephone only [12].

Within the IP12 interview, participants were invited to provide a range of biomeasures [14]. For this paper we focus on the request to provide a blood sample. Participants allocated to a nurse were asked to give both venous (VBS) and dried blood samples (DBS) during the interview. In both cases the nurse, trained in venepuncture, took the blood samples after seeking written consent from the participant and checking for contraindications. For the venous blood the nurse posted the sample to the lab, for the DBS, the DBS card was left with the participant to dry before they returned it. In the interviewer mode, the interviewer explained to participants about the DBS, and if they consented, left a kit for them to take their own sample and return it. In the web survey participants were asked if they would like to carry out a blood test themselves and if so, a DBS kit was sent to them. In all modes, for those participants living in households randomly allocated to the feedback group, once the bloods had been processed, they were sent their total cholesterol and HbAlc results, and were advised to consult their GP if their results were above recommended cut-offs. All participants received a £5 voucher for returning their samples.

Our first hypothesis was that those offered feedback would be more likely to take part in the study overall, both in the current and subsequent wave, and be more likely to consent to blood sample collection. The second hypothesis was that feedback would have a bigger impact on participation where the burden of collection for the participant was higher, and the encouragement/support lowest (i.e., the impact on web interviews would be greater than on interviewers’ ones, and impact on the latter would be greater than on nurse interview). This would obviously be truer when examining the mode the participants took part in than the mode to which they were randomly allocated. We hypothesized that the longer a participant had been in the study the less effect offering feedback would have on their participation, as they are already committed to the Study. We did not have specific hypotheses for how feedback would influence participation among different social groups.

We compared the response rate to the overall survey for those offered feedback or not in IP12 (the biomarker wave) and IP13 (the subsequent wave). We then investigated in more detail consent to give blood samples by feedback group: and by mode arm both issued (random mode allocation) and actual mode. The latter includes those participants who switched modes and is not therefore random, although as noted above most participants took part in the mode to which they were initially allocated. Actual mode may better reflect the burden and encouragement the participant may have received to take part in this aspect of the study.

We wished to assess whether participants were willing to give blood, rather than whether it was actually possible to provide a sample. Given the collection processes described above, the best way of capturing this was slightly different for each way of collecting the blood. For the VBS this was based on the consent question, whether or not a sample was actually collected by the nurse, but for the DBS samples this was based on whether the consent form and sample were returned (since these happened in tandem) to the Study team. For simplicity these are described as consenting to give a sample. In addition, in the descriptive tables we also report on whether participants requested a DBS kit (which might indicate willingness), but this is not a primary focus as often they did not then proceed to give blood.

Eight covariates were included in the models, all collected in the same data collection: sex (male v female); age (grouped as < 30; 30 to < 50; 50 to < 70; 70 +); education as measured by qualifications obtained (grouped as degree or equivalent; GCSE and A-levels or equivalent; no qualifications or ‘other’); self-assessed health (grouped excellent and good v fair and poor); use of NHS in last 12 months as a hospital or clinic out-patient (none v at least once); country of residence (England, Wales or Scotland); whether in paid employment (yes v no); and, length of time in study (original sample; joined between waves 4 and 10; joined at wave 11).

Descriptive analyses were carried out to explore basic differences in response rates by feedback group. Logistic regression models were calculated to examine the difference feedback made to providing blood samples. Four separate models were calculated – one for each mode and one for the combined sample. Covariates were added in two separate groups – participant characteristics and time in study – and then combined. In the overall model an interaction between mode and feedback was included. Complete case analysis was undertaken as item missingness was small (5%). Analysis was carried out in the statistical software R.

Results

At IP12, 2401 households were eligible for inclusion, and at least one adult participated in 1408 (58.6%) households. Within participating households there were 2692 eligible adults and of these 2162 participants took part in a full interview (80.3%). The analytical sample is 2047 when cases with item missing data on the covariates are removed.

As shown in Table 1 most of the sample took part in their allocated mode. Only 32 participants initially assigned a nurse interview (4.5%) and 99 initially assigned an interviewer (15%) chose to take part in the web or telephone survey. While 209 participants initially allocated to the web-survey (26%) chose to be interviewed in person.

Table 1 Allocated and actual interview mode for the interviewed sample, IP12

At IP12 there was very little difference in the response rates overall between the group offered feedback in advance and those not offered feedback. Among eligible adults 80% (1117/1395) of those offered feedback took part, compared to 81% (1045/1297) in non-feedback households. A year later, in 2020, 2270 eligible IP12 participants were invited to take part in IP13. The IP13 response rate was marginally lower among those offered feedback in the previous wave (83.8%, n = 981/1171) than those not in the feedback group (84.5%, n = 929/1099).

Table 2 shows the sample characteristics of those who took part in IP12, comparing those allocated to the feedback and non-feedback groups. Overall, the characteristics of the feedback and non-feedback groups are very similar.

Table 2 Sample characteristics of IP12 participants in feedback and non-feedback arms

Table 3 describes the blood consent rate by feedback group and the allocated and actual modes. Of those who participated in IP12 52% of those offered feedback consented to give a blood sample, while 45% of those who were not offered feedback consented to give a blood sample(p = 0.002). This varied by actual mode. Those interviewed by nurse were much more likely to consent to give blood (via venous or DBS) and offering feedback only made a modest 1% difference to their blood consent rates. For those interviewed by an interviewer, while a high percentage of the non -feedback group asked for a DBS kit to be left with them (80% non-feedback group; 76% feedback group), only 36% of the non-feedback group and 43% of the feedback group returned a blood sample. Finally, for those that took part through a web survey, more than double the number of participants requested DBS kits as actually gave samples, with kits being requested by 58% of the non-feedback group and 63% of the feedback group, and blood samples being returned by 27% of the non-feedback group and 35% of the feedback group. Comparing rates of consenting to give a blood sample by the initial randomly allocated mode, showed very similar patterns. Those allocated to a nurse were much more willing to give blood, with feedback having a very modest effect, unsurprising given few participants allocated to a nurse swapped mode. For those allocated to an interviewer, offering feedback increased the willingness to give a blood sample by 10 percentage points (48% v 38%), while on the web, 33% of the feedback group gave blood sample and only 27% of the non-feedback group.

Table 3 Blood consent rates by allocated and actual mode of interview and feedback group

Table 4 shows the results of the logistic regression for consent to give a blood sample within each interview mode for both allocated and actual modes. With no covariates in the model, the feedback groups were more likely to give blood than the non-feedback groups. The top section of the table shows that this was highest in the group allocated to an interviewer (OR 1.57 (1.14 – 2.26)) and lowest among those allocated to a nurse (OR 1.26 (0.88 – 1.80)). Adjusting for participants characteristics or time in the Study made little difference to the impact of feedback on giving blood samples. The bottom section of Table 4 shows the association within the mode the participants actually took part. Again in all cases feedback groups had higher consent to give blood than those not offered feedback. The difference being highest for those who took part on the web. Adding covariates did not attenuate this. Comparing results between allocated and actual mode does reveal interesting comparisons. As might be expected, there was little difference in the effect of feedback between the allocated and actual mode for nurse interviews since 95% of those allocated to a nurse interview took part this way. However, there were differences for the other two modes. Feedback had less effect on those who actually took part with an interviewer than those allocated to one, and the opposite was true for the web; feedback had a bigger effect for those who took part by web than those allocated to it.

Table 4 Blood consent/provision rate by feedback group by allocated and actual mode, adjusting for IP12 characteristics

Table 5 shows the results of the logistic regression models for the full sample. With no covariates in the model those in the feedback group are 1.38 times more likely to give a blood sample, across the modes, than those who were not offered feedback. Actual mode, and switching mode were all significantly associated with giving blood. However, when the interactions between interview mode and feedback were included in the model the main effect for feedback became insignificant, reflecting the fact it only influenced participants willingness to give blood in the interviewer and web modes but not with a nurse. Adjusting for participant characteristics makes little differences to the odds ratio for being offered feedback. The only characteristic with a bigger impact on willingness to give blood was age, with those over 50 nearly twice as likely to give a blood sample as those under 30 years of age. Those with degrees or higher education (compared to those with less education) were also more likely to give blood. Time in the study had little impact on willingness to give a blood sample.

Table 5 Logistic regression models of consent to give blood, full sample, IP12

In the nurse led interview, participants who refused were asked why they did not give blood. Across both the feedback and non-feedback groups the main reason for not consenting was dislike of giving blood (about half of respondents in both feedback groups cited this as their reason). The other main reason given was that they had recently had a blood test or health check.

Discussion

In a longitudinal study, randomising offering feedback of blood samples to participants had a very small impact on their overall willingness to take part in the current or subsequent wave. However, it did have a significant impact on whether they gave a blood sample among the groups who took part via a web survey or with an interviewer, but not in those interviewed by a nurse. Older participants and those with more qualifications were also more likely to give blood than other groups.

We have found no other study that has empirically tested whether providing participants with feedback of their own health results influences their participation in the study. However, qualitative studies of participant’s views suggests that, while they would overwhelmingly like feedback, it does not affect their decision to take part in the study itself [6, 16]. Such studies have suggested that it may influence their willingness to take part in subsequent data collection [6], but we did not find this one year later. However, the uniqueness of 2020 because of the COVID-19 pandemic should be borne in mind.

With the increasing use of web surveys for data collection, evidence that feeding back results has the greatest impact on this group of participants is welcome. However, such forms of data collection place a greater burden on the study team to communicate effectively at all stages of the collection and feedback process as participants do not have contact with interviewers or nurses to answer queries and concerns. This study demonstrates that while interviewers did not collect samples themselves, they had higher rates of respondents requesting kits and later providing a blood sample, suggesting that the process of personal explanation and two-way communication may encourage participation. The highest rate of providing a blood sample and the least impact of offering feedback was among those interviewed by a nurse, which suggests nurse data collection may be sufficient without feedback. It may be that public respect and trust of nurses encourages all those willing and able to give blood to do so without any further incentive. There may be other ways of creating this trust without the use of nurse interviews, for example, having information in the web survey provided by medical practitioners or by having a nurse call participants to reassure them about the test and to encourage them to provide blood.

The differences in the impact of feedback between allocated and actual mode are interesting. Actual mode is a combination of those randomly allocated to the mode and those who choose to switch to it (web) or fail to take up the web survey and are followed up by an interviewer. This suggests that perhaps web participants are more personally motivated to engage with the survey, and feedback has the most impact on them. While adding those reluctant to take part by web to the interviewer group reduces the impact of feedback on providing a blood sample perhaps reflecting such participants are likely to be harder to engage more generally.

This study is the first to use a randomised design to investigate the effect of providing feedback on Study participation rates. It does, however, have some limitations. The sample size did not allow us to examine whether the effect of feedback varied for subgroups of the population beyond interview mode. As yet we do not know if the provision of feedback will change participants’ behaviours; qualitative research suggests it may [7], but the effect has not been quantified. However, we will be able to investigate this in future waves of the study.

Conclusions

In a randomised study providing feedback of health-related findings did not impact on overall participation but did impact on the proportion providing blood samples, especially for those participating by web. Given that understanding population health, within its social context, has never been more important, identifying ways of doing this that ensures the highest participation rates, especially with remote forms of data collection, is vital. This study suggests ensuring participants are provided with health-related findings will have a positive impact on response.