Skip to main content

‘Putting Life in Years’ (PLINY) telephone friendship groups research study: pilot randomised controlled trial

Abstract

Background

Loneliness in older people is associated with poor health-related quality of life (HRQoL). We undertook a parallel-group randomised controlled trial to evaluate the effectiveness and cost-effectiveness of telephone befriending for the maintenance of HRQoL in older people. An internal pilot tested the feasibility of the trial and intervention.

Methods

Participants aged >74 years, with good cognitive function, living independently in one UK city were recruited through general practices and other sources, then randomised to: (1) 6 weeks of short one-to-one telephone calls, followed by 12 weeks of group telephone calls with up to six participants, led by a trained volunteer facilitator; or (2) a control group. The main trial required the recruitment of 248 participants in a 1-year accrual window, of whom 124 were to receive telephone befriending. The pilot specified three success criteria which had to be met in order to progress the main trial to completion: recruitment of 68 participants in 95 days; retention of 80% participants at 6 months; successful delivery of telephone befriending by local franchise of national charity. The primary clinical outcome was the Short Form (36) Health Instrument (SF-36) Mental Health (MH) dimension score collected by telephone 6 months following randomisation.

Results

We informed 9,579 older people about the study. Seventy consenting participants were randomised to the pilot in 95 days, with 56 (80%) providing valid primary outcome data (26 intervention, 30 control). Twenty-four participants randomly allocated to the research arm actually received telephone befriending due to poor recruitment and retention of volunteer facilitators. The trial was closed early as a result. The mean 6-month SF-36 MH scores were 78 (SD 18) and 71 (SD 21) for the intervention and control groups, respectively (mean difference, 7; 95% CI, -3 to 16).

Conclusions

Recruitment and retention of participants to a definitive trial with a recruitment window of 1 year is feasible. For the voluntary sector to recruit sufficient volunteers to match demand for telephone befriending created by trial recruitment would require the study to be run in more than one major population centre, and/or involve dedicated management of volunteers.

Trial registration

ISRCTN28645428.

Peer Review reports

Background

Many older people live in social isolation, with those over the age of 65 and living in the UK twice as likely as other age groups to spend over 21 hours of the day alone [1]. Social isolation and loneliness are strongly correlated with poor physical and mental health outcomes and admission to residential care [2], while low levels of social engagement in older people are related to morbidity and mortality [3]. On the other hand, strong social networks are known to be protective of physical and mental health [46]. As a result, policy makers are encouraging the delivery of health promotion interventions to older people with the aim of compressing morbidity and increasing quality of life in the later years of life [712].

In 2008, the UK National Institute for Health and Clinical Excellence (NICE) highlighted shortcomings in the evidence (identified by systematic reviews) for interventions that promote mental wellbeing in older people [1113]. In particular, one review suggested that the most effective interventions were those conducted in a group with educational and/or supportive input [13]. As a result, the PLINY study was commissioned to establish whether a home-based intervention could improve or successfully maintain the mental wellbeing of older people living in the community with a focus upon those who are vulnerable and hard to reach. Qualitative research reported since the publication of the NICE guidance suggested that telephone befriending services promoted by two UK national charities “helped older people to gain confidence, re-engage with the community and become socially active” [14]. The authors’ recommendation, that initial one-to-one telephone calls with older people might be used to encourage participation in telephone clubs [15], echoed that of an earlier randomised controlled trial (RCT) conducted in the US [16]. It was these research findings which informed the design of the PLINY intervention, the evaluation of which we report here.

We undertook an RCT to evaluate the effectiveness and cost-effectiveness of a telephone befriending intervention compared with usual health and social care provision for the maintenance of health-related quality of life (HRQoL) in community-based older people. Telephone befriending is an example of a complex intervention, in that it has several interacting components [17]. As evaluation of complex interventions is challenging [17], and publicly funded trials often fail due to inadequate participant recruitment [18]; the UK National Institute for Health Research tend to commission RCTs with internal pilots to assess feasibility of the full or main study. In this paper, we report the results of the internal pilot trial and discuss the decision to stop the main trial early due to feasibility concerns. The dissemination of pilot trial results to inform the design and conduct of future studies is widely recommended [19, 20]. The results of our pilot study have utility, beyond underpinning further trials of telephone befriending, as they incorporate rarely documented issues with the delivery of health and social care interventions by the voluntary sector. This pilot trial does not attempt to provide evidence for the clinical effectiveness of telephone befriending for the maintenance of HRQoL in older people. For this reason, our findings are presented using the CONSORT 2010 checklist [21] (Additional file 1), but are also in conformity with proposed CONSORT-modifications for reporting the results of pilot studies and pragmatic trials [22, 23].

Methods

The protocol for the main trial, including the internal pilot, is available from the National Institute for Health Research (NIHR) website [24].

Trial design

This paper reports on the internal pilot trial of a parallel-group RCT with a 1:1 allocation ratio.

Participants and setting

Between June 2011 and December 2013, eighteen general practices sent brief study information and invitations to contact the research team to 9,051 people aged 75 years and over from their practice lists. Further invitations were sent to 528 participants of an existing longitudinal observational study who had consented to be contacted about further research [25]. A total of 2,000 recruitment packs containing similar invitations were issued to local NHS, social care and third sector organisations who agreed to distribute them; the number subsequently received by the target population is unknown.

Research assistants posted the participant information sheet to those who expressed an interest, and then telephoned respondents to arrange a screening visit, which was held in their own home. Those eligible for the study: (a) were aged 75 or over; (b) had good cognitive function, defined as Six Cognitive Impairment Test (6CIT [26]) score of 7 or under; (c) lived independently (alone or with others) or in sheltered housing; and (d) could converse in English. We excluded those who: (a) could not use a telephone even if provided with appropriate assistive technology; (b) lived in residential/nursing care homes; and (c) were already receiving telephone interventions. Those scoring 7 or more on the 6CIT were contacted by a clinically qualified member of the research team, informed of their score and advised to contact their general practitioner, and excluded from the study.

Interventions

After confirmation of eligibility and consent, we used a centralised web based randomisation service provided by the Sheffield Clinical Trials Research Unit central web-based randomisation service to allocate participants to either: (1) telephone befriending group intervention; or (2) a control group receiving no treatment as part of the study protocol. Participants in both groups continued to receive usual health and social care outside of the study protocol. The principal investigator and study statisticians were blinded to treatment allocation codes until the final analysis was complete.

The aim of the group intervention was to help older people maintain good mental health by increasing the extent of their social networks. The group intervention was preceded by using one-to-one telephone befriending to encourage participants to join telephone friendship groups [14]. The intervention was delivered by volunteers, with no previous experience of one-to-on befriending or group facilitation, who were recruited by a local franchise of a national UK charity dedicated to improving the lives of older people (Age UK), hereafter ‘the provider’. Following delivery of a standard induction programme for new volunteers, the provider’s Customer Engagement Manager then facilitated training in one-to-one befriending to groups of between two and seven volunteers in one session lasting between 1 and 2.5 hours. This initial training covered topics consisting of issues of confidentiality and equality, information about the research study, and training in making one-to-one calls. Training in group facilitation was then delivered to all volunteers by the same professional trainer who was experienced in this role. This training used standardised content developed for telephone friendship group facilitators working with Community Network, a national charity and social enterprise which supplies a range of commercial telephone services to the third sector. Up to five volunteers simultaneously received four 1-hour training sessions in group facilitation skills, delivered over Community Network’s teleconferencing system. Training involved using scenarios to teach volunteers how to facilitate cohesive groups thereby providing a safe and supportive environment for achieving group goals. It also entailed skills development to be able to intervene in the event of conflict or where the pre-defined participant ground-rules were broken [27]. The training was supported by a written manual for the volunteer befrienders. Community Network and the service provider harmonised their policies on confidentiality and safeguarding ‘clients’ for the purposes of study intervention delivery. To avoid cost to the volunteers and participants, one-to-one and group calls were made through the Community Network teleconferencing system and paid for by Age UK (National).

Initial one-to-one befriending involved 10- to 20-minute calls once per week for up to 6 weeks made by the volunteer befriender to an allocated participant. One-to-one calls aimed to familiarise the participant with the volunteer, conduct everyday conversation and prepare participants for the telephone friendship groups.

Subsequent friendship groups consisted of up to six participants and involved 1 hour teleconferences, at a pre-arranged time, once per week for 12 weeks facilitated by the same volunteer as had conducted one-to-one befriending. Friendship groups did not aim to induce behaviour change but to reduce social isolation by providing a safe environment for building relationships, sharing experiences, companionship and support, thereby maintaining participants’ sense of confidence and mental well-being.

Clinical outcomes

The primary clinical endpoint was the level of mental wellbeing at 6-months post-randomisation, measured using the Short Form (36) Health Instrument (SF-36) mental health (MH) dimension [28]. Secondary endpoints were: other dimensions of the SF-36 to measure functional health and well-being; subjective wellbeing, measured using the Office for National Statistics (ONS) approach [29]; health status, measured with the EuroQol 5-Dimension (EQ-5D) questionnaire [30]; symptoms of self-reported depression, using the Patient Health Questionnaire (PHQ-9) [31]; optimistic self-beliefs about the ability to cope with difficult life using the 10-item General Perceived Self Efficacy (GSE) scale [32]; overall, emotional, and social loneliness, using the 11-item De Jong Gierveld Loneliness Scale [33]; and a bespoke health and social care resource use questionnaire. A cost-effectiveness analysis was planned but, due to early closure of the main trial, was not undertaken [25]. In the absence of data on actual expenditure, a detailed breakdown of the provider and trainer budgets will appear in the NIHR monograph.

Sample size for the main trial

The SF-MH dimension is scored on a 0 (poor) to 100 (good health) scale, with between-group differences of between 5 and 10 points considered “clinically and socially relevant” [34]. In a general population survey of 3,084 community residents, the mean SF-36 MH score was 68.3 with an SD of 19.9 [35]. We assumed a correlation of 0.50 between the baseline and 6-month MH score, an average cluster size of six participants per telephone befriending group and an intra-cluster correlation (ICC) of 0.04, with a design effect of 1.28. With 80% power to detect a mean difference of eight points in 6-month MH scores and allowing for 20% loss to follow-up, the main trial required recruitment and randomisation of 124 people per arm (248 in total).

Feasibility criteria

The internal pilot study assessed two formal progression criteria. In order to continue the full trial to completion the trial team had to: (1) recruit a minimum of 68 participants in 95 days; and (2) collect valid primary outcome data for 56 (80%) of those recruited 6 months later. A third progression criterion, which was not defined in formal quantitative terms in the research protocol, was that the service provider should be able to recruit, train and retain enough volunteers to deliver the telephone friendship service. In order to match supply of service provision to demand for telephone befriending from participants, the research team contracted the service provider to recruit and train 50 volunteers over a 12-month window between March 2012 and February 2013. This number was intended to retain enough trained volunteers to facilitate twenty 12-week friendship groups for 124 participants between August 2012 and December 2013, notwithstanding unplanned absences and the high levels of volunteer attrition predicted by the literature [36, 37]. Because each four-session group facilitation training programme required a minimum of four people and cost £840, it was deemed particularly important that places were filled to ensure capacity for service delivery and efficient use of a finite training budget.

Randomisation

The randomisation sequence was generated in advance by a CTRU statistician who was not a member of the trial team, without stratification but using blocked randomization with randomly-selected block sizes.

Blinding

Neither participants nor outcome assessors were blind to treatment allocation. Trial statisticians and the chief investigator were blinded to the treatment allocation codes until after the final analysis. Data presented to the Trial Steering Committee and Trial Management Group did not identify treatment allocations.

Statistical methods

The early closure of the trial (see below) meant there was no opportunity to follow-up participants recruited from 1 October 2012. As participants randomised to the intervention arm from October 2012 onwards were unable to receive the intervention due to service provider capacity, the primary analysis used an ‘intention-to-treat’ data set. This included all participants randomised before that time plus one participant randomised thereafter who received the intervention due to another participant dropping out prior to receiving the intervention. The ‘per protocol’ data set contained all participants in the control group and participants in the intervention group who completed nine (75%) or more of the group telephone calls over the 12 weeks of group intervention.

As a pilot study, the analysis was largely descriptive and focused on confidence interval estimation and not formal hypothesis testing. Since the intervention is volunteer-led, we also used the data to estimate the ICC.

Baseline and socio-demographic characteristics were summarised and assessed for comparability between trial arms without formal testing of statistical significance [38, 39]. Data completeness, based on the primary outcome, is displayed in Figure 1.

Figure 1
figure 1

Flow of participants through the study. aOne withdrawn by Chief Investigator due to protocol violation relating to eligibility; two withdrew consent shortly after allocation (one unhappy with involvement of service provider; one felt the study was not for them); five withdrew consent at the point of arranging 6 month follow-up (one due to ill health; one no longer unhappy so did not want to take part; one unhappy with the intervention - at this point they had not received any calls; one other reason - unhappy with being left uninformed about lack of intervention; one due to personal or family issues); one not contactable (minimum of six telephone attempts and reminder letter sent). bOne withdrew consent at the point of arranging 6 month follow-up (unhappy with allocated study arm); one not contactable (line dead, letter and email reminder sent); one on 4 week holiday; two refused (one felt no different so did not want to answer the same questions again; one was too ill). cTwo participants no longer wanted intervention (one was too busy; one thought intervention was not for them) and one participant did not give any reason for intervention withdrawal. dAssigned to intervention group 4 but the volunteer dropped out before intervention delivery. eOne withdrew consent at the point of arranging 6 months follow-up (unhappy with study arm allocation); one not contactable (no dial tone, letter and email reminder sent); one on four week holiday; two refused (one felt no different so did not want to answer the same questions again; one felt too ill). fTwo no longer wanted intervention (one was too busy; one thought intervention was not for them); one did not give any reason for intervention withdrawal. gAssigned to intervention group 4 but intervention not delivered as volunteer dropped out. ITT, intention-to-treat.

We used a marginal general linear model (GLM) with robust standard errors, and an exchangeable correlation to compare the mean SF-36 MH scores from the treatment and control groups [40]. The GLM used Generalised Estimating Equations to estimate regression coefficients. The exchangeable correlation assumes individual outcomes in the same cluster (telephone friendship group) have the same correlation. Participants in the control group were treated as a cluster of size one in the analysis. A 95% CI for the between-arm difference in scores is reported. An adjusted analysis was also performed which included baseline covariates, such as age, sex and baseline SF-36 MH dimension score in the marginal GLM.

Secondary outcomes were analysed in the same way. Estimates of the critical parameters which would be used for a sample size calculation (SD, correlation between baseline and 6-month outcomes and the ICC) are reported.

Ethical approval

This study received ethics approval from South Yorkshire Research Ethics Committee.

Results

Participant recruitment and retention

The team received 298 inquiries about involvement in the trial, of which 275 (92%) were derived from postal invitation and 23 (8%) from other sources (see Figure 1). The first study progression target was met on 30 September 2012 by which time 70 participants had been randomised in the 95 days since recruitment began. As a result, recruitment continued and, between 28 June and 11 January 2012, a total of 157 participants were randomised. By the end of March 2013, the team had successfully followed up 80% (56/70) of the participants randomised before October 2012.

Delivery of the intervention

Between 17 May 2012 and 22 October 2012, the service provider received 42 expressions of interest from potential volunteers as a result of their advertising campaign and direct approaches. Thirty, however, did not follow up their initial expression of interest to commit to training for the role and, of the twelve who did commence training, only four commenced service provision. One of the four then dropped out due to ill health before delivering the group intervention. The eight who commenced training and then dropped out did so because they could not prioritise volunteering over other commitments including return to employment and fulltime education (n = 3), objected to the allocation of public money to the research team (n = 2), lacked confidence (n = 1), and grew tired of waiting for participant recruitment to start (n = 1). Reasons for discontinuation were not available from one volunteer. Over the same period, four 4-session group training programmes intended for 20 volunteers were conducted, but only 11 volunteers were trained. Lack of take-up meant that three further training programmes, intended to train 15 volunteers, were cancelled between August 2012 and January 2013. The number of days volunteers were retained by the service provider ranged from 12 days to 118 days (mean 62) between point of completing group training and the day they dropped out.

After up to 6 weeks of one-to-one befriending, three volunteers facilitated four 12-week groups (n = 24) between September 2012 and May 2013. However, one group received one-to-one befriending and group facilitation from different volunteers, due to the volunteer attrition described above. As a result of poor recruitment and retention of volunteers, by 17 January 2013, 55 out of 78 participants randomly allocated to the research arm had not been allocated a volunteer facilitator - that is, could not be treated per protocol. For these reasons, and after ruling out the availability of an alternative service provider, the Trial Management Group suspended recruitment to the main trial and made recommendations to the Trial Steering Committee. Shortly after, the funder recommended that the main trial should be terminated when 6-month follow-up was complete for the pilot cohort. These recommendations were accepted.

Participant characteristics

Tables 1 and 2 show the baseline demographic characteristics and participant reported outcome (PRO) scores for the SF-36, EQ-5D, PHQ-9, de Jong Gierveld scale, ONS well-being outcome and the general self-efficacy scale of the 70 subjects who were part of the internal pilot study. Overall, the two randomised groups were well matched with respect to baseline demographic characteristics.

Table 1 Participant baseline characteristics by randomised group (N = 70)
Table 2 Mean baseline participant reported outcomes by randomised group (N = 70)

Participant reported outcomes

By 6 months post-randomisation follow-up, 56 participants had valid primary outcome data (SF-36 MH Dimension) - 26 in the intervention group and 30 in the control group (Figure 2). The mean SF-36 MH score at 6 months post-randomisation was 77.5 (SD 18.4) in the intervention group and 70.7 (SD 21.2) in the control group, a mean difference of 6.5 (95% CI, -3.0 to 16.0) or 9.5 (4.5 to 14.5), adjusting for age, sex and baseline score (Table 3).

Figure 2
figure 2

Mean Short Form (36) (SF-36) Mental Health Dimension scores over time by randomised group.

Table 3 Mean 6 month post-randomisation follow-up participant reported outcomes by randomised group (N = 56)

Table 3 also shows that, for the secondary PROs such as the other dimensions of the SF-36, the differences in quality of life favoured the intervention group. For five dimensions (role physical, bodily pain, social functioning, physical component summary and mental component summary) after adjustment for baseline score, age and sex, the confidence interval excluded zero, suggesting a non-zero effect. There were no differences in mean scores between the intervention and control groups, observed for the other PROs except for the ONS wellbeing total score.

The results for the primary outcome were robust to missing data in sensitivity analyses, with all imputation methods producing similar results (Table 4 and Figure 3). Only 35% (9/26) of intervention group participants who had valid 6-month outcome data completed 75% or more of the group intervention telephone calls and were entered in the per-protocol analysis. Six months after randomisation, there was a mean difference in the SF-36 MH score of 3.2 (95% CI, -5.2 to 11.6), or 8.0 (3.3 to 12.7) after adjustment for age, sex and baseline score.

Table 4 Mean observed and imputed 6-month post-randomisation follow-up SF-36 MH outcomes by randomised group (N = 70)
Figure 3
figure 3

Forest plot of sensitivity analysis of mean difference in Short Form (36) Health Instrument (SF-36) mental health outcome between groups. LOCF, last observation carried forward; PMM, predictive mean matching.

The estimated ICC from the marginal model for the primary outcome was -0.06 indicating little if any clustering by facilitator; the correlation between baseline and 6 months MH scores was 0.78.

Discussion

This internal pilot trial demonstrated that the trial team could recruit 0.74 participants per day over a 3-month period and collect valid primary outcome data for 80% of randomised participants, rates which fulfilled pre-specified success criteria. It also established that local charitable providers do not necessarily have the resources to match service demand that exceeds what they would usually respond to. The trial was closed early when targets for recruitment and training of volunteer interventionists, built into the subcontract between the University and the service provider, were unmet, leaving 55/78 (70%) of participants randomised to the intervention unable to receive it more than 3 months after randomisation.

The adjusted, between-arm mean difference (9.5; 95% CI, 4.5 to 14.5 points) in the primary outcome (SF-36 MH score at 6 months) is within the 5 to 10 point range defined by the instrument developers as “clinically and socially relevant” [34], but must be treated with caution. The lack of statistical power, the small number of intervention arm participants who received the intervention per protocol, the method of recruitment which was reliant upon individuals opting in and the possibility of resentful demoralisation [41] of control arm participants not blinded to their allocation, all make this estimate of effect problematic for decision-making purposes.

The participant consent rate was 1.6% of those approached about the study, which is in line with rates achieved in other studies evaluating preventive interventions in middle-aged and older populations within the region [14, 42]. The same studies also confirm that opt-in recruitment for the purposes of research studies using targeted mail-outs is more reliable than direct referral by health and social care professionals or third sector agencies, if potentially less externally valid. Levels of participant self-efficacy that are high and levels of loneliness that are low, when compared with population norms [43, 44], and low uptake rate presents the possibility of participant bias, where the target population for preventive services does not get involved in the RCTs which evaluate them [45, 46]. The 20% attrition rate is at the margin of acceptability [47]; comorbidity, exhaustion, and respondent burden frequently result in rates of 20% and 30% in RCTs evaluating health promotion interventions in community-dwelling older people [48].

A strength of our study is that volunteers received standardised training and delivered an intervention that is manualised and therefore more reproducible than most interventions intended to ameliorate social isolation or loneliness [49]. In line with the Medical Research Council Framework [17], a process evaluation, nested within the trial to assess intervention fidelity and quality of implementation, will be published in the NIHR monograph series. The problems experienced by the service provider with the recruitment and retention of volunteers are well-documented in research papers on volunteer management. The retention of volunteers can be affected by personal and organisational factors. The evidence that demographic and psychometric variables are associated with volunteer adherence to work programmes is often weak or contradictory; the factors most strongly associated with retention are educational achievement, prior voluntary experience and life-course stability [36, 37]. Policies which require recipients of state benefits to be available for paid work, or which sanction participation by those perceived as ‘workshy’ are thought by some researchers to be creating barriers to sustained volunteering [50]. Two volunteers dropped out of our programme due to pressure to take paid work. Organisational factors are often cited as drivers of volunteer attrition [36, 51, 52]. Sufficient support to ensure that volunteers are comfortable with their role and its procedures [36, 5255], with a professional volunteer co-ordinator dedicated wholly to the programme, is essential [16]. Volunteers also frequently cite ongoing training as a motivation for programme adherence [36, 53, 54, 56]. More generally, congruence between the goals and ideals of the volunteers and those of the voluntary sector organisations for which they work are thought to promote adherence [36]. The only trial of which we are aware which documented recruitment and attrition of volunteers to deliver a befriending intervention recorded 60/124 (48%) of those expressing interest completing training and 49/60 (82% of those trained) delivering the intervention, compared to 11/42 (26%) and 3/11 (27%), respectively, in our study [57]. Reasons for volunteer attrition were not reported. Unlike in our study, volunteers were recruited and hosted by more than one type of organisation, and resource was available to employ dedicated volunteer co-ordinators, jointly managed by the ‘host’ organisations and the research team. Those wishing to recruit rapidly and retain large numbers of volunteers to telephone befriending programmes should consider using either charitable providers in multiple population centres or outsourcing the work of volunteer recruitment and management to commercial or (where available) state providers.

Our trial adds to tentative evidence that community befriending interventions may be effective in the preservation of good mental health. One systematic review found that, compared with usual care or no treatment, befriending demonstrated small but significant effects on self-reported symptoms of depression in nine studies, five of which followed up for 12 months or more [58]. However, the results should be interpreted with caution as the review authors acknowledged the possibility of publication bias in their work, and only half of the included studies evaluated befriending by lay volunteers, as in our trial. A second systematic review evaluated interventions to reduce loneliness and social isolation in older people [59], including two randomised evaluations of telephone interventions [16, 60], and one of a combination one-to-one/group programme like that evaluated in this paper [61]. Whilst the quality of most of the included studies was poor, the review concluded that effective interventions had a theoretical basis and offered “social activity and/or support within a group format” [59]. A third systematic review synthesised the results of RCTs evaluating four strategies to reduce loneliness and social isolation [62]. The conclusion drawn was that social cognitive training interventions yielded greater effect sizes than trials of interventions to enhance social support, improve social skills, or increase opportunities for social interaction, and is unlikely to have applicability to volunteer-led interventions. Its formal analysis, showing that a group-based format was not found to be an effective modifier, is likely to be an artefact of the number of professionally-delivered one-to-one interventions included in the review.

The need for well-conducted studies evaluating theoretically informed, manualised interventions to alleviate loneliness and reduce social isolation in older people remains [49]. Services commissioned especially for research studies are likely to encounter the same issues with matching service supply to demand as demonstrated through our study [15]. The natural tendency of many local voluntary sector organisations may be to deliberately regulate demand for their services based on the resources available to them, resulting in ‘trickle’ recruitment of both volunteers and clients based on self-referral [63]. Ideally services with well-established and effective processes for volunteer recruitment and management systems should be identified to ensure the feasibility of large-scale evaluation. There may also be an argument for non-randomised evaluations if there are significant concerns that trial participants are systematically different from those who would take up the offer of an intervention outside the context of a randomised trial.

Conclusions

It is feasible to recruit and retain participants aged 75 years or more for an RCT evaluating a volunteer-led telephone friendship group intervention for the maintenance of good mental health. Failure to deliver the intervention at scale led to the early termination of the trial. Future studies should focus on theoretically-based, manualised interventions delivered by service providers with track record of rapidly recruiting and managing large numbers of volunteers. Commissioners of volunteer-led services should be aware that, even where part-time, paid volunteer co-ordinators exist, volunteer recruitment and retention represent a significant management challenge, and such services cannot always be scaled up quickly.

Abbreviations

6CIT:

Six Cognitive Impairment Test

EQ-5D:

EuroQol 5-Dimension

GLM:

general linear model

GSE:

General Perceived Self Efficacy

HRQoL:

health-related quality of life

ICC:

intra-cluster correlation

MH:

Mental Health

NICE:

National Institute for Health and Clinical Excellence

NIHR:

National Institute for Health Research

ONS:

Office for National Statistics

PHQ:

Patient Health Questionnaire

PRO:

participant reported outcome

RCT:

randomised controlled trial

SF-36:

Short Form (36) Health Instrument.

References

  1. Concern A: Promoting Mental Health and Wellbeing in Later Life: a first report into the UK enquiry into mental health and Wellbeing in later life. 2006, London: Age Concern and Mental Health Foundation

    Google Scholar 

  2. Wenger GC, Davies R, Shahtahmasebi S, Scott A: Social isolation and loneliness in old age: review and model refinement. Ageing Soc. 1996, 16: 333-358. 10.1017/S0144686X00003457.

    Article  Google Scholar 

  3. Glass TA, De Leon CM, Marottoli RA, Berkman LF: Population based study of social and productive activities as predictors of survival among elderly Americans. BMJ. 1999, 319: 478-483. 10.1136/bmj.319.7208.478.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Cohen S, Gottlieb B, Underwood L: Social relationships and health. Social Support Measurement and Intervention. Edited by: Cohen S, Underwood L, Gottlieb B. 2000, Oxford: Oxford University Press, 3-25.

    Chapter  Google Scholar 

  5. Bell R, LeRoy J, Stephenson J: Evaluating the mediating effects of social support upon life events and depressive symptoms. J Community Psychol. 1982, 10: 325-340. 10.1002/1520-6629(198210)10:4<325::AID-JCOP2290100405>3.0.CO;2-C.

    Article  CAS  PubMed  Google Scholar 

  6. Cohen S, Wills TA: Stress, social support, and the buffering hypothesis. Psychol Bull. 1985, 98: 310-357.

    Article  CAS  PubMed  Google Scholar 

  7. World Health Organization: Active Ageing: A Policy Framework. 2002, Geneva: World Health Organization, 1-60.

    Google Scholar 

  8. Godfrey M, Townsend J, Denby T: Building a Good Life for Older People in Local Communities. 2004, York: Joseph Rowntree Foundation

    Google Scholar 

  9. Social Exclusion Unit: A Sure Start to Later Life; Ending Inequalities for Older People. 2006, London: OPDM

    Google Scholar 

  10. Swartz A: James Fries: healthy aging pioneer. Am J Public Health. 2008, 98: 1163-1166. 10.2105/AJPH.2008.135731.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Windle G, Hughes D, Linck P, Morgan R, Burholt V, Edwards RT, Reeves C, Yeo ST, Woods R, Russell I: Public Health Interventions to Promote Mental Well-Being in People Aged 65 and Over: Systematic Review of Effectiveness and Cost-Effectiveness. 2007, Bangor: University of Wales

    Google Scholar 

  12. National Institute for Health and Clinical Excellence: Guidance on Occupational Therapy and Physical Activity Interventions that Promote Good Health and Wellbeing in Older People. 2008, London: NICE

    Google Scholar 

  13. Cattan M, White M, Bond J, Learmouth A: Preventing social isolation and loneliness among older people: a systematic review of health promotion interventions. Ageing Soc. 2005, 25: 41-67. 10.1017/S0144686X04002594.

    Article  Google Scholar 

  14. Cattan M, Kime N, Bagnall AM: The use of telephone befriending in low level support for socially isolated older people - an evaluation. Health Soc Care Community. 2011, 19: 198-206.

    PubMed  Google Scholar 

  15. Cattan M, Kime N, Bagnall AM: Low-level support for socially isolated older people: An evaluation of telephone befriending. 2008, Leeds, UK: Age UK Centre for Health Promotion Research, Leeds Metropolitan University, 1-107.

    Google Scholar 

  16. Heller K, Thompson MG, Trueba PE, Hogg JR, Vlachos-Weber I: Peer support telephone dyads for elderly women: was this the wrong intervention?. Am J Community Psychol. 1991, 19: 53-74. 10.1007/BF00942253.

    Article  CAS  PubMed  Google Scholar 

  17. Medical Research Council: Developing and Evaluating Complex Interventions: New Guidance. 2013, London: MRC

    Google Scholar 

  18. McDonald A, Knight R, Campbell M, Entwistle V, Grant A, Cook J, Elbourne DR, Francis D, Garcia J, Roberts I, Snowdon C: What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006, 7: 9-10.1186/1745-6215-7-9.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Arain M, Campbell M, Cooper C, Lancaster G: What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Med Res Methodol. 2010, 10: 67-10.1186/1471-2288-10-67.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Fain JA: Should we publish pilot/feasibility studies?. Diabetes Educ. 2010, 36: 521-10.1177/0145721710379355.

    Article  PubMed  Google Scholar 

  21. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c389-

    Article  Google Scholar 

  22. Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, Robson R, Thabane M, Giangregorio L, Goldsmith CH: A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010, 10: 1-10.1186/1471-2288-10-1.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, Oxman AD, Moher D: Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008, 337: a2390-10.1136/bmj.a2390.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Mountain G: PHR - Funded projects: Putting Life in Years (PLINY): evaluation of the effectiveness and cost effectiveness of an intervention to promote mental wellbeing in community living older people.http://www.nets.nihr.ac.uk/projects/phr/09300401,

  25. Relton C, Bissell P, Smith C, Blackburn J, Cooper C, Nicholl J, Tod A, Copeland R, Loban A, Chater T, Thomas K, Young T, Weir C, Harrison G, Millbourn A, Manners R: South Yorkshire Cohort: a cohort trials facility’ study of health and weight - protocol for the recruitment phase. BMC Public Health. 2011, 11: 640-10.1186/1471-2458-11-640.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Brooke P, Bullock R: Validation of a 6 item cognitive impairment test with a view to primary care usage. Int J Geriatr Psychiatry. 1999, 14: 936-940. 10.1002/(SICI)1099-1166(199911)14:11<936::AID-GPS39>3.0.CO;2-1.

    Article  CAS  PubMed  Google Scholar 

  27. Corey MS, Corey G: Groups: Process and Practice. 1997, Pacific Grove, California: Brooks/Cole Publishing Company

    Google Scholar 

  28. Maruish ME: User’s Manual for the SF-36v2 Health Survey. 2011, Lincoln, RI: QualityMetric Incorporated

    Google Scholar 

  29. Tinkler L, Hicks S: Measuring Subjective Well-being. 2011, London: Office for National Statistics

    Google Scholar 

  30. Brazier J, Ratcliffe J, Salomon JA, Tsuchiya A: Measuring and Valuing Health Benefits for Economic Evaluation. 2007, Oxford: OUP

    Google Scholar 

  31. Spitzer RL, Kroenke K, Linzer M, Hahn SR, Williams JB, de Gruy FV, Brody D, Davies M: Health-related quality of life in primary care patients with mental disorders. JAMA. 1995, 274: 1511-1517. 10.1001/jama.1995.03530190025030.

    Article  CAS  PubMed  Google Scholar 

  32. Schwarzer R, Jerusalem M: Generalised self-efficacy. Measures in Health Psychology: A User’s Portfolio. Causal and Control Beliefs. Edited by: Weinman J, Wright S, Johnston M. 1995, Windsor, UK: NFER-Nelson, 35-37.

    Google Scholar 

  33. de Jong-Gierveld J, Kamphuls F: The development of a Rasch-type loneliness scale. Appl Psychol Meas. 1985, 9: 289-299. 10.1177/014662168500900307.

    Article  Google Scholar 

  34. Ware JEJ, Snow KK, Kosinski M, Gandek B: SF-36 Health Survey Manual and Interpretation Guide. 1993, Boston, MA: The Health Institute, New England Medical Centre

    Google Scholar 

  35. Walters SJ, Munro JF, Brazier JE: Using the SF - 36 with older adults: a cross - sectional community - based survey. Age Ageing. 2001, 30: 337-343. 10.1093/ageing/30.4.337.

    Article  CAS  PubMed  Google Scholar 

  36. Locke M, Ellis A, Smith JD: Hold on to what you’ve got: the volunteer retention literature. J Soc Ser Res. 2003, 20: 73-97.

    Google Scholar 

  37. Smith K, Cordery CJ: What Works? A Systematic review of research and evaluation literature on encouragement and support of volunteering. 2011, Wellington, NZ: Social Science Electronic Publishing

    Google Scholar 

  38. Pocock SJ, Assmann SE, Enos LE, Kasten LE: Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practice and problems. Stat Med. 2002, 21: 2917-2930. 10.1002/sim.1296.

    Article  PubMed  Google Scholar 

  39. Senn S: Testing for baseline balance in clinical trials. Stat Med. 1994, 13: 1715-1726. 10.1002/sim.4780131703.

    Article  CAS  PubMed  Google Scholar 

  40. Walters SJ: Quality of Life Outcomes in Clinical Trials and Health-Care Evaluation: a Practical Guide to Analysis and Interpretation. 2009, Oxford: Wiley

    Book  Google Scholar 

  41. Bradley C: Designing medical and educational intervention studies: a review of some alternatives to conventional randomized controlled trials. Diabetes Care. 1993, 16: 509-518. 10.2337/diacare.16.2.509.

    Article  CAS  PubMed  Google Scholar 

  42. Scott E, Dimairo M, Hind D, Goyder E, Copeland R, Breckon J, Crank H, Walters SJ, Loban A, Cooper CL: “Booster” interventions to sustain increases in physical activity in middle-aged adults in deprived urban neighbourhoods: internal pilot and feasibility study. BMC Public Health. 2011, 11: 129-10.1186/1471-2458-11-129.

    Article  PubMed  PubMed Central  Google Scholar 

  43. de Jong-Gierveld J, Tilburg TV: Manual of the Loneliness Scale. 1999, VU University: Faculty of Social Sciences, Department of Sociology, 1

    Google Scholar 

  44. Scholz UG, Benicio GD, Sud S: R Schwarzer: is general self-efficacy a universal construct? Psychometric findings from 25 countries. Eur J Psychol Assess. 2002, 18: 242-251. 10.1027//1015-5759.18.3.242.

    Article  Google Scholar 

  45. Martinson BC, Crain AL, Sherwood NE, Hayes MG, Pronk NP, O’Connor PJ: Population reach and recruitment bias in a maintenance RCT in physically active older adults. J Phys Act Health. 2010, 7: 127-135.

    PubMed  PubMed Central  Google Scholar 

  46. DiMartino LD, Hammill BG, Curtis LH, Gottdiener JS, Manolio TA, Powe NR, Schulman KA: External validity of the cardiovascular health study: a comparison with the Medicare population. Med Care. 2009, 47: 916-923. 10.1097/MLR.0b013e318197b104.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Schulz KF, Grimes DA: Sample size slippages in randomised trials: exclusions and the lost and wayward. Lancet. 2002, 359: 781-785. 10.1016/S0140-6736(02)07882-0.

    Article  PubMed  Google Scholar 

  48. Ferrucci L, Guralnik JM, Studenski S, Fried LP, Cutler GB, Walston JD: Designing randomized, controlled trials aimed at preventing or delaying functional decline and disability in frail, older persons: a consensus report. J Am Geriatr Soc. 2004, 52: 625-634. 10.1111/j.1532-5415.2004.52174.x.

    Article  PubMed  Google Scholar 

  49. Windle K, Francis J, Coomber C: Preventing Loneliness and Social Isolation: Interventions and Outcomes. 2011, London: Social Care Institute for Excellence, 1-16.

    Google Scholar 

  50. Lister R: The dilemmas of pendulum politics: balancing paid work, care and citizenship. Econ Soc. 2002, 31: 520-532. 10.1080/0308514022000020661.

    Article  Google Scholar 

  51. Gaston K, Alexander J: Effective organisation and management of public sector volunteer workers: police special constables. Int J Public Sector Manag. 2001, 14: 59-74. 10.1108/09513550110387075.

    Article  Google Scholar 

  52. Hidalgo MC, Moreno P: Organizational socialization of volunteers: the effect on their intention to remain. J Community Psychol. 2009, 37: 594-601. 10.1002/jcop.20317.

    Article  Google Scholar 

  53. Bussell H, Forbes DL: The volunteer life cycle: a marketing model for volunteering. Volunt Action. 2003, 5: 61-79.

    Google Scholar 

  54. Dennis CL: Breastfeeding peer support: maternal and volunteer perceptions from a randomized controlled trial. Birth. 2002, 29: 169-176. 10.1046/j.1523-536X.2002.00184.x.

    Article  PubMed  Google Scholar 

  55. Stirling C, Kilpatrick S, Orpin P: A psychological contract perspective to the link between non-profit organizations’ management practices and volunteer sustainability. Human Res Dev Int. 2011, 14: 321-336. 10.1080/13678868.2011.585066.

    Article  Google Scholar 

  56. Fahey C: Training can be a recruitment and retention tool for emergency service volunteers. Aus J Emergency Manag. 2002, 17: 3-7.

    Google Scholar 

  57. Charlesworth G, Shepstone L, Wilson E, Reynolds S, Mugford M, Price D, Harvey I, Poland F: Befriending carers of people with dementia: randomised controlled trial. BMJ. 2008, 336: 1295-1297. 10.1136/bmj.39549.548831.AE.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Mead N, Lester H, Chew-Graham C, Gask L, Bower P: Effects of befriending on depressive symptoms and distress: systematic review and meta-analysis. Br J Psychiatry. 2010, 196: 96-101. 10.1192/bjp.bp.109.064089.

    Article  PubMed  Google Scholar 

  59. Dickens AP, Richards SH, Greaves CJ, Campbell JL: Interventions targeting social isolation in older people: a systematic review. BMC Public Health. 2011, 11: 647-10.1186/1471-2458-11-647.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Evans RL, Jaureguy BM: Phone therapy outreach for blind elderly. Gerontologist. 1982, 22: 32-35. 10.1093/geront/22.1.32.

    Article  CAS  PubMed  Google Scholar 

  61. Drentea P, Clay OJ, Roth DL, Mittelman MS: Predictors of improvement in social support: five-year effects of a structured intervention for caregivers of spouses with Alzheimer’s disease. Soc Sci Med. 2006, 63: 957-967. 10.1016/j.socscimed.2006.02.020.

    Article  PubMed  Google Scholar 

  62. Masi CM, Chen HY, Hawkley LC, Cacioppo JT: A meta-analysis of interventions to reduce loneliness. Pers Soc Psychol Rev. 2011, 15: 219-266. 10.1177/1088868310377394.

    Article  PubMed  Google Scholar 

  63. Cattan M: Preventing Social Isolation and Loneliness Among Older People. 2010, Saarbrucken: Lambert Academic Publishing

    Google Scholar 

Download references

Acknowledgements

This project was funded by the Public Health Research programme (PHR 09/3004/01) and will be published in full in the Public Health Research journal series. Further information available at: http://www.nets.nihr.ac.uk/projects/phr/09300401. This report presents independent research commissioned by the NIHR. The views and opinions expressed by authors in this publication are those of the authors and do not necessarily reflect those of the NHS, the NIHR, MRC, CCF, NETSCC, the Public Health Research programme or the Department of Health. We thank 157 generous participants who offered us their time. We would like to acknowledge the support of the people, too numerous to mention, from Sheffield community groups, health and social care organisations, who facilitated participant recruitment to the study. We would also like to acknowledge the technical, procedural and moral support of: Professor Jon Nicoll, University of Sheffield; James Goodwin, Age UK; Julie Howe, Sheffield Expert Elders; Mike Bradburn, Tim Chater, Amanda Loban, Karen Beck, Lauren O’Hara, Sheffield CTRU; Mark Berkeley, RNIB for information concerning the Talk and Support telebefriending scheme; and Pat Linck for advice on administering the REMCARE health and social care resource use questionnaire. The following members of the Trial Steering Committee also provided invaluable expertise and advice throughout: Yvonne Birks (Chair), Deputy Director York Trials Unit, University of York; Louise Robinson, Professor of Primary Care and Ageing, Newcastle University; Chris Armitage, Professor of Health Psychology, University of Manchester; Joan Hubbard, Sheffield Expert Elders.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniel Hind.

Additional information

Competing interests

Community Network is a national charity and social enterprise which runs telephone friendship groups and a commercial teleconferencing service for the third sector which could be perceived as having influenced contributions to the report.

Authors’ contributions

GAM was the chief investigator and conceived of the study. GAM, DH, SJW and RG-W drafted the manuscript. GAM, SJW, DH, AB, MC, CC, RTE and ECG designed the study. RG-W was the study co-coordinator and, with RD, conducted qualitative research interviews. The trial management group were GAM, RG-W, SJW, DH, AB, MC, CC, RTE, AC, CJ and ECG together with Julia Howe of the Sheffield Expert Elder Network, James Goodwin of Age UK, and Kath Horner of NHS Sheffield. The trial management group together with RD and LN and Lauren O’Hara (Sheffield CTRU) helped to implement the study on a day-to-day basis. SJW, supported by Alex Hayman and Ellen Lee, was the study statistician and contributed to the statistical analysis plan and undertook (with SR) the statistical analysis. All authors read, commented on and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mountain, G.A., Hind, D., Gossage-Worrall, R. et al. ‘Putting Life in Years’ (PLINY) telephone friendship groups research study: pilot randomised controlled trial. Trials 15, 141 (2014). https://doi.org/10.1186/1745-6215-15-141

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1745-6215-15-141

Keywords