A co-produced method to involve service users in research: the SUCCESS model
BMC Medical Research Methodology volume 19, Article number: 34 (2019)
Public and patient involvement is a routine element of health services research methods to produce better designed and reported studies. Although co-production is recommended when involving people in research, methods for involving people are usually designed and managed by researchers and there is little evidence about methods to co-produce models for effective public and patient involvement. We report the method used by a group of patient and carer service users to develop and implement a model for involving public members in research.
We recruited people with experience of chronic conditions, as patients and carers, and supported them to develop and implement the involvement model. We collected written records to describe the processes of co-production.
Sixteen service users were involved through a series of workshop, meeting and email discussions. They specified principles and operating characteristics of the model which concerned an inclusive culture, adequate resources, accessibility, good communication and clarity of purpose and roles. Components of the model included an on-line Panel of members (n = 20), Steering Group meetings, representation and communication system, facilitator, supportive research environment and access to research activities. Over 8 years, members were active in 218 research activities and held 22 Steering Group meetings. The model was named SUCCESS standing for Service Users with Chronic Conditions Encouraging Sensible Solutions.
We supported patients and carers to co-produce the SUCCESS model of involvement in research. The model’s components, addressing their needs and priorities, led to sustained involvement in research over 8 years. Further work is needed to apply the model in different settings and assess impact of this method of involving people in research.
Public and patient involvement is a routine element of health services research in order to make research more accountable, rigorous and relevant [1,2,3,4]. There is evidence that research methods planned and implemented in partnership with patients and public members produce better designed and reported studies [5, 6]. Involving patients and public members in designing and carrying out studies and disseminating findings is seen as a way to narrow the gap between patient and clinician priorities, to change the focus of intervention development and implementation [7,8,9,10] and to improve implementation of evidence-based findings . The National Institute for Health Research (NIHR) expects researchers to demonstrate public involvement in proposals seeking NIHR funding in order to enhance research quality . The UK goal is for all patients and more public members to be aware of and involved in research by 2025 . Researchers are increasingly following this method of designing and undertaking research and the number of studies which involve public members is steadily rising [14, 15].
Meaningful public involvement in research is best achieved by collaboration, where research is co-produced by public and patient members working within research teams, or by service user-led approaches [1, 16, 17]. The aim is to enable insight, derived from people’s experiences of a health condition or care service, to shape the questions which are defined and how they are studied by research teams [5, 18, 19]. This fits the definition of active involvement, as research carried out ‘with’ or ‘by’ members of the public, rather than ‘to’, ‘about’ or ‘for’ them .
Methods for involving patients and public members in research are usually designed and managed by researchers who have access to guidance and others’ experience about how to achieve collaborative working [1, 20, 21]. To achieve active involvement, researchers are encouraged to consider how to support access to meetings and information and how to build relationships with public and patient members, so their involvement can be as effective as possible . Patients and public members joining research teams generally follow an involvement process without the opportunity to influence the method of research co-production. A commonly used approach is to involve two individuals in groups undertaking research development, study management and study oversight . Some research teams seek public and patient views on an individual study through a separate public or patient advisory group, instead or as well [18, 19, 23], but involving patient and public members across a programme of research is uncommon [24,25,26].
In contrast to the emphasis on co-production of research, little is written about methods to co-produce models for effective public and patient involvement. Rich descriptions of how involvement groups operate over time and how public members co-produce training to support their involvement are available [24, 27,28,29,30].However, these lack reproducible detail about how the groups were developed and the role of public members.
We aimed to identify a group of patients and carers to be involved in research and to support this group to define and establish structures and processes of working which they believed would best enable them to be involved in research. We believed this co-production approach would increase the number of public members involved in our research and improve the experience, for public and researcher collaborators. We also anticipated it would give research teams access to a wider range of patient and carer experiences to inform research development and implementation. This paper reports the method used by a group of patients and carers to develop and implement a model of involving public members in research over an 8 year period.
Within practice and discussion of involvement, one of the complexities is the language used to name the individuals and roles. When reporting our study, we use the term ‘service user’ to describe people who use health and care services as patients, former patients, prospective patients and people who care for others [1, 29, 31].
We (HS with BAE and AP) were commissioned by the Welsh Government to evaluate implementation of the Chronic Conditions Policy in Wales  and wanted service users to be involved with this work. We did not have a preconceived idea about how to achieve this but wanted to establish a collaborative working relationship within the research team . We obtained funding for 1.5 days per week of researcher time over 2 years to recruit service users, hold an initial workshop meeting and also to support the service users through the process of developing and implementing their involvement model. The funding also enabled us to reimburse expenses incurred by individuals and to offer an honorarium . We offered an honorarium at the then-recommended rate of £65/half day or £130/day and reimbursed travel expenses, petrol costs and meals. We also covered overnight accommodation when this was required in order to undertake involvement activities. We then incorporated responsibility for facilitating the model into the researcher’s role and accessed the Involving People Network in Wales to support expenses and honoraria.
We recruited individuals through two Welsh networks: one supporting public involvement in research (Involving People); the other coordinating support for people with experience of chronic conditions (the Long Terms Conditions Alliance-Cymru). The recruitment information is available at Additional file 1. We anticipated a response rate of between five and 25 people, based on previous experience of involving service users in research. We sought people diagnosed with, or caring for someone (adult or child) with, a chronic or long term condition, since carers and patients have shared and individual experiences of managing chronic illness. Relevant experience is considered an important aspect in enhancing effective involvement in research through collaboration [2, 3] (see Table 1). We provided information about the task, role and resources available, which the organisations disseminated through their networks and contacts. The information directed people to respond, if interested, to the respective organisation or to the lead author (BAE). She then telephoned each person to discuss the opportunity, confirm their interest and identify any requirements to facilitate their involvement, such as accessibility, diet, timings and training.
We held one workshop for all interested service users to enable them to develop the involvement model from the start. This ran from 10.30 am-3 pm with lunch and refreshment breaks provided. The workshop format aimed to encourage discussion and consensus building using a modified Normative Group Technique . It included group work sessions around open questions about factors facilitating and limiting involvement in research and how to design an accessible involvement model. Following feedback, we facilitated whole group discussion to discuss and confirm agreed items. The workshop was facilitated by BAE supported by a research colleague. They circulated among the groups, drawing out quieter members if appropriate, and becoming familiar with all attendees so discussions could be facilitated to provide optimum participation and reach consensus. The workshop programme is shown in Additional file 2.
We collected written records in order to describe the process of establishing the model and how it functioned between 2008 and 2015. We identified types of data to be collected in order to depict the ‘web of activities’ ( p2) that these data depicted and the iterative process which interwove the development and implementation processes. These were collected as the study proceeded and included: information to describe the workshop to devise the involvement model; notes and minutes of all meetings about development and implementation; a table of research activities members were involved with; notes of all other contacts with and support provided to service users and researchers.
We obtained informed, written consent from all service users and participating researchers to collect and use information. We reviewed documentary evidence chronologically to report the sequence and outcome of events, reading and re-reading the data and moving between different periods and source documents . The purpose was to gain an overall impression and also to identify stages, key events and transitions in the story of developing and implementing the model .
Consent from a Research Ethics Committee was not required for this study. This was based on Health Research Authority guidance that it was not necessary because respondents were not identified through NHS sources and it was taking place in a non-NHS setting . However, standards of ethical research were observed throughout.
Characteristics of respondents
Twenty three service users expressed an interest in being involved: 19/23 service users were patients only; 1/23 was a parent of a child with a chronic condition; 3/23 were both a patient and a carer. The 22 patients reported having at least one chronic condition; 7/22 had two conditions; 3/22 had three conditions; 1/22 had five conditions; 1/22 said he lived with seven chronic conditions. One respondent, who was a patient, was also employed as a support worker. Reported conditions included arthritis, respiratory and heart conditions, diabetes and epilepsy, five of the six most common chronic conditions experienced in Wales. No one reported experience of stroke, the fifth most commonly treated chronic condition in Wales .
The 23 respondents came from 12 of the 22 Welsh counties (5/23 in northern Wales; 18/23 in southern Wales), living in urban and rural areas. Two thirds of respondents were women (15/23) and one third were men (8/23). This differed from the Welsh profile of patients with chronic conditions, which reports almost equal numbers of males and females with long term illnesses . Respondents’ reported experiences of multiple conditions generally matched co-morbidity profiles and geographic distribution of chronic conditions patients in Wales. Respondents reported hearing about the opportunity through different channels, indicating that information was cascaded through a variety of networks to reach people with experience of chronic disease and interest in being involved in research.
Three respondents chose not to continue to participate after first telephone contact. One was suffering a relapse of her condition; another pulled out when her spouse was diagnosed with a terminal condition; and the third withdrew, saying she was no longer interested. The total number of service users who remained involved was 20.
Even though respondents experienced a range of different health conditions, their requirements for being involved in the workshop were similar. They asked for: meeting times which allowed for relaxed travel arrangements; good parking at venues; pre-confirmed meal times so they could manage medication; access to a quiet room or option to leave early if needed.
How service users devised and developed the model
14/20 service users attended the workshop to discuss and develop an involvement model. Through group discussion, they identified principles which they agreed should underpin a model for collaborative involvement in research (Table 2). With these in mind, they agreed how they wanted to be involved in research identifying six components for the involvement model (see Table 3).
Workshop notes were circulated to all service users (n = 20) and comments and amendments were invited, by email or telephone. No amendments were proposed. These principles and ways of working were reviewed at the next meeting, held 1 month later and agreed by all present to be the basis for the involvement model.
The model was named SUCCESS by members. SUCCESS was an acronym for Service Users with Chronic Conditions Encouraging Sensible Solutions. This was implemented at meetings and through email discussions in an iterative process as members’ experience and understanding of the research environment grew. It operated over 8 years until the Welsh research infrastructure was re-commissioned and thematically changed .
The process of developing the SUCCESS model is shown in Fig. 1.
Components of the SUCCESS model
All service users were members of the Panel. Operation was through email, enabling communication between all SUCCESS members and with the group by the facilitator. All 20 inaugural members remained part of the SUCCESS Panel and received regular emails over the study period. The virtual forum enabled members to tailor their involvement as personal circumstances dictated. Some regularly contributed to discussions and involvement activities, others opted out periodically, while four were not active in any way because health and family circumstances prevented commitment.
SUCCESS Steering Group
Members asked to hold regular quarterly meetings, open to all in person or by Skype. They valued the personal contact of face-to-face meetings. These sessions, held 10 am-3 pm, were an opportunity for interactive discussion about research involvement and ways to fine-tune the SUCCESS model. For example, they selected a logo, agreed a mission statement and terms of reference, in order to implement the SUCCESS principles of effective involvement (Table 2). They also produced a leaflet and website. One new member was recruited after the information was circulated. Meetings and lunchtime conversations were also opportunities to share experiences and offer mutual support about research involvement and health care experiences which helped highlight any issues experienced by members and avoid or address challenges, such as skills and confidence in research meetings and communicating patient views to researchers, policy and clinical partners in projects. Attendance at SUCCESS Steering Group meetings fluctuated between seven and 14.
Involvement in research activities
The SUCCESS Panel was available to all researchers linked to the commissioned evaluation of the Chronic Conditions Policy in Wales . All Panel members received information, circulated by the facilitator, about opportunities to be involved in research. Researchers, contacted by the facilitator and offered SUCCESS as a way of gaining public involvement, provided their information for distribution. Different routes of involvement were developed according to the type of research activity.
Researchers sought feedback about research proposals and ongoing studies by inviting comments on written information, distributed by email. They also attended Steering Group meetings to present and receive feedback on research proposals and results. For example, researchers who met SUCCESS members incorporated patient interviews to explore patient perspectives in a proposed study evaluating electronic records in ambulances, which gained NIHR funding 
The facilitator acted as a link between the research community and SUCCESS members by circulating opportunities to join research study teams and liaising between research teams and SUCCESS. These included the SAFER 2 study about referring older people, who fall and call 999, to a community falls service  and the PRISMATIC study about evaluating implementation of a risk prediction model in primary care .
SUCCESS members were involved in one-off research activities including attending and presenting at conferences, taking part in research development groups, piloting interview schedules and reviewing dissemination materials. The facilitator circulated information to the Panel who then took on activities, individually or collectively. For example: three SUCCESS members co-analysed patient stories about chronic conditions management services alongside researchers and practitioners ; SUCCESS members gave conference presentations on their work .
16/20 SUCCESS members were involved in at least one research activity over 8 years. The four non-active members, three of whom were patients and one a carer, said that health, family commitments or work arrangements were the reason. However, they all asked to continue receiving information and active members agreed the four should remain as members with the opportunity to contribute if they wished. The frequency of activities varied according to the work programmes of researchers, timings of funding calls and successful funding awards. Table 4 describes types of activities and numbers involved.
System for representation and communication
SUCCESS members established a system to enhance the breadth of patient and carer experience which individuals brought to research activities. Through a two-way process, individuals involved in research projects as SUCCESS members shared information about their activities with the Panel, who in turn provided contributions based on their experiences to enhance the input of each individual. They also reported to other health or community groups they belonged to. Email exchanges supplemented networking at Steering Group meetings. The aim was to enable SUCCESS members to reflect a patient voice that was wider than their personal experience, so that the SUCCESS model:
is representing a wider experience of living with chronic conditions, not just a personal perspective. Experience of chronic conditions is the ‘common denominator’ (Minutes of SUCCESS Steering Group meeting, July 2010)
The facilitator role was identified by service users as necessary to coordinate and support the operation of the model. The role included: distributing information to the SUCCESS Panel; convening SUCCESS Steering Group meetings; promoting the SUCCESS Panel to researchers; and recruiting service users for research activities. The facilitator also provided training within the SUCCESS meetings about research skills, structure and organisations within the research setting. All members had access to a range of courses provided through the Involving People Network, the network in Wales funded to support public involvement in research (http://www.wales.nhs.uk/sites3/home.cfm?orgid=1023). The facilitator provided briefing sessions about research studies for individuals who became involved in research opportunities as a SUCCESS member. A handbook was also prepared for each member (see Additional file 3). These aspects of the facilitator’s role enabled many of the principles of effective involvement (Table 2) to be achieved, such as: instilling inclusive and respectful values; resourcing involvement; ensuring accessibility and mutual communication. There were no instances where the principles were referred to in order to resolve tensions or poor practice. The facilitator had experience of involving service users in research, undertaking participatory group work and supporting and empowering individuals.
The SUCCESS model operated in a supportive research environment. Senior academics were informed about best practice about involvement in research and briefed about the SUCCESS principles (Table 2). They encouraged service user involvement in research and demonstrated that they valued their contributions by: proactively seeking service users to join research projects; making involvement a standing agenda item in meetings to ensure service users contributed and to give status to their involvement; creating an accessible environment with non-jargon meetings, a welcoming atmosphere and meeting times to allow travel arrangements; directing research and administrative staff to involve and support service users. Barriers to involvement were identified by the facilitator and service users and addressed where possible, in discussion with senior staff where necessary, so that involvement processes were seamless. For example, Skype and phone participation was arranged for individuals unable to travel to meetings. Meeting times were altered to suit train travel times. Briefing sessions were held, with the facilitator or research staff, to provide extra information requested by service users. Administrative staff were encouraged to support and ease processes by booking carparking spaces and overnight accommodation, arranging suitable refreshments, processing paperwork and taking phone calls. The supportive, collaborative atmosphere of the research environment was noted and praised by service users.
We have described a method, co-produced by service users, to involve patients and carers in research. Our paper reports how the SUCCESS model was developed and how the components operated to enable public involvement in 218 research opportunities including developing research, research management meetings, research tasks and dissemination activities linked to different research projects.
Enabling service users to design the ways they are involved in research appears to have resulted in a distinctive and deliverable model underpinned by principles based on values and practical steps to support involvement. The method of involvement which they co-produced differs from other methods in several ways. Firstly it incorporated different levels and routes of involvement through the SUCCESS Panel and Steering Group meetings to enable involvement by written contribution, by group discussion, by joining research partnerships and by undertaking dissemination and engagement activities. These provided complementary ways to help members be involved in research. That most SUCCESS members were involved in at least one research activity suggests this range provided something accessible and of interest to almost everyone who joined SUCCESS. The model was also distinctive for creating ways for service users to gain mutual support, share information and build relationships. The emphasis on face-to-face contact and communication systems reflected the priority that these patients and carers gave to emotional needs and values, suggesting that these underpin the confidence, knowledge and skills that enable people to be actively involved in research. Despite calls for researchers to give feedback and reward to patients and public members to support their involvement, this can be overlooked or difficult to achieve [8, 44,45,46]. Additionally, informal support is reported to be as valuable as formal training for service users . Thirdly, the method incorporated a system for reporting and communicating involvement activity between SUCCESS service users who undertook various research roles and the wider SUCCESS membership. This two-way communication was a distinctive feature of this novel involvement model: it aimed to communicate diverse patient and carer experience via SUCCESS members into research activities; and it was designed for service users to receive feedback on research progress and issues raised, relating to public involvement in research. The system for reporting and communication shares features of the outreach model of patient and public involvement  as a way of providing a conduit to and from a wider population. However, it benefited from the personal relationships formed between SUCCESS members. Having an opportunity to co-produce their involvement model enabled these individuals to jointly devise a system which combined their shared knowledge and enhanced their networks beyond the SUCCESS pool. This avoided the risks of tokenism cited by Wilson  who also observed that involved service users’ links with their population or patient group could weaken as their involvement experience grew. However, a common purpose and good relationships strengthen interaction among patients and public members . These benefits of well developed relationships between service users and also with researchers, which are nurtured by a sustained period of involvement, may have outweighed the potential for involvement fatigue or the SUCCESS Panel’s perspective becoming more singular and less challenging for researchers. While some members could be more active than others, the size of the Panel increased the opportunity for a wider range of views to come forward. Our experience adds to the ongoing debate about whether people become too professionalised and lose their outside perspective over time .
We facilitated this method to co-produce an involvement model because we hoped it would increase the quality and quantity of involvement in our research. The tally of 218 separate and diverse research activities, involving people with various conditions as patients and carers, suggests that co-production added value to the model by incorporating features that enabled people to be involved in developing, implementing and disseminating research. We don’t report the experiences of research partners here. But it is likely that the model gave researchers an easy route to recruit people to their studies. Identifying service users is a reported challenge for researchers, limiting their ability and opportunity to identify people with relevant experience and to involve them in research [5, 22]. It is possible that researchers had greater confidence in a process incorporating the SUCCESS ‘brand’ because it suggested these service users had confidence, research awareness and experience to enable them to effectively contribute to research activities. Researchers report that skilled service users, who understand the timescales and demands of a research environment, help research partnerships to function more smoothly by supporting consensus in decisions about research development and implementation [5, 49, 50]. It is also possible that researchers perceived that the SUCCESS ‘brand’ indicated that these individuals represented more than an individual experience. Service users are often included in research because they are perceived to be able to talk on behalf of other people in a similar situation or can present a typical experience [49,50,51,52,53]. Their credibility comes from being ‘experience based experts’ . However, people who seek opportunities to be involved in research may not be representative of the average patient or carer, even when their diagnosis or care experience is commonly shared [5, 54]. The SUCCESS members were a self-selected group and could not be typical of all patients and carers with chronic conditions. Nevertheless, their perspectives were based on their experience of living with illness and added to the views which informed the research activities they became involved with.
Strengths and limitations
Data about development and implementation of the model, structure and operating processes provide a comprehensive description at a detail which allows it to be reproduced. This contrasts with the lack of detail and anecdotal quality of much research literature on this topic [3, 55, 56]. Experiences of those involved in research through the SUCCESS model are important in order to assess how well the model functioned. We do not report the views of service users and researchers who were involved nor assess its possible impact on research of involving service users through the model. However, we did interview all participants and these data are reported separately . We have not assessed whether the model is sustainable in the long term.
Although the process of developing and implementing the SUCCESS model nurtured commitment and prolonged involvement from its service user members, it is unclear how this affects reproducibility in other contexts, with tighter budgets and in countries where existing patient/carer networks are not well developed. The iterative process of developing and implementing the model closely related to the individuals involved and the associated research programme. Membership did not change over the study period, except for one new recruit after leaflets were produced, which may have hindered development and dynamic exchange in the Panel. Involving people with fluctuating and deteriorating health means models must enable changing membership. This method of co-producing an involvement model enabled members to define what was relevant to their needs and would help them feel more informed, confident and skilled when contributing in research teams . This is in line with other research reporting that self-organisation enables people to gain information, confidence and skills, develop ideas and potentially to exert more influence [45, 59].
Only one service user was a carer and three were both a patient and a carer. Researchers inviting SUCCESS involvement were seeking patient and carer perspectives and were informed of the experience mix among members. Although carers’ experiences differ from patients, we did not attempt to balance contributions from different subgroups or seek additional carer members. It is therefore possible that carers’ perspectives were not fully presented when researchers accessed views from SUCCESS members.
Public and patient involvement is a routine element of health services research in order to improve accountability, rigour and relevance. Despite the emphasis on co-production in developing and undertaking research, methods through which public and patient members are involved are normally set by researchers. We supported patients and carers to co-produce the SUCCESS model of involvement in research. The model’s components, addressing their needs and priorities, led to sustained involvement in research over 8 years. Further work is needed to apply the model in different settings and assess impact of this method of involving people in research.
National Institute for Health Research
Service Users with Chronic Conditions Encouraging Sensible Solutions
INVOLVE. Briefing notes for researchers: involving the public in NHS, public health and social care research. INVOLVE: Eastleigh; 2012.
Collins HM, Evans R. The third wave of science studies: studies of expertise and experience. Soc Stud Sci. 2002;32(2):235–96.
Staley K. Exploring impact: public involvement in NHS, public health and social care research. INVOLVE: Eastleigh; 2009.
Boote J, Baird W, Sutton A. Public involvement in the systematic review process in health and social care: a narrative review of case examples. Health Policy. 2011;102:105–16.
Forbes LJL, McNaughton NC, Linsell L, Graham J, Tomkins C, Ramirez AJ. Involving users in the design of a randomised controlled trial of an intervention to promote early presentation in breast cancer: qualitative study. BMC Med Res Methodol. 2010. https://doi.org/10.1186/1471-2288-10-110.
Newhouse RP, Johantgen M, Thomas SA, Trocky NM, Dennison-Himmmelfarb C, Cheon J, Miller W, Gray T, Pruitt R. Engaging patients with heart failure into the design of health system interventions: Impact on research methods. Geriatr Nurs. 2016. https://doi.org/10.1016/j.gerinurse.2016.12.012.
Boivin A, Lehoux P, Lacombe R, Lacasse A, Burgers J, Grol R. Target for improvement: a cluster randomised trial of public involvement in quality-indicator prioritisation (intervention development and study protocol). Implement Sci. 2011;6:–45.
Boivin A, Lehoux P, Lacombe R, Burgers J, Grol R. Involving patients in setting priorities for healthcare improvement: a cluster randomized trial. Implement Sci. 2014;9:24.
Den Breejen EME, Hilbink MAHW, Nelen WLDM, Wiersma TJ, Burgers JS, Kremer JAM, Hermens RPMG. A patient-centered network approach to multidisciplinary-guideline development: a process evaluation. Implement Sci. 2014;9:68.
Lehoux P, Gauthier P, Williams-Jones B, Miller FA, Fishman JR, Hivon M, Vachon P. Examining the ethical and social issues of health technology design through the public appraisal of prospective scenarios: a study protocol describing a multimedia- based deliberative method. Implement Sci. 2017;9:81.
Rycroft-Malone J, Burton CR, Wilkinson J, Harvey G, McCormack B, Baker R, Dopson S, Graham ID, Staniszewska S, Thompson C, Ariss S, Melville-Richards L, Williams L. Collective action for implementation: a realist evaluation of organisational collaboration in healthcare. Implement Sci. 2016;11:17.
NIHR Research Design Service. Patient and public involvement in health and social care research: a handbook for researchers. 2014. https://www.nihr.ac.uk/about-us/CCF/funding/how-we-can-help-you/RDS-PPI-Handbook-2014-v8-FINAL.pdf. Accessed 4 Aug 2016.
NIHR. Going the extra mile: Improving the nation’s health and wellbeing through public involvement in research. https://www.nihr.ac.uk/patients-and-public/documents/Going-the-Extra-Mile.pdf. Accessed 17 Sept 2015.
Boote J., Wong R., Booth A. ‘Talking the talk or walking the walk?’ A bibliometric review of the literature on public involvement in health research published between 1995 and 2009. Health Expectations 2012;doi: https://doi.org/10.1111/hex.12007
Mathie E, Wilson P, Poland F, McNeily E, Howe A, Staniszewska S, Cowe M, Munday D, Goodman C. Consumer involvement in health research: a UK scoping and survey. Int J Consum Stud. 2014;38:35–44.
Oliver SR, Rees RW, Clarke-Jones L, Milne R, Oakley AR, Gabbay J, Stein K, Buchanan P, Gyte G. A multidimensional conceptual framework for analysing public involvement in health services research. Health Expect. 2008;11:72–84.
Arnstein S. A ladder of citizen participation. JAIP. 1969;35:216–24.
Taylor RM, Mohain J, Gibson F, Solanki A, Whelan J, Fern LA. Novel participatory methods of involving patients in research: naming and branding a longitudinal cohort study, BRIGHTLIGHT. BMC Med Res Methodol. 2015;15:20.
Rayment J, Lanlehin R, McCourt C, Husain SM. Involving seldom-heard groups in a PPI process to inform the design of a proposed trial on the use of probiotics to prevent preterm birth: a case study. Res Involvement Engagement. 2017;3:11.
Bagley HJ, Short H, Harman NL, Hickey HR, Gamble CL, Woolfall K, Young B, Williamson PR. A patient and public involvement (PPI) toolkit for meaningful and flexible involvement in clinical trials – a work in progress. Res Involvement Engagement. 2016. https://doi.org/10.1186/s40900-016-0029-8.
Wright D, Foster C, Amir Z, Elliott J, Wilson R. Critical appraisal guidelines for assessing the quality and impact of user involvement in research. Health Expectations. 2010. https://doi.org/10.1111/j.1369-7625.2010.00607.x.
Buck D, Gamble C, Dudley L, et al. From plans to actions in patient and public involvement: qualitative study of documented plans and the accounts of researchers and patients sampled from a cohort of clinical trials. BMJ Open. 2014;4:e006400. https://doi.org/10.1136/bmjopen-2014-006400.
Edwards V, Wyatt K, Logan S, Britten N. Consulting parents about the design of a randomized controlled trial of osteopathy for children with cerebral palsy. Health Expect. 2011;14:429–38.
Collins K, Boote J, Ardron D, Gath J, Green T, Ahmedzai SH, on behalf of the NTCRN CRP. Making patient and public involvement in cancer and palliative research a reality: academic support is vital for success. BMJ Support Palliat Care. 2015;5:203–6.
Horobin A. Going the extra mile – creating a cooperative model for supporting patient and public involvement in research. Res Involvement Engagement. 2016;2:9.
Jinks C, Carter P, Rhodes C, Taylor R, Beech R, Dziedzic K, Blackburn S, Hughes R, Ong BN. Patient and public involvement in primary care research – an example of ensuring its sustainability. Res Involvement Engagement. 2016;2:1.
Thompson J, Bissell P, Cooper CL, Armitage CJ, Barber R. Exploring the impact of patient and public involvement in a Cancer research setting. Qual Health Res. 2014;24:46–54.
Jinks C, Carter P, Rhodes C, Beech R, Dziedzic K, Hughes R, Blackburn S, Ong BN. Sustaining patient and public involvement in research: a case study of a research Centre. J Care Serv Manag. 2013;7:146–54.
Howe A, Mathie E, Munday D, Cowe M, Goodman C, Keenan J, Kendall S, Poland F, Staniszewska S, Wilson P. Learning to work together – lessons from a reflective analysis of a research project on public involvement. Res Involvement Engagement. 2017;3:1.
Horobin A, Brown G, Higton F, Vanhegan S, Wragg A, Pl W, Walker D-M. Co-producing public involvement training with members of the public and research organisations in the East Midlands: creating, delivering and evaluating the lay assessor training programme. Res Involvement Engagement. 2017;3:7.
Boote J, Telford R, Cooper C. Consumer involvement in health research: a review and research agenda. Health Policy. 2002;61:213–36.
Welsh Assembly Government. Improving health and the Management of Chronic Conditions in Wales: an integrated model and framework for action. Cardiff: Welsh Assembly Government; 2007.
Sink DS. Productivity management: planning, measurement and evaluation, control and improvement. Oxford: Wiley; 1985.
Prior L. Using documents in social research. London: Sage; 2003.
Coffey A, Atkinson P. Making sense of qualitative data. London: Sage; 1996.
Health Research Authority (no date) Health Research Authority: Research Community. Available at: http://www.hra.nhs.uk/research-community/ (Accessed: 30 October 2014).
Welsh Assembly Government. A profile of long-term and chronic conditions in Wales. Cardiff: Welsh Assembly Government; 2006.
Welsh Assembly Government. Health and Care Research Wales Strategic Plan 2015 – 2020;2016. Available at: https://www.healthandcareresearch.gov.wales/uploads/Policy%20%26%20Strategy/Health_and_Care_Research_Wales_Strategic_Plan_2015_2020.pdf (Accessed: 3 January 2018).
National Institute for Health Research (2018) ERA Electronic Records in Ambulances to support the shift to out of hospital care: challenges, opportunities and workforce implications. Available at: https://www.journalslibrary.nihr.ac.uk/programmes/hsdr/144722/#/. (Accessed 5 December 2018).
Koniotou M, Evans BA, Chatters R, Fothergill R, Garnsworthy C, Gaze S, Halter M, Mason S, Peconi J, Porter A, Siriwardena AN, Toghill A, Snooks H. Involving older people in a multi-centre randomised trial of a complex intervention in pre-hospital emergency care: implementation of a collaborative model. Trials. 2015;16:298. https://doi.org/10.1186/s13063-015-0821-z.
Snooks H, Bailey-Jones K, Burge-Jones D, Dale J, Davies J, Evans BA, et al. Effects and costs of implementing predictive risk stratification in primary care: a randomised stepped wedge trial. BMJ Qual Saf Published Online First. 2018. https://doi.org/10.1136/bmjqs-2018-007976.
Health in Wales (no date) Cardiff CCM Demonstrator Model For Diabetes Intermediate Care Clinics-Progress Underway. Available at: http://www.wales.nhs.uk/news/16399 (Accessed 13 November 2018).
Evans A, Snooks H, Rea D, Service User Steering Group. How can patients and carers be involved in research to improve care? Developing and evaluating a model of involvement. J Epidemiol Commun Health. 64(Suppl):pA61.
Wilson P, Mathie E, Keenan J, McNeilly E, Goodman C, Howe A, Poland F, Staniszewska S, Kendall S, Munday D, Cowe M, Peckham S. ReseArch with Patient and Public invOlvement: a RealisT evaluation – the RAPPORT study. Health Serv Deliver Res. 2015;3:38. https://doi.org/10.3310/hsdr03380.
Oliver S, Milne R, Bradburn J, Buchanan P, Kerridge L, Walley T, Gabbay J. Involving consumers in a needs-led research programme: a pilot project. Health Expect. 2001;4:18–28.
Cotterell P. Exploring the value of service user involvement in data analysis: 'Our interpretation is about what lies below the surface'. Educ Action Res. 2008;16:5–17.
Evans D, Coad J, Cottrell K, Dalrymple J, Davies R, Donald C, Laterza V, Long A, Longley A, Moule P, Pollard K, Powell J, Puddicombe A, Rice C, Sayers R. Public involvement in research: assessing impact through a realist evaluation. Health Serv Deliv Res. 2014;2:36.
McNichol E, Grimshaw P. An innovative toolkit: increasing the role and value of patient and public involvement in the dissemination of research findings. Int Pract Dev J. 2004;4:8.
Healthtalk (2018) Researchers' experiences of patient & public involvement: Long-term involvement and ‘professionalisation’. Available at http://www.healthtalk.org/peoples-experiences/medical-research/patient-public-involvement-researchers/long-term-involvement-and-professionalisation (Accessed 13 November 2018).
Thompson J, Barber R, Ward PR. Researchers’ attitudes to public involvement in research. Health Expect. 2009;12:209–20.
Ward PR, Thompson J, Barber R. Critical perspectives on ‘consumer involvement’ in health research: epistemological dissonance and the know–do gap. J Sociol. 2010;46:63–82.
Martin GP. ‘Ordinary people only’: knowledge, representativeness and the publics of public participation in healthcare. Sociol Health Illn. 2007;30:35–54.
Ross F, Donovan S, Brearly S, Victor C, Cottee M, Crowther P, Clark E. Involving older people in research: methodological issues. Health Soc Care Community. 2005;13:268–75.
Walter I, Davies H, Nutley S. Increasing research impact through partnerships: evidence from outside healthcare. J Health Serv Res Policy. 2003;8(Suppl 2):58–61.
Lindenmeyer A, Hearnshaw H, Sturt J, Ormerod R, Aitchison G. Assessment of the benefits of user involvement in health research from the Warwick diabetes care research user group: a qualitative case study. Health Expect. 2007;10:268–77.
Staniszewska S, Brett J, Mockford C, Barber R. The GRIPP checklist: strengthening the quality of patient and public involvement reporting in research. Int J Technol Assess Health Care. 2011;27:391–9.
Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, Suleman R. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. 2012. https://doi.org/10.1111/j.1369-7625.2012.00795.x.
Evans B.A. Involving People in Research Structures, Processes and Impact of a Model to Involve Service Users in a Programme of Chronic Conditions Management Research. Doctoral thesis submitted to Swansea University. Swansea: Swansea University; 2015.
Beresford P. Theory and practice of user involvement in research: making the connection with public policy and practice. In: Lowes L, Hulatt I, editors. Health and Social Care Research. Abingdon: Routledge; 2005. p. 6–17.
The authors thank the service user members who were involved in developing and implementing the SUCCESS model and contributed data to this study.
This work was supported by the Clinical Research Collaboration Cymru (2008–10) and National Institute for Social Care and Health Research Clinical Research Centre (2010–15). The funders had no role in: the design of the study; collection, analysis and interpretation of data; writing of the manuscript.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
We obtained informed written consent from all participants to collect and use information reported in this paper. Consent from a Research Ethics Committee was not required but standards of ethical research were observed throughout.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1: Title of data - Information sheet to recruit service users. Description of data – information which was circulated to recruit members to the SUCCESS model. (DOC 95 kb)
Appendix 2: Title of data – Appendix 2: programme for the workshop to develop a model for involvement. Description of data – Table setting out the programme followed to deliver the workshop held to develop the SUCCESS model. (DOC 35 kb)
Appendix 3: Title of data - Appendix 3 – Service user handbook developed and agreed by members of the SUCCESS model. Description of data – handbook provided to SUCCESS members. (PDF 546 kb)
About this article
Cite this article
Evans, B.A., Porter, A., Snooks, H. et al. A co-produced method to involve service users in research: the SUCCESS model. BMC Med Res Methodol 19, 34 (2019). https://doi.org/10.1186/s12874-019-0671-6
- Patient and public involvement