Patients are key stakeholders of clinical research, and their perspectives are relevant for researchers when planning and conducting clinical trials. Numerous aspects of trial process can influence participants’ experiences. Their experiences within a trial can impact retention rates. Poor treatment adherence may bias treatment effect estimates. One way to improve recruitment and adherence is to design trials that are aligned with patients’ needs and preferences. This study reports a process evaluation of the Otago MASTER feasibility trial.
ObjectivesOur aims were to investigate the patients’ perceptions of the trial interventions through individual interviews.
MethodsTwenty-five participants were recruited for the feasibility trial and were allocated to two groups: tailored or standardised exercise. Sixteen participants agreed to take part in individual semi-structured interviews. Interviews were transcribed verbatim, and all interviews were analysed thematically using an iterative approach.
ResultsOur key findings suggest participants: (1) took part in the study to access healthcare services and contribute to research; (2) valued interventions received; (3) reported certain barriers and facilitators to participate in the trial; and (4) highlighted areas for improvement when designing the full trial.
ConclusionParticipants volunteered to access healthcare and to contribute to research. Participants valued the personalised care, perceived that their engagement within the trial improved their self-management and self-efficacy behaviour, valued the time spent with clinicians, and the empathetic environment and education received. Facilitators and barriers will require careful consideration in the future as the barriers may impact reliability and validity of future trial results.
Shoulder pain is a common musculoskeletal disorder.1 Within shoulder complaints, rotator cuff-related shoulder pain is the most common disorder and has slow recovery.2,3 Rotator cuff-related shoulder pain is defined as pain at the top and lateral part of the shoulder joint, that may spread to the neck and elbow, and is worsened by overhead activity.4 It is estimated that only 50% of patients presenting with new episode of rotator cuff-related shoulder pain fully recover within six months.5 Pending on treatment received (e.g., usual care or exercise therapy), recovery may take up to 12 months.3
Process evaluation studies help us to understand findings from clinical trials.6,7 The key components of process evaluation are contextual, implementation, and mechanism of impact.8 Contextual factors can inform theories of how the intervention works; and can affect or be affected by the implementation of interventions, their mechanisms, and outcomes. The implementation processes refer to how and what elements (e.g., fidelity, dose, adaptations to planned interventions, and reach) of an intervention is delivered.8,9 The mechanisms of impact refer to understand the causal pathways through which an intervention achieves its outcomes.8-10
Process evaluation studies should be conducted, ideally, at all stages of trials (from pilot or feasibility to implementation trials).8 When conducted alongside pilot or feasibility trials, these studies can inform researchers how to improve the design of the full trial.8-11 When conducted alongside the full trial or during implementation trials, process evaluation studies help stakeholders to understand whether an intervention tested was (in)effective due to its implementation during the trial or its design.8,9
Patients’ experiences within a trial can affect retention rates and treatment adherence.12 By understanding participants’ experiences during a feasibility trial, researchers can amend and improve the design of the full trial. Numerous aspects of a trial can influence participants’ experiences, including administrative-related factors (e.g., information sheet, consent forms, questionnaires), design-related factors (e.g., time required, burden).13 Their experiences within a trial can impact on retention rates as well as on treatment adherence.14 Poor treatment adherence may bias treatment effect estimates15,16 and one way to improve recruitment and adherence is to design trials that are aligned with patients’ needs and preferences.12-17 Given patients are one of the key stakeholders of clinical trials, their perspectives are relevant for researchers when planning and conducting clinical trials.18,19
In this paper, we expand the analyses reported in the MAnagement of Subacromial disorders of The shouldER (MASTER) feasibility trial.20 During the Otago MASTER trial, we recruited 28 participants who were randomly allocated into one of the following groups: (a) tailored exercise or (b) manual therapy and standardised exercise interventions. A total of 25 participants received interventions and completed all follow-ups. Interventions for both groups consisted of two sessions per week over eight weeks (i.e., 16 sessions in total). Each session lasted for approximately 45 min. We assessed the outcome measures at baseline and at 4, 8, and 12 weeks. One important characteristic of interventions planned for the MASTER trial was the high dose of interventions which does not reflect clinical practice in New Zealand.20,21 We have previously reported clinicians’ perceptions and treatment fidelity using a mixed-method process evaluation during the Otago MASTER feasibility trial.11 In this study, our aim was to explore participants’ perceptions of the trial interventions tested within the Otago MASTER feasibility trial.
MethodsDesignUsing a qualitative descriptive approach,22,23 we explored participant views about participating in the Otago MASTER feasibility trial (registration number ANZCTR: 12617001405303). We were particularly interested in finding out about the participants’ perceived value of participating in the trial, along with any perceived barriers. Ethics approval for the feasibility trial was granted by the University of Otago Ethics Committee (Ref: H17/080). The original study undertook process of Māori consultation. We report this study following the Consolidated Criteria for Reporting Qualitative Research (COREQ).24 Patients or members of the public were not involved in the design or conduct of this study. The feasibility trial was conducted in Dunedin (New Zealand) and recruited participants aged from 18 to 65 years old with shoulder subacromial pain.
Participants’ perceptions on planned interventionsParticipants (n = 25) who completed the feasibility trial (received all interventions and completed all follow-ups) were invited to participate in an individual semi-structured interview. Participants were invited by the trial coordinator through e-mail and confirmed their interest (or not) by responding to that invitation by e-mail. Interested participants were provided with study information and a consent form. All participants provided signed consent to be interviewed. We conducted the interviews between April 2018 and April 2019. Recruitment continued until the research team agreed that no new information was added upon subsequent interviews suggesting data saturation had been reached.25,26 The semi-structured interview guide was developed by members of the research team with experience in qualitative studies and clinical experience in treating patients with shoulder pain (Supplementary material).
Interviews were held at a time and place of the participants choosing and were undertaken by three different members of the research team (DCR, the trial coordinator, and a research officer). DCR conducted two interviews, the trial coordinator conducted three interviews, and the remaining interviews were conducted by the research officer. DCR, male, is the principal investigator with clinical experience on shoulder rehabilitation and clinical research and has three years of qualitative research experience. The trial coordinator is a female physical therapist researcher, who did not know the participants and was trained by the research team to conduct interviews. The trial coordinator was trained prior to conducting the qualitative interviews. The research officer (DJ) has 15 years of experience with clinical and qualitative research, did not know the participants. Interviews were held in a quiet room within the School of Physiotherapy building.
None of the participants who agreed to take part in this study had a partner present during the interview. Before commencement of the interview, verbal consent to be digitally recorded was obtained from participants. Interviews were recorded using a digital voice recorder and lasted between 45 and 60 min. Interviews were transcribed by a private company. Transcripts were checked by the team but not returned to participants for verification.
Data analyses and interpretationWe analysed data thematically using an iterative and inductive approach.27 To ensure anonymity, we allocated a number to each participant who was interviewed (from 1 to 16). Data were analyzed by three members of the research team (AW, DCR, and VG). AW has extensive experience in qualitative analysis and worked together with two other team members (DCR and VG) to analyse the data. VG is a physical therapist and graduate research student. All analysts were involved in all steps of data analyses. We familiarised ourselves with the data through multiple readings of the transcripts and recorded ideas linked to the research question, participants’ perceived value of and barriers to participating in the trial. Through multiple discussions data were coded, codes were tabulated along with representative participant quotes, and these were sorted into potential themes and a thematic map. Themes were defined through a consensus exercise and named and are reported below.
During data analyses, we explored whether participants had different perceptions and experiences according to the group they were allocated to. Through the data analyses, we identified themes and subthemes were similar for both groups. For that reason, we report themes and subthemes without referring to group allocation.
ResultsWe invited all 25 participants who took part in the feasibility trial. Nine participants informed us they were not interested in participating and sixteen participants agreed to take part in the interviews. The demographic information for those who participated in this study are presented in Table 1.
Demographics of participants.
Data are median (range) or frequency. Kg: kilogram; cm: centimetres; m: metres.
We identified three main themes: (1) motivations to volunteer; (2) perceived value, and (3) barriers and facilitators.
Motivations to volunteerParticipants took part in the study for personal reasons and to contribute to research (Participant 1 and 3, Table 2). Some participants took part in the study to find a solution to their shoulder pain (Participant 7, Table 2), after experiencing long-lasting pain that impacted on their ability to undertake daily living activities (Participant 2 and 7, Table 2), or to receive free treatment (Participant 4, Table 2). Other participants were seeking some form of diagnosis or reliable information concerning their condition (Participant 13, Table 2). Other participants had a desire to contribute to the greater good and reported a desire to contribute to the university research being undertaken and to benefit future patients who experience shoulder pain (Participant 1, Table 2).
Motivations to volunteer in the trial.
The second theme, ‘Perceived value’, showed how participants valued the personalised care they received (Participant 1 and 14, Table 3). They were happy to commit to the time required of them (Participants 12 and 13, Table 3) and appreciated the empathetic environment (Participant 15, Table 3) and the information they received (Participants 3 and 7, Table 3). Participants valued the frequent supervised sessions with clinicians, as those sessions: (1) reinforced the need for and importance of home-based exercises (Participant 16, Table 3); (2) increased participants confidence with doing the exercises and managing their condition (Participants 6 and 15, Table 3); (3) motivated them to increase the exercise load (Participants 2 and 3, Table 3); and (4) provided an opportunity to learn about their condition. One participant described the relevance of supervised exercises, with progressions being better than their previous experiences with physical therapy treatments, in which, they received a fixed, non-changeable exercise programme (Participant 2, Table 3). Participants valued the explanations regarding the mechanisms that may have contributed to their shoulder condition (Participant 3 and 8, Table 3). Despite that, some participants still felt a need for having a specific diagnosis (Participant 2, Table 3).
Perceived value from being part of the trial.
The planned interventions required participants to attend two sessions per week over 8 weeks and this required them to plan their days to attend sessions. Participants valued the possibility to schedule all sessions in advance and, if required, the possibility to reschedule sessions when needed. They considered the scheduling of sessions went smoothly and were pleased with how easy it was to book appointments throughout the trial (Participant 12, Table 4). Some participants who did not live or work near the clinic mentioned the distance they needed to travel as being a barrier to participate in the study, with commuting time and parking being the key barriers (Participants 4 and 6, Table 4). Parking was offered to participants, and one acknowledged this was helpful (Participant 1, Table 4).
Barriers and Facilitators to take part in the trial.
The use of a logbook was perceived differently by participants. Some participants had problems filling the logbook due to clarity of instructions (Participant 5, Table 4) and considered the descriptions of exercises were unclear for a non-specialist audience (Participant 7, Table 4). On the other hand, some participants considered completing the logbook was not a problem and encouraged them to continue with the exercise programme (Participant 2, Table 4).
The scales of different questionnaires combined into one document was confusing for participants (Participant 8 and 14, Table 4). The scoring system was different between questionnaires, with some having low scores as better outcomes and other questionnaires having low scores as worse outcomes (Participants 8, Table 4). On the other hand, some participants adapted well to the types of questionnaires used and got used to the change in score direction, acknowledging the support from the research assistant to help them to complete the surveys (Participant 2, Table 4).
There were mixed perceptions about how useful the pictures included in the booklet were and some participants thought the exercise descriptions could also be improved (Participant 14, Table 4). Some participants thought more pictures were required to improve clarity of the instructions provided (Participant 9, Table 4), while other participants thought the pictures used were sufficient (Participant 1, Table 4). One participant did not have problems with the pictures used, but recognized these needed to improve if the aim was to share the exercises with other members of the community who were not health professionals (Participant 7, Table 4).
Exercise barriersParticipants noted that doing home exercises required motivation or time (Participant 2, Table 4). One participant thought the exercises were not interesting and was uncomfortable with the need to count the number of times the exercise was done (Participant 9, Table 4). Participants expressed interest in knowing the value and importance of prescribed exercises and were keen to be informed which one was beneficial for their condition (Participant 9, Table 4).
Clinicians’ perceptions and attitudesSome barriers reported by participants reflected those perceived by the clinicians who delivered the interventions. Our findings showed that clinicians perceptions on the exercises included within the trial were transmitted to patients, who shared similar thoughts to those from clinicians (Participant 9, Table 4).
Areas for improvementFurther information neededParticipants suggested more information regarding management of shoulder pain after completing their participation in the trial (Participant 1 and 9, Table 5), including the dose of home exercises to self-manage and general information (Participant 9, Table 5). They were interested in understanding which exercises were more effective for their condition, so that they could continue doing those exercises to manage their shoulder pain if needed.
Areas for improvement.
This qualitative study explored the perspectives of participants in a trial comparing a tailored intervention to a standardized strengthening programme. Our key findings suggest that participants: (1) took part in the study to access healthcare services and contribute to research; (2) valued interventions received; (3) reported certain barriers and facilitators to participate in the trial; and (4) highlighted areas for improvement when designing the full trial. As trialists, we need to be cognisant of the facilitators for participants and of the barriers, to enhance and mitigate these respectively, when planning the full trial.
Our findings suggest participants were motivated to take part in the trial due to access to healthcare (a service that they would not receive otherwise) and for a desire to give something back to the university or to research in general. These motivations are like those reported by patients with cardiovascular disease,28 who were interested in seeing the same clinician over time and keen to promote science. Contrary to our findings, those patients with cardiovascular disease rated access to free healthcare as least important and this may be due to the context of the healthcare system these participants came from. In New Zealand, patients who have chronic musculoskeletal pain (e.g., shoulder pain) have limited access to physical therapy services through the national healthcare system. In this study, we recruited participants from the community who were less likely to have easy access to appropriate healthcare.
Participants valued supervised sessions with a clinician and some participants reported those sessions increased their confidence and motivation to adhere to interventions (including home exercises). Participants reported developing self-management strategies and an increase in their self-efficacy behaviour. Self-efficacy is considered an important determinant of pain behaviour29 and was reported to be associated with better clinical outcomes in patients with shoulder pain.30 This study highlights the possible benefits of both interventions tested within the feasibility trial and seem to refute the idea that frequent sessions with a clinician would reduce self-efficacy, as participants reported feeling more confident to engage with exercises at home. Participants valued the empathetic environment. Through an empathetic relationship, clinicians can improve diagnostic accuracy, patient satisfaction, and their commitment to intervention requirements.31-34
Participants expressed interest and value in being informed about the mechanisms that caused their shoulder pain. Interestingly, these were not part of the planned intervention within the feasibility trial and some of those focused on neuromechanical causes for shoulder pain. Currently, it is unclear what causes shoulder pain and it is very challenging to identify the potential source of symptoms in this population.35,36 Clinicians clearly shared their clinical beliefs with participants and these influenced participants’ perceptions of the prescribed exercises. Some participants also expected a diagnosis and more detailed explanation regarding the cause of their pain, which is consistent with other studies.37
While participants reported barriers and facilitators to participating in the trial, (parking, health literacy level of materials, and ease of undertaking home exercises and scheduling sessions) these are all well discussed in the wider literature. Transport and commuting is known to be a barrier for patients to access to healthcare.38 Health literacy of an individual can have a negative impact on health behaviour and clinical outcomes (e.g., poor self-management skills, non-adherence to treatment, increased healthcare costs).39 In our study, it highlighted the need to further simplify the instructions used in documents prepared for participants. Some participants thought home-based exercises were easy to perform, however others reported a lack of motivation to complete these at home. The complexity of exercises and patients’ motivations can impact on patients’ commitment to home-based exercise.40 Our findings suggest that by attending face-to-face sessions, some participants felt more motivated to perform the exercises at home. These findings suggest that a combination of supervised and home-based exercises is likely to be the most beneficial for improving patients’ long-term commitment to therapeutic exercises.
Clinicians’ perceptions about interventions tested within the trial also influenced patients’ perceptions about the efficacy of the prescribed exercises. Clinicians are likely to have a strong input into patients’ perceptions about their condition and the relevance of the treatment received.41 In this study, some clinicians were not completely comfortable with changing their practice to follow the protocol of the trial and the issues raised by participants are very similar to those raised in other literature.11 These findings highlight the need to have clinicians onboard with the planned intervention. Clinicians’ input at the design stage may help reduce perceived barriers and providing training and education in research and trial methods could reduce those barriers.11,42,43
Participants suggested presenting more information about the management of shoulder pain within the planned interventions, including the “dose” of home-based exercises. These suggestions will be incorporated by the research team when planning the full trial. Adding supporting material to participants could also address their requests for understanding why their shoulder hurts. Participants also showed interest in knowing the results of the feasibility trial. At the time of the interview, we had not completed the analyses of the trial, so we could not share findings with participants. We did, however, share the main findings with participants once data analyses and the report were completed. This is considered best practice in research and is an important aspect of dissemination of study results.44,45
This study has limitations. Nine participants opted to not take part in the study. It is possible that these participants had different perspectives and experiences about the feasibility trial. On the other hand, we reached data saturation during the interview of those 16 participants who agreed to take part in the study, so we consider it likely that we have identified the key issues faced by participants during the study. Further, we recorded limited information about participating interviewees demographics, so as to minimize burden, thus we cannot exclude the possibility of sociodemographic bias. Our findings suggest participants included in the study had heterogeneous occupations (which imply different levels of education and income). Despite the heterogeneous occupations held by participants, they all presented similar perspectives regarding the trial.
ConclusionThis study explored participant perceptions of the feasibility trial which compared a tailored intervention to a standardised strengthening programme. Our findings suggest participants volunteered mainly to access healthcare for a specific issue that happened to match the trial requirements and to contribute to research. We found that participants valued the personalised care, perceived that their engagement within the trial improved their self-management and self-efficacy behaviour, valued the time spent with clinicians to receive interventions planned, as well as the empathetic environment of and education received during the trial. Participants recommended areas that could improve the design of the full trial including the health literacy level of written materials, making sure potential participants were aware of the time required to participate in a trial, and consideration be given to how to best encourage participant motivation to perform the exercises at home. We also found that clinicians’ perceptions of the trial influenced participants’ perceptions (in a negative way). Both the facilitators and barriers will require careful consideration in the future as the barriers may impact on reliability and validity of future trial results.
This project received financial support from the Health Research Council of New Zealand (17/536 and 18/111). DCR (principal investigator) and JH Abbott (co-investigator) secured the HRC 17/536 grant. This research was conducted during tenure of The Sir Charles Hercus Health Research Fellowship of the Health Research Council of New Zealand (Grant number: 18/111) awarded to DCR (principal investigator) and SEL JH Abbott (co-investigators). Sarah Lamb was supported by the NIHR Exeter BRC.