Introduction
Recent evidence suggests that the levels of mental health difficulties in young people are increasing; for example, 1 in 4 young women experience emotional problems, including anxiety and depression [1]. The previous protocol published [2] for this study highlighted the prevalence of behavioral problems in young people and its association with academic attainment and mental health difficulties [3-6].
Mobile health (mHealth) provides new opportunities to support young people’s mental health. About 95% of adolescents aged 13-17 years own or have access to a smartphone [7]. Moreover, 69% of schools in the United Kingdom are currently using tablet computers [8].
The authors have co-designed an mHealth intervention, ReZone, with young people, parents/carers, and teachers. As described in detail previously [2], ReZone is based on cognitive behavioral therapy, mindfulness, and attention bias–modification training. These methods have been shown to be effective in addressing thought processes [9,10], self-regulation of attention [11], behavior and emotions [12,13], and negative cognitive biases [14,15].
However, a limitation of the existing technology-enabled interventions for young people is that the content of many of these interventions is not grounded in psychological theory or evidence-based practice [16]. There is a need for evidence from rigorous trials regarding the effectiveness of digital interventions for mental health among young people [17] in addition to research investigating the ways to best integrate these interventions into support provision [18].
Implementation and sustained adoption of interventions within schools can be impacted by a range of contextual issues. The general organizational structure, level and quality of support available, leadership, and administrative resources are factors of successful implementation of such interventions [19,20]. A wider system view must be adopted to consider the whole school in terms of alignment of the intervention with the school’s philosophy, goals, and policies [19]. The role, views, knowledge, and skills of the staff member who is most often at the forefront of implementation within the school must also be considered [21]. Teachers play a crucial role in the successful implementation of digital technologies, and their beliefs regarding teaching practices impact the level of resistance or acceptability of new technologies within the school [22].
Challenges are further highlighted in a recent evidence framework proposed for theorizing and evaluating nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) of health and care technologies [23]. The NASSS framework outlines seven areas included for prediction and evaluation of the success of technology-supported health or social care programs. Areas for consideration are the condition or illness, the technology, the value proposition (ie, benefits of the intervention), the adopter system (comprising professional staff, patient, and lay caregivers), the organization(s), the wider context (institutional and societal), and the interaction and mutual adaptation between all these domains over time. Within these domains, there are potential challenges to consider, each classified as simple (few straightforward, predictable components), complicated (multiple interacting components or issues), or complex (dynamic, unpredictable, not easily disaggregated into constituent components).
The aim of this research was to bridge the gap in evidence of the implementation of mHealth interventions and examine the implementation of one such intervention, ReZone, for young people in schools. We report preliminary data from a cluster randomized trial of ReZone within schools. We additionally conducted postimplementation consultations with teachers to examine their views on and experiences of the facilitators and barriers to implementation.
Discussion
The aim of this study is to address the gap in evidence of the implementation of mHealth interventions. We used preliminary data and data from teacher consultations from a larger RCT conducted in schools to consider implementation barriers, facilitators, and strategies. The preliminary data include 36 students in the intervention arm across 6 schools who participated in 1082 sessions.
Implementation strategies should involve both teacher-directed and student-requested use of the tool. Feedback points to initial teacher direction for new resources, as needed, with steady integration, allowing students to independently request use over time. ReZone can be embedded into the current tools offered to students when they are feeling overwhelmed or when an incident has occurred, or as a reward/incentive or a preventative measure.
Use of the tool for the whole class can work to address the general well-being or a specific stressful period, for example, exams. Any limitations can be overcome if the school has a sufficient number of digital devices and can find time within the timetable to set aside for use of ReZone. In a class-use scenario, sessions would be less individually tailored, and there is a possibility of lower concentration and openness while discussing feelings in a group setting and more influence of social concerns.
Based on teacher guidance, implementation barrier themes seem to be widely related to the domains within the NASSS framework [23], mainly the technology, the adopter system, and the organization. A common issue raised by the consultations was related to the point of contact: The advocate for the intervention was not necessarily the one who actually implements it on a daily basis (ie, the class teacher). Due to barriers such as competing priorities, busy schedules, and engagement with the intervention, teachers could support but not promote the use of the tool. Implementation can also be impacted by staff agenda, opinions, preferences, and resistance to change routine practice. The NASSS framework and other evidence [19,20] highlight that the school system, as a whole, needs to be considered with a shared vision and plan to encompass a new technology program. School-wide capacity, readiness, and willingness are all potential barriers. These barriers are related to the feedback regarding who has the main investment in the program, emphasizing the importance of the school head being on board and active. As briefly addressed in our consultations, reluctance or unmanageable change to routine, specifically, the potential change brought on by a new technology program, is a possible barrier. Work routines can be disrupted, with a sensitive transition period when merging old and new routines. Other issues include the novelty of the technology to the school’s current system, the level of support, and the visibility of the impact of the program. Implementation of the intervention also depends on whether the school already incorporates tablets into its daily methods and routines and the level of change.
Teachers felt that technology can increase engagement through illustrations, design, interactive elements, and general appeal within the population of young people [27,28]. However, within alternative provision schools, the concern related to the risk of damage was evident and can increase reluctance to suggest tablet use in some circumstances. In mainstream schools, budgets often permit only one tablet per class or school-wide sharing of tablets. This system can be implemented using a booking system and extra planning. However, when a student asks for the tool, it may not always be available, which could be a possible deterrent for future requests of the tool. The NASSS framework highlights the importance of our methods of prototyping ReZone sufficiently, ensuring it is usable and attractive to the target user. The issue of budget allocation is also a potential barrier in the framework and was evident when some teachers discussed only having one tablet per class for use.
Parental engagement is another potential barrier: Teachers felt that some parents were difficult to engage in general communication and were therefore unlikely to sign and return letters sent home, including those for consent for their child to take part in a research study. Teachers often felt frustrated by this, as it was often these parents/carers whose children could potentially benefit from the intervention the most. Additionally, some parents were apprehensive about the level of technology their child was using and did not want them to take part in such a study. It is therefore worthwhile to attempt addressing parent/carer views, opinions, and communication preferences before the start of such a study. We worked with parents/carers on the layout and language for our information sheets and consent forms. Future work should also consider ways to increase acceptability of the research, particularly with a digital focus within this population. The NASSS framework questions what is required from those indirectly involved, such as carers. Although nothing may be required from them, if the child is using the tool at school, the question of acceptability persists.
The barriers related to students were more commonly highlighted in alternative provision schools than in mainstream schools. These barriers included opposition to repeating activities, revisiting an incident to talk through it, difficulty concentrating on a specific task, and the need for instant impact from activities. Acceptance and consideration of the work required by the adopter is a challenge considered in the NASSS framework. It can be difficult to implement long-term mental health interventions when their effect is not always immediately evident. Teacher consultations aligned with the framework in drawing attention to the level of support needed to use the technology. Most young people are familiar with the use of tablets [27] and can use them independently. However, teacher guidance and support are needed to address the initial hesitation for new things and to remember that the tool is available for use. Due to the high pupil turnover in these types of schools, attrition can be higher than that in mainstream schools.
Implementation strategies, barriers, and facilitators for digital interventions need to be considered in order to limit nonadoption and inadequate implementation in larger trials. Topics that need attention involve requirements and characteristics of the intended user group, the technology, and the organization where the tool will be implemented.
As this study was an analysis of preliminary data, the results of the full trial are needed to examine the effectiveness of ReZone. Other limitations of the present study are mentioned below. First, the consultations were conducted with a small number of teachers, and it is likely that most teachers who engaged with the study were more likely to give their views and experiences. Future research should examine implementation strategies with teachers least likely to adopt technology entirely or identify nonadopters early if implementation needs to be abandoned. Second, as with digital psychotherapy research, in general, a lack of allocation concealment and a reliance on self-report measures are also limitations.
Notwithstanding the abovementioned limitations, the findings of this research suggest that ReZone was successfully implemented and utilized, and this study identified implementation strategies, barriers, and facilitators, which are essential ingredients of larger effectiveness trials. Important considerations involve tailoring the characteristics of the intervention to the requirements of the intended user group, the technology itself, and the organization in which it is implemented.