Published on 28.07.20 in Vol 4, No 7 (2020): July
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/19485, first published Apr 20, 2020.
A Web-Based Intervention to Prevent Multiple Chronic Disease Risk Factors Among Adolescents: Co-Design and User Testing of the Health4Life School-Based Program
Background: Chronic diseases are the leading cause of death worldwide. Addressing key lifestyle risk factors during adolescence is critical for improving physical and mental health outcomes and reducing chronic disease risk. Schools are ideal intervention settings, and electronic health (eHealth) interventions afford several advantages, including increased student engagement, scalability, and sustainability. Although lifestyle risk behaviors tend to co-occur, few school-based eHealth interventions have targeted multiple behaviors concurrently.
Objective: This study aims to summarize the co-design and user testing of the Health4Life school-based program, a web-based cartoon intervention developed to concurrently prevent 6 key lifestyle risk factors for chronic disease among secondary school students: alcohol use, smoking, poor diet, physical inactivity, sedentary recreational screen time, and poor sleep (the Big 6).
Methods: The development of the Health4Life program was conducted over 18 months in collaboration with students, teachers, and researchers with expertise relevant to the Big 6. The iterative process involved (1) scoping of evidence and systematic literature review; (2) consultation with adolescents (N=815) via a cross-sectional web-based survey to identify knowledge gaps, attitudes, barriers, and facilitators in relation to the Big 6; (3) content and web development; and (4) user testing of the web-based program with students (n=41) and teachers (n=8) to evaluate its acceptability, relevance, and appeal to the target audience.
Results: The co-design process resulted in a six-module, evidence-informed program that uses interactive cartoon storylines and web-based delivery to engage students. Student and teacher feedback collected during user testing was positive in terms of acceptability and relevance. Commonly identified areas for improvement concerned the length of modules, age appropriateness of language and alcohol storyline, the need for character backstories and links to syllabus information, and feasibility of implementation. Modifications were made to address these issues.
Conclusions: The Health4Life school-based program is the first universal, web-based program to concurrently address 6 important chronic disease risk factors among secondary school students. By adopting a multiple health behavior change approach, it has the potential to efficiently modify the Big 6 risk factors within one program and to equip young people with the skills and knowledge needed to achieve and maintain good physical and mental health throughout adolescence and into adulthood.
JMIR Form Res 2020;4(7):e19485
Chronic diseases such as cardiovascular disease, type 2 diabetes, and mental disorders are the leading causes of death globally . It is well established that major chronic diseases share 4 common lifestyle risk factors: poor diet, physical inactivity, smoking, and alcohol use [ , ]. Emerging evidence has also linked these established chronic disease risk factors with 2 additional risk behaviors: sedentary behavior (ie, sitting and recreational screen time) [ , ] and poor sleep (ie, long or short duration and/or poor quality) [ ]. Together, these 6 risk factors (the Big 6) are important targets for prevention and early intervention programs to reduce chronic disease.
A life course approach to prevention includes intervening early to reduce risk factors before the onset of chronic disease . Early adolescence is a critical period to intervene, as it coincides with the emergence of many health risk factors and is a time when young people acquire greater autonomy over their lifestyle choices [ ]. To date, most prevention approaches have focused on changing single behaviors, despite risk factors commonly co-occurring [ ]. For example, watching television is associated with high-fat snacking [ ], and young people who engage in risky alcohol and other drug use are also more likely to eat poorly and be sedentary [ ]. In recognition of this clustering, multiple health behavior change interventions [ ] have been developed to address risk factors together, rather than in isolation. These interventions are underpinned by the transfer theory [ ], whereby skills and knowledge learned about one behavior are thought to transfer to other contexts [ ], resulting in improvements across multiple behaviors without additional intervention [ ]. For example, an intervention targeting physical activity was also shown to improve eating habits [ ].
Schools are ideal locations to deliver healthy lifestyle interventions, as they provide an opportunity to engage large numbers of students during this critical time period, and in Australia, schools are mandated to teach health education. Furthermore, outside of the family environment, the school is the primary setting within which the development of children and young people can be directed and shaped . As teaching time is often limited, multiple health behavior change interventions that can simultaneously address multiple risk factors are particularly advantageous. However, evidence-based prevention programs are typically poorly implemented, often because of limited resources, a lack of teacher training and support, and program adaptations that undermine efficacy [ , ]. In fact, it has been estimated that only 14% of programs delivered in schools have the correct content and modes of delivery [ ], and more recently, that teachers adapt between 50% and 68% of content in prevention interventions [ , ]. This may help to explain why interventions targeting health behaviors, such as physical activity, among adolescents have been largely unsuccessful [ ]. Web-based interventions have the potential to overcome implementation barriers encountered by face-to-face interventions and offer several advantages, including increased student engagement, scalability, and program fidelity [ ]. For example, core content is preprogrammed on the web, and completion is self-directed by students; therefore, delivery is not dependent on teacher training or skills, which promotes faithful delivery of key program components [ , ]. Research indicates that web-based interventions can be an effective means of preventing and reducing substance use among adolescents [ , ], and computer-based education has been shown to be superior to a generic classroom curriculum in increasing physical activity and improving diet [ ]. Furthermore, schools are increasingly looking for digital web-based platforms to deliver key curriculum content as an alternative or adjunct to face-to-face teaching. However, there are no existing web-based interventions that adopt a multiple health behavior change approach to address the Big 6 among school students.
The effective Climate Schools prevention programs [- ] use interactive, web-based cartoons about a group of teenagers to engage students; summaries and optional class activities to reinforce key content; and principles of social influence theory, namely, information provision, normative education, and resistance skills training [ ], to prevent risky substance use and associated harms among adolescents [ - ]. Using the Climate Schools programs as a model, we developed the Health4Life school-based program to address gaps in the field. Underpinned by a multiple health behavior change approach [ ], Health4Life aims to empower adolescents to reduce chronic disease risk and improve current physical and mental health by providing simultaneous web-based education about the Big 6 lifestyle risk factors. The intervention consists of 3 components: (1) a school-based program delivered to all grade 7 students (aged approximately 12 years) during class time, regardless of risk (universal prevention); (2) an accompanying smartphone app, available to all students regardless of risk (universal prevention); and (3) additional web and app content delivered outside of school to students who remain at risk of chronic disease 1 and 2 years after initial intervention delivery (selective prevention).
This study aims to describe the co-design and user testing of the universal in-class school-based component of the Health4Life intervention to aid in the development of future web-based prevention resources.
The Health4Life school-based program was developed using an iterative co-design process consisting of 4 key stages (). A co-design approach was used to engage young people in the co-creation and refinement of the program. Co-design allows for a richer understanding of user needs and may be particularly important in fostering the engagement and satisfaction needed for web-based interventions to succeed among young people [ ]. The Health4Life school-based program was co-designed with youth and teachers, with development coordinated by a research team comprising experts in addiction, physical activity, exercise physiology, sleep, dietetics, mental health, electronic health (eHealth) interventions, and behavior change.
Stage 1: Scoping of the Literature
Although guided by an overarching multiple health behavior change approach , scoping of the literature was conducted to identify evidence-based prevention principles and best practice for the prevention of each of the Big 6 behaviors. Specifically, members of the research team with expertise in each of the 6 health behaviors were consulted to identify key behavioral theories and seminal school-based prevention papers and systematic reviews concerning each behavior. In addition, searches were conducted to identify national guidelines or recommendations, along with any further school-based prevention papers or systematic reviews and behavioral theories that could guide development. The key behavioral theories and evidence-based prevention principles that were identified and embedded in the Health4Life school-based program are outlined in .
|Big 6 behavior||Key behavioral theories||Evidence-based prevention principles|
|Alcohol use and smoking|
|Sedentary recreational screen time|
In addition, to better understand the effectiveness of interventions targeting multiple risk behaviors, we conducted a systematic review and meta-analysis of eHealth school-based multiple health behavior change interventions targeting two or more of the Big 6 risk factors . A total of 22 publications assessing 16 interventions were included in the review. Most of the studies assessed interventions to prevent alcohol use and smoking or improve diet and physical activity. Few studies targeted screen or sitting time, and none addressed sleep. Pooled findings supported the effectiveness of eHealth school-based multiple health behavior change interventions for improving both accelerometer- (standard mean difference [SMD] 0.33; 95% CI 0.05 to 0.61) and self-report–(SMD 0.14; 95% CI 0.05 to 0.23) measured physical activity, screen time (SMD −0.09; 95% CI −0.17 to −0.01), and fruit and vegetable intake (SMD 0.11; 95% CI 0.03 to 0.19). However, the effects were small and short lived. No effects were seen for alcohol or smoking, fat, or sugar-sweetened beverage or snack consumption.
Interventions varied greatly in their content and delivery. Few studies described specific behavior change techniques, and none of the studies referred to an established behavior change taxonomy , making it difficult to tease apart effective intervention components that could be embedded into future programs. However, effective programs tended to use computer-based tailored feedback, whereby students were provided with individualized, normative, or stage-matched feedback based on self-reported responses to computer-based assessments, suggesting that this may be an important component to include in future interventions.
Results from the systematic review highlighted the need to develop multiple health behavior change interventions that address sleep problems among youth, as none of the included interventions addressed sleep. This is despite the growing recognition that physical inactivity, sedentary behavior, and sleep are codependent [, ] and the fact that many young people report sleep problems [ ]. Generally, ineffective interventions for alcohol use and smoking were brief, primarily used the transtheoretical model [ ], and did not provide sufficient opportunities for skill building. It was concluded that future eHealth multiple health behavior change interventions targeting alcohol and tobacco use alongside other risk behaviors should be guided by principles of effective substance use prevention (eg, normative education and life skills training). Finally, the findings indicated that eHealth multiple behavior change interventions were only effective in increasing physical activity among students aged 13 years or older, and boys had a greater increase in physical activity than girls. This suggests that such interventions might not adequately engage girls or young teenagers (aged <13 years) and that formative research is required to better understand the beliefs, attitudes, and motivations of these groups regarding physical activity.
Stage 2: Web-Based Survey With Adolescents
A web-based self-report survey was conducted to understand young people’s knowledge about the Big 6, their current engagement with health behaviors, their beliefs and attitudes about health, and barriers and facilitators to achieving good health.
Participants and Procedure
A total of 7 independent secondary schools in New South Wales and the Australian Capital Territory of Australia were invited to participate. Of the 7 schools, 3 agreed to participate. Participating schools were asked to distribute information and consent forms to the parents or guardians of their grade 7 to 9 students. Passive parental consent and active student consent were required for youth to be eligible to participate in the study (99% consent rate). Students completed an anonymous web-based survey in a supervised classroom setting between August 2018 and September 2018. Participants who completed the survey were entered into the draw to win a Fitbit valued at Aus $450 (US $315), with one prize given per school. Ethics approval was obtained from the University of New South Wales Human Research Ethics Committee (HREC; HC180224).
Demographic data collected included age, sex, self-reported height and weight, and postcode. Self-reported health status was measured using a single item, “How would you rate your own health?,” with responses made on a 5-point Likert scale ranging from “Poor” to “Excellent.”
To assess moderate-to-vigorous physical activity (MVPA) students were asked, “Over the past 7 days, how many days did you do moderate or vigorous intensity physical activity for at least 60 minutes per day?” . Participants were provided with a written description of what constitutes MVPA.
Using a modified version of the Adolescent Sedentary Activity Questionnaire , students were asked to recall the amount of time (hours and minutes) typically spent on recreational screen time on weekdays and weekend days.
Fruit and Vegetable Consumption
Using validated short items commonly used in health research [, ], fruit intake was assessed via a single item: “About how many serves of fruit do you usually have each day?” (“don’t eat fruit” to “6 serves or more”). A similar item measured vegetable intake. Participants were provided with information about what constitutes one serve of fruit or vegetables.
Students were asked to report their usual bedtime and wake time on school nights and weekend nights. Sleep duration (in hours) was calculated as the difference between wake time and bedtime. Self-reported estimates of bedtime, wake time, and sleep duration have been shown to be reliable and valid .
Alcohol and Tobacco Use
Students were asked to report if they had ever tried alcohol or tobacco, based on validated items used in previous school-based trials [, ].
Attitudes, Knowledge, Barriers, and Facilitators
A series of open-ended questions were asked to understand attitudes toward health, for example, “What does good health mean to you?” Students were asked 5 multiple-choice questions to test their knowledge about age-appropriate national recommendations for the Big 6 risk behaviors. These items were based on national guidelines for each behavior [, - ]. As there are no official national guidelines for smoking, participants’ knowledge could not be assessed. Open-ended questions were used to assess key motivational factors, barriers, and facilitators of health, for example, “What gets in the way, or stops you, from being more physically active?”
Data were collated and analyzed using IBM SPSS Statistics 24 (IBM Corp). Descriptive analyses were conducted to illustrate the sample characteristics, prevalence rates of the Big 6, and knowledge. For the collected open-ended data, we selected a subsample of student responses (20%-25%) and carried out a qualitative analysis on these responses until no new themes emerged (ie, data saturation was reached). The sample was stratified by age and year group, and a random subsample was selected to ensure balanced representation across age and year groups. Using an inductive approach, one author (LG) coded responses from the subsample, examined the data for frequent or significant responses, and grouped them according to key themes or categories.
Health Behaviors and Knowledge
A total of 815 students (mean age 13.89 years, SD 0.89; 84.3% [687/815] female) from 3 schools (2 coeducational and 1 female only) completed the survey. The majority of participants perceived their health to be “very good” (334/801, 41.7%) or “good” (274/801, 34.2%); however, adherence to national guidelines for the Big 6 was mixed. Only 12.9% (101/784) of participants achieved the recommended amount of MVPA, and only 11.8% (92/779) of participants reported eating enough vegetables per day. The majority of students (622/779, 79.8%) reported eating sufficient fruit serves, and approximately half of the participants (382/779, 49.0%) met guidelines for screen time on weekdays; however, only 23.0% (179/779) of participants met guidelines on the weekend. A small proportion of students (29/778, 3.7%) had tried tobacco in their lifetime, and 64.0% (498/779) of students had used alcohol in their lifetime (including a taste or sip). Among students aged 14 years or older, 70.1% (262/374) met the guidelines of sleeping 8 to 10 hours; however, only 53.0% (222/419) of students aged 12 to 13 years met their guideline of 9 to 11 hours. Knowledge of the recommended guidelines was poor for physical activity, diet, and sleep (); however, most students (719/786, 91.5%) correctly identified that for adolescents, the safest option is not to drink alcohol at all, and 98.1% (771/786) of students agreed that smoking is harmful.
|Risk behavior and Australian guidelines for young people||Value, n (%)|
|Physical activity (n=798)|
|Accumulate 60 min or more of moderate-to-vigorous physical activity per day||212 (26.6)|
|Sedentary recreational screen time (n=792)|
|No more than 2 hours per day||394 (49.7)|
|9-11 hours of uninterrupted sleep per night for those aged 5-13 years (n=405)||77 (19.0)|
|8-10 hours per night for those aged 14-17 years (n=351)||210 (59.8)|
|Minimum of 2 serves of fruit per day||279 (35.4)|
|Minimum of 5 serves of vegetables per day||266 (33.7)|
|Alcohol use (n=786)|
|For children and young people aged younger than 18 years, not drinking alcohol is the safest option||719 (91.5)|
Attitudes, Barriers, and Facilitators
The key themes extracted from the open-ended responses are illustrated in. Many of the student responses aligned with the key behavioral theories and prevention principles outlined in stage 1. For example, consistent with self-determination theory, key facilitators of physical activity included social connection and intrinsic motivation. In addition, in line with social influence and social learning theories, the role of peers and older influences was prominent when considering reasons to drink alcohol and smoke cigarettes. These findings further shaped the storylines and guided the core content in the Health4Life program (more information is provided in the Stage 3: Content and Web Development section).
|The meaning of good health|
|Physical health factors such as being physically fit or active and having a good diet||“Eating well and just keeping active.” (Male, 14 years)|
|Mental health factors such as having a positive mental state and feeling well||“Being active and eating healthy, but also to have a positive and healthy mindset.” (Female, 13 years)|
|Emotional health factors such as feeling happy||“Good health to me means being happy. It also means being healthy by exercising and eating the right foods. But mainly I think it means being happy.” (Female, 13 years)|
|Physical activity motivators|
|Outcomes of being active such as the positive emotions felt afterward and maintenance of fitness and health||“I know that when I do exercise it puts me in a better mood which motivates me because who doesn\'t want to be in a good mood.” (Female, 14 years)|
|Social factors such as friends, family, and teammates||“My friends and family. They help encourage me to take part in sport and also get me outside of the house for a run.” (Female, 12 years)|
|Enjoyment and fun derived from physical activity and sports||“What motivates me is my liking and love for sports. I find most sports extremely fun to play.” (Female, 12 years)|
|Physical activity barriers|
|Lack of time because of school, homework, or assignments and other commitments||“My schedule is full with other work [homework, study for exams] and also I have commitments like family and community work so I don’t always have enough time to work out.” (Male, 14 years)|
|Laziness or a lack of motivation and feeling tired||“Things such as not having enough sleep, not being motivated enough and being too tired can contribute.” (Female, 13 years)|
|Reasons for young people smoking|
|To look or feel cool||“It is seen as the cool thing to do or a way to make you seem older than you are.” (Male, 14 years)|
|Peer pressure or to fit in||“Peer pressure from people either older than them or their age.” (Female, 12 years)|
|Curiosity or just to try it||“Some people my age smoke probably because they want to seem like a ‘cool’ kid and also try to experience what it tastes like.” (Female, 14 years)|
|No reason as people do not smoke at that age||“I don’t think they smoke.” (Female, 12 years)|
|Reasons for young people drinking alcohol|
|To look or feel cool||“I think people my age drink alcohol because they want to seem cool and mature, as alcohol is an adult thing to do.” (Female, 13 years)|
|Peer pressure or to fit in||“Because of peer pressure, thinks it’s cool and will achieve friends loyalty.” (Male, 13 years)|
|Curiosity||“People my age drink alcohol mostly out of curiosity and because they want to see what it tastes like.” (Female, 12 years)|
|No reason as people do not drink alcohol at that age||“I don\'t think people my age drink alcohol.” (Female, 13 years)|
|Barriers to getting enough sleep|
|Using technology and devices||“...because they are on their technology just before bed, making it hard to get to sleep.” (Female, 13 years)|
|Other commitments taking their time such as homework or extracurricular activities||“I think that people my age do not sleep because they stay awake doing homework or schoolwork. Assignments, projects.” (Male, 14 years)|
Stage 3: Content and Web Development
Background and Content Development
The development of the Health4Life school-based program was based on the effective Climate Schools substance use prevention programs [- ], which use web-based cartoon storylines about a group of teenagers to deliver key prevention messages and engage students. Underpinned by a multiple health behavior change approach [ ] and guided by the key behavioral theories and prevention principles for each of the Big 6 behaviors identified in stage 1, the findings from the web-based youth survey conducted in stage 2, and consultation with researchers with expertise in the Big 6, the core content areas were developed, which formed the basis for the 6-module Health4Life program ( ).
Character Development and Script Writing
The first step in designing the cartoon modules was to develop character profiles. The characters were purposely designed to be of similar age to the target audience (ie, grade 7 students, aged approximately 12 years) and to have different strengths and weaknesses and various health behavior clusters. Basic character profiles were developed with and reviewed by young people (n=7; aged 12-15 years; 2 males and 5 females) recruited via personal and professional networks. The youth reviewers were asked to make suggestions about character names, appearance, personalities, and health habits and to provide ideas for age-appropriate scenarios to be embedded into the storylines. Next, based on these characters and the findings from the web-based youth survey (stage 2), initial cartoon scripts for the 6 modules were written by members of the research team. The scripts aimed to provide students with information and skills about the Big 6 through the context of a teenage drama. The script writing was an iterative process, undergoing review by the expert researchers (n=22) and young people (n=9) before being sent for animation. Youth reviewers were asked to comment on the language used and relevance of the storylines, whereas expert reviewers commented on the accuracy of the content and prevention messages. Scripts were modified accordingly and then sent to animators to develop into the cartoon animations.
Module Summaries and Activities
Consistent with the Climate Schools programs [- ], teacher and student summaries and optional class activities were developed, in addition to the cartoon storylines, for each of the 6 modules. Module summaries were developed to reinforce the key content taught within the cartoons. The summaries were written by members of the research team, drawing on the latest available evidence, including national prevalence data, for example [ , ], national guidelines, for example [ ], and recent scientific literature relating to the Big 6 risk factors, for example, benefits of engaging in healthy behaviors and consequences of engaging in risky behaviors. In addition, a set of 4 to 5 activities was developed for each module, including points for class discussions, worksheets, quizzes, and homework tasks. Activities were designed to develop key self-management and interpersonal skills, such as communication, decision making, and problem-solving, and to meet key outcomes from the stage 4 New South Wales Personal Development, Health and Physical Education syllabus, the Western Australian Year 7 Health and Physical Education syllabus, and the years 7 and 8 Australian Health and Physical Education curriculum (for Queensland). Each module includes one web-based activity, such as interactive worksheets, games, or quizzes, to provide an engaging and immersive learning experience. Summaries and activities for each module were reviewed by members of the wider Health4Life team, including those with expertise relevant to the Big 6 behaviors.
Stage 4: User Testing
User testing was conducted in 2019 with year 7 students and teachers to gain feedback on the acceptability and feasibility of the Health4Life school-based program before implementation. Ethical approval was obtained from the University of Sydney HREC (2018/882).
Student Testing: Participants and Procedure
A selection of secondary schools in Sydney that had previously expressed interest in participating in research were invited to participate in user testing of the Health4Life program, of which 2 agreed to participate. A total of 2 focus groups (45-60 min) were conducted with grade 7 students in 2 independent secondary schools in Sydney: one all male (n=21; mean age 12.05 years, SD 0.38) and one all female (n=20; mean age 12.10 years, SD 0.31). Consent forms were distributed to parent or guardians, with passive parental consent and active student consent required. Facilitated by 2 researchers, the focus group consisted of students watching a video presentation of modules 1 and 2 cartoons as a group. Following each cartoon, the facilitators led a class discussion, prompting students with questions regarding the likability and relatability of the characters, storylines, and language used in the cartoons. The focus groups were audio recorded and later transcribed. At the end of the discussion, students were also asked to complete a brief, 10-min questionnaire to provide their written feedback about the acceptability and relevance of the Health4Life modules. Students were remunerated a Aus $30 (US $20) gift voucher for their time spent in the focus group. Students were also invited to provide feedback on the remaining 4 modules via a web-based survey for an additional reimbursement of one Aus $15 gift (US $10) voucher per module.
Teacher Testing: Participants and Procedure
All grade 7 health education teachers at the same 2 participating schools were invited to participate in the user testing process. Additional teachers were recruited via social media and personal and professional networks. A total of 8 teachers from 5 schools agreed to participate. After providing informed consent, teachers were invited to view 2 Health4Life modules (including cartoons, module summaries, and activities) and asked to complete a web-based survey to comment on the acceptability and suitability of the Health4Life school-based program. The teachers were reimbursed Aus $50 (US $35) for each module they reviewed. In addition, health education curriculum experts (n=6) from New South Wales, Western Australia, and Queensland were engaged to provide expert advice on the alignment of the Health4Life content with the national- and state-based health education curricula.
Student and teacher questionnaire data were analyzed using IBM SPSS Statistics 24. Descriptive statistics were conducted to calculate the percentage agreement for each survey item. The focus group data were transcribed by one researcher (EH). Individual comments and specific recommendations were extracted to inform refinements and modifications to the Health4Life program.
User Testing Results
A total of 41 students (mean age 12 years, SD 0.35; 49% [20/41] female) provided feedback about the Health4Life school-based program. As the review of modules 3 to 6 occurred outside of the classroom and was optional, the response rate ranged from 39% (16/41) to 100% (41/41) across modules. Overall, students rated the cartoon modules favorably, providing positive feedback about the likability and believability of the storylines and characters (). An example of open-ended feedback provided by students is summarized in .
|Question||Module 1 (n=41), n (%)||Module 2 (n=41), n (%)||Module 3 (n=31), n (%)||Module 4 (n=26), n (%)||Module 5 (n=18), n (%)||Module 6 (n=16), n (%)|
|Overall rating (% good/very good)||36 (88)||37 (90)||30 (97)||24 (92)||16 (89)||14 (88)|
|How much did you like the storylines? (% liked a little/lot)||35 (85)||38 (93)||30 (97)||24 (92)||18 (100)||13 (81)|
|How much did you like the characters? (% liked a little/lot)||29 (71)||34 (83)||28 (90)||24 (92)||17 (94)||12 (75)|
|How believable and realistic were the storylines? (% completely/somewhat)||31 (78)||32 (82)||26 (87)||23 (88)||16 (89)||13 (81)|
|Do you think that other year 7 students will understand the information in the lessons? (% strongly agree/agree)||30 (77)||—a||22 (73)||22 (85)||14 (78)||14 (88)|
|Do you think other year 7 students will like the characters? (% strongly agree/agree)||28 (72)||—||20 (67)||20 (77)||14 (78)||11 (69)|
|Do you think that other students will find the cartoons an engaging way to learn? (% strongly agree/agree)||32 (82)||—||21 (70)||20 (77)||11 (61)||10 (63)|
aStudents were asked to respond to questions 5-7 about both modules 1 and 2, so separate data for each module were not available.
A total of 8 teachers (75% male) participated in user testing: 7 taught at coeducational schools and 1 taught at a single-sex school. On average, participants had been teaching for 11.5 (SD 10.09) years.summarizes the feedback provided by teachers via the web-based questionnaire. Overall, the teachers rated the Health4Life program positively, with the percentage of teachers rating the modules as good or very good ranging from 88% to 100%. The vast majority of teachers also indicated that the modules were a good fit with the health education syllabus and that the storylines were believable, age appropriate, and understandable to students. However, some teachers had concerns about the modules adequately covering content, having sufficient lesson time, and feasibility of implementation. provides key themes and examples extracted from the open-ended teacher feedback.
|Feedback item||Module 1 (n=8), n (%)||Module 2 (n=8), n (%)||Module 3 (n=7), n (%)||Module 4 (n=7), n (%)||Module 5 (n=7), n (%)||Module 6 (n=7), n (%)|
|Overall rating (% good/very good)||7 (88)||7 (88)||7 (100)||7 (100)||7 (100)||7 (100)|
|Fit with syllabus (% very well/extremely well)||6 (75)||6 (75)||6 (86)||6 (86)||7 (100)||7 (100)|
|Believable and valid storylines (% yes)||7 (88)||8 (100)||7 (100)||7 (100)||6 (86)||7 (100)|
|Age-appropriate content (% yes)||8 (100)||7 (88)||7 (100)||7 (100)||7 (100)||7 (100)|
|Concepts understood/remembered by students (% yes)||8 (100)||8 (100)||6 (86)||6 (86)||7 (100)||7 (100)|
|Lesson length adequately covers content (% yes)||4 (50)||5 (63)||3 (43)||4 (57)||4 (57)||3 (43)|
|Language acceptable to youth (% yes)||8 (100)||7 (88)||7 (100)||7 (100)||7 (100)||7 (100)|
|Concerns about language used (% yes)||1 (13)||1 (13)||1 (14)||1 (14)||0 (0)||0 (0)|
|Effectiveness of program improving students’ health behaviors (% somewhat effective/very effective)||8 (100)||8 (100)||7 (100)||7 (100)||7 (100)||7 (100)|
|Likely to have implementation problems (% yes)||5 (63)||5 (63)||4 (57)||4 (57)||1 (14)||1 (14)|
|Sufficient time to deliver modules (% yes)||6 (75)||6 (75)||4 (57)||4 (57)||4 (57)||4 (57)|
|Sufficient computers for students (% yes)||7 (88)||7 (88)||6 (86)||6 (86)||5 (71)||5 (71)|
Key Changes Made to the Health4Life Program After User Testing
On the basis of feedback obtained from students and teachers, several modifications were made to the Health4Life program, including changes to the language, a reduction in cartoon text and slides, the addition of a backstory module and links to syllabus overviews, and the provision of alternate delivery methods ().
|Key issues identified||Modifications|
|Linking content to the health and physical education curricula|
|Implementation feasibility for schools with limited access to computer rooms or devices|
The Final Health4Life School-Based Program
The Health4Life school-based program is underpinned by a multiple health behavior change approach . It is anticipated that by providing students with concurrent education about the Big 6, while also highlighting the associations and interrelations between health behaviors, the program will efficiently facilitate change across multiple behaviors. The program uses principles of social influence [ ], social cognitive [ ], social learning [ ] and self-determination theories [ ], and the two-process model of sleep [ , ] ( and ), with key behavior change components and mechanisms for change woven into the storyline and accompanying activities. The Health4Life school-based program was developed to meet outcomes from the stage 4 New South Wales Personal Development, Health and Physical Education syllabus, the Western Australian Year 7 Health and Physical Education syllabus, and the years 7 and 8 Australian Health and Physical Education curriculum (for Queensland). Teachers are provided with unit overviews that map the cartoon content and activities to the state-based syllabus outcomes and descriptors, along with an outline of how the components of the Health4Life program align with the different stages of learning (knowledge, understanding, skills, and application) and the 5 propositions (taking a strengths-based approach, focusing on educative purposes, valuing movement, developing health literacy, and including a critical inquiry approach) that shape the health and physical education curriculum. An overview of the program content is provided in .
The Health4Life school-based program consists of 6 modules, ideally delivered once per week, each comprising the following:
- A 20-min web-based cartoon completed individually by students ( ): The cartoons follow the story of a group of teenagers, of similar ages to grade 7 students, to impart key prevention messages while engaging students and maintaining interest. The cartoon modules aim to provide evidence-based information about the Big 6, improve resistance skills, modify existing norms, and increase autonomous motivation. Short web-based quizzes are embedded at the end of each cartoon module to test knowledge.
- Module summaries: teachers and students are provided with PDF factsheets for each module to provide additional details and reinforce key messages.
- Optional activities: teachers are provided with a selection of 4 activities (eg, worksheets, group discussions, and homework tasks) to implement with their students after the cartoon in remaining lesson time (approximately 20 min). Teachers can select which and how many activities they implement to best suit the needs of their class. A self-directed interactive web-based activity (eg, web-based worksheet and game) is also included after each cartoon module to accommodate students completing the cartoon component at different speeds.
On the basis of the findings of the systematic review conducted in stage 1, the final component of the Health4Life school-based program is web-based tailored feedback. Students are provided color-coded strengths-based feedback about their adherence to national health guidelines for each of the Big 6 immediately after completing a self-report web-based assessment, via the study website (). The feedback aims to help students identify behaviors to increase, decrease, or maintain. Using a traffic light system, green notifications are provided to students who are currently meeting national guidelines (Going Strong), orange notifications are given to students who are not yet meeting guidelines but are close (Needs some work), and red notifications are provided to students who are not meeting guidelines (Action needed).
The Health4Life school-based program is a universal intervention designed to be delivered to all grade 7 students, regardless of their level of risk for chronic disease. It was designed for delivery during health education classes approximately once per week over 6 weeks. All materials are available on the web and accessed via student and teacher portals. Teachers are provided with implementation guidelines and links to the syllabus; however, no teacher training is required.
This study aimed to describe the comprehensive, formative research and development process of the school-based component of the Health4Life initiative. The program was developed in collaboration with students, teachers, and health professionals and is grounded in theory and the best available scientific evidence and is aligned closely with the latest health education curricula in Australia.
Strengths and Limitations
A key strength of the Health4Life school-based program is that it is the first eHealth intervention to concurrently address the Big 6 lifestyle risk factors for chronic disease—physical inactivity, poor diet, smoking, alcohol use, poor sleep, and sedentary recreational screen time—among school students. By adopting a multiple health behavior change approach, it has the potential to efficiently modify the Big 6 within one program and to equip young people with the skills and knowledge needed to maintain good physical and mental health throughout adolescence and into adulthood. Although not the focus of this paper, the Health4Life school-based program is supplemented by a universal smartphone app that prompts students to monitor their behaviors, track their progress, and set goals. In addition, a selective intervention based on cognitive behavioral and motivational enhancement principles provides youth who remain at risk of chronic disease when they are in grades 8 and 9, with additional web and app content to assist them in developing coping strategies and skills to facilitate healthy behavior change. Detailed information about these additional components has been published elsewhere . Together, these 3 components span both universal and selective prevention, maximizing outcomes for students throughout their secondary school years. Finally, as the Health4Life program is delivered to students via web-based technology with interactive components and no teacher training is required for implementation, student engagement and program fidelity is likely to be increased [ ] (assessment of these outcomes is reported on elsewhere [ ]). Importantly, web-based interventions also typically lead to improved scalability and sustainability, which enhances the dissemination potential and reach of the Health4Life program. A notable limitation of the co-design process is that students and teachers were only recruited from independent schools in Sydney for user testing and, although the web-based survey sample in stage 2 spanned across 2 states, participants were predominantly female. Nonetheless, this study was successful in engaging end users at various stages of the development process, and the final program was rated favorably and deemed acceptable and relevant by young people.
The next important step is to evaluate the effectiveness of the Health4Life intervention. A large cluster randomized controlled trial is currently underway in 71 Australian schools (>6600 students) to evaluate whether Health4Life is more effective than health education as usual in delaying the uptake of alcohol and tobacco use, reducing sedentary recreational screen time, reducing the decline in MVPA, reducing consumption of sugar-sweetened beverages, and improving sleep .
Ultimately, this study has the potential to make a substantial public health impact by concurrently addressing 6 key risk factors, thereby reducing the incidence of chronic disease and minimizing the associated costs, disability, and early mortality.
The authors acknowledge Professor Michael Gradisar, the Association of Independent Schools of New South Wales, and Dominque Sidaros for providing expert advice and feedback throughout the development process. The authors would also like to thank Evelyn Heap and Courtney Maher for their assistance with data collection and the many students and teachers who participated in the development and testing process. Finally, the authors acknowledge Warren Salley and John Horvarth at Big Q productions for producing the cartoon animations and Netfront Pty Ltd for programming and web development. This study was funded by the Paul Ramsay Foundation and the Australian National Health and Medical Research Council via Fellowships (KC, APP1120641; MT, APP1078407; and NN, APP1166377) and via the Centre of Research Excellence in the Prevention and Early Intervention in Mental Illness and Substance Use (APP11349009). The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
The Health4Life Team includes: Frances Kay-Lambkin, Tim Slade, Katherine Mills, Matthew Sunderland, Steve Allsop, Leanne Hides, Emma Barrett, Louise Mewton, Lexine Stapinski, and Louise Birrell.
Conflicts of Interest
Student open-ended feedback.DOCX File , 17 KB
Teacher open-ended feedback.DOCX File , 18 KB
- Understanding Health and Illness. Australian Institute of Health and Welfare. 2014. URL: https://www.aihw.gov.au/getmedia/d2946c3e-9b94-413c-898c-aa5219903b8c/16507.pdf.aspx?inline=true [accessed 2020-04-20]
- Ezzati M, Riboli E. Behavioral and dietary risk factors for noncommunicable diseases. N Engl J Med 2013 Sep 5;369(10):954-964. [CrossRef] [Medline]
- Ding D, Rogers K, van der Ploeg H, Stamatakis E, Bauman AE. Traditional and emerging lifestyle risk behaviors and all-cause mortality in middle-aged and older adults: evidence from a large population-based Australian cohort. PLoS Med 2015 Dec;12(12):e1001917 [FREE Full text] [CrossRef] [Medline]
- Lynch BM, Owen N. Too much sitting and chronic disease risk: steps to move the science forward. Ann Intern Med 2015 Jan 20;162(2):146-147. [CrossRef] [Medline]
- Cappuccio FP, Cooper D, D'Elia L, Strazzullo P, Miller MA. Sleep duration predicts cardiovascular outcomes: a systematic review and meta-analysis of prospective studies. Eur Heart J 2011 Jun;32(12):1484-1492. [CrossRef] [Medline]
- Wilcox S. Chronic Diseases in Australia: Blueprint For Preventive Action. Victoria University: Melbourne Australia. 2015. URL: https://www.vu.edu.au/sites/default/files/AHPC/pdfs/Chronic-Diseases-in-Australia-Blueprint-for-preventive-action.pdf [accessed 2020-04-20]
- de la Haye K, D'Amico EJ, Miles JN, Ewing B, Tucker JS. Covariance among multiple health risk behaviors in adolescents. PLoS One 2014;9(5):e98141 [FREE Full text] [CrossRef] [Medline]
- Spring B, Moller AC, Coons MJ. Multiple health behaviours: overview and implications. J Public Health (Oxf) 2012 Mar;34(Suppl 1):i3-10 [FREE Full text] [CrossRef] [Medline]
- Marsh S, Ni Mhurchu C, Maddison R. The non-advertising effects of screen-based sedentary activities on acute eating behaviours in children, adolescents, and young adults. A systematic review. Appetite 2013 Dec;71:259-273. [CrossRef] [Medline]
- Prochaska JJ, Spring B, Nigg CR. Multiple health behavior change research: an introduction and overview. Prev Med 2008 Mar;46(3):181-188 [FREE Full text] [CrossRef] [Medline]
- Lippke S, Nigg CR, Maddock JE. Health-promoting and health-risk behaviors: theory-driven analyses of multiple health behavior change in three international samples. Int J Behav Med 2012 Mar;19(1):1-13 [FREE Full text] [CrossRef] [Medline]
- Fleig L, Lippke S, Pomp S, Schwarzer R. Intervention effects of exercise self-regulation on physical exercise and eating fruits and vegetables: a longitudinal study in orthopedic and cardiac rehabilitation. Prev Med 2011 Sep;53(3):182-187. [CrossRef] [Medline]
- Johnson SS, Paiva AL, Mauriello L, Prochaska JO, Redding C, Velicer WF. Coaction in multiple behavior change interventions: consistency across multiple studies on weight management and obesity prevention. Health Psychol 2014 May;33(5):475-480 [FREE Full text] [CrossRef] [Medline]
- Mata J, Silva MN, Vieira PN, Carraça EV, Andrade AM, Coutinho SR, et al. Motivational 'spill-over' during weight control: increased self-determination and exercise intrinsic motivation predict eating self-regulation. Health Psychol 2009 Nov;28(6):709-716. [CrossRef] [Medline]
- National Research Council (US) and Institute of Medicine (US) Committee on the Prevention of Mental Disorders and Substance Abuse Among Children, Youth, and Young Adults: Research Advances and Promising Interventions. Family, School, and Community Interventions. In: O'Connell ME, Boat T, Warner KE, editors. Preventing Mental, Emotional, and Behavioral Disorders Among Young People: Progress and Possibilities. Washington, DC: National Academies Press; 2009:157-190.
- Dusenbury L, Brannigan R, Hansen WB, Walsh J, Falco M. Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. Health Educ Res 2005 Jun;20(3):308-313. [CrossRef] [Medline]
- Miller-Day M, Pettigrew J, Hecht ML, Shin Y, Graham J, Krieger J. How prevention curricula are taught under real-world conditions: types of and reasons for teacher curriculum adaptations. Health Educ (Lond) 2013;113(4):324-344 [FREE Full text] [CrossRef] [Medline]
- Ennett ST, Ringwalt CL, Thorne J, Rohrbach LA, Vincus A, Simons-Rudolph A, et al. A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prev Sci 2003 Mar;4(1):1-14. [CrossRef] [Medline]
- Pettigrew J, Graham JW, Miller-Day M, Hecht ML, Krieger JL, Shin YJ. Adherence and delivery: implementation quality and program outcomes for the seventh-grade keepin' it REAL program. Prev Sci 2015 Jan;16(1):90-99 [FREE Full text] [CrossRef] [Medline]
- Borde R, Smith JJ, Sutherland R, Nathan N, Lubans DR. Methodological considerations and impact of school-based interventions on objectively measured physical activity in adolescents: a systematic review and meta-analysis. Obes Rev 2017 Apr;18(4):476-490. [CrossRef] [Medline]
- Champion KE, Newton NC, Barrett EL, Teesson M. A systematic review of school-based alcohol and other drug prevention programs facilitated by computers or the internet. Drug Alcohol Rev 2013 Mar;32(2):115-123. [CrossRef] [Medline]
- Backer TE. Finding the Balance: Program Fidelity and Adaptation in Substance Abuse Prevention: A State-of-the-Art Review. California State University, Northridge (CSUN). 2001. URL: https://www.csun.edu/sites/default/files/FindingBalance1.pdf [accessed 2020-07-09]
- Pankratz MM, Jackson-Newsom J, Giles SM, Ringwalt CL, Bliss K, Bell ML. Implementation fidelity in a teacher-led alcohol use prevention curriculum. J Drug Educ 2006;36(4):317-333. [CrossRef] [Medline]
- Champion KE, Newton NC, Teesson M. Prevention of alcohol and other drug use and related harm in the digital age: what does the evidence tell us? Curr Opin Psychiatry 2016 Jul;29(4):242-249. [CrossRef] [Medline]
- de Bourdeaudhuij I, van Cauwenberghe E, Spittaels H, Oppert J, Rostami C, Brug J, et al. School-based interventions promoting both physical activity and healthy eating in Europe: a systematic review within the HOPE project. Obes Rev 2011 Mar;12(3):205-216. [CrossRef] [Medline]
- Newton NC, Teesson M, Vogl LE, Andrews G. Internet-based prevention for alcohol and cannabis use: final results of the climate schools course. Addiction 2010 Apr;105(4):749-759. [CrossRef] [Medline]
- Newton NC, Vogl LE, Teesson M, Andrews G. CLIMATE schools: alcohol module: cross-validation of a school-based prevention programme for alcohol misuse. Aust N Z J Psychiatry 2009 Mar;43(3):201-207. [CrossRef] [Medline]
- Teesson M, Newton NC, Slade T, Carragher N, Barrett EL, Champion KE, et al. Combined universal and selective prevention for adolescent alcohol use: a cluster randomized controlled trial. Psychol Med 2017 Jul;47(10):1761-1770. [CrossRef] [Medline]
- Botvin GJ. Preventing drug abuse in schools: social and competence enhancement approaches targeting individual-level etiologic factors. Addict Behav 2000;25(6):887-897. [CrossRef] [Medline]
- Thabrew H, Fleming T, Hetrick S, Merry S. Co-design of ehealth interventions with children and young people. Front Psychiatry 2018;9:481 [FREE Full text] [CrossRef] [Medline]
- Champion KE, Parmenter B, McGowan C, Spring B, Wafford QE, Gardner LA, et al. Effectiveness of school-based eHealth interventions to prevent multiple lifestyle risk behaviours among adolescents: a systematic review and meta-analysis. Lancet Digit Health 2019 Sep;1(5):e206-e221. [CrossRef]
- Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol 2008 May;27(3):379-387. [CrossRef] [Medline]
- Tremblay MS, Aubert S, Barnes JD, Saunders TJ, Carson V, Latimer-Cheung AE, SBRN Terminology Consensus Project Participants. Sedentary behavior research network (SBRN) - terminology consensus project process and outcome. Int J Behav Nutr Phys Act 2017 Jun 10;14(1):75 [FREE Full text] [CrossRef] [Medline]
- Australian 24-Hour Movement Guidelines For Children and Young People (5 to 17 Years). Australian Government Department of Health. 2019. URL: https://www1.health.gov.au/internet/main/publishing.nsf/Content/AC46EFBE3130BC97CA2583D00023E7B0/$File/Australian%2024-Hour%20Movement%20Guidelines%20for%20Children%20and%20Young%20People%205-17%20years.pdf [accessed 2020-04-20]
- Matricciani L, Olds T, Petkov J. In search of lost sleep: secular trends in the sleep time of school-aged children and adolescents. Sleep Med Rev 2012 Jun;16(3):203-211. [CrossRef] [Medline]
- Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol 1983 Jun;51(3):390-395. [CrossRef] [Medline]
- Ridgers ND, Timperio A, Crawford D, Salmon J. Validity of a brief self-report instrument for assessing compliance with physical activity guidelines amongst adolescents. J Sci Med Sport 2012 Mar;15(2):136-141. [CrossRef] [Medline]
- Hardy LL, Booth ML, Okely AD. The reliability of the adolescent sedentary activity questionnaire (ASAQ). Prev Med 2007 Jul;45(1):71-74. [CrossRef] [Medline]
- Nguyen B, Ding D, Mihrshahi S. Fruit and vegetable consumption and psychological distress: cross-sectional and longitudinal analyses based on a large Australian sample. BMJ Open 2017 Mar 15;7(3):e014201 [FREE Full text] [CrossRef] [Medline]
- Rustihauser I, Webb K, Abraham B, Allsopp R. Evaluation of Short Dietary Questions From the 1995 NNS. Canberra, Australia: Commonwealth Department of Health and Aged Care; 2001.
- Golley RK, Maher CA, Matricciani L, Olds TS. Sleep duration or bedtime? Exploring the association between sleep timing behaviour, diet and BMI in children and adolescents. Int J Obes (Lond) 2013 Apr;37(4):546-551. [CrossRef] [Medline]
- Teesson M, Newton NC, Slade T, Chapman C, Birrell L, Mewton L, et al. Combined prevention for substance use, depression, and anxiety in adolescence: a cluster-randomised controlled trial of a digital online intervention. Lancet Digit Health 2020 Feb;2(2):e74-e84. [CrossRef]
- National Health and Medical Research Council. Australian Dietary Guidelines. Canberra, Australia: NHMRC; 2013.
- Hirshkowitz M, Whiton K, Albert SM, Alessi C, Bruni O, DonCarlos L, et al. National sleep foundation's sleep time duration recommendations: methodology and results summary. Sleep Health 2015 Mar;1(1):40-43. [CrossRef] [Medline]
- National Health and Medical Research Council. Australian Guidelines to Reduce Health Risks From Drinking Alcohol. Canberra, Australia: Commonwealth of Australia; 2009.
- Guerin N, White V. Secondary School Students’ Use of Tobacco, Alcohol and Other Drugs in 2017. Australian Government Department of Health. 2018. URL: https://www.health.gov.au/resources/publications/secondary-school-students-use-of-tobacco-alcohol-and-other-drugs-in-2017 [accessed 2020-04-20]
- Muscular Fitness: It’s Time for a Jump Start. Active Healthy Kids Australia. 2018. URL: https://www.activehealthykidsaustralia.com.au/siteassets/documents/2018/ahka-report-card-long-form-2018-final-for-web.pdf [accessed 2020-04-20]
- Australian 24-Hour Movement Guidelines for Children and Young People (5-17 years) – An Integration of Physical Activity, Sedentary Behaviour and Sleep. Australian Government Department of Health. 2019. URL: https://www1.health.gov.au/internet/main/publishing.nsf/Content/health-24-hours-phys-act-guidelines [accessed 2020-07-09]
- Bandura A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, NJ: Prentice-Hall; 1986.
- Kelman HC. Compliance, identification, and internalization three processes of attitude change. J Conflict Resolut 2016 Jul;2(1):51-60. [CrossRef]
- Ryan RM, Deci EL. Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp Educ Psychol 2000 Jan;25(1):54-67. [CrossRef] [Medline]
- Borbély AA. A two process model of sleep regulation. Hum Neurobiol 1982;1(3):195-204. [Medline]
- Daan S, Beersma DG, Borbély AA. Timing of human sleep: recovery process gated by a circadian pacemaker. Am J Physiol 1984 Feb;246(2 Pt 2):R161-R183. [CrossRef] [Medline]
- Teesson M, Champion KE, Newton NC, Kay-Lambkin F, Chapman C, Thornton L, Health4Life Team. Study protocol of the Health4Life initiative: a cluster randomised controlled trial of an eHealth school-based program targeting multiple lifestyle risk behaviours among young Australians. BMJ Open 2020 Jul 13;10(7):e035662 [FREE Full text] [CrossRef] [Medline]
|eHealth: electronic health|
|HREC: human research ethics committee|
|MVPA: moderate-to-vigorous physical activity|
|SMD: standard mean difference|
Edited by G Eysenbach; submitted 20.04.20; peer-reviewed by H Thabrew, R Pine; comments to author 12.06.20; revised version received 22.06.20; accepted 25.06.20; published 28.07.20
©Katrina Elizabeth Champion, Lauren Anne Gardner, Cyanna McGowan, Cath Chapman, Louise Thornton, Belinda Parmenter, Nyanda McBride, David R Lubans, Karrah McCann, Bonnie Spring, Maree Teesson, The Health4Life Team, Nicola Clare Newton. Originally published in JMIR Formative Research (http://formative.jmir.org), 28.07.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on http://formative.jmir.org, as well as this copyright and license information must be included.