This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.
Background
The prevalence of mental health disorders among children in Japan has increased rapidly, and these children often show depressive symptoms and reduced quality of life (QOL). We previously developed a smartphone-based self-monitoring app to deliver cognitive behavioral therapy (CBT), implemented it in healthy children, and reported its effectiveness for health promotion.
Objective
This study aims to examine the usefulness of the CBT app for improvement in depressive symptoms and QOL in children with mental health disorders.
Methods
The participants were 115 children with mental health disorders (eg, school refusal, orthostatic hypotension, eating disorders, developmental disorders, among others) and aged 12‐18 years. The CBT app–based program comprised 1 week of psychoeducation followed by 1 week of self-monitoring. After reading story-like scenarios, participants created a self-monitoring sheet with 5 panels: events, thoughts, feelings, body responses, and actions. All participants received regular mental health care from physicians in addition to the app-based program. To evaluate the participants’ depressive symptoms and QOL, Patient Health Questionnaire for Adolescents (PHQ-9A), Depression Self-Rating Scale for Children (DSRS-C), and Pediatric Quality of Life Inventory (PedsQL) were measured at the beginning of the intervention, and at 2 and 6 months thereafter. Questionnaire for Triage and Assessment with 30 items (QTA30), and Rosenberg Self-Esteem Scale (RSES) were also used to measure their health and self-esteem. Participants were divided into 4 groups on the basis of the PHQ-9A score (above or below the cutoff; PHQ-9A≥5 or PHQ-9A<5) and completion or noncompletion of the CBT app–based program (app [+] or app [-]). The primary outcome was improvement in the DSRS-C score, and secondary outcomes were improvement in other psychometric scales including PedsQL, QTA30, and RSE. A paired-samples t test was used for statistical analysis. The Medical Ethics Committee of Fukuoka University Faculty of Medicine (approval U22-05-002) approved the study design.
Results
There were 48, 18, 18, and 7 participants in the PHQ-9A≥5 app (+), PHQ-9A≥5 app (-), PHQ-9A<5 app (+), and PHQ-9A<5 app (-) groups, respectively. A total of 24 participants dropped out. No improvement in the DSRS-C score was observed in all groups. However, PedsQL scores improved significantly at 2 and 6 months in the PHQ-9A<5 app (+) group (t17=6.62; P<.001 and t17=6.11; P<.001, respectively). There was a significant positive correlation between the PHQ-9A scores and the number of self-monitoring sheets completed.
Conclusions
The CBT app was useful for improving PedsQL scores of children with mental health disorders. However, a higher-intensity CBT program is necessary for more severely depressed children.
Trial Registration
University Hospital Medical Information Network Clinical Trials Registry UMIN000046775; center6.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000053360
The prevalence of mental health disorders among children has increased rapidly, and mental health care for children is an increasingly important part of pediatric health care delivery [1,2]. The number of children with school refusal is rapidly rising, and the “hikikomori” (severe social withdrawal) phenomenon may become more common in the postpandemic era [3]. In addition, it has been reported that COVID-19 has led to an increase in the number of children worldwide with depression, eating disorders, and sleep disorders [4-7]. Disability-adjusted life years of Japanese adolescents indicated that mental health disorders accounted for approximately 20% of the burden of disease [8]. Children with mental health disorders are more prone to experiencing depressive symptoms, which in turn can lead to a decline in their quality of life (QOL) [9-11] and potentially increase their risk of suicide. Suicide has become the leading cause of death among adolescents in many countries [12]. Therefore, it is important to establish a system for the treatment of these children’s mental health disorders.
Cognitive behavioral therapy (CBT) is one of the most effective means of treating mental health disorders in children. CBT, which focuses on improving the emotional state by changing thinking and behavior patterns, has been applied to a range of mental health disorders including depression, anxiety disorders, insomnia, and eating disorders [13-15]. It has also been reported that CBT improves QOL in patients with various physical conditions and mental health disorders [16]. In a study applying CBT in children with school refusal, improvements in school attendance, depression, and anxiety were reported [17]. However, the use of CBT treatments for mental health disorders in children and adolescents is often limited, where adolescents frequently refuse face-to-face psychotherapy because of embarrassment or time constraints. In recent years, mental health research has increased on CBT treatment provided via the internet and smartphones (ICBT) as an alternative to face-to-face CBT treatment [16,18-21], and the effectiveness of ICBT is reportedly no different from that of face-to-face CBT [22]. According to Aemissegger et al [23], the baseline characteristics of patients in internet-based and face-to-face intervention trials revealed no significant differences. However, internet-based trials showed a longer duration of depression and a lower proportion of patients with previous treatment experience, suggesting that such trials may attract patients who tend to delay seeking treatment [23].
ICBT includes therapist-guided ICBT and unguided ICBT, which does not involve a therapist. Guided ICBT provides individualized support and is considered highly effective, but the time of use is restricted. Unguided ICBT, on the other hand, offers convenience but no individualized guidance and is strongly dependent on the motivation of the user. In both forms of ICBT, while their effectiveness has been recognized, there are instances where the quality is lacking or randomized controlled trials (RCTs) meeting adequate standards have not been carried out [24-26]. However, time and effort tend to be spent on children’s mental illness in primary care [27], and it is hoped that ICBT will play a supplementary role to general practice.
We previously developed a smartphone-based self-monitoring application to deliver CBT (CBT app), implemented it in 217 healthy children, and reported its effectiveness for health promotion [28]. The CBT app was highly effective in terms of providing users with self-monitoring skills and reducing depressive symptoms. This study sought to examine the usefulness of the CBT app for improvement of depressive symptoms and QOL in children with mental health disorders including school refusal, eating disorders, and developmental disorders, among others. The primary outcome of this intervention is the improvement in the Depression Self-Rating Scale for Children (DSRS-C) scores after implementation of the CBT app.
MethodsStudy Design
We conducted a prospective, single-arm clinical trial involving 115 children with mental health disorders aged 11‐18 years (mean age 14.9 SD 1.6 y). The trial was registered in the University Hospital Medical Information Network Clinical Trials Registry (registration UMIN000046775). Participants were enrolled from 6 collaborating institutions, and there were 49 and 66 male and female participants, respectively. The primary diagnoses were school refusal (n=54), orthostatic dysregulation (n=15), eating disorders (n=13), developmental disorders (n=10), irritable bowel syndrome (n=5), sleep disorders (n=5), somatoform disorders (n=4), obsessive-compulsive disorder (n=3), and other mental health disorders (n=6). The diagnoses were carried out entirely by pediatricians and conducted in accordance with the Japanese version of the Pediatric Psychosomatic Medicine Guidelines and the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. Following the diagnosis, the primary physician introduced the study to the patient and their family, explained the use of the app as part of routine care, and obtained their consent. The app itself did not provide any information about the primary illness. Postdiagnosis interventions focused on disease education, lifestyle management guidance, dietary and sleep counseling, as well as directive counseling. Participants who were receiving medication did not change their medications during the study period. Participants were divided into 4 groups on the basis of the PHQ-9A score (above or below the cutoff; PHQ-9A≥5 or PHQ-9A<5) and completion or noncompletion of the CBT app-based program (app [+] or app [-]. PHQ-9A score of 5 or higher (PHQ-9A≥5) is considered indicative of a tendency toward depression. The program completion was verified on the basis of server records.
Ethical Considerations
The design of this study and the procedures for obtaining informed consent were approved by the Medical Ethics Committee of Fukuoka University Faculty of Medicine (approval: U22-05-002). Informed consent was obtained from the children and their guardians, and the electronic consent forms were stored on a secure server. The research institution managed personal information by creating a correspondence table that linked participant names to research identification numbers, with the file protected by a password. Information provided by the collaborating research institutions to the primary research institution was anonymized, with participants identified only by their research identification numbers. As compensation, each participant received a US $15 QUO card per visit, provided directly to the individual. Payments were made three times: at the initial visit, 2 months later, and 6 months later.
Procedure
The study inclusion criteria were as follows: (1) aged 11‐18 years, (2) first visit to a collaborating institution within 6 months, (3) approval for concurrent psychiatric treatment by the attending physician, and (4) access to a smartphone or Wi-Fi network. After the participants and parents signed the informed consent form, the CBT app was installed on their smartphones. While using the CBT app at home, participants visited the hospital at 1‐2-month intervals to receive psychological counseling for their primary illnesses from their physicians. The observation period was 6 months, and psychometric scales were assessed at the beginning of the intervention and 2 and 6 months thereafter.
CBT App
A smartphone-based CBT app, named Mugimaru (L2B Corporation). The program based on the app was described in detail previously [28]. Briefly, the program comprised 1 week of psychoeducation followed by 1 week of self-monitoring. Mugimaru presents story-like scenarios to provide psychoeducation, so that adolescents can easily understand the rationale of the CBT and are motivated to continue using the app. The story featured an adolescent boy, an adolescent girl, and a cat (Mugimaru). In the story, the boy and girl have troubles in their relationships with friends and concerns about their future. Mugimaru teaches them how feelings, thoughts, and actions mutually affect each other. Similarly, they learn that their feelings are associated with their thoughts and actions. The story consisted of 10 scenarios, and participants could browse 1‐2 scenarios each day. After reading a scenario, a new scenario could be read on the following day. The ending of the story was available 1 week after the participants had read the rest of the story. During the intervention period, participants completed several self-monitoring sheets comprising 5 panels: events, thoughts, feelings, body responses, and actions. The participants inputted their thoughts, feelings, body responses, and actions in association with daily events. In another window, the adolescents could input comments or advice for a friend who had experienced the same event. This input was used by adolescents to practice cognitive reappraisal and problem solving. Figure 1 shows screenshots of the smartphone CBT app. By repeatedly creating self-monitoring sheets, the adolescents could monitor their own experiences, develop solutions, and make necessary changes. The shortest time in which Mugimaru can be completed is 2 weeks. All of the data were stored in the main server, and the participants were informed in advance that only the principal investigator could view the data.
Screenshots of the smartphone cognitive behavior therapy app.
Psychometric Scales
The following 4 psychometric scales were used for outcome assessment. DSRC-S and PedsQL were used for measurement of the extent of depressive symptoms and QOL, respectively. QTA30 and RSES were used for measurement of health scores and self-esteem, respectively.
Depression Self-Rating Scale for Children (DSRS-C)
The DSRS-C is an 18-item self-report questionnaire that measures depressive symptoms [29]. Participants are asked to select 1 of 3 response options for each item: “most of the time” (score=2), “sometimes” (score=1), or “never” (score=0). The maximum score is 36, and higher scores indicate stronger depressive tendencies. The Japanese version of the DSRS-C has good reliability and validity [30]. The cutoff score for possible depression on the Japanese version is 16 points.
Pediatric Quality of Life Inventory (PedsQL)
The PedsQL is a brief measure of adolescents’ health-related quality of life [31]. The 23 items are distributed among 4 generic core scales: physical functioning, emotional functioning, social functioning, and school functioning. Items are scored as 0 (“never”), 1 (“almost never”), 2 (“sometimes”), 3 (“often”), or 4 (“almost always”). The total scale score is calculated as the mean score of all the items transformed to a 0‐100 scale. Higher scores indicate better health-related quality of life. The Japanese version of the PedsQL has good reliability and validity [32].
QTA30
The QTA30, a psychosomatic evaluation scale for pediatric populations created by the Japanese Society of Psychosomatic Pediatrics [33], is a standardized tool for triage and assessment of pediatric patients with mental health disorders that takes Japanese cultural and social factors into account. The QTA30 comprises 4 scales: physical symptoms, depression symptoms, sense of self-efficacy, and anxiety symptoms. Higher scores on all scales correlate with poorer mental health. A total score of ≥37 points is considered to indicate poor mental health.
Rosenberg Self-Esteem Scale (RSES)
The RSES is the most widely recognized and used measure of global positive and negative attitudes toward the self [34]. It comprises 10 items, and responses are provided via a 4-point Likert scale (4, “strongly agree”; 3, “agree”; 2, “disagree”; and 1, “strongly disagree”). Negatively worded items are reverse scored, and total scores range from 10 to 40. Higher scores reflect greater levels of self-esteem. The Japanese version of the RSES has good reliability and validity [35].
Data Analysis
As stated previously, the primary outcome of this study is the improvement in DSRS-C scores after completion of the CBT app-based program. The secondary outcomes were improvements in other psychometric scales including PedsQL, QTA30, and RSE. A paired-samples t test was used for statistical analysis. The mean baseline PHQ-9A scores between the app completion and noncompletion were compared. In addition, we explored the relationship between participants’ suicidal ideation and their completion or noncompletion of the app. To assess this, we calculated the number of individuals who selected “More than half the days” or “Nearly every day” for the PHQ-9A item, “Thoughts that you would be better off dead or of hurting yourself in some way,” and analyzed it in relation to their completion of the app. In addition, to determine the effect of app implementation for PHQ-9A score, multiple linear regression models were tested with the change in depression score (DSRS-C) or the change in QOL score (PedsQL) as the dependent variable and the PHQ-9A score and app implementation as independent variables. We also evaluated the correlations between the number of self-monitoring sheets completed by participants and their psychometric scale scores.
Results
In total, 115 children with mental health disorders participated in this study. According to the PHQ-9A data, 79 of the children showed PHQ-9A scores above the cutoff (PHQ-9A≥5), and 36 were PHQ-9A scores below the cutoff (PHQ-9A<5; see (Figure 2). Although 91 participants completed the 6-month outcome measurements, 24 dropped out (13 participants with PHQ-9A≥5 and 11 participants with PHQ-9A<5) before the 6-month measurements. Of the 91 participants who completed the 6-month outcome measurements, 66 also completed the CBT app-based program (48 participants with PHQ-9A≥5 and 18 participants with PHQ-9A<5); of the remaining 25 participants, 18 participants were PHQ-9A≥5 and 7 participants were PHQ-9A<5. The 91 participants who completed the 6-month outcome measurements were divided into 4 groups on the basis of PHQ-9A score (above or below the cutoff; PHQ-9A≥5 or PHQ-9A<5) and completion or noncompletion of the CBT app-based program (PHQ-9A≥5 app [+], PHQ-9A≥5 app [-], PHQ-9A<5 app [+], and PHQ-9A<5 app [-] groups). The primary diagnosis was not related to whether they completed the app. Table 1 shows the preintervention scores on each psychological scale.
Participant flow chart. CBT: cognitive behavioral therapy; PHQ-9A: Patient Health Questionnaire for Adolescents.
Comparison of the mean scores for each psychometric scale between baseline and follow-up measurements in 4 groups, categorized by the Patient Health Questionnaire for Adolescents (PHQ-9A) cutoff value and completion or noncompletion of the app program.
Follow-up period
PHQ-9aA≥5
PHQ-9A<5
App completion (n=48), mean (SD)
t test (df)
P value
App noncompletion (n=18), mean (SD)
t test (df)
P value
App completion (n=18), mean (SD)
t test (df)
P value
App noncompletion(n=7), mean (SD)
t test (df)
P value
DSRS-Cb
Baseline
18.77 (5.33)
—
—
17.83 (5.53)
—
—
10.17 (3.24)
—
—
11.57 (6.32)
—
—
2-month
18.75 (5.51)
0.03 (47)
.98
16.22 (5.81)
1.68 (17)
.11
8.83 (4.63)
1.90 (17)
.07
10.86 (3.29)
0.47 (6)
.65
6-month
19.04 (5.06)
0.39 (47)
.70
15.72 (5.68)
1.61 (17)
.13
8.56 (5.07)
1.87 (17)
.08
9.14 (4.45)
0.98 (6)
.37
PedsQLc
Baseline
64.22 (17.53)
—
—
67.81 (13.01)
—
—
84.96 (8.42)
—
—
78.57 (12.13)
—
—
2-month
67.44 (17.03)
1.85 (47)
.07
71.26 (11.57)
1.59 (17)
.13
92.57 (7.44)
6.62 (17)
<.001
83.39 (11.72)
1.25 (6)
.26
6-month
71.22 (14.55)
3.36 (47)
.002
75.00 (10.67)
2.20 (17)
.04
94.75 (5.96)
6.11 (17)
<.001
81.21 (10.70)
0.54 (6)
.61
QTA30d
Baseline
54.33 (14.19)
—
—
55.61 (12.35)
—
—
27.94 (12.13)
—
—
25.43 (6.02)
—
—
2-month
52.06 (18.01)
1.19 (47)
.24
49.78 (10.82)
2.03 (17)
.06
21.78 (12.76)
2.32 (17)
.03
26.43 (8.20)
0.34 (6)
.75
6-month
47.56 (16.12)
3.08 (47)
.003
47.11 (16.85)
2.44 (17)
.03
26.56 (22.43)
0.23 (17)
.82
23.43 (11.83)
0.42 (6)
.69
RSESe
Baseline
20.85 (4.31)
—
—
21.50 (4.83)
—
—
27.94 (3.90)
—
—
26.57 (5.97)
—
—
2-month
20.40 (4.46)
0.96 (47)
.34
21.22 (4.18)
0.32 (17)
.76
28.11 (4.71)
0.25 (17)
.81
25.14 (3.76)
0.81 (6)
.45
6-month
20.38 (4.57)
0.76 (47)
.45
20.78 (3.59)
0.64 (17)
.53
27.94 (5.22)
0.00 (17)
≥.99
26.57 (3.87)
0.00 (6)
≥.99
aPHQ-9A; Patient Health Questionnaire-9.
bDSRS-C: Depression Self-Rating Scale for Children.
cPedsQL: Pediatric Quality of Life Inventory
dQTA30; Questionnaire Triage and Assessment with 30 items.
eRSE: Rosenberg Self-esteem scale,
Outcomes at 2 and 6 Months
DSRS-C: Regardless of the completion or noncompletion of the CBT app-based program or whether the PHQ-9A value is above or below the cutoff, the DSRS-C scores did not improve significantly at 2 or 6 months (see Table 1 and Figure 3).
PedsQL: In the participants with PHQ-9A ≥5, the PedsQL scores at 6 months improved significantly regardless of the completion or noncompletion of the CBT app-based program. In the participants with PHQ-9A <5, the PedsQL scores at 2 and 6 months improved significantly only among those who completed the program.
QTA30: In the participants with PHQ-9A <5, the QTA30 score at 2 months improved significantly only among those who completed the program. In the participants with PHQ-9A ≥5, the QTA30 scores at 6 months improved significantly regardless of the completion or noncompletion of the CBT app-based program.
RSES: Regardless of the completion or noncompletion of the CBT app-based program or whether the PHQ-9A value is above or below the cutoff, the RSES scores did not improve significantly at 2 or 6 months.
Changes in psychometric scores in the 4 groups during the follow-up period. DSRS-C: Depression Self-Rating Scale for Children; PHQ-9A: Patient Health Questionnaire for Adolescents; PedsQL: Pediatric Quality of Life Inventory; QTA30: Questionnaire for Triage and Assessment with 30 items; RSES: Rosenberg Self-Esteem Scale.
Comparison of the Mean Baseline PHQ-9A Scores Between the App Completion and Noncompletion Groups
In the group with PHQ-9A values above the cutoff (PHQ-9A≥5), the PHQ-9A score showed a tendency to be higher in the app noncompletion group (mean 13.33, SD 4.51), compared to the app completion group (mean 10.94, SD 5.02); however, the difference was not statistically significant (t33,79=1.86; P=.07). Conversely, in the group with PHQ-9A values below the cutoff (PHQ-9A<5), the PHQ-9A score (mean 3.29, SD 0.95) was significantly higher in the app noncompletion group (mean 1.72, SD 1.56) (t18,17=1.86; P<.01). For the PHQ-9A question, “Thoughts that you would be better off dead or of hurting yourself in some way,” 17 individuals responded with “More than half the days” or “Nearly every day.” Among them, 14 successfully completed the app.
Multiple Linear Regression Analysis
Multiple linear regression models were used to test if PHQ-9A score and completion or noncompletion of the CBT app-based program significantly predicted the change in DSRS-C or the change in PedsQL score. These regression models were not statistically significant (see Tables 2 and 3).
Results of the regression model for changes in Depression Self-Rating Scale (DSRS) at 6 months of follow-up.
Terms
Ba
SE
t test (df)
95% CI
P value
Intercept
1.210
1.659
0.729 (90)
−2.088 to 4.507
.47
PHQ-9Ab
0.080
0.087
0.916 (90)
−0.094 to 0.253
.36
Implementation of the app
−2.125
1.173
1.182 (90)
−4.456 to 0.206
.07
aB: unstandardized coefficient.
bPHQ-9A: Patient Health Questionnaire for Adolescents.
Results of the regression model for changes in Pediatric Quality of Life Inventory (PedQL) at 6 months of follow-up.
Terms
Ba
SE
t test (df)
95% CI
P value
Intercept
7.887
4.365
1.807 (90)
–0.787 to 16.561
.07
PHQ-9Ab
0.271
0.230
1.180 (90)
–0.185 to 0.727
.24
Implementation of the app
2.412
3.085
0.782 (90)
–0.8542 to 3.719
.44
aB:unstandardized coefficient.
bPHQ-9A: Patient Health Questionnaire for Adolescents.
Correlation Between the Number of Monitoring Sheets Completed and Baseline Psychometric Scale Scores
There was a significant positive correlation between the PHQ-9A score at baseline and the number of monitoring sheets completed (see Figure 4).
Correlation between the number of self-monitoring sheet completed by the participants and the PHQ-9A score. PHQ-9A: Patient Health Questionnaire for Adolescents.
Discussion
This single-arm clinical trial demonstrated the usefulness of our CBT app-based program in terms of improving QOL (PedsQL) and health (QTA30) scores among children with mental health disorders who exhibited PHQ-9A scores below cutoff (PHQ-9A<5). However, children with PHQ-9A scores above the cutoff (PHQ-9A≥5) also showed improvements in QOL (PedsQL) and health (QTA30) scores at 6 months, even in the group that did not use the app. The app did not demonstrate effectiveness in improving depressive symptoms (DSRS-C) or self-esteem (RSE) at any time point. While a higher-intensity CBT program is necessary for more severely depressed children, this unguided app may play a supplementary role in the treatment of children with mental health disorders.
The improvement in depressive symptoms through the use of the app in children with mental health disorders was the primary outcome of this study; however, the app failed to show improvement in DSRS-C scores at any point, regardless of the initial PHQ-9A value. Although the CBT app has potential as an easily accessible, low-intensity intervention, the app might not be sufficient to reduce depressive symptoms in children with mental health disorders. Skar et al [36] analyzed the factors associated with nonresponse among children receiving CBT and identified higher baseline stress and older age as significant predictors; they also identified high intensity of the CBT intervention as key to prevent nonresponse. Nevertheless, the usefulness of app-based low-intensity CBT has also been noted. A meta-analysis of 66 randomized controlled trials of app-supported smartphone interventions for mental health problems found no significant difference in effectiveness versus active face-to-face interventions, showing the potential of apps to serve as cost-effective, easily accessible, low-intensity interventions for those who cannot receive standard high-intensity psychological treatment [37]. Adding standard CBT after low-intensity CBT was also reportedly effective in improving anxiety disorders in children [38,39]. The present CBT app consisted of 2 modules (psychoeducation and self-monitoring); additional modules including cognitive restructuring and behavioral activation are necessary to increase the effectiveness of the CBT app for children with more severe depression.
A notable finding of this study was improvements in PedsQL scores at 2- and 6-month follow-ups among children with PHQ-9A scores below the cutoff (PHQ-9A<5), achieved through the use of the app. The mechanism by which CBT improves QOL is believed to occur alongside improvements in depressive symptoms and self-esteem facilitated by CBT [40]. In this study, however, neither improvements in depressive symptoms nor self-esteem were observed, suggesting that the cartoon-style psychoeducational stories may have activated behavioral activation, a component of CBT, in the participants. On the other hand, improvements in PedsQL associated with the app were also observed at the 6-month follow-up among children with PHQ-9A scores above the cutoff (PHQ-9A≥5); however, similar improvements were noted in children who did not complete the CBT app-based program. As a medical examination was also performed and psychosocial counseling was provided in conjunction with the CBT app, it was not possible to evaluate the effects of the CBT app when analyzing the changes in the PedsQL scores in children with PHQ-9A ≥5. In general, smartphone and internet-based CBT apps are of low intensity, and their effects do not persist for a long time [41]; this likely explains why many intervention studies have 3-month outcome assessment periods [42]. In practice, it is difficult to provide treatment for mental health disorders using an app alone, that is, without also providing psychosocial counseling, so intervention studies comparing groups receiving psychosocial counseling with and without an app-based intervention are necessary to precisely determine the effects of apps.
One of the goals of this study was to learn about the differences in clinical characteristics between the CBT app-based program completion and noncompletion groups. In general, the noncompletion rate for smartphone- and web-based CBT is between 10% and 30% [43-45]. Predictors of discontinuation of CBT app use include worse physical health, lower education level, cognitive deficits, and less positive expectations of the outcome [43,46,47]. More severe pretreatment symptoms, comorbidities, lack of social support, and parental conflict are also associated with nonresponse to CBT [43,48-51]. In our study, 24 participants (20.9%) dropped out and another 25 (21.7%) discontinued the CBT app-based program. Among the latter cases, the PHQ-9A scores showed a trend toward being higher in those who did not complete the program compared with the scores among those who completed it. On the other hand, participants with strong suicidal ideation were more likely to complete the app. Furthermore, given that the participants with higher PHQ-9A scores completed more monitoring sheets, it appears that, although individuals with more severe depressive symptoms may be more likely to use a CBT app initially, they may also be more likely to give up. A stepped-care approach, which begins with lower-intensity internet-delivered CBT and then proceeds to more intensive treatments with face-to-face therapist involvement, could be effective for those who might otherwise show a poor response [38,39].
A few limitations of this study need to be addressed. First, this was a single-arm clinical trial involving children with mental health disorders who presented with varying PHQ-9A scores; a control group not using the app derived from the same population would be needed to precisely determine the effects of our CBT app. In the future, studies using randomized controlled trials (RCTs) with control groups are anticipated to provide more comprehensive and robust evidence. Second, the inclusion of participants with many disorders, such as school refusal, eating disorders, and developmental disorders, among others, may have led to variability in the results; conducting an intervention study including a population with a single disorder may have increased the reproducibility of the results. Third, 45 of the 115 participants dropped out of the study or discontinued their app use. There was a greater tendency toward dropout or discontinuation of the app among participants without depressive symptoms, and it is necessary to devise ways to encourage them to continue using the program.
Our CBT app-based program was useful for improving the QOL of children with mental health disorders with PHQ-9A<5. The program also seemed to be useful for children with PHQ-9A≥5, although the importance of regular psychosocial counseling is undeniable. A higher-intensity CBT program is necessary for more severely depressed children. By integrating this app into routine clinical practice, it serves as a supplementary tool to therapy, based on the principles of CBT, allowing individuals to observe their own mental states from a broader perspective.
This work was supported by grants from the Japan Agency for Medical Research and Development (Grants 21gk0110055h0001, 22gk0110055h0002, and 23gn0110055h0003), JSPS KAKENHI (Grant 23K02324), and Fukuoka University (Grant GR2416). We would like to thank all participants. We also thank Michael Irvine, PhD, from Edanz for editing a draft of this manuscript.
Data Availability
The datasets generated or analyzed during this study are available from the corresponding author on reasonable request.
SN, AO, RS, RI, KK, and CH were the lead researchers in the 6 collaborating institutions and participated in the design of the study. SN compiled the manuscript. RO, TI, Kitajima T, NM, CT, CF, YS, and MM recruited and examined participants and provided psychological counseling. MH, AK, MI, and Katayama T designed the CBT app. Kakuma T conducted the statistical analyses. All authors read and approved the manuscript.
None declared.
AbbreviationsCBT
cognitive behavioral therapy
DSRS-C
Depression Self-Rating Scale for Children
PedsQL
Pediatric Quality of Life Inventory
PHQ-9A
Patient Health Questionnaire for Adolescents
QOL
quality of life
QTA30
Questionnaire for Triage and Assessment with 30 items
RSES
Rosenberg Self-Esteem Scale
ReferencesMadiganSRacineNVaillancourtTChanges in depression and anxiety among children and adolescents from before to during the COVID-19 pandemic: a systematic review and meta-analysisJAMA Pediatr2023061177656758110.1001/jamapediatrics.2023.084637126337AraújoL deVelosoCFSouzaM de CAzevedoJ deTarroGThe potential impact of the COVID-19 pandemic on child growth and development: a systematic reviewJ Pediatr (Rio J)202197436937710.1016/j.jped.2020.08.00832980318FongTCYipPSPrevalence of hikikomori and associations with suicidal ideation, suicide stigma, and help-seeking among 2,022 young adults in Hong KongInt J Soc Psychiatry2023116971768178010.1177/0020764023117437637191282BignardiGDalmaijerESAnwyl-IrvineALLongitudinal increases in childhood depression symptoms during the COVID-19 lockdownArch Dis Child202108106879179710.1136/archdischild-2020-320372ChenFZhengDLiuJGongYGuanZLouDDepression and anxiety among adolescents during COVID-19: a cross-sectional studyBrain Behav Immun20200888363810.1016/j.bbi.2020.05.06132464156ÜnverHRodopman ArmanAErdoğduABİlbasmışÇCOVID-19 pandemic-onset anorexia nervosa: three adolescent casesPsychiatry Clin Neurosci202012741266366410.1111/pcn.1316033000521SharmaMAggarwalSMadaanPSainiLBhutaniMImpact of COVID-19 pandemic on sleep in children and adolescents: a systematic review and meta-analysisSleep Med20218425926710.1016/j.sleep.2021.06.002.27IgarashiTResearch report on the biopsychosocial health issues of children, kodomo/kosodate shiensuishin chousakenkyujigyou [article in japanese]2018https://www.mhlw.go.jp/content/11900000/000520474.pdfShigeyasuYOkadaAFujiiCQuality of life and physical/psychosocial factors in children and adolescents with orthostatic intoleranceBiopsychosoc Med202306121712310.1186/s13030-023-00278-137308984MierauJOKann-WeedageDHoekstraPJAssessing quality of life in psychosocial and mental health disorders in children: a comprehensive overview and appraisal of generic health related quality of life measuresBMC Pediatr202007320132910.1186/s12887-020-02220-832620157DeyMLandoltMAMohler-KuoMHealth-related quality of life among children with mental disorders: a systematic reviewQual Life Res20121221101797181410.1007/s11136-012-0109-722298200SaitoTReinesEHFloreaIDalsgaardMKManagement of depression in adolescents in JapanJ Child Adolesc Psychopharmacol201912291075376310.1089/cap.2019.002331268356CoullGMorrisPGThe clinical effectiveness of CBT-based guided self-help interventions for anxiety and depressive disorders: a systematic reviewPsychol Med20111141112239225210.1017/S003329171100090021672297TurnerHMarshallEWoodFStopaLWallerGCBT for eating disorders: the impact of early changes in eating pathology on later changes in personality pathology, anxiety and depressionBehav Res Ther201602771610.1016/j.brat.2015.11.01126690743AlimoradiZJafariEBroströmAEffects of cognitive behavioral therapy for insomnia (CBT-I) on quality of life: a systematic review and meta-analysisSleep Med Rev2022086410164610.1016/j.smrv.2022.10164635653951O’ConnorKABagnellARosychukRJA randomized controlled trial evaluating the effect of an internet-based cognitive-behavioral program on anxiety symptoms in a community-based sample of adolescentsJ Anxiety Disord2022129210263710.1016/j.janxdis.2022.10263736179438StrömbeckJPalmérRSundberg LaxIFäldtJKarlbergMBergströmMOutcome of a multi-modal CBT-based treatment program for chronic school refusalGlob Pediatr Health202182333794X21100295210.1177/2333794X21100295233855128SakataMToyomotoRYoshidaKComponents of smartphone cognitive-behavioural therapy for subthreshold depression among 1093 university students: a factorial trialEvid Based Ment Health20221225e1e18e2510.1136/ebmental-2022-30045535577537McCloudTJonesRLewisGBellVTsakanikosEEffectiveness of a mobile app intervention for anxiety and depression symptoms in university students: randomized controlled trialJMIR Mhealth Uhealth2020073187e1541810.2196/1541832735221DonkerTCorneliszIvan KlaverenCEffectiveness of self-guided app-based virtual reality cognitive behavior therapy for acrophobia: a randomized clinical trialJAMA Psychiatry201907176768269010.1001/jamapsychiatry.2019.021930892564ChanCSWongCYFYuBYMHuiVKYHoFYYCuijpersPTreating depression with a smartphone-delivered self-help cognitive behavioral therapy for insomnia: a parallel-group randomized controlled trialPsychol Med2023045351799181310.1017/S003329172100342137310329WagnerBHornABMaerckerAInternet-based versus face-to-face cognitive-behavioral intervention for depression: a randomized controlled non-inferiority trialJ Affect Disord201401152-15411312110.1016/j.jad.2013.06.03223886401AemisseggerVLopez-AlcaldeJWittCMBarthJComparability of patients in trials of ehealth and face-to-face psychotherapeutic interventions for depression: meta-synthesisJ Med Internet Res20220914249e3697810.2196/3697836103217MobergCNilesABeermannDGuided self-help works: randomized waitlist controlled trial of Pacifica, a mobile app integrating cognitive behavioral therapy and mindfulness for stress, anxiety, and depressionJ Med Internet Res2019068216e1255610.2196/1255631199319OlthuisJVWattMCBaileyKHaydenJAStewartSHTherapist-supported internet cognitive behavioural therapy for anxiety disorders in adultsCochrane Database Syst Rev20150353CD01156510.1002/14651858.CD01156525742186PelucioLQuagliatoLANardiAETherapist-guided versus self-guided cognitive-behavioral therapy: a systematic reviewPrim Care Companion CNS Disord2024032126223r0356610.4088/PCC.23r0356638512281O’BrienDHarveyKHowseJReardonTCreswellCBarriers to managing child and adolescent mental health problems: a systematic review of primary care practitioners’ perceptionsBr J Gen Pract20161066651e69370710.3399/bjgp16X68706127621291NagamitsuSKanieASakashitaKAdolescent health promotion interventions using well-care visits and a smartphone cognitive behavioral therapy app: randomized controlled trialJMIR Mhealth Uhealth20220523105e3415410.2196/3415435604760PoznanskiEOGrossmanJABuchsbaumYBanegasMFreemanLGibbonsRPreliminary studies of the reliability and validity of the children’s depression rating scaleJ Am Acad Child Psychiatry19840323219119710.1097/00004583-198403000-000116715741MurataTShimizuAMoriYOushimaSChildhood depressive state in the school situation-consideration from the Birleson’s Scale [Article in Japanese]Jpn J Psychiatr19962025-07-181131138https://jglobal.jst.go.jp/en/detail?JGLOBAL_ID=200902158429010530VarniJWSeidMRodeCAThe PedsQL: measurement model for the pediatric quality of life inventoryMed Care19990237212613910.1097/00005650-199902000-0000310024117KobayashiKKamibeppuKMeasuring quality of life in Japanese children: development of the Japanese version of PedsQLPediatr Int201002521808810.1111/j.1442-200X.2009.02889.x19496977IshiiRNagamitsuSSakuraiRKoyanagiKKanbaraYFurushoJThe development and standardization of the questionnaire for triage and assessment: a self-report health-related outcome scale for children with somataization [Article in Japanese]J Jpn Pediatr Soc2025-07-1812110001008https://jglobal.jst.go.jp/detail?JGLOBAL_ID=201702223104152954RosenbergMSociety and the Adolescent Self-Image1965Princeton, NJ: Princeton University Press10.1515/9781400876136MimuraCGriffithsPA Japanese version of the Rosenberg Self-Esteem Scale: translation and equivalence assessmentJ Psychosom Res20070562558959410.1016/j.jpsychores.2006.11.00417467414SkarAMSBraathuNJensenTKOrmhaugSMPredictors of nonresponse and drop-out among children and adolescents receiving TF-CBT: investigation of client-, therapist-, and implementation factorsBMC Health Serv Res20220929221121210.1186/s12913-022-08497-y36175864LinardonJCuijpersPCarlbringPMesserMFuller-TyszkiewiczMThe efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trialsWorld Psychiatry20191018332533610.1002/wps.2067331496095OllendickTHÖstLGFarrellLJInnovations in the psychosocial treatment of youth with anxiety disorders: implications for a stepped care approachEvid Based Ment Health20180821311211510.1136/eb-2018-10289229976564PettitJWReyYBechorMCan less be more? Open trial of a stepped care approach for child and adolescent anxiety disordersJ Anxiety Disord2017105171310.1016/j.janxdis.2017.08.00428843575WatsonHJAllenKFurslandAByrneSMNathanPRDoes enhanced cognitive behaviour therapy for eating disorders improve quality of life?Eur Eat Disord Rev20120920539339910.1002/erv.218622730260GristRPorterJStallardPMental health mobile apps for preadolescents and adolescents: a systematic reviewJ Med Internet Res20170525195e17610.2196/jmir.733228546138PennantMELoucasCEWhittingtonCComputerised therapies for anxiety and depression in children and young people: a systematic review and meta-analysisBehav Res Ther2015046711810.1016/j.brat.2015.01.00925727678BennemannBSchwartzBGiesemannJLutzWPredicting patients who will drop out of out-patient psychotherapy using machine learning algorithmsBr J Psychiatry202204220419220110.1192/bjp.2022.1735177132BurkeDLennonOBlakeCAn internet-delivered cognitive behavioural therapy pain management programme for spinal cord injury pain: a randomized controlled trialEur J Pain2019082371264128210.1002/ejp.140231002442AxelssonEHedman-LagerlöfEUnwanted outcomes in cognitive behavior therapy for pathological health anxiety: a systematic review and a secondary original study of two randomized controlled trialsExpert Rev Pharmacoecon Outcomes Res20232391001101510.1080/14737167.2023.225091537614181SchindlerAHillerWWitthöftMWhat predicts outcome, response, and drop-out in CBT of depressive adults? a naturalistic studyBehav Cogn Psychother20130541336537010.1017/S135246581200106323211066van Emmerik-van OortmerssenKBlankersMVedelEPrediction of drop-out and outcome in integrated cognitive behavioral therapy for ADHD and SUD: results from a randomized clinical trialAddict Behav20200410310622810.1016/j.addbeh.2019.10622831838443RotondiAJBelnapBHRothenbergerSFeldmanRHanusaBRollmanBLPredictors of use and drop out from a web-based cognitive behavioral therapy program and health community for depression and anxiety in primary care patients: secondary analysis of a randomized controlled trialJMIR Ment Health2024011711e5219710.2196/5219738231552Lundkvist-HoundoumadiIThastumMAnxious children and adolescents non-responding to CBT: clinical predictors and families’ experiences of therapyClin Psychol Psychother201701241829310.1002/cpp.198226514088Lundkvist-HoundoumadiIHougaardEThastumMPre-treatment child and family characteristics as predictors of outcome in cognitive behavioural therapy for youth anxiety disordersNord J Psychiatry20141168852453510.3109/08039488.2014.90329524754469ArgirosAVenanziLDaoASocial support and parental conflict as predictors of outcomes of group cognitive behavioral therapy for adolescent depressionInt J Cogn Ther202316220222110.1007/s41811-023-00159-z37228300