Published on in Vol 7 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/42986, first published .
Screening for Media Use in the Emergency Department Among Young Australians: Cross-sectional Study

Screening for Media Use in the Emergency Department Among Young Australians: Cross-sectional Study

Screening for Media Use in the Emergency Department Among Young Australians: Cross-sectional Study

Original Paper

1Discipline of Psychiatry and Mental Health, University of New South Wales, Sydney, Australia

2Infant, Child and Adolescent Mental Health Services, South Western Sydney Local Health District Liverpool, Sydney, Australia

3Discipline of Mental Health, Western Sydney University, Sydney, Australia

4Medical Education, Faculty of Medicine, University of New South Wales, Sydney, Australia

*these authors contributed equally

Corresponding Author:

Joanne Joseph, BMed

Discipline of Psychiatry and Mental Health

University of New South Wales

High St Kensington

NSW 2052

Sydney

Australia

Phone: 61 9385 1000

Email: z5173736@ad.unsw.edu.au


Background: Research on problematic internet use has largely adhered to addiction paradigms, possibly impeding the identification of specific internet behaviors related to psychopathology. This study presents a novel approach to screening for specific problematic internet behaviors by using a new measure, the emergency department media use screener (EDMUS).

Objective: The purpose of this study was to identify patterns of internet use in young people presenting with mental health concerns to the emergency department (ED), ascertain associations with their mental health, and evaluate whether the EDMUS can be used to predict subsequent ED presentations within 3 months.

Methods: This cross-sectional retrospective study of Australian young people (N=149, aged 11-25 years; female: n=92, 61.7%) sought to use the EDMUS, a 24-item questionnaire, to identify problematic internet behaviors, including accessing or posting prosuicidal or proeating disorder content, cyberbullying, and inappropriate digital content. Data on each person’s mental health were extracted from electronic medical records to look for associations with EDMUS responses and ED re-presentation over 3 months. EDMUS items were grouped into clusters for analysis using chi-square tests, binary logistic regression, and path analyses.

Results: Sharing suicidal digital content was the most common problematic internet use pattern identified by the EDMUS. However, this did not correlate with having a prior mental health diagnosis or predict readmission. Most participants had families with a concern for their internet use; however, this was less likely in participants with a diagnosis of personality disorder. Diagnoses of personality disorder or posttraumatic stress disorder were independent predictors of readmission (P=.003; P=.048).

Conclusions: Although a history of complex psychopathology increases the likelihood of subsequent ED presentations, its links to internet use–related behaviors are still unclear. The EDMUS has potential for identifying young people who are most vulnerable to problematic internet behaviors and offers the opportunity for early intervention and potential prevention of more entrenched difficulties.

JMIR Form Res 2023;7:e42986

doi:10.2196/42986

Keywords



Background

Internet use is continually rising, with around 27,000 new internet users every hour [1] and over 4.6 billion active users globally [2]. Around 89% of Australia’s population is on the internet today, compared to 76% in 2010 [3], with a majority of internet users aged 15-17 years [4]. There has been a 13% rise in mental illness in the past decade [5], with suicide being the leading cause of adolescent death in Australia [6], and the pandemic has further exacerbated the increase in child and adolescent mental health presentations [7].

In 1996, Young [8] laid the groundwork to describe mental health pathology related to increasing internet use. This has since morphed into internet gaming disorder (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition; DSM-5) and gaming disorder in the International Classification of Diseases (ICD-11), with ongoing debate on the validity of these diagnoses [9-11]. Further research on such specific internet behaviors has been encouraged and would aid in their formal recognition and classification by diagnostic manuals [12].

While several researchers have criticized the term “internet addiction” for its narrowness in describing only risky behaviors displayed by internet users [13-17], other terms used in literature such as “excessive internet use,” “pathological internet use” [18,19], “problematic interactive media use” [20], and “compulsive internet use” [21] allude to the same notion of addiction. In the context of screening, this has resulted in measuring the frequency and length of internet use and its behavioral consequences, but not how time is spent digitally. As such, an individual spending excessive time watching educational videos could score the same as an individual gaming on the internet every day, despite these behaviors having different impacts and concerns. This paper defines problematic internet behaviors as “internet use that is excessive, impulsive, or risky in nature, with adverse consequences to mental, physical, emotional, social, and functional health,” in line with most frequently used definitions in current literature, but additionally investigates a range of internet behaviors likely to indicate different kinds of mental health risk [22].

Accessing harm-advocating websites is one avenue through which excessive internet use seems to increase mental distress, while other problematic internet behaviors, such as excessive social media use, have been associated with increasing body image concerns and disordered eating [23-25]. Similarly, internet gaming disorder has been correlated with anxiety, depression, attention-deficit/hyperactivity disorder (ADHD) or hyperactivity symptoms, social phobia or anxiety, and obsessive-compulsive symptoms [26-28]. Furthermore, digital platforms provide opportunities for cyberbullying and sending inappropriate or unwanted content, leading to psychological distress [29].

Screen use can contribute toward increased risk in numerous ways. Cyberbullying, exposure to suicide-related content, problematic internet use, sexting, and frequency of social media use have all been associated with self-injurious thoughts and behaviors [30]. Recent social phenomena such as the Blue Whale Challenge and 13 Reasons Why have also contributed to normalizing or glorifying suicide. One study showed a substantial increase in self-harm emergency department (ED) visits among adolescents associated with the release of 13 Reasons Why [31]. Yet, screening for such problematic internet behaviors is not routine practice and occurs broadly in the context of internet addiction through monitoring screen time or withdrawal behaviors [32,33].

While rates of mental health presentations to the ED in adolescents are increasing in New South Wales, the prevalence of internet-related presentations remains unclear [7,34]. One study of over 200 adolescents hospitalized for psychiatric reasons showed that over 20% responded that their admission was related to something that happened on the internet [35]. A limited number of studies have discussed internet use in the context of EDs, while research on youth hospitalized or within the community is more common [36]. This study was proposed after a cluster of suicides in adolescents was noted in various areas of a large metropolitan city in Australia, with the use of social media to access suicide-related material on the internet being at the forefront of these presentations.

The Emergency Department Media Use Screener

Despite evidence linking excessive internet use with mental illness, psychiatrists generally have a poor understanding of their patient’s internet use [37]. Hence, researches supporting screening tools are critical in assessing risk and implementing appropriate supports to minimize harm from problematic internet behaviors and are vital next steps in addressing this knowledge gap [38-40].

The emergency department media use screener (EDMUS) is a screening tool developed by clinicians in 2019 and is being piloted as part of a quality improvement project for use in the Campbelltown Hospital ED in Sydney (Figure 1). The EDMUS was developed in response to increasing ED presentations of suicides facilitated by the internet through the sharing of news, apps, and content among adolescents [41,42]. Hence, the tool has a heavy focus on suicide and self–harm-related items. Adolescents presenting to the ED with mental health concerns were also screened for other specific internet behaviors that may indicate risk of psychopathology, including aggression, accessing proeating disorder websites, and cyberbullying, through 24 yes-or-no items assessed digitally.

Figure 1. The emergency department media use screener (EDMUS).

Research Objectives and Questions

The study had 3 primary research questions concerning adolescents aged 11-25 years. They were as follows:

  1. What are the rates of participant responses to each EDMUS item?
  2. Do EDMUS responses vary depending on an individual’s mental health diagnosis?
  3. Do EDMUS responses and mental health diagnoses predict future ED presentations?

The following were the study objectives:

  • Screening for patterns of media use in young people presenting to the ED with a mental health concern.
  • Ascertaining whether patterns of media use vary depending on the mental health backgrounds of individuals.
  • Deciphering whether patterns of media use can predict subsequent ED presentations.

Study Design

Campbelltown Hospital is located on the south-west fringe of metropolitan Sydney and has one of the highest rates of ED presentations for mental health concerns across this age group in the state of New South Wales, Australia. A cross-sectional retrospective study design was adopted. A web-based survey was distributed to young people aged 11-25 years presenting to the Campbelltown ED with a mental health concern from August 2020 to March 2021. Upon completion, the survey generated helpful links for young people to use. Responses were collected via the University of New South Wales’ Research Electronic Data Capture (REDCap), a secure web-based data management and survey tool [43,44]. This tool was linked to patients’ medical records to extract demographic and diagnostic data.

The inclusion criteria of the study included young people aged between 11 and 25 years who completed an EDMUS screen upon presenting to the Campbelltown Hospital ED with a mental health concern. The exclusion criteria included young people who presented to the Campbelltown Hospital ED, completed an EDMUS screen, but had a medical record number that was invalid or could not be ascertained, and young people outside the age range of the study.

Measurements

Demographics

Demographic and clinical characteristics, including age, gender, educational status, Indigenous status, culturally and linguistically diverse status, postcode, ethnicity, date and time of arrival and departure at the ED, presenting problem, mode of arrival, mental health diagnoses, discharge diagnoses, and referrals, were investigated.

Problematic Internet Behaviors—EDMUS

The EDMUS was designed with a clinical purpose and not with the intent of assigning scores to items. Hence, the total EDMUS score was not a metric of choice. Tetrachoric correlation matrices (Multimedia Appendices 1 and 2) and dendrograms (Multimedia Appendix 3) were constructed to assess multicollinearity between variables. EDMUS items that most highly correlated with each other were grouped into clusters to test research questions 2 and 3. Cluster 1 included EDMUS items 2,3, and 4; cluster 2 included EDMUS items 5,6,7, and 8; cluster 3 included EDMUS items 19 and 21; and cluster 4 included EDMUS items 20 and 22 (Figure 1). A “yes” was assigned to a cluster if participants answered “yes” to any of the items within the cluster. Items 9-18 were omitted from further analysis as inaccurate recall was deemed to reduce the reliability of responses, given that participants were asked to recall events that occurred 12 months prior to the presentation [45-48].

Mental Health Status

Mental health diagnoses from medical records were grouped for ease of data analysis, following DSM-5 groupings. In particular, anxiety disorders (n=57) comprised participants with generalized anxiety disorder (n=55) and social anxiety (n=4). Personality disorders (PDs; n=39) comprised those who had cluster B traits (n=12), cluster C traits (n=3), antisocial PDs (n=3), and borderline PDs (n=28). Only mental health diagnoses with a sample size above 12 were considered for further analysis, representing at least 10% of those with mental health diagnoses in our sample. Multimedia Appendix 4 lists the range of mental health diagnoses in our sample.

Statistical Analysis

Research question 1 was tested through a descriptive analysis of participant responses to each EDMUS item. Age and gender differences for each EDMUS item were also evaluated. Participants were split into 3 age groups, from youngest to oldest in equal increments for ease of analysis: 11-15, 16-20, and 21-25 years of age.

Research question 2 was tested by performing a chi-square analysis to test for differences in EDMUS responses across different diagnostic categories for mental health and associated concerns. P values from the Fisher exact test were used for analyses with a sample size of less than 5 participants.

Research question 3 was tested by examining associations between EDMUS clusters and subsequent ED presentations 3 months after their initial visit. Statistically significant clusters and mental health diagnoses identified through chi-square analysis were stratified through a binary logistic regression model. This analysis aimed to evaluate the association with readmission (defined as re-presenting to the ED within 3 months of a recorded visit) after adjusting for confounders. A structured equation model path analysis was constructed as a final model showcasing the relationship between statistically significant findings.

Statistical analyses were conducted on IBM SPSS Statistics 26 (IBM Corp) [49] and Stata (StataCorp LLC) [50]. For statistical analyses, a P value <.05 was considered statistically significant. Given the correlation of the variables with each other, correcting the P value based on the number of comparisons would have increased the type-2 error. Therefore, multitesting corrections for this proof-of-concept study were not conducted. After the extraction of relevant data from medical records and coding for analysis, there were 13 missing values. Since these comprised less than 5% of the total number of cases, listwise deletion was considered appropriate.

Ethics Approval

Ethical approval was obtained from the Human Research Ethics Committee, South West Sydney Local Health District (2021/ETH00321). Patients completed the measure as part of a quality-improvement project rolled out internally by the hospital, and their data was shared with researchers by the data custodian as approved by the district’s ethics office. This did not involve consent by individual clients but rather consent from the institution for the use of their data, which was obtained.


Respondents’ Characteristics

Baseline demographics of participants are presented in Table 1.

Table 1. Demographics of respondents included in the study (N=149).
DemographicValue
Age (years), mean (SD); range17.31 (3.387); 11-25
Age group, n (%)

11-15 years55 (36.9)

16-20 years64 (42.3)

21-25 years30 (20.1)
Gender, n (%)

Male56 (37.6)

Female92 (61.7)

Other1 (0.7)
Age group by gender, n (%)

11-15 years, males13 (8.72)

11-15 years, females42 (28.2)

11-15 years, other0 (0)

16-20 years, males28 (18.8)

16-20 years, females35 (23.5)

16-20 years, other1 (0.67)

21-25 years, males15 (10.1)

21-25 years, females15 (10.1)

21-25 years, other0 (0)
Indigenous status, n (%)

Aboriginal34 (22.8)

Torres Strait1 (0.70)

Neither114 (76.5)
CALDa, n (%)

Yes2 (1.30)

No147 (98.7)
Decile (IRSDb)4.89
Mean (SD)2.689
At least 1 psychiatric diagnosis, n (%)

Yes120 (80.54)

No29 (19.46)

Cluster 1 (yes)18 (12.1)

Cluster 2 (yes)18 (12.1)

Cluster 3 (yes)37 (24.8)

Cluster 4 (yes)32 (21.5)
More than 1mental healthdiagnosis

Yes98 (65.8)

No51 (34.2)

Cluster 1 (yes)14 (9.40)

Cluster 2 (yes)15 (10.1)

Cluster 3 (yes)31 (20.8)

Cluster 4 (yes)35 (23.5)

aCALD: culturally and linguistically diverse.

bIRSD: index of relative socio-economic disadvantage.

A total of 149 participants met the study criteria and were included in the analysis (Figure 2). Participants had a mean age of 17.3 (SD 3.39; range 11-25) years at the time of EDMUS screening, were mostly female (n=92, 61.7%), not from an Indigenous background (n=114, 76.5%), and presented predominantly with suicide- or self-harm–related concerns and behaviors (n=118, 79.2%). Among participants, 80.5% (n=120) had a mental health diagnosis, of which depression (n=82, 55.0%) and anxiety (n=57, 38.3%) were most common.

Figure 2. Recruitment flowchart. ED: emergency department; EDMUS: emergency department media use screener; MRN: medical record number.

Analysis 1: Rates of EDMUS Responses

Table 2 summarizes EDMUS response rates by age and gender. EDMUS item 19 (family concern) had the highest endorsement, with 50 of 149 (33.6%) participants responding “yes,” followed by item 10 (sharing suicidal content on the internet in the past 12 months; n=43, 28.9%) and item 20 (own concern about internet use; n=39, 26.2%). Item 8 (experiencing problems with inappropriate, unwanted content) had the lowest “yes” response rate, with 5 of 149 (3.4%) participants responding “yes.”

Among the 3 age groups, participants aged 11-15 and 16-20 years were most likely to endorse items. Female participants affirmed EDMUS items more than male participants. Across male and female participants, item 19 (family concern) had the highest response rate in the age group of 11-15 years (63.6%, n=35). Response rates decreased with age across genders, except for cluster 2, which had peak response rates in the age group of 21-25 years.

Table 2. Emergency department media use screener (EDMUS) response rates (%) by age and gender.


Gender (yes), %Total (yes), %Total population (yes), %


FemaleMale



Age group (years)TotalAge group (years)TotalAge group (years)


11 to 1516 to 2021 to 25
11 to 1516 to 2021 to 25
11 to 1516 to 2021 to 25
EDMUSa items

114.6320.0020.0017.5830.7717.866.6717.8618.5218.7513.3317.4

211.9011.4313.3311.9615.3810.7108.9312.7310.946.6710.7

314.298.5713.3311.9630.7710.71012.5018.189.386.6712.1

414.2917.146.6714.1330.777.14010.9118.1812.503.4512.8

514.2906.677.6123.08005.3616.3603.336.70

611.908.576.679.7815.383.5705.3612.736.253.338.10

79.765.716.677.6915.3806.675.3611.113.136.676.70

89.7606.675.4900007.4103.333.40

938.1028.5713.3330.4330.7717.86016.0736.3623.446.6724.8

1042.8631.4326.6735.8723.0825.00017.8638.1828.1313.3328.9

1114.295.8813.3310.9907.1403.5710.916.356.678.10

1211.908.576.679.7803.5701.799.096.253.336.70

1316.6714.29013.0415.387.1407.1416.3610.94010.7

1421.4311.436.6715.227.6910.7107.1418.1810.943.3312.1

1523.8111.43015.227.697.146.677.1420.009.383.3312.1

169.5214.297.1410.997.697.146.677.149.0910.946.909.40

1738.1022.866.6727.1730.7710.716.6714.2936.3617.196.6722.1

189.522.8605.437.6906.673.579.091.563.334.70

1961.9011.4313.3334.7869.2325.936.6730.9163.6419.0510.0033.6

2041.4614.2913.3326.3746.1528.576.6726.7942.5920.3110.0026.2

2143.9011.436.6725.2753.8514.296.6721.4346.3014.066.6724.2

2236.5914.296.6723.0830.777.146.6712.5035.1912.506.6719.5

2334.1517.146.6723.0830.7721.436.6719.6433.3318.756.6721.5

2424.398.57014.2915.383.5705.3622.226.25010.7
EDMUS clusters

123.820.017.420.738.510.7014.327.315.66.6718.1

231.011.410.721.738.53.606.6712.534.07.8113.318.1

366.714.312.138.069.225.06.6730.467.320.310.035.6

445.220.012.830.446.228.6026.846.325.010.029.5

aEDMUS: emergency department media use screener.

Analysis 2: Associations With Background Mental Health Diagnoses

Participant Well-being

The prevalence of mental health diagnoses in accordance with EDMUS clusters is summarized in Table 3. A total of 36 different mental health diagnoses were extracted from the medical records of participants (Multimedia Appendix 2). After grouping similar disorders into broader diagnostic categories and excluding diagnoses with fewer than 12 participants, 7 mental health categories remained. These were depression, anxiety disorders, PD, posttraumatic stress disorder (PTSD), ADHD, autism spectrum disorder, and oppositional defiant disorder.

Table 3. Emergency department media use screener (EDMUS) cluster responses and chi-square or Fisher exact test results by mental health history of participants.
EDMUSa items (total “yes” responses)DepressionAnxiety disordersPDbPTSDcADHDdASDeODDf
Cluster 1 (n=27)







Response rate, n (%)g13 (15.9)9 (15.8)7 (17.9)2 (7.14)6 (21.4)6 (27.3)4 (25.0)

Chi-square or Fisher exact test (P value).43.56.97.11.61.23.49
Cluster 2 (n=27)







Response rate, n (%)13 (15.9)13 (22.8)6 (15.4)6 (21.4)7 (25.0)2 (9.10)3 (18.7)

Chi-square or Fisher exact test (P value).42.27.63.60.31.371.00
Cluster 3 (n=53)







Response rate, n (%)30 (36.6)24 (42.1)8 (20.5)7 (25.0)11 (39.3)9 (40.9)7 (43.8)

Chi-square or Fisher exact test (P value).78.19.02h27.65.57.47
Cluster 4 (n=44)







Response rate, n (%)25 (30.5)19 (33.3)7 (17.9)4 (14.3)8 (28.6)9 (40.9)4 (25.0)

Chi-square or Fisher exact test (P value).82.45.06h.07h.88.21.78
Total participants, n (%)82 (55.0)57 (38.3)39 (26.2)28 (18.8)28 (18.8)22 (14.8)16 (10.7)

aEDMUS: emergency department media use screener.

bPD: personality disorder.

cPTSD: posttraumatic stress disorder.

dADHD: attention-deficit/hyperactive disorder.

eASD: autism spectrum disorder.

fODD: oppositional defiant disorder.

gPercentage of total participants with each mental health diagnoses.

hValues considered for further analysis.

Among participants, 80.5% (n=120) had at least 1 psychiatric diagnosis and 65.8% (n=98) had more than 1 psychiatric diagnosis recorded, with depression being the most common (n=82, 55%), followed by anxiety disorders (n=57, 38.3%) and PD (n=39, 26.2%).

Chi-square Analysis

Table 3 presents chi-square analyses between each EDMUS cluster and mental health diagnoses. A statistically significant association between PD and cluster 3 (P=.02) was found.

Analysis 3: Predicting Readmission

From our sample, 58 (38.9%) participants presented to the ED within 3 months of their initial EDMUS screen, of whom 53 (91.4%) presented with mental health–related concerns.

Table 4 reports the binary logistic regression models after stratifying significant mental health diagnoses and clusters. Participants without PD whose families were not concerned about their internet use (cluster 3) and participants without PTSD who were concerned about their own internet use (cluster 4) were more likely to present to an ED subsequently (P=.02; P=.05).

Table 4. Stratification of clusters and mental health diagnoses.

BSignificanceExp (B)95% CI
PDa (no)b




Cluster 1–0.2440.7160.7840.211-2.908

Cluster 20.5430.4211.7210.459-6.455

Cluster 3–1.5510.0240.2120.055-0.813

Cluster 40.7600.2262.1390.624-7.332
PD (yes)




Cluster 1–20.3350.99900

Cluster 2–20.0040.99900

Cluster 3–20.3270.99900

Cluster 479.4950.9983.343E+340
PTSDc (no)d




Cluster 1–0.1200.8370.8870.283-2.780

Cluster 2–0.4570.5170.6330.159-2.520

Cluster 3–0.9480.1340.3870.112-1.339

Cluster 41.1510.0533.1620.985-10.151
PTSD (yes)




Cluster 121.4210.9992.009E+90

Cluster 2–0.4360.6880.6470.077-5.442

Cluster 322.0760.99900

Cluster 4–0.1321.0000.8760

aPD: personality disorder.

bModel statistics: the model significantly (P=.001) predicted readmission, capturing 54.6% (Nalgelkerke R2=0.546) of the variance in the outcome. The Hosmer and Lemeshow test of goodness of fit was not significant (P≥.99) indicating an adequate fit to the data.

cPTSD: posttraumatic disorder.

dModel statistics: The model significantly (P=.03) predicted readmission, capturing 42.0% (Nalgelkerke R2=0.420) of the variance in the outcome. The Hosmer and Lemeshow test of goodness of fit was not significant (P=.38) indicating an adequate fit to the data.

The path analysis (Figure 3, Table 5) revealed that cluster 3 (P=.009), cluster 4 (P=.02), PD (P=.003), and PTSD (P=.048) were independent predictors for readmission.

The arrows in Figure 3 suggest directions of associations with variables. The B coefficient suggests the degree of change in the outcome. A positive B coefficient suggests that an increase in the predictor variable increases the likelihood of the outcome, whereas a negative B coefficient suggests that an increase in the predictor variable decreases the likelihood of the outcome (eg, a participant with PD is less likely to answer “yes” to cluster 3).

Figure 3. Structured equation model path analysis. PD: personality disorder; PTSD: posttraumatic disorder.
Table 5. Structured equation model path analysis.a

BP value95% CI
PDb → Cluster 3–0.11.07–0.238 to 0.019
Cluster 3–0.25.009–0.441 to –0.062
Cluster 40.23.020.039 to 0.419
PD0.23.0030.077 to 0.385
PTSDc → Readmission0.16.0480.001 to 0.313
PTSD → Cluster 4–0.12.07–0.247 to 0.008

aModel statistics: χ22=2.661, P=.26, suggesting a good fit of the model to the data. The root mean squared error values were <0.05, indicating a close fit of the model to the data, and the Comparative Fit Index and Tucker-Lewis index values were >0.95, indicating a very good fit of the model to the data.

bPD: personality disorder.

cPTSD: posttraumatic stress disorder.


Principal Findings

From our sample, 17.4% (n=26) presented to the ED with an internet use–related presentation. The EDMUS did not correlate with any mental health diagnosis. However, having a recorded diagnosis of PD or PTSD were strong independent predictors of readmission. While studies endorse the idea that having a PD is a predictor of readmission [51-53], our finding that PTSD is a readmission predictor contradicts the scarce literature [54].

EDMUS Item Endorsement

Participants aged 11-15 years were more likely to endorse EDMUS items. Prior studies have demonstrated that younger adolescents are more likely to engage in harm-advocating digital content [55,56], while older age groups are more likely to post about positive experiences on the internet [57]. Some studies have also revealed that while older teenagers are more likely to use social media [58,59] and have more prevalent digital exposure to self-harm or suicide content [55], younger adolescents are more likely to reflect negatively about their negative digital experiences [59] and hence may be more likely to report them. This suggests that younger adolescents are more vulnerable to harmful digital content and may exhibit problematic internet behaviors that can be identified through internet use screening.

Female participants were more likely to endorse EDMUS items compared to male participants. Previous findings suggest that female participants are more likely to use social media and to have a negative digital experience [57]. Female participants are also more likely to engage in self-harm, with self-harm presentations in female participants aged 10-24 years almost twice that of young male participants of the same age [60]. Interestingly, cluster 2 was highly endorsed by female participants, except in the age group of 11-15 years. Our data showed higher “yes” responses among female participants, especially for item 8 (experiencing problems with inappropriate, unwanted content), endorsed by 5.49% (n=5) of female participants but by no male participants. This may be due to female participants being more likely to report negative digital experiences [59], including cyberbullying, and be negatively impacted by them [58,61]. However, it could also be the effect of having more female participants in this sample. Nevertheless, it is important to note such gender differences while screening, considering that low response rates by male participants may not necessarily reflect their intact mental well-being and may be a result of a social desire to be perceived as such.

Among the clusters investigated, cluster 3 had the highest endorsement, especially among younger participants. This is supported by literature indicating that parental concern and awareness of web-based activity decrease with age [58]. However, high response rates among younger participants may also be the effect of having a lower proportion of 21-25–year-olds in our sample compared to 11-15 and 16-20-year-olds. Nevertheless, familial awareness of internet behaviors would be valuable in various aspects, regardless of age, by mitigating risky behaviors early and providing monitoring and support, including access to interventions, and possibly improving health outcomes.

Associations With Background Mental Health Diagnoses

Overall, “yes” responses for EDMUS items were generally low. There were statistically significant associations between cluster 3 and PD. This may have been the influence of selection bias due to the mental health of participants at screening. Given that in our sample, 79% (n=118) presented to the ED with suicidal ideation or attempt and 55% (n=82) had depression, it is likely that this biased the range of recorded mental health diagnoses in the sample toward internalizing presentations. Research suggests this association between internalizing behaviors as psychological difficulties and having negative self-schemas is likely to lead to higher web-based risk-taking [62], including methods of self-harm or suicide [56,63]. However, the low endorsement of EDMUS items in our sample may be a result of individual preferences not to disclose negative behaviors to preserve self-esteem. Given that data collection was completed during the COVID-19 pandemic, the effects of the lockdown may have impacted the mental health of participants and affected their EDMUS responses. While participants with depression may engage in more risky internet behavior, the influence of social desirability biases may result in lower “yes” response rates. Hence, any indication of poorer mental well-being should not be disregarded but rather explored further.

Participants with PD were less likely to answer yes to cluster 3 items about parental concern. Research on PD and its associations with parental concern and excessive internet use have been conducted in the context of internet addiction, using the scales mentioned previously [64-66]. Low parental concern was shown to increase the likelihood of internet addiction [67], possibly due to a lack of family support exacerbating the negative emotionality seen in individuals with PD and making them more susceptible to internet overuse [66,68]. This may be due to the challenges that come with the nature of the disorder itself, where families are less likely to get along with individuals with PD because of their personality characteristics. Emotional support from both parents would increase their child’s self-esteem, in turn reducing the risk of being addicted to the internet [65]. While parental concern was measured in the EDMUS, there is no indication of how this was perceived by participants—whether a low yes response was an indication of poor emotional support or as their internet use not being a cause for concern. Yet, previous research has found that 84% of people with PD retrospectively describe experiences of biparental neglect [67]. Hence, clinically, these findings may have some importance, as low EDMUS responses may be an indication of underlying psychopathology or poor social supports.

Readmission

Our final model suggests that while individuals with PD were more likely to re-present to the ED, their response to cluster 3 items was not statistically significant in predicting readmission. Individuals without PD and whose families had no concern about their internet use were more likely to re-present to the ED, suggesting that cluster 3 was a stronger independent predictor. Figure 4 summarizes these findings in the context of current literature. Studies on psychiatric diagnoses as possible predictors of readmission reveal increasing readmission rates associated with PD or affective disorders [51-53]. While research endorses that poor emotional support in general increases the likelihood of readmission, especially among individuals with psychiatric diagnoses [67,69], literature specific to family concern over internet use and readmission is lacking. Hence, these exploratory findings may address this knowledge gap. Similarly, the interaction between low family concern over internet use, readmission, and PD specifically has not been explored previously. While our findings suggest that these variables were independent predictors of readmission, further research on this specific interaction is needed to confirm our findings.

Figure 4. Venn diagrams summarizing our findings in the context of the current literature. PTSD: posttraumatic disorder.

Further, a recorded history of PTSD was an independent predictor for readmission, contradicting the scarce emerging evidence. One meta-analysis on predictors of psychiatric readmission in children and adolescents found that while abuse and neglect were predictors for readmission in youth with externalizing disorders, having a history of PTSD was not a predictor for readmission [54]. While this study was done in the context of psychiatric in-patient readmission and in patients aged below 18 years, another study in the ED context in this age group seems to support their results [70]. It is possible that the recorded history of PTSD in our study may have reflected a history of abuse or neglect, which may have driven the statistical significance seen in our findings. Furthermore, participants in similar studies may have presented with PTSD and subsequently been readmitted, compared to primarily presenting with a depressive episode as in our study, with PTSD as a comorbidity. Nevertheless, given the degree of bias disclosed in studies within the meta-analysis, further research with larger sample sizes is required to clarify the relationships observed, including whether a history of complex psychopathology may increase the likelihood of a distressed individual re-presenting to the ED.

Our results suggest that posting about suicide was not predictive of readmission. This suggests that posting about suicide does not necessarily result in a suicidal act, contradicting previous research that has reported that accessing prosuicidal content increases the likelihood of suicidality [71]. However, recent studies question the usefulness of this information given the low validity of using search volumes to predict suicidal activity. For example, suicide-related terms used on the internet in Italy are more likely to be related to bereavement or curiosity than suicidality [72,73]. This highlights the need for clinical interviews in the future, as assumptions made through the detection of internet access may be flawed or misinterpreted.

Given that none of the other EDMUS clusters were predictive of readmission, this suggests how unpredictable mental health can be. Without follow-ups, it is difficult to know the rates of false-negatives and whether these had any impact on our findings. Hence, implementing screening or reviews at different time points may be valuable in assessing the risk posed by problematic internet behaviors for readmission and in identifying those individuals most at risk.

Strengths and Limitations

To our knowledge, the EDMUS is one of the first tools to assess excessive internet use holistically, looking at patterns of behavior as opposed to a narrow focus on either internet addiction or suicide. This adds to its strength in raising valuable questions on excessive internet use and related behaviors. The EDMUS can provide clinicians with a better understanding of their patients’ behaviors and the internet’s underlying influence, hence potentially being a point of acute intervention for risk to others; for example, 6.7% (n=10) of our participants reported having planned self-harm or suicide with someone else. Furthermore, the EDMUS can be used as a means to facilitate conversations between patients and families, allowing for better matching of interventions and supports alongside implementation of risk-mitigating strategies.

Our sample had its strengths in being naturalistic, with participants seeking help, hence having high ecological validity. Our analysis was thorough, with the implementation of further tests to confirm our findings and provide valuable insights into risk profiles and problematic internet behaviors that can be incorporated clinically. The EDMUS generated links to help young people after discharge, in line with the recommendation for novel web-based help approaches from Biddle et al [36], adding to its strengths.

In hindsight, there were several modifications that would have strengthened the EDMUS and have been considered for future versions. Redesigning the EDMUS with appropriate recall intervals and using a Likert scale for a dimensional rather than categorical assessment would allow for a better measure of risk and improve the reliability of responses.

No causal relationships and directions of association can be established between variables due to the cross-sectional design of the study. In the future, having a larger sample size and conducting longitudinal studies would be valuable in exploring these associations further, especially between perceived and actual family support. The impact of the COVID-19 pandemic on the participants was not measured through the EDMUS and may have influenced an increase in mental health presentations to the ED and responses to the EDMUS.

Conclusions

The EDMUS is a tool with potential for identifying problematic internet behaviors in young people. It also offers the opportunity for early intervention and the potential prevention of more entrenched difficulties. Identifying how young people access harm-advocating digital content may also be valuable in eliminating access and improving health outcomes. This study has reiterated that understanding a participant’s risk profile involves exploring their social supports, among other attributes. Assessing the usefulness of the EDMUS through follow-ups would be valuable in understanding the impact of its implementation.

Acknowledgments

The research team acknowledges and pays respect to the Dharawal people, who are the traditional custodians of the land this research was conducted on and pays respect to Elders both past, present, and future. We also acknowledge the support received from peers and staff at the South Western Sydney Local Health District and the Academic Unit of Infant, Child, Adolescent Psychiatry, South West Sydney, who provided feedback and moral support amidst the uncertainty brought by COVID-19. The project received funding from the Narellan Rotary Pediatric Research Grant via the Ingham Institute for Medical Research.

Data Availability

The data for this project will not be made publicly available as it contains sensitive patient information. The ethics approval sought for the project did not include data sharing provisions. A limited subset of the data may be available upon request.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Tetrachoric correlation matrix between each emergency department media use screener (EDMUS) item.

DOCX File , 17 KB

Multimedia Appendix 2

Tetrachoric correlation matrix between emergency department media use screener (EDMUS) clusters and mental health diagnosis.

DOCX File , 65 KB

Multimedia Appendix 3

Dendrogram to show collinearity between emergency department media use screener (EDMUS) items.

DOCX File , 100 KB

Multimedia Appendix 4

List of mental health diagnoses among participants.

DOCX File , 15 KB

  1. Roser M, Ritchie H, Ortiz-Ospina E. Internet. Our World in Data.   URL: https://ourworldindata.org/internet [accessed 2023-04-12]
  2. Johnson J. Worldwide digital population as of January 2021. Statista. 2021.   URL: https://www.statista.com/topics/1145/internet-usage-worldwide/#topicOverview [accessed 2021-03-08]
  3. Individuals using the internet (% of population). The World Bank.   URL: https://data.worldbank.org/indicator/IT.NET.USER.ZS?end=2018&start=2018&view=map&year=2010 [accessed 2023-04-12]
  4. Smart J. Digital technology use in the child, youth and family sector. Australian Institute of Family Studies. 2018.   URL: https:/​/aifs.​gov.au/​resources/​policy-and-practice-papers/​digital-technology-use-child-youth-and-family-sector [accessed 2023-04-12]
  5. World mental health report: transforming mental health for all. World Health Organization. 2022.   URL: https://www.who.int/publications/i/item/9789240049338 [accessed 2023-04-12]
  6. Suicide and self-harm monitoring. Australian Institute of Health Welfare. 2020.   URL: https:/​/www.​aihw.gov.au/​suicide-self-harm-monitoring/​data/​populations-age-groups/​suicide-among-young-people [accessed 2023-04-12]
  7. Hu N, Nassar N, Shrapnel J, Perkes I, Hodgins M, O'Leary F, et al. The impact of the COVID-19 pandemic on paediatric health service use within one year after the first pandemic outbreak in New South Wales Australia: a time series analysis. Lancet Reg Health West Pac 2022;19:100311 [FREE Full text] [CrossRef] [Medline]
  8. Young KS. Psychology of computer use: XL. Addictive use of the Internet: a case that breaks the stereotype. Psychol Rep 1996 Dec;79(3 Pt 1):899-902. [CrossRef] [Medline]
  9. Dullur P, Starcevic V. Internet gaming disorder does not qualify as a mental disorder. Aust N Z J Psychiatry 2018;52(2):110-111. [CrossRef] [Medline]
  10. King DL, Delfabbro PH, Potenza MN, Demetrovics Z, Billieux J, Brand M. Internet gaming disorder should qualify as a mental disorder. Aust N Z J Psychiatry 2018;52(7):615-617. [CrossRef] [Medline]
  11. van Rooij AJ, Ferguson CJ, Carras MC, Kardefelt-Winther D, Shi J, Aarseth E, et al. A weak scientific basis for gaming disorder: let us err on the side of caution. J Behav Addict 2018 Mar 01;7(1):1-9 [FREE Full text] [CrossRef] [Medline]
  12. Diagnostic and statistical manual of mental disorders: DSM-5. American Academy of Paediatrics. 2013.   URL: https://nla.gov.au/nla.cat-vn6261708):797 [accessed 2023-04-12]
  13. Lachmann B, Duke É, Sariyska R, Montag C. Who’s addicted to the smartphone and/or the internet? Psychol Pop Media Cult 2019;8(3):182-189. [CrossRef]
  14. Laconi S, Rodgers RF, Chabrol H. The measurement of internet addiction: a critical review of existing scales and their psychometric properties. Comput Human Behav 2014;41:190-202. [CrossRef]
  15. Widyanto L, Griffiths M. ‘Internet addiction’: a critical review. Int J Ment Health Addiction 2006;4(1):31-51. [CrossRef]
  16. Yellowlees PM, Marks S. Problematic internet use or internet addiction? Comput Human Behav 2007;23(3):1447-1453. [CrossRef]
  17. Yau YHC, Crowley M, Mayes LM, Potenza MN. Are internet use and video-game-playing addictive behaviors? Biological, clinical and public health implications for youths and adults. Minerva Psichiatr 2012;53(3):153-170 [FREE Full text] [Medline]
  18. Durkee T, Carli V, Floderus B, Wasserman C, Sarchiapone M, Apter A, et al. Pathological internet use and risk-behaviors among European adolescents. Int J Environ Res Public Health 2016;13(3):294 [FREE Full text] [CrossRef] [Medline]
  19. Fuchs M, Riedl D, Bock A, Rumpold G, Sevecke K. Pathological internet use-an important comorbidity in child and adolescent psychiatry: prevalence and correlation patterns in a naturalistic sample of adolescent inpatients. Biomed Res Int 2018;2018:1629147 [FREE Full text] [CrossRef] [Medline]
  20. Nereim C, Bickham D, Rich M. A primary care pediatricianʼs guide to assessing problematic interactive media use. Curr Opin Pediatr 2019;31(4):435-441. [CrossRef]
  21. Ciarrochi J, Parker P, Sahdra B, Marshall S, Jackson C, Gloster AT, et al. The development of compulsive internet use and mental health: a four-year study of adolescence. Dev Psychol 2016;52(2):272-283. [CrossRef] [Medline]
  22. D'Angelo J, Moreno MA. Screening for problematic internet use. Pediatrics 2020;145(Suppl 2):181-185. [CrossRef]
  23. Fardouly J, Vartanian LR. Social media and body image concerns: current research and future directions. Curr Opin Psychol 2016;9:1-5 [FREE Full text] [CrossRef]
  24. Holland G, Tiggemann M. A systematic review of the impact of the use of social networking sites on body image and disordered eating outcomes. Body Image 2016;17:100-110. [CrossRef] [Medline]
  25. Vannucci A, Flannery KM, Ohannessian CM. Social media use and anxiety in emerging adults. J Affect Disord 2017;207:163-166. [CrossRef] [Medline]
  26. Dullur P, Krishnan V, Diaz AM. A systematic review on the intersection of attention-deficit hyperactivity disorder and gaming disorder. J Psychiatr Res 2021;133:212-222. [CrossRef] [Medline]
  27. González-Bueso V, Santamaría JJ, Fernández D, Merino L, Montero E, Ribas J. Association between internet gaming disorder or pathological video-game use and comorbid psychopathology: a comprehensive review. Int J Environ Res Public Health 2018;15(4):668 [FREE Full text] [CrossRef] [Medline]
  28. King DL, Delfabbro PH. The cognitive psychopathology of internet gaming disorder in adolescence. J Abnorm Child Psychol 2016;44(8):1635-1645. [CrossRef] [Medline]
  29. Livingstone S, Stoilova M, Kelly A. Cyberbullying: incidence, trends and consequences. In: Ending the Torment: Tackling Bullying from the Schoolyard to Cyberspace. New York: United Nations Publications; 2016:115-120.
  30. Nesi J, Burke TA, Bettis AH, Kudinova AY, Thompson EC, MacPherson HA, et al. Social media use and self-injurious thoughts and behaviors: a systematic review and meta-analysis. Clin Psychol Rev 2021;87:102038 [FREE Full text] [CrossRef] [Medline]
  31. Sinyor M, Mallia E, de Oliveira C, Schaffer A, Niederkrotenthaler T, Zaheer J, et al. Emergency department visits for self-harm in adolescents after release of the Netflix series '13 Reasons Why'. Aust N Z J Psychiatry 2022;56(11):1434-1442 [FREE Full text] [CrossRef] [Medline]
  32. Bailey E, Rice S, Robinson J, Nedeljkovic M, Alvarez-Jimenez M. Theoretical and empirical foundations of a novel online social networking intervention for youth suicide prevention: a conceptual review. J Affect Disord 2018;238:499-505. [CrossRef] [Medline]
  33. Shafi RMA, Nakonezny PA, Romanowicz M, Nandakumar AL, Suarez L, Croarkin PE. The differential impact of social media use on middle and high school students: a retrospective study. J Child Adolesc Psychopharmacol 2019;29(10):746-752 [FREE Full text] [CrossRef] [Medline]
  34. Perera J, Wand T, Bein KJ, Chalkley D, Ivers R, Steinbeck KS, et al. Presentations to NSW emergency departments with self-harm, suicidal ideation, or intentional poisoning, 2010-2014. Med J Aust 2018;208(8):348-353. [CrossRef] [Medline]
  35. Gansner M, Belfort E, Cook B, Leahy C, Colon-Perez A, Mirda D, et al. Problematic internet use and associated high-risk behavior in an adolescent clinical sample: results from a survey of psychiatrically hospitalized youth. Cyberpsychol Behav Soc Netw 2019;22(5):349-354. [CrossRef] [Medline]
  36. Biddle L, Derges J, Goldsmith C, Donovan JL, Gunnell D. Using the internet for suicide-related purposes: contrasting findings from young people in the community and self-harm patients admitted to hospital. PLoS One 2018;13(5):e0197712 [FREE Full text] [CrossRef] [Medline]
  37. Dullur P, Hay P. Problem internet use and internet gaming disorder: a survey of health literacy among psychiatrists from Australia and New Zealand. Australas Psychiatry 2017;25(2):140-145. [CrossRef] [Medline]
  38. Berryman C, Ferguson CJ, Negy C. Social media use and mental health among young adults. Psychiatr Q 2018;89(2):307-314. [CrossRef] [Medline]
  39. de Vries DA, Vossen HGM, van der Kolk-van der Boom P. Social media and body dissatisfaction: investigating the attenuating role of positive parent-adolescent relationships. J Youth Adolesc 2019;48(3):527-536 [FREE Full text] [CrossRef] [Medline]
  40. Shafi RMA, Romanowicz M, Croarkin PE. #SwitchedOn: a call for assessing social media use of adolescents. Lancet Psychiatry 2018;5(11):e27. [CrossRef]
  41. Ayers JW, Althouse BM, Leas EC, Dredze M, Allem J. Internet searches for suicide following the release of 13 Reasons Why. JAMA Intern Med 2017;177(10):1527-1529 [FREE Full text] [CrossRef] [Medline]
  42. Blue Whale: the game. Devon Children and Families Partnership.   URL: https:/​/www.​dcfp.org.uk/​health-and-wellbeing/​suicide-awareness/​suicide-awareness-information-for-professionals/​blue-whale/​ [accessed 2023-04-12]
  43. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap): a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42(2):377-381 [FREE Full text] [CrossRef] [Medline]
  44. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, REDCap Consortium. The REDCap consortium: building an international community of software platform partners. J Biomed Inform 2019;95:103208 [FREE Full text] [CrossRef] [Medline]
  45. Schaeffer NC, Dykema J. Advances in the science of asking questions. Annu Rev Sociol 2020;46(1):37-60. [CrossRef]
  46. Coughlin SS. Recall bias in epidemiologic studies. J Clin Epidemiol 1990;43(1):87-91. [CrossRef] [Medline]
  47. McPhail S, Haines T. Response shift, recall bias and their effect on measuring change in health-related quality of life amongst older hospital patients. Health Qual Life Outcomes 2010;8:65 [FREE Full text] [CrossRef] [Medline]
  48. Stopher P. Collecting, Managing, and Assessing Data Using Sample Surveys. Cambridge: Cambridge University Press; 2012.
  49. IBM support. IBM SPSS. 2019.   URL: https://www.ibm.com/support/pages/downloading-ibm-spss-statistics-26 [accessed 2023-04-12]
  50. Stata 17 released. The Stata Blog. 2021.   URL: https://blog.stata.com/2021/04/20/stata-17-released/ [accessed 2023-04-12]
  51. Korkeila JA, Lehtinen V, Tuori T, Helenius H. Frequently hospitalised psychiatric patients: a study of predictive factors. Soc Psychiatry Psychiatr Epidemiol 1998;33(11):528-534. [CrossRef] [Medline]
  52. Mellesdal L, Mehlum L, Wentzel-Larsen T, Kroken R, Jørgensen HA. Suicide risk and acute psychiatric readmissions: a prospective cohort study. Psychiatr Serv 2010;61(1):25-31. [CrossRef] [Medline]
  53. Barker D, Jairam R, Rocca A, Goddard L, Matthey S. Why do adolescents return to an acute psychiatric unit? Australas Psychiatry 2010;18(6):551-555. [CrossRef] [Medline]
  54. Edgcomb JB, Sorter M, Lorberg B, Zima BT. Psychiatric readmission of children and adolescents: a systematic review and meta-analysis. Psychiatr Serv 2020;71(3):269-279. [CrossRef] [Medline]
  55. Hawton K, Saunders KE, O'Connor RC. Self-harm and suicide in adolescents. Lancet 2012;379(9834):2373-2382. [CrossRef]
  56. Oksanen A, Näsi M, Minkkinen J, Keipi T, Kaakinen M, Räsänen P. Young people who access harm-advocating online content: a four-country survey. Cyberpsychology 2016;10(2):1-10. [CrossRef]
  57. The digital lives of Aussie teens. Office of the eSafety Commissioner.   URL: https://apo.org.au/node/310831 [accessed 2023-04-12]
  58. Like, post, share: young Australians' experience of social media. Australian Communications and Media Authority.   URL: https://apo.org.au/node/35223 [accessed 2023-04-12]
  59. State of play-youth, kids and digital dangers. Office of the eSafety Commissioner.   URL: https://apo.org.au/node/143541 [accessed 2023-04-12]
  60. Sara G, Wu J, Uesi J, Jong N, Perkes I, Knight K, et al. Growth in emergency department self-harm or suicidal ideation presentations in young people: comparing trends before and since the COVID-19 first wave in New South Wales, Australia. Aust N Z J Psychiatry 2023;57(1):58-68 [FREE Full text] [CrossRef] [Medline]
  61. Milton AC, Gill BA, Davenport TA, Dowling M, Burns JM, Hickie IB. Sexting, web-based risks, and safety in two representative national samples of young australians: prevalence, perspectives, and predictors. JMIR Ment Health 2019;6(6):e13338 [FREE Full text] [CrossRef] [Medline]
  62. Harris KM, McLean JP, Sheffield J. Examining suicide-risk individuals who go online for suicide-related purposes. Arch Suicide Res 2009;13(3):264-276. [CrossRef] [Medline]
  63. Livingston S, Haddon L, Görzig A. Children, Risk and Safety on the Internet: Research and Policy Challenges in Comparative Perspective. Bristol: Bristol University Press; 2012.
  64. Restrepo A, Scheininger T, Clucas J, Alexander L, Salum GA, Georgiades K, et al. Problematic internet use in children and adolescents: associations with psychiatric disorders and impairment. BMC Psychiatry 2020;20(1):252. [CrossRef]
  65. Yao MZ, He J, Ko DM, Pang K. The influence of personality, parental behaviors, and self-esteem on internet addiction: a study of Chinese college students. Cyberpsychol Behav Soc Netw 2014;17(2):104-110 [FREE Full text] [CrossRef] [Medline]
  66. Zadra S, Bischof G, Besser B, Bischof A, Meyer C, John U, et al. The association between internet addiction and personality disorders in a general population-based sample. J Behav Addict 2016;5(4):691-699 [FREE Full text] [CrossRef] [Medline]
  67. Steele KR, Townsend ML, Grenyer BFS. Parenting and personality disorder: an overview and meta-synthesis of systematic reviews. PLoS One 2019;14(10):e0223038 [FREE Full text] [CrossRef] [Medline]
  68. Lu WH, Lee KH, Ko CH, Hsiao RC, Hu HF, Yen CF. Relationship between borderline personality symptoms and internet addiction: the mediating effects of mental health problems. J Behav Addict 2017;6(3):434-441 [FREE Full text] [CrossRef] [Medline]
  69. Donisi V, Tedeschi F, Wahlbeck K, Haaramo P, Amaddeo F. Pre-discharge factors predicting readmissions of psychiatric patients: a systematic review of the literature. BMC Psychiatry 2016;16(1):449 [FREE Full text] [CrossRef] [Medline]
  70. Rosic T, Duncan L, Wang L, Eltorki M, Boyle M, Sassi R, et al. Trends and predictors of repeat mental health visits to a pediatric emergency department in Hamilton, Ontario. J Can Acad Child Adolesc Psychiatry 2019;28(2):82-90 [FREE Full text] [Medline]
  71. Tran US, Andel R, Niederkrotenthaler T, Till B, Ajdacic-Gross V, Voracek M. Low validity of Google Trends for behavioral forecasting of national suicide rates. PLoS One 2017;12(8):e0183149 [FREE Full text] [CrossRef] [Medline]
  72. Ortiz P, Khin Khin E. Traditional and new media's influence on suicidal behavior and contagion. Behav Sci Law 2018;36(2):245-256. [CrossRef] [Medline]
  73. Solano P, Ustulin M, Pizzorno E, Vichi M, Pompili M, Serafini G, et al. A Google-based approach for monitoring suicide risk. Psychiatry Res 2016;246:581-586. [CrossRef] [Medline]


ADHD: attention-deficit/hyperactive disorder
DSM-5: Diagnostic and Statistical Manual of Mental Disorders
ED: emergency department
EDMUS: emergency department media use screener
PD: personality disorder
PTSD: posttraumatic stress disorder


Edited by A Mavragani; submitted 26.09.22; peer-reviewed by M Eltorki, M Gilbert; comments to author 16.12.22; revised version received 05.03.23; accepted 06.03.23; published 15.05.23

Copyright

©Pravin Dullur, Joanne Joseph, Antonio Mendoza Diaz, Ping-I Lin, Rajeev Jairam, Rhian Davies, Anne Masi, Boaz Shulruf, Valsamma Eapen. Originally published in JMIR Formative Research (https://formative.jmir.org), 15.05.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.