The first 5 most commonly used search engines in Italy (namely, Bing, Virgilio, Yahoo, Google, and Libero) were mined with the search term “suicidio” (Italian for suicide). For each search, the first 100 webpages were considered. Websites resulting from each search were collected and duplicates deleted so that webpages could be analyzed and rated by 2 authors independently (MO and DP).

Quality assessment of the included webpages was performed with the HONcode instrument, which comprises the following sections: authoritative (if the qualifications of the authors are mentioned), complementarity (if the site aims at supporting but not replacing or substituting the physician-patient relationship), privacy (if visitors' data are protected and respected), attribution (if sources of published information in the medical and health-related pages are explicitly mentioned and referred to), justifiability (if claims related to potential benefits or performance are evidence based), transparency (if the presentation of the online material is accessible, with accurate email contacts), financial disclosure (if eventual funding sources are identified and mentioned), and advertising policy (if advertising and editorial materials are separate and identifiable) [16].

The agreement between the 2 authors was assessed with the Cohen κ statistic.

Furthermore, the 2 authors filled in an ad hoc predesigned Excel spreadsheet (Microsoft Corp) containing questions concerning the attitude of the webpage toward suicide (prosuicide, antisuicide, mixed or neutral), content and purpose of the webpage (supporting or emotional, informative, preventive), supervision or guidance (if the webpage was user-generated or handled by a professional figure, such as a psychiatrist or a psychologist), reference to age groups (adolescents or older people) targeted or referred to by the webpage (this simple dichotomic stratification was applied based on the availability of information provided and considering that the majority of internet users consist of adolescents), reference to other psychiatric disorders or comorbidities, the presence of figures or pictures related to suicide, and the presence of access restraint.

Moreover, for each included webpage, the number of comments’ likes, and shares, if any, was recorded.

Before commencing any statistical handling and processing of the data, figures were visually inspected for potential outliers. The normality of data distribution was checked using the D’Agostino-Pearson omnibus test. Univariate analysis (chi-squared test and the chi-squared test for trend, Fisher’s exact test, t test, and analysis of variance or their nonparametric versions in case of violation of normal distribution) was performed for the variables under study. Multivariate linear regression analysis was performed to shed light on the determinants of the HONcode score.

All statistical analyses were performed with the commercial SPSS for Windows, version 24.0 (IBM Corp). Figures with P values less than .05 were considered statistically significant.

To the best of our knowledge, this is the first study to assess the quality and content of suicide-related webpages in the Italian language.

We found that the percentage of explicitly prosuicide websites was greater than that reported by Wong et al [11] but less than that reported by Chen et al (16.3%), who analyzed 375 linked webpages in Chinese [12]. According to the authors, 41.3% of the included webpages were antisuicide, and the majority of the prosuicide sites were user-generated (96.7%). Interestingly, searches using the search term “ways to kill yourself” (31.7%) and “painless suicide” (28.3%) generated much larger numbers of potentially harmful webpages than did the keyword “suicide” (4.3%).

A much larger portion of prosuicide websites (42%) was found by Sakarya et al [17], who analyzed 100 webpages. Thirteen percent of the studied sample was found to have content or material that may be considered protective against suicidal behavior, a result in line with our findings. However the authors found that “protective” websites did not have any kind of medical supervision or guidance from specialized mental health professionals. In contrast to this, we managed to find a statistically significant association between these 2 variables.

Til and Niederkrotenthaler [18] performed a cross-cultural study by comparing the suicide-related web searches in Austria and the USA. They found that in both countries, protective outweighed harmful website characteristics by approximately 2:1, a finding in line with our result. Authors were able to confirm the observation of Wong et al: websites retrieved with method-related search terms (eg, how to hang yourself) contained more harmful information (USA: P<.001; Austria: P<.05) and fewer protective characteristics (USA: P<.001; Austria: P<.001) compared to the term “suicide” [11]. Conversely, help-related search terms (eg, suicidal thoughts) yielded more webpages with positive and protective characteristics (USA: P=.07; Austria: P<.01). Interestingly, authors found that websites retrieved with the US search engines generally had more protective characteristics (P<.001) than did those retrieved with Austrian search engines. Moreover, resources with dangerous or harmful characteristics were better ranked than those with positive or protective characteristics (USA: P<.01; Austria: P<.05).

In another study, Thornton and colleagues [13] found that among Google searches retrieved related to suicide, a high portion of them were irrelevant webpages (n=136, approximately 26% of the entire sample). Of the 329 relevant websites, the majority were suicide preventive (about 68%); however, a considerable proportion of sites expressed mixed/ambiguous (22%) or neutral (8%) attitudes toward suicide, and 1% were explicitly prosuicide, figures which were slightly different from ours.

These inconsistent literature findings could be explained by the cultural differences across countries in which suicide-related web searches are performed, as shown by the research of Till and Niederkrotenthaler [15], as well as policies concerning the web. Overall, the combination of societal data and online behavior monitoring provide the best indication of risks [19].

The presence of antisuicide online material is of crucial importance for 2 major reasons: (1) according to a recent review of the literature [6], individuals at risk for suicide are probably more prone to look for suicide-related information online, and searching online information related to suicide is a proxy of suicidal ideation; and (2) according to a randomized controlled trial, education professional suicide prevention websites appear to increase and improve suicide prevention–related knowledge, especially among vulnerable and socially isolated individuals [18]. Therefore, exposure to high-quality curated websites may be associated with a reduction in suicidal thoughts and actions. Recent research has shown that the proactive suicide prevention online model is robust for identifying people that are at risk of suicide [20].

Despite some strengths, including being the first study to systematically assess the quality of suicide-related webpages in the Italian language, our investigation suffers from some limitations that should be properly acknowledged. The major shortcoming is the small sample size of webpages analyzed and the search limited to the keyword “suicide.” Future research should also explore other words indirectly related to suicide as well as other terms related to the ways suicide can be committed (ie, method-related search terms) and explore whether the semantic differential has an impact on suicide-related webpages in terms of content and quality. Moreover, caution should be used when generalizing the present findings to other countries, as our results could be affected by country-specific cultural issues and may not reflect the nature of other settings. Further, although we assessed the reference to other psychiatric disorders or comorbidities in the webpages included in our study, we were not able to establish a link between mental illness and suicide in terms of browsing websites. This warrants dedicated, ad hoc studies specifically exploring this topic. Another aspect that should be investigated concerns the size or burden of the psychological effect imposed by browsing suicide-related websites.

Sixty-four webpages were included in our analysis: 12.5% (8/64) were antisuicide and 6.3% (4/64) explicitly prosuicide. The majority of the included websites had a mixed or neutral attitude toward suicide (52/64, 81.2%) and had an informative content and purpose (39/64, 60.9%). Most webpages targeted adolescents as an age group (38/64, 59.4%), contained a reference to other psychiatric disorders or comorbidities (42/64, 65.6%), had medical or professional supervision or guidance (45/64, 70.3%), lacked figures or pictures related to suicide (41/64, 64.1%), and did not use any access restraint (62/64, 96.9%).

Specialized mental health professionals should take into account these findings, make an effort to improve their presence online, and provide high-quality material. However, given the aforementioned limitations, further research in the field is warranted.