This paper is in the following e-collection/theme issue:

Early Results in Infodemiology and Infoveillance (57) eHealth Service, Product, Resource Reviews (25) Quality/Credibility of eHealth Information and Trust Issues (485) Information Quality in Digital Media (316) Infodemiology in Public Health Informatics (12) Infodemiology and Infoveillance (1269)

Published on in Vol 8 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/49198, first published .
Arabic Web-Based Information on Oral Lichen Planus: Content Analysis

Arabic Web-Based Information on Oral Lichen Planus: Content Analysis

Arabic Web-Based Information on Oral Lichen Planus: Content Analysis

Authors of this article:

Azzam AlMeshrafi1 Author Orcid Image ;   Arwa F AlHamad2, 3, 4 Author Orcid Image ;   Hamoud AlKuraidees5 Author Orcid Image ;   Lubna A AlNasser3, 6 Author Orcid Image
Article Authors Cited by Tweetations (2) Metrics

    Original Paper

    1Department of Periodontics, King Saud Medical City, Riyadh, Saudi Arabia

    2Dental Services, Ministry of National Gaurd Health Affairs, Riyadh, Saudi Arabia

    3King Saud bin Abdulaziz University for Health Sciences, Ministry of National Gaurd Health Affairs, Riyadh, Saudi Arabia

    4King Abdullah International Medical Research Center, Ministry of National Gaurd Health Affairs, Riyadh, Saudi Arabia

    5Department of Dental Medicine, Maple Clinic, Dammam, Saudi Arabia

    6Department of Population Health, King Abdullah International Medical Research Center, Ministry of National Gaurd Health Affairs, Riyadh, Saudi Arabia

    Corresponding Author:

    Arwa F AlHamad, BDS, MSc, PhD

    Dental Services

    Ministry of National Gaurd Health Affairs

    Prince Mutib bin Abdullah bin Abdulaziz Rd

    Riyadh, 11426

    Saudi Arabia

    Phone: 966 118011111

    Email: hamadar@mngha.med.sa


    Background: The use of web-based health information (WBHI) is on the rise, serving as a valuable tool for educating the public about health concerns and enhancing treatment adherence. Consequently, evaluating the availability and quality of context-specific WBHI is crucial to tackle disparities in health literacy and advance population health outcomes.

    Objective: This study aims to explore and assess the quality of the WBHI available and accessible to the public on oral lichen planus (OLP) in Arabic.

    Methods: The Arabic translation of the term OLP and its derivatives were searched in three general search platforms, and each platform’s first few hundred results were reviewed for inclusion. We excluded content related to cutaneous LP, content not readily accessible to the public (eg, requiring subscription fees or directed to health care providers), and content not created by health care providers or organizations (ie, community forums, blogs, and social media). We assessed the quality of the Arabic WBHI with three standardized and validated tools: DISCERN, Journal of the American Medical Association (JAMA) benchmarks, and Health On the Net (HON).

    Results: Of the 911 resources of WBHI reviewed for eligibility, 49 were included in this study. Most WBHI resources were provided by commercial affiliations (n=28, 57.1%), with the remainder from academic or not-for-profit affiliations. WBHI were often presented with visual aids (ie, images; n=33, 67.4%). DISCERN scores were highest for WBHI resources that explicitly stated their aim, while the lowest scores were for providing the effect of OLP (or OLP treatment) on the quality of life. One-quarter of the resources (n=11, 22.4%) met all 4 JAMA benchmarks, indicating the high quality of the WBHI, while the remainder of the WBHI failed to meet one or more of the JAMA benchmarks. HON scores showed that one-third of WBHI sources had scores above 75%, indicating higher reliability and credibility of the WBHI source, while one-fifth of the sources scored below 50%. Only 1 in 7 WBHI resources scored simultaneously high on all three quality instruments. Generally, WBHI from academic affiliations had higher quality scores than content provided by commercial affiliations.

    Conclusions: There are considerable variations in the quality of WBHI on OLP in Arabic. Most WBHI resources were deemed to be of moderate quality at best. Providers of WBHI could benefit from increasing collaboration between commercial and academic institutions in creating WBHI and integrating guidance from international quality assessment tools to improve the quality and, hopefully, the utility of these valuable WBHI resources.

    JMIR Form Res 2024;8:e49198

    doi:10.2196/49198

    Keywords

    oral lichen planus; health information; Arabic; medical information; information seeking; quality; online information; Arab; oral; inflammatory; inflammation; chronic; mouth; mucous membrane; mucous membranes; reliable; reliability; credible; credibility; periodontology; dental; dentist; dentistry 


    The internet has revolutionized the visibility and accessibility of data [1]. Over half of today’s world population used the internet in 2021 [2]. Searching the internet for web-based health information (WBHI) was the third most frequent internet activity, and 6.75 million searches are performed daily for health information [3,4]. Often, WBHI is considered a “first aid” resource for health information and is used to compare diagnoses or treatment options [5,6], or to supplement insufficient time with a health care provider [6,7]. More seriously, some patients believe that WBHI is trustworthy and might defer or replace medical consultation or treatment from health care providers [6,8,9]. Lastly, recent evidence suggests that seeking WBHI could be associated with changes in health behavior or patient outcomes [6,8,9]. Therefore, ensuring the availability, accessibility, and quality of WBHI is essential to the well-being of individuals and the community.

    The format and quality of WBHI vary substantially. The format ranges from health blogs/forums based on personal experiences offering unregulated information to peer-reviewed journal articles that provide complex data addressed to medical professionals [10,11]. Therefore, the quality of WBHI could vary considerably between the resources of WBHI. Some global research indicates that the quality of some WBHI targeting the public could be of low quality [10,11]. Evidence that examined Arabic WBHI often found that a considerable proportion of the WBHI had low quality, including but not limited to not disclosing the authorship of the information, outdated information, and lack of advice that WBHI should not replace a health care consultation [12-16]. Often, high-quality WBHI would require payment (ie, subscription) for access, exacerbating the inequalities in accessing WBHI for some individuals [10]. The evaluation of context-specific WBHI (ie, language) emerges as a public health priority that might address some health literacy inequality.

    Oral lichen planus (OLP) is a prevalent chronic inflammatory mucocutaneous disease that frequently affects the oral mucosa. Between 0.5%-2% of the world’s population is affected by OLP [17-19]. In a review of studies conducted in Arab countries, OLP had a potential malignant transformation rate ranging from 0.4% to 6.5% [20]. Although there is no gold standard measure of the quality of WBHI, some international tools like the Journal of the American Medical Association (JAMA) benchmarks and Health On the Net (HON) are frequently used to examine the WBHI in different languages. Literature that evaluated the English content of WBHI regarding OLP using the aforementioned tools reported moderate accuracy and reliability [11]. A comprehensive evaluation of 122 Arabic health websites revealed that these websites varied substantially in meeting some industry benchmarks, like the HON code. For instance, 16% of the websites provided information on their advertising policies, while 73% provided justification for the content included within a website [21,22].

    Though accessing high-quality WBHI can effectively increase the public’s knowledge, support health-related decision-making, and improve health-seeking behaviors or outcomes [8,23], no studies focused on evaluating OLP-related WBHI in Arabic. As such, the need arises to scrutinize the content and accuracy of Arabic WBHI related to OLP that is accessible to the public. This study assessed the availability and quality of OLP-related resources in Arabic.


    Search Strategy

    This study was a cross-sectional evaluation of Arabic WBHI on OLP. We searched for the Arabic translation of the keywords “oral lichen planus,” “treatment of oral lichen planus,” and their derivatives (علاج حزاز فموي, حزاز فموي منبسط,حزاز فموي مسطح ,حزاز فموي) in three main search engines, namely, Google, Yahoo, and Bing. We used the Boolean operator (OR) to link these terms but did not use any conditions of filters to mimic electronic research that patients or members of the public might perform on OLP.

    We reviewed the first few hundred links on each platform for inclusion until links were no longer relevant to OLP. We included resources (ie, web pages) with information on OLP in Arabic. We excluded WBHI focusing on extra-oral lichen planus, scientific content requiring membership (eg, subscriptions) or directed to professionals (ie, specialty journals), community-based forums without professional guidance, social media posts, and results promoted or advertised by search engines. We also excluded resources that included video or audio content only with no accompanying text and results that were in .doc, .pdf, or .ppt format, as the public might be less likely to seek such resources. Two trained evaluators (AA and HA) simultaneously screened and evaluated the OLP Arabic WBHI resources and deferred to the senior author (AFA) in case of disagreement.

    Domains and Tools for Evaluating WBHI

    The WBHI resources were assessed for content and quality. The content of the resources was categorized as reported previously by Ni Riordan and McCreary [24] and attached in Multimedia Appendix 1 [24]. Briefly, results were grouped according to the affiliation of the web page (commercial, nonprofit, governmental, or university/medical center), specialization (if a web page is either entirely or partially related to the searched topic), content type (medical facts, clinical trials, human interest stories, or question and answer), and content presentation (text, images/graphs, videos, and audio). The quality of the web pages was assessed with the DISCERN instrument [25], the JAMA benchmarks [26], and the HON code [27].

    The DISCERN tool aims to empower consumers when making treatment choices by evaluating the quality of written health information (ie, publications). DISCERN is a validated 16-item instrument, with each item rated on a 5-point scale (1=did not fulfill item to 5=complete fulfillment of item) and is arranged in three sections. The first section (items 1-8) addresses the reliability of the publication, the second section (items 9-15) assesses the quality of the information related to treatment choices, and the third section consists of one item (item 16) that gives an overall quality rating of the content [25,28,29].

    JAMA benchmarks assess the accountability of WBHI by examining the following domains of resources: authorship (providing authors and their affiliations), attribution (eg, citations) of the source of information provided, disclosure (revealing any ownership, sponsorship, or conflict of interest in providing the WBHI), and currency (ie, updates of the WBHI) [26].

    The HON tool evaluates the reliability and credibility of health websites. HON asks reviewers to evaluate a given web page regarding eight sections: authority, complementarity, confidentiality, attribution, justifiability, transparency, financial disclosure, and advertising policy [30]. The reviewer will score each item from 0% (did not fulfill the specific item) to 100% (total fulfillment of that item), while the HON final score is an average of scores across the eight items.

    Statistical Analysis

    Data were extracted, coded, and cleaned in Excel (Microsoft Corporation), then analyzed using SPSS Statistics (Version 24.0; IBM Corp). The data were summarized using frequency and percentage distribution for the categorical variables and means with SDs for the continuous variables. We classified WBHI by type of affiliation into commercial and academic (including nonprofit, medical center, and governmental), then compared the quality of WBHI across these groups using bivariate analyses. To facilitate comparison with previous literature, the HON score was categorized into an ordinal variable as such: scores <50% (low credibility), 51%-75% (moderate credibility), and scores >75% (high credibility). Fleiss κ was used to calculate the interrater reliability of the reviewers in assigning the HON score as a categorical variable [31]. Lastly, to synthesize information from all three quality measures, we created a composite variable as follows: high-quality WBHI means the resource satisfied at least 3 of the JAMA benchmarks, had a HON score ≥75, and had a DISCERN overall score ≥3; otherwise, the WBHI was considered low-quality.

    Ethical Considerations

    This study was exempt from ethical review since it used publicly available data sources that do not include any patient-identifying data.


    Overview

    The keywords returned the highest number of hits in Google (n=56,770), followed by Yahoo (n=5188) and Bing (n=1910). We reviewed the first 400 results on Google, 300 on Yahoo, and 211 on Bing until the web pages were unrelated to OLP. After removing duplicated results, a total of 49 results were included in this study. The most frequent reason for exclusion was results about oral lesions other than OLP (Figure 1). The interrater reliability measure indicated a high agreement between the evaluators in assigning HON scores (κ=0.826, 95% CI 0.823-0.828).

    ‎
    Figure 1. Flowchart of web-based health information resources' identification, screening, and inclusion (n=49). OLP: oral lichen planus.

    Content Assessment

    More than half of the web pages had commercial affiliations (n=28, 57.1%), that is, WBHI provided by for-profit clinics with clear advertisements for treatment or establishments (Table 1). Conversely, 43% (n=21) of the WBHI resources had academic affiliations (nonprofit, medical centers, and governmental affiliations). Only one-fifth of the web pages (n=11, 22%) were focused exclusively on OLP, rather than lichen planus in general. The vast majority of Arabic OLP WBHI was in the format of medical facts (n=42, 85.7%), and most WBHI included images of OLP (n=31, 63%; Table 1).

    Table 1. Content assessment of Arabic web-based health information on oral lichen planus (OLP) using Ni Riordan and McCreary’s [24] method (n=49).
    CategoriesWeb pages, n (%)
    Content affiliation

    		Commercial28 (57.1)

    		Nonprofit19 (38.8)

    		Medical center2 (4.1)

    		Governmental0 (0.0)
    Content specialization

    		Entirely related to OLP11 (22.3)

    		Partially related to OLP38 (77.6)
    Content format

    		Medical facts42 (85.7)

    		Human stories2 (4.1)

    		Question and answer format4 (8.2)

    		Clinical trials1 (2.0)
    Content presentation

    		Included images31 (63.3)

    		Included videos2 (4.1)

    		Included audio1 (2.0)

    		Text only15 (30.6)

    Quality Assessment by DISCERN

    The overall mean score of DISCERN for the included WBHI was rather low (mean 2.61, SD 1); however, the average rating of single items varied substantially (Table 2). Items with the highest DISCERN scores described the publication’s aims and the alternative OLP treatment options. There was no evidence to indicate meaningful differences in the DISCERN scores between WBHI presented by commercial and academic affiliations.

    Table 2. Overall and stratified average (SD) of DISCERN scores by affiliation type (n=49).
    Domain and DISCERN itemAll (N=49), mean (SD)Academic (n=21), mean (SD)Commercial (n=28), mean (SD)P value
    Reliability

    		Q1. Explicit aims3.37 (1.0)3.61 (0.7)3.19 (1.1).07

    		Q2. Attainment of aims3.27 (1.0)3.17 (1.1)3.42 (0.7).27

    		Q3. Relevance3.18 (1.1)3.47 (0.92)2.96 (1.10).07

    		Q4. Explicit sources2.20 (1.8)2.76 (1.94)1.78 (1.57).06

    		Q5. Explicit date1.73 (1.4)2.05 (1.5)1.5 (1.17).13

    		Q6. Balanced and unbiased2.69 (1.5)2.57 (1.50)2.78 (1.47).66

    		Q7. Additional sources1.92 (1.2)1.90 (1.22)1.92 (1.27).96

    		Q8. Areas of uncertainty2.08 (1.3)3.09 (1.13)1.32 (0.77)<.001a
    Treatment options

    		Q9. How treatment works2.57 (1.5)2.47 (1.28)2.64 (1.63).84

    		Q10. Benefits of treatment2.08 (1.3)1.95 (0.86)2.17 (1.56).85

    		Q11. Risk of treatment1.92 (1.2)1.95 (0.86)1.89 (1.47).24

    		Q12. Effect of no treatment1.67 (1.4)1.42 (1.20)1.85 (1.48).25

    		Q13. Effect on quality of life1.24 (0.7)1.09 (0.43)1.35 (0.78).18

    		Q14. All alternatives described3.37 (1.9)3.38 (1.93)3.35 (1.88).96

    		Q15. Shared decision3.20 (1.8)2.61 (1.49)3.64 (1.80).04

    		Q16. Overall rating of the source2.61 (1.0)2.61 (1.16)2.60 (0.91).98

    aItalics indicate a statistically significant result.

    Quality Assessment by JAMA Benchmarks

    Only 22.4% (n=11) of the WBHI resources met all 4 JAMA benchmarks, indicating high quality, and another 24.5% (n=12) met 3 of the 4 benchmarks. Overall, most WBHI fulfilled the “Disclosure” criteria, while less than half of the web pages fulfilled the “Attribution” criteria (Table 3). Academic affiliations satisfied the authorship and attribution more often than commercial affiliations but were less current than commercial resources (Table 3).

    Table 3. Overall and stratified distribution of the fulfillment of Journal of the American Medical Association (JAMA) benchmarks and Health On the Net (HON) scores among reviewed web-based health information (WBHI; n=49).

    		All (n=49), n (%)Commercial affiliation (n=28), n (%)Academic affiliation (n=21), n (%)P value
    JAMA benchmarks fulfilleda

    		Authorship27 (55.1)14 (50.0)13 (61.9).56

    		Attribution18 (36.7)7 (25.0)11 (52.4).07

    		Currency33 (67.3)20 (71.4)13 (61.9).55

    		Disclosure40 (81.6)23 (82.1)17 (80.9)>.99

    		Fulfilling 3 benchmarks12 (24.5)6 (21.43)6 (28.57).74

    		Fulfilling all 4 benchmarks11 (22.4)6 (21.43)5 (23.81)>.99
    HON score (range 0-100)b.09

    		<5010 (20.4)8 (28.6)2 (10)

    		51-7525 (51.1)15 (53.6)10 (46.6)

    		>7514 (28.6)5 (17.9)9 (43.9)
    High-quality WBHIc7 (14.29)2 (7.14)5 (23.81).12

    aJAMA comparisons denote raw percentages comparing the relative contribution by affiliation type within each JAMA benchmark.

    bHON comparison denotes column contribution by affiliation type across levels of HON scores.

    cHigh-quality WBHI denotes a WBHI resource that satisfied at least 3 of the JAMA benchmarks, had a HON score >75, and had an overall DISCERN score ≥3; otherwise, a resource was labeled as low-quality.

    Quality Assessment by HON

    The average HON score was significantly higher for academic affiliation sources of WBHI than commercial affiliations (mean 71, SD 14 vs mean 56, SD 15; P<.001). When HON scores were examined as an ordinal variable, almost one-third (n=14, 29%) of the WBHI resources scored higher than 75, indicating high credibility of the WBHI, with more contributions from academic rather than commercial affiliations (Table 3).

    Overall Quality Assessment

    When WBHI information was classified by collective score combining all three quality instruments, it was found that 1 in every 7 resources (n=7, 14.3%) had high quality, and most of this high-quality evidence came from academic affiliations (n=5, 23.8% vs n=2, 7.1% from commercial affiliations; Table 3). However, the difference in the distribution of quality levels across affiliation types was not significant (Fisher exact test P=.12).


    Principal Findings

    This study evaluated the content and quality of the Arabic WBHI on OLP available to the public using prevalidated standardized tools. The results indicated that approximately one-third of the WBHI had high scores, corresponding to higher quality, as indicated by the JAMA and HON tools. The Arabic WBHI on OLP was often presented as a narration of medical facts and frequently included audiovisual aids to enhance the consumer’s comprehension of health information, and most were provided by commercial affiliations. To the best of our knowledge, this is the first study to evaluate Arabic WBHI on OLP. As OLP can be a chronic condition with occasional atypical forms and a potential for malignant transformation, patients are likely to supplement their clinical consultations with WBHI [7,17,32,33]. Hence, this evaluation of the quality of WBHI on OLP in Arabic is essential and timely.

    The Arabic WBHI on OLP in this study included a higher percentage of resources deemed to be of higher quality compared to Arabic WBHI on other diseases, including periodontal diseases and breast and oral cancers [12,14,34]. For instance, in this study, 1 in every 5 WBHI sources had fulfilled all 4 JAMA benchmarks, while recent results by Halboub et al [16] and Al-Ak’hali et al [34] found the same for 8% and 4%, respectively, of the websites they reviewed. The association of higher quality with resources classified as academic was noted in previous studies evaluating Arabic WBHI [34]. Lastly, DISCERN scores in this study were slightly higher than those reported by Alakhali et al [14] on oral cancer. However, these studies evaluated different diseases, and the higher scores could reflect “better” WBHI on OLP compared to oral cancer or an inherent subjectivity in the DISCERN instrument by virtue of having a Likert scale.

    Most of the WBHI resources we reviewed had more commercial affiliations than affiliations to medical or research centers. This generally agrees with the literature where commercial affiliations were the most prolific providers of WBHI [12,13,34]. This is consequential as the web pages with a commercial affiliation often include advertising of certain treatments or care providers. Some evidence suggests that advertising negatively affects the credibility of the information offered and individuals’ trust in the source of WBHI [35]. Moreover, compared to academic affiliations, we observed a lower quality among WBHI by commercial affiliations, as evidenced by the HON, DISCERN, and JAMA benchmarks scores. While these differences in quality scores did not always reach statistical significance (possibly due to the relatively small sample size), they indicate a consistent trend among commercial affiliations across all the quality tools used.

    Of the WBHI we reviewed, the authority and attribution were the least fulfilled JAMA domains—that is, resources rarely mentioned the authors and the references of the WBHI. This was in line with previous studies on Arabic WBHI on oral cancer, periodontal diseases, and epilepsy [13,34]. This highlights an area of potential improvement as the authority of the author (ie, the level of expertise of the person writing the information) was found to increase the credibility and trust in the content of the WBHI [35]. Moreover, other evidence from an Arabic-speaking country showed that participants prioritized information provided by health care professionals over other sources [9]. Our findings, along with conclusions from other Arabic WBHI, are useful for developers of WBHI resources to promote transparency when creating web-based content to maximize the benefit of WBHI to the public.

    Enhancing the content and quality of Arabic WBHI is pivotal in optimizing its effectiveness and influence on patients’ well-being. For example, research reported that 49% of the participants in a US-based national survey used WBHI as a first resource to address health concerns [36]. Another study from Saudi Arabia reported that the patients who sought diabetes mellitus–related WBHI, compared to nonseekers, were more health conscious and showed a positive trend of better self-care [8]. Three critical issues must be highlighted when we combine evidence from this study with conclusions from similar research on Arabic WBHI. First, the quality of available resources in Arabic is moderate at best, leaving the public at a disadvantage as most of the evidence is deemed low-quality. Second, developers and providers of WBHI of digital health content must invest in the quality of WBHI in Arabic to empower the public [37]. This could be accomplished by benchmarking the finalized content against the quality tools frequently used in the relevant literature to build more robust, impactful WBHI. Third, it is imperative to establish policies and guidelines that guarantee the quality of Arabic WBHI that are produced, disseminated, or promoted for the benefit of the public.

    Strengths and Limitations

    This study reviewed the content of three major search engines, potentially covering the majority of OLP-related WBHI that the public could find, access, and use. Additionally, we used validated and standardized tools to evaluate the quality and content of OLP health information on the web, enhancing the comparability with research elsewhere. However, this study could not assess Arabic readability due to some challenges related to the available tools and our belief that readability in Arabic is context specific and best explored through research that uses community participatory methods (ie, focus groups). Future efforts should strive to include the readability of the Arabic WBHI from both the providers’ and the consumers’ perspectives. Lastly, the WBHI we evaluated included published web pages up to mid-2020, coinciding with the height of the COVID-19 pandemic. The COVID-19 pandemic increased the demand for digital resources in general, which might have positively affected the quality of WBHI in general in response to the increased demand for web-based information. However, given the comparison of our results to other recent evidence on Arabic WBHI post COVID-19 [14,34,38], we assume that the Arabic WBHI content did not experience a change of a magnitude large enough to substantially alter our conclusions regarding the quality of Arabic WBHI related to OLP available to the public.

    Conclusion

    This study evaluated the quality of Arabic WBHI on OLP available to the public, using several validated and standardized tools, namely, JAMA, DISCERN, and HON. The results indicated that the quality of the WBHI is moderate at best, with only 1 in 7 resources scoring simultaneously high on all three resources. Commercial affiliations of the WBHI provided more content than academic affiliations; however, the content delivered by the former was of lower quality. Therefore, the collaboration between commercial and academic WBHI providers could improve the quality of the OLP resources offered to the public. Lastly, providers of WBHI in Arabic could benefit from integrating guidance from international quality tools to enhance the quality and, hopefully, the utility of these valuable WBHI resources.

    Acknowledgments

    The authors wish to thank Ms Lolwah Almousa for her help with the statistical analysis and creating graphs. The authors also thank the anonymous peer reviewers for their valuable feedback that shaped the final version of this manuscript.

    The authors received no financial support for this research. No generative artificial intelligence tools were used to write any portion of this manuscript.

    Data Availability

    Data are available from the corresponding author upon request.

    Authors' Contributions

    AFA conceptualized the study. AA and HA acquired and curated the data. LAA performed the data analysis. AA, HA, and AFA wrote the initial draft. LAA and AFA edited and critically reviewed the draft. All authors have reviewed and agreed to publish the final version of this manuscript.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Riordan and McCreary content categorization.

    DOCX File , 16 KB
    1. Tonsaker T, Bartlett G, Trpkov C. Health information on the internet: gold mine or minefield? Can Fam Physician. May 2014;60(5):407-408. [FREE Full text] [Medline]
    2. Internet usage statistics: the internet big picture world internet users and 2023 population stats. Internet World Stats. URL: https://www.internetworldstats.com/stats.htm [accessed 2024-06-11]
    3. Eysenbach G, Kohler CH. What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the internet. AMIA Annu Symp Proc. 2003;2003:225-229. [FREE Full text] [Medline]
    4. de Boer MJ, Versteegen GJ, van Wijhe M. Patients' use of the internet for pain-related medical information. Patient Educ Couns. Sep 2007;68(1):86-97. [CrossRef] [Medline]
    5. Susannah F, Deborah F. Internet Health Resources. Semantic Scholar. Jul 16, 2003. URL: https://api.semanticscholar.org/CorpusID:70962132 [accessed 2024-03-11]
    6. Beck F, Richard J, Nguyen-Thanh V, Montagni I, Parizot I, Renahy E. Use of the internet as a health information resource among French young adults: results from a nationally representative survey. J Med Internet Res. May 13, 2014;16(5):128-141. [FREE Full text] [CrossRef] [Medline]
    7. Iverson SA, Howard KB, Penney BK. Impact of internet use on health-related behaviors and the patient-physician relationship: a survey-based study and review. J Am Osteopath Assoc. Dec 2008;108(12):699-711. [Medline]
    8. Jamal A, Khan SA, AlHumud A, Al-Duhyyim A, Alrashed M, Bin Shabr F, et al. Association of online health information-seeking behavior and self-care activities among type 2 diabetic patients in Saudi Arabia. J Med Internet Res. Aug 12, 2015;17(8):196-212. [FREE Full text] [CrossRef] [Medline]
    9. Alduraywish SA, Altamimi LA, Aldhuwayhi RA, AlZamil LR, Alzeghayer LY, Alsaleh FS, et al. Sources of health information and their impacts on medical knowledge perception among the Saudi Arabian population: cross-sectional study. J Med Internet Res. Mar 19, 2020;22(3):1-9. [FREE Full text] [CrossRef] [Medline]
    10. Fox S, Duggan M. Health online 2013. Pew Research Center. Dec 15, 2013. URL: https://www.pewresearch.org/internet/2013/01/15/health-online-2013/ [accessed 2022-09-17]
    11. Hu X, Pan H, He W, Hua H, Yan Z. Evaluation of the content quality of websites for recurrent aphthous ulcers and oral lichen planus. BMC Oral Health. Dec 29, 2017;17(1):170-177. [FREE Full text] [CrossRef] [Medline]
    12. Alnaim L. Evaluation breast cancer information on the internet in Arabic. J Cancer Educ. Aug 2019;34(4):810-818. [CrossRef] [Medline]
    13. Alnemary F, Alnemary F, Alamri A, Alamri Y. Characteristics of Arabic websites with information on autism. Neurosciences (Riyadh). Apr 2017;22(2):143-145. [FREE Full text] [CrossRef] [Medline]
    14. Alakhali MS. Quality assessment of information on oral cancer provided at Arabic speaking websites. Asian Pac J Cancer Prev. Apr 01, 2020;21(4):961-966. [FREE Full text] [CrossRef] [Medline]
    15. Alkhateeb JM, Alhadidi MS. Information about epilepsy on the internet: an exploratory study of Arabic websites. Epilepsy Behav. Jan 2018;78:288-290. [CrossRef] [Medline]
    16. Halboub E, Al-Ak'hali MS, Alqahtani AS, Abdulghani EA, Kamil MA, Alhajj MN, et al. Quality of web-based Arabic health information on dental implants: an infodemiological study. BMC Oral Health. Apr 20, 2023;23(1):232-239. [FREE Full text] [CrossRef] [Medline]
    17. Carbone M, Arduino PG, Carrozzo M, Gandolfo S, Argiolas MR, Bertolusso G, et al. Course of oral lichen planus: a retrospective study of 808 northern Italian patients. Oral Dis. Apr 17, 2009;15(3):235-243. [CrossRef] [Medline]
    18. Boorghani M, Gholizadeh N, Taghavi Zenouz A, Vatankhah M, Mehdipour M. Oral lichen planus: clinical features, etiology, treatment and management; a review of literature. J Dent Res Dent Clin Dent Prospects. Feb 22, 2010;4(1):3-9. [FREE Full text] [CrossRef] [Medline]
    19. Chen Y, Wang Y, Yu H, Yu C, Chang Y. Time trend in the prevalence of oral lichen planus based on Taiwanese National Health Insurance Research Database 1996-2013. J Dent Sci. Sep 01, 2018;13(3):274-280. [FREE Full text] [CrossRef] [Medline]
    20. Al-Nasser L, El-Metwally A. Oral lichen planus in Arab countries : a review. J Oral Pathol Med. Nov 2014;43(10):723-727. [CrossRef] [Medline]
    21. AlHuziah M, AlKahtany M, AlAmmari R, AlFaiz R. Assessment of online health information for Arabic sites. Dokumen. Nov 2009. URL: https://dokumen.tips/documents/assessment-of-online-health-information-for-arabic-sites.html?page=1 [accessed 2023-11-06]
    22. Altuwaijri MM. Empowering patients and health professionals in the Arab world: the King Abdullah bin Abdulaziz Arabic Health Encyclopedia on the Web. Yearb Med Inform. 2011;6:125-130. [Medline]
    23. Jacobs W, Amuta AO, Jeon KC. Health information seeking in the digital age: an analysis of health information seeking behavior among US adults. Cogent Soc Sci. Mar 13, 2017;3(1):1-11. [CrossRef]
    24. Ni Riordain R, McCreary C. Head and neck cancer information on the internet: type, accuracy and content. Oral Oncol. Aug 2009;45(8):675-677. [CrossRef] [Medline]
    25. Charnock D, Shepperd S. Learning to DISCERN online: applying an appraisal tool to health websites in a workshop setting. Health Educ Res. Aug 2004;19(4):440-446. [CrossRef] [Medline]
    26. Morris ME, Aguilera A. Mobile, social, and wearable computing and the evolution of psychological practice. Prof Psychol Res Pr. Dec 2012;43(6):622-626. [FREE Full text] [CrossRef] [Medline]
    27. Health On the Net. URL: https://web.archive.org/web/20220916033954/https://myhon.ch/en/ [accessed 2022-09-16]
    28. Charnock D. Quality criteria for consumer health information on treatment choices. In: The DISCERN Handbook. Abingdon. Radcliffe Medical; 1998.
    29. Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. Feb 1999;53(2):105-111. [FREE Full text] [CrossRef] [Medline]
    30. Boyer C, Selby M, Scherrer J, Appel R. The Health On the Net Code of Conduct for medical and health Websites. Comput Biol Med. Sep 1998;28(5):603-610. [CrossRef] [Medline]
    31. Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bull. Nov 1971;76(5):378-382. [CrossRef]
    32. Lauritano D, Arrica M, Lucchese A, Valente M, Pannone G, Lajolo C, et al. Oral lichen planus clinical characteristics in Italian patients: a retrospective analysis. Head Face Med. Apr 26, 2016;12:18-24. [FREE Full text] [CrossRef] [Medline]
    33. Tadakamadla J, Kumar S, Lalloo R, Gandhi Babu DB, Johnson NW. Impact of oral potentially malignant disorders on quality of life. J Oral Pathol Med. Jan 2018;47(1):60-65. [CrossRef] [Medline]
    34. Al-Ak'hali MS, Fageeh HN, Halboub E, Alhajj MN, Ariffin Z. Quality and readability of web-based Arabic health information on periodontal disease. BMC Med Inform Decis Mak. Feb 04, 2021;21(1):41-49. [FREE Full text] [CrossRef] [Medline]
    35. Sbaffi L, Rowley J. Trust and credibility in web-based health information: a review and agenda for future research. J Med Internet Res. Jun 19, 2017;19(6):218-235. [FREE Full text] [CrossRef] [Medline]
    36. Hesse BW, Nelson DE, Kreps GL, Croyle RT, Arora NK, Rimer BK, et al. Trust and sources of health information: the impact of the Internet and its implications for health care providers: findings from the first Health Information National Trends Survey. Arch Intern Med. 2005;165(22):2618-2624. [CrossRef] [Medline]
    37. Alhuwail D, Abdulsalam Y. Assessing electronic health literacy in the state of Kuwait: survey of internet users from an Arab state. J Med Internet Res. May 24, 2019;21(5):e11174. [FREE Full text] [CrossRef] [Medline]
    38. Halboub E, Al-Ak'hali MS, Al-Mekhlafi HM, Alhajj MN. Quality and readability of web-based Arabic health information on COVID-19: an infodemiological study. BMC Public Health. Jan 18, 2021;21(1):151-158. [CrossRef] [Medline]

    ‎
    HON: Health On the Net
    JAMA: Journal of the American Medical Association
    OLP: oral lichen planus
    WBHI: web-based health information

    Edited by A Mavragani; submitted 21.05.23; peer-reviewed by L Alnaim, M Alakhali, Z Huang, M Sarhan; comments to author 05.09.23; revised version received 20.11.23; accepted 13.02.24; published 19.03.24.

    Copyright

    ©Azzam AlMeshrafi, Arwa F AlHamad, Hamoud AlKuraidees, Lubna A AlNasser. Originally published in JMIR Formative Research (https://formative.jmir.org), 19.03.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.