Published on in Vol 8 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/55270, first published .
Using Smartphones to Enhance Vision Screening in Rural Areas: Pilot Study

Using Smartphones to Enhance Vision Screening in Rural Areas: Pilot Study

Using Smartphones to Enhance Vision Screening in Rural Areas: Pilot Study

Authors of this article:

Zheng Wang1 Author Orcid Image ;   John Kempen2, 3, 4, 5 Author Orcid Image ;   Gang Luo2 Author Orcid Image

Original Paper

1School of Medicine, Jiaxing University, Jiaxing, China

2Schepens Eye Research Institute, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, United States

3Department of Ophthalmology, Harvard Medical School, Boston, MA, United States

4Sight for Souls, Bellevue, WA, United States

5Eye Unit, MyungSung Christian Medical Center General Hospital, MyungSung Medical School, Addis Ababa, Ethiopia

Corresponding Author:

Gang Luo, PhD

Schepens Eye Research Institute

Massachusetts Eye and Ear

Harvard Medical School

20 Staniford Street

Boston, MA, 02114

United States

Phone: 1 6179122529

Email: gang_luo@meei.harvard.edu


Background: While it is treatable, uncorrected refractive error is the number one cause of visual impairment worldwide. This eye condition alone, or together with ocular misalignment, can also cause amblyopia, which is also treatable if detected early but still occurs in about 4% of the population. Mass vision screening is the first and most critical step to address these issues, but due to limited resources, vision screening in many rural areas remains a major challenge.

Objective: We aimed to pilot-test the feasibility of using smartphone apps to enhance vision screening in areas where access to eye care is limited.

Methods: A vision screening program was piggybacked on a charity summer camp program in a rural county in Sichuan, China. A total of 73 fourth and fifth graders were tested for visual acuity using a standard eye chart and were then tested for refractive error and heterophoria using 2 smartphone apps (a refraction app and a strabismus app, respectively) by nonprofessional personnel.

Results: A total of 5 of 73 (6.8%, 95% CI 2.3%-15.3%) students were found to have visual acuity worse than 20/20 (logarithm of minimal angle of resolution [logMAR] 0) in at least one eye. Among the 5 students, 3 primarily had refractive error according to the refraction app. The other 2 students had manifest strabismus (one with 72–prism diopter [PD] esotropia and one with 33-PD exotropia) according to the strabismus app. Students without manifest strabismus were also measured for phoria using the strabismus app in cover/uncover mode. The median phoria was 0.0-PD (IQR 2.9-PD esophoria to 2.2-PD exophoria).

Conclusions: The results from this vision screening study are consistent with findings from other population-based vision screening studies in which conventional tools were used by ophthalmic professionals. The smartphone apps are promising and have the potential to be used in mass vision screenings for identifying risk factors for amblyopia and for myopia control. The smartphone apps may have significant implications for the future of low-cost vision care, particularly in resource-constrained and geographically remote areas.

JMIR Form Res 2024;8:e55270

doi:10.2196/55270

Keywords



Visual impairment impacts individuals’ ability to participate in activities of daily living and social integration, disrupting their quality of life and health. To mitigate the impact of visual impairment, regular eye exams are important. However, regular eye exams are still a luxury for many people for various reasons that lead to limited access to eye care.

For instance, in sub-Saharan Africa, there are only 2 ophthalmologists per million people, while the global mean is 32. It is the only region in the world where the prevalence of moderate and severe vision impairment has increased from 1990 to 2020 [1,2]. Even in developed countries, disparity in eye care is a grim reality. According to US Centers for Disease Control, the percentage of American adults who reported not having an eye examination within the past year ranged from 20% to 30% [3]. The number is even higher among older persons residing in nursing homes, 53% of whom had not seen an eye care provider in the past year [4]. Inconvenience or inability to visit hospitals, cost concerns, and the limited scale of the eye care work force are the major reasons [4].

The World Health Organization and the International Agency for the Prevention of Blindness launched the VISION 2020: The Right to Sight initiative, aiming to eliminate avoidable blindness in the world by 2020 [5]. In 2021, the agency recognized that uncorrected refractive error is still a major cause of blindness and vision impairment in the world, affecting 86 million individuals [6], although it is treatable with glasses.

The rates of annual vision screening among school-aged children in developed countries are relatively high, but there are still gaps. Strabismus is one of the main risk factors for amblyopia, but it is usually not included in screening protocols due to a lack of professional skills in school nurses. When a child is flagged for amblyopia based on a stereopsis test, the vision disorder is often already present and may be difficult to treat. In 2002, the American Academy of Pediatrics strongly urged the development of efficient strabismus screening technology for preschool and school-aged children [7,8].

A number of studies and reports have suggested that community eye care programs should use health workers with entry-level qualifications and platforms to help patients in remote areas more easily access professionals; these are the 2 key approaches to the success of public vision programs [9,10]. However, a gap in these approaches is the lack of detailed vision examinations for informing medical decisions. This may cause excessively high false-positive referral rates [11]. To address this gap, we have invented several key technologies for smartphone-based vision testing, which include computer vision and psychophysical methods for measuring ocular misalignment [12,13], refractive error [14], and retinal degeneration [15]. Key features of these apps are that no specially made attachment is needed in order to use them and they run on standard smartphones. With minimal training, laypersons can use the apps to perform vision tests as long as their smartphones are compatible. The accuracy of these apps has been evaluated previously against standard clinical testing methods in hospital settings [12,14]. This paper reports the findings from a school vision screening program that used the apps we developed for the first time. We aimed to demonstrate the feasibility of an app-based vision screening program involving both strabismus and refractive error tests performed by nonprofessionals.


Vision Testing Apps

The app for strabismus assessment (Figure 1) has been validated and evaluated previously in a clinical setting by comparing it with standard clinical methods, including the modified Thorington test, the cover test with prism, and synoptophores [12]. When the app was used in this study, the automated cover test mode was used, in which one of the subject’s eyes was covered while the computer vision algorithm kept tracking the status of both eyes, and the app automatically took a snapshot of both eyes with a flash as soon as the covered eye was uncovered. This mode allowed the examiners to perform cover/uncover or alternating-cover tests. In this study, the cover/uncover test was performed. The app calculates ocular alignment using the Hirshberg method and gives results in prism diopters (PDs) [13].

Figure 1. Two vision screening apps were used in this study. On the left is the photo screening app based on the Hirschberg test to measure ocular alignment. Here, the tester has zoomed in to check the visualization of the measurement. On the right is the interface of the refraction measurement app, which captures images of the patient’s face with the selfie camera and shows stimuli (the letter E has been chosen here) on the left of the screen according to a viewing distance estimated from the face images.

The app for refractive error measurement (Figure 1) has been validated previously and evaluated in a clinical setting by comparing it with standard clinical methods, including autorefractors and noncycloplegic subjective refraction [14]. The app estimates refractive error by measuring the far point distance for discerning 20/20 Tumbling E letters [14] or the 20/20-equivalent clock dial chart [16]. When Tumbling E letters are used, the result is spherical equivalent (SE) power in diopters (D), and when the clock dial chart is used, the results give spherical power and cylindrical power based on 2 far points for perpendicular lines. In this study, the Tumbling E letter stimuli were used first to determine the SE, and then clock dial chart was used to estimate cylinder power around the SE range.

Vision Screening Protocol

Participants first underwent visual acuity testing at a 5-m distance from a standard Tumbling E chart (Figure 2). There are 5 letters on each line from 20/40 downwards. Participants were given 0.02 log units credit for each extra letter read. Participants who had visual acuity worse than 20/20 in at least one eye were tested further for refractive error with the refraction app (Figure 1). Near phoria was measured with the strabismus app (Figure 1) approximately 40 cm from the phone while the participants were instructed to fixate on the phone flash. The vision measurement with apps was performed by personnel without optometry expertise. All vision tests were performed under a noncycloplegic condition.

Figure 2. A standard Tumbling E eye chart was used in vision screening of 73 children in Sichuan, China, in 2023.

Participants

A total of 73 fourth and fifth graders in Meigu County, Sichuan, China, who attended a charity summer camp in 2023 were screened for vision as a part of the charity program. All children lived locally and were members of the Yi people, an ethnic minority group in China. The per capita gross domestic product in Meigu County is about US $2270, 18% of the Chinese national average. Being in a low-income mountainous area, most of the children had never undergone vision testing due to very limited access to local eye care services. They needed to be taught how to report the orientation of the letter E on the eye chart.

Ethical Considerations

The vision screening was one component of the charity summer camp program. Consent for the vision test was included in the summer camp consent form. Participants received free tutoring classes, meals, and school supplies during the 2-week summer camp. Other than that, they were not compensated specifically for participating in the vision screening. This paper reports the results of a secondary data analysis. The vision measurement data, with individual identifiable information removed, were shared by the charity program. This research received approval with exemption of consent from the Institutional Review Board of Massachusetts Eye and Ear. The study was conducted in accordance with the tenets of the Declaration of Helsinki.


We identified 5 students (7%, 95% CI 2.3%-15.3%) as having visual acuity worse than 20/20 in at least one eye (Table 1). Measuring refraction with the app showed that 2 students had astigmatism (patient P1, cylinder –1 D in the left eye, patient P4, cylinder –0.5 D in the right eye). One student was found to be hyperopic in both eyes (patient P3, sphere +3.2 D in both eyes), and also was strabismic (72-PD esotropia). This was probably a case of accommodative esotropia [17]. His refractive error was not measured directly at the site, but estimated based on the commonly used near point distance of human eyes (25 cm). According to the app, his near point was at 1.2 m, which corresponds to –0.8 D, where he could not see 20/80 letters at close range and maintained 20/80 vision beyond the near point. Therefore, the estimate of his refractive error was 4 – 0.8 = 3.2 D. According to Mäntyjärvi’s [18] findings in a hyperopic population, the amplitude of accommodation is at least 4 D, based on which the estimate would also be 3.2 D. Another student was also found to be strabismic (patient P4, 35-PD exotropia). The 2 students with manifest strabismus were suspected to have amblyopia. The student with the worst visual acuity among the participants (20/100 in the right eye and 20/167 in the left eye) had moderate myopia (patient P5, sphere –3 D in both eyes), and her near-phoria was 7-PD esotropia. This student was given a pair of off-the-shelf glasses (–3 D for both eyes), and her vision in both eyes improved to 20/33.

Table 1. Among the 73 students screened in a rural area in China, participants who had visual acuity lower than 20/20 in at least 1 eye (5 of 73 children) are listed here. Refraction and phoria were measured using the 2 apps shown in Figure 1. The text describes the estimation method.
PatientVisual acuity 20/xx (logMARa)Refraction (diopters)Phoria/tropia (prism diopters)

Right eyeLeft eyeRight eyeLeft eye
P120 (0)25 (0.1)Sphere –0.5Sphere –1.2; cylinder –1.04 esophoria
P217 (–0.07)26 (0.12)Sphere –0.8Sphere –0.92 exophoria
P3b80 (0.6)80 (0.6)Sphere +3.2Sphere +3.272 esotropiac
P433 (0.2)25 (0.1)Sphere 0.5; cylinder –0.5Sphere –0.533 exotropiac
P5100 (0.7)167 (0.9)Sphere –3.0Sphere –3.07 esophoria

alogMAR: logarithm of minimal angle of resolution.

bRefraction for patient 3 was calculated based on the near point acquired by the refraction app.

cManifest strabismus, measured without cover.

Figure 3 shows the distribution of the near-phoria of the students, excluding the 2 students with manifest strabismus, who are listed in Table 1. Phoria was under 10 PD in the majority. The median phoria was 0.0 PD (IQR 2.9-PD esophoria to 2.2-PD exophoria). There was 1 outlier, a student with 26-PD esophoria and normal visual acuity. Excluding this outlier, the mean phoria of the group was 0.2 (SD 4.1)-PD esophoria.

Figure 3. Distribution of phoria measured with the strabismus app during vision screening. Negative values represent exophoria. The curve is smoothed by a 3-PD wide sliding window. PD: prism diopter.

Summary

By using 2 mobile apps designed for vision testing, ocular alignment and refraction measurements were successfully and easily incorporated in school vision screening. The testing results provided much richer information than conventional vision screening, which normally does not include the 2 tests. Based on this particular screening, the vision issues among the rural-area, school-aged children were primarily uncorrected refractive error and amblyopia.

Interpretations

While myopia prevalence rates are very high in East Asia, including China, where in some economically developed cities, it is even above 80% among school-aged students [19], the majority of the fourth and fifth grade students in this screening had emmetropic vision (uncorrected visual acuity better than 20/20). Ample outdoor activity time and a light burden of study requiring the use of near vision, as we witnessed and surveyed during the summer camp, are likely the main reasons for the large differences between these students and their urban counterparts. Nevertheless, 4% (3/73) of the children mainly had refractive error (patients P1, P2 and P5 in Table 1). This rate is very similar to the prevalence (4.1%) found in the rural child population in India [20]. In addition, there were 2 students (2.7%) with manifest strabismus (patients P3 and P4 in Table 1). This rate is within the range of strabismus prevalence (2.06%-3.9%) among children in Taiwan in the years 2014 to 2019 [21]. As for the phoria of the nonstrabismic students in this study (mean phoria 0.2-PD esophoria, SD 4.1 PD; IQR 2.9-PD esophoria to 2.2-PD exophoria), it is similar to the normative range found among 879 elementary school students by Lyon et al [22] using the modified Thorington test (mean 1-PD exophoria, SD 4 PD; IQR 2-PD esophoria to 2-PD exophoria).

The consistency with epidemiology findings from other large population-based vision screening studies suggests that the screening results in this study are probably reliable. A difference from previous screening studies, though, is that this screening study used smartphone-based strabismus and refractive error tests, while most vision screening studies were conducted by professionals using conventional optometry methods. For instance, in the screening study by Dandona et al [20], strabismus was assessed using a penlight and refractive error was measured using a streak retinoscope and handheld autorefractor; both measurements were made by ophthalmic professionals. Our study provides a proof of concept that vision screening tests, including for strabismus and refractive error, can be performed using smartphone apps by persons without optometry expertise. A further study to develop the use of this simple and portable approach to mass vision screening is warranted.

Limitations

One limitation of this study was that the vision test results were not verified by clinical gold standard testing due to the nature of the education charity program. However, it should be noted that the main focus of this study was not to evaluate measurement accuracy, as previous evaluation studies have already addressed that aspect. The difference from our previous evaluation is that this study involved a sample that included people with and without eye conditions, while previous studies deliberately selected patients with a wide range of conditions.

Implications

Thanks to their affordability, ubiquity, and validity, smartphone-based vision screening tools have the potential to play a pivotal role in mass vision screening efforts, particularly in areas where access to eye care is limited. These innovative tools may impact eye health care by providing a cost-effective and convenient solution for screening, identifying, and addressing vision issues, especially in underserved communities.

One example of such technology is the Peek Acuity app (Peek Vision), which has made significant strides in the field of mobile vision screening. This app has been deployed to screen tens of thousands of individuals in some studies in Africa [9,23,24]. Its success in large-scale vision screening efforts underscores the scalability and effectiveness of smartphone-based apps. By offering an efficient way to measure visual acuity, the Peek Acuity app has empowered health care providers to reach more people, making it a useful tool for addressing visual impairment.

Another photoscreening app, GoCheck Kids (Gobiquity Inc), is primarily designed to assess for amblyopia risk factors [11,25]. By analyzing eccentric photorefraction red-reflex images, the app does not require patients to respond, and it therefore can be used to examine preverbal children. The app has been tested in clinical trials by comparing it with its counterparts among dedicated screening devices, such as iScreening [26]. It is reported by the company that developed GoCheck Kids that 4 million children have been screened [27].

Considering the successful deployment of these smartphone apps, we expect that a mobile technology–based vision screening approach, operated by personnel with basic training, will be scalable and will complement service programs provided by ophthalmic clinicians and dedicated screening devices (eg, iScreen, Spot Vision Screener). The mobile app approach is particularly suitable for low -resource countries and could also be used for screening in classrooms. Compared to Peek Acuity and GoCheck Kids, the screening apps assessed in this study can measure refractive error and strabismus quantitatively rather than flagging for risk factors (GoCheck Kids) or not measuring these most common conditions at all (Peek Acuity).

Our future investigations will aim to assess the positive and negative predictive values of these apps in large-scale vision screening programs, building upon the feasibility demonstrated in this preliminary study.

Acknowledgments

The phoria testing app was developed with support in part from the National Institutes of Health (NIH; grant SBIR R44 EY025902 awarded to EyeNexo LLC, which GL cofounded). The refraction testing app was developed in collaboration with EyeNexo by GL’s lab with support in part from the NIH (grant EY034345), a Harvard Catalyst award (National Center for Advancing Translational Sciences; NIH award UL1 TR002541), and financial contributions from Harvard University and its affiliated academic health care centers. The content is solely the responsibility of the authors and does not necessarily represent the official views of Harvard Catalyst, Harvard University and its affiliated academic health care centers, or the NIH. JK received funding from Sight for Souls and the Massachusetts Eye and Ear Global Surgery Program. We thank Joye Luo for helping with visual acuity measurement in the vision screening.

Data Availability

Data used in this paper may be made available for research purposes if requested through the corresponding author.

Conflicts of Interest

GL owns a patent on ocular alignment assessment and a patent on refraction assessment. GL is a cofounder of EyeNexo LLC, a startup company developing smartphone apps for vision tests. ZW and JK declare no conflicts.

  1. GBD 2019 Blindness and Vision Impairment Collaborators, Vision Loss Expert Group of the Global Burden of Disease Study. Trends in prevalence of blindness and distance and near vision impairment over 30 years: an analysis for the Global Burden of Disease Study. Lancet Glob Health. Feb 2021;9(2):e130-e143. [FREE Full text] [CrossRef] [Medline]
  2. Kempen J, Naidoo K, Gichuhi S, Briant P, Vos T, Resnikoff S, et al. et al. Prevalence of blindness and visual impairment in sub-Saharan Africa in 2020: magnitude and temporal trends, systematic review and meta-analysis (forthcoming). Ophthalmic Epidemiol. 2024.
  3. US Centers for Disease Control and Prevention. The State of Vision, Aging, and Public Health in America. Atlanta, GA. US Department of Health and Human Services; 2011.
  4. Elliott AF, Heskett M, Spiker C, McGwin G, Owsley C. Low rates of eye care utilization among visually impaired subsidized senior housing residents. Aging Ment Health. Feb 2021;25(2):360-366. [FREE Full text] [CrossRef] [Medline]
  5. Pizzarello L, Abiose A, Ffytche T, Duerksen R, Thulasiraj R, Taylor H, et al. VISION 2020: The Right to Sight: a global initiative to eliminate avoidable blindness. Arch Ophthalmol. Apr 2004;122(4):615-620. [CrossRef] [Medline]
  6. GBD 2019 Blindness and Vision Impairment Collaborators, Vision Loss Expert Group of the Global Burden of Disease Study. Causes of blindness and vision impairment in 2020 and trends over 30 years, and prevalence of avoidable blindness in relation to VISION 2020: the Right to Sight: an analysis for the Global Burden of Disease Study. Lancet Glob Health. Feb 2021;9(2):e144-e160. [FREE Full text] [CrossRef] [Medline]
  7. Committee on Practice and Ambulatory Medicine, Section on Ophthalmology, American Academy of Pediatrics. Use of photoscreening for children's vision screening. Pediatrics. Mar 2002;109(3):524-525. [CrossRef] [Medline]
  8. Scheiman M, Amos C, Ciner E, Marsh-Tootle W, Moore B, Rouse M. Pediatric eye and vision examination. In: Optometric Clinical Practice Guideline. St. Louis, MO. American Optometric Association; 2002;1-34.
  9. Manus M, van der Linde J, Kuper H, Olinger R, Swanepoel DW. Community-based hearing and vision screening in schools in low-income communities using mobile health technologies. Lang Speech Hear Serv Sch. Apr 20, 2021;52(2):568-580. [CrossRef] [Medline]
  10. Bastawrous A, Rono HK, Livingstone IAT, Weiss HA, Jordan S, Kuper H, et al. Development and validation of a smartphone-based visual acuity test (Peek Acuity) for clinical practice and community-based fieldwork. JAMA Ophthalmol. Aug 2015;133(8):930-937. [FREE Full text] [CrossRef] [Medline]
  11. Law MX, Pimentel MF, Oldenburg CE, de Alba Campomanes AG. Positive predictive value and screening performance of GoCheck Kids in a primary care university clinic. J AAPOS. Feb 2020;24(1):17.e1-17.e5. [FREE Full text] [CrossRef] [Medline]
  12. Pundlik S, Tomasi M, Liu R, Houston K, Luo G. Development and preliminary evaluation of a smartphone app for measuring eye alignment. Transl Vis Sci Technol. Jan 2019;8(1):19. [FREE Full text] [CrossRef] [Medline]
  13. Luo G, Pundlik S, Tomasi M, Houston K. Using an automated Hirschberg test app to evaluate ocular alignment. J Vis Exp. Mar 24, 2020.(157):e60908. [CrossRef] [Medline]
  14. Luo G, Lee C, Shivshanker P, Cheng W, Wang J, Marusic S, et al. Preliminary evaluation of a smartphone app for refractive error measurement. Transl Vis Sci Technol. Feb 01, 2022;11(2):40. [FREE Full text] [CrossRef] [Medline]
  15. Pundlik S, Luo G. Preliminary evaluation of a mobile device for dark adaptation measurement. Transl Vis Sci Technol. Jan 2019;8(1):11. [FREE Full text] [CrossRef] [Medline]
  16. Luo G, Lee CY, Wang Z. Pilot testing a smartphone app for astigmatism measurement. Invest Ophthalmol Vis Sci. 2023;64(8):1501. [FREE Full text]
  17. Heidar K. Accommodative esotropia. EyeWiki. 2023. URL: https://.aao.org/Accommodative_Esotropia [accessed 2024-03-15]
  18. Mäntyjärvi MI. Accommodation in hyperopic and myopic school children. J Pediatr Ophthalmol Strabismus. 1987;24(1):37-41. [CrossRef] [Medline]
  19. Xu L, Zhuang Y, Zhang G, Ma Y, Yuan J, Tu C, et al. Design, methodology, and baseline of whole city-million scale children and adolescents myopia survey (CAMS) in Wenzhou, China. Eye Vis (Lond). Aug 19, 2021;8(1):31. [FREE Full text] [CrossRef] [Medline]
  20. Dandona R, Dandona L, Srinivas M, Sahare P, Narsaiah S, Muñoz SR, et al. Refractive error in children in a rural population in India. Invest Ophthalmol Vis Sci. Mar 2002;43(3):615-622. [Medline]
  21. Hou C, Pu C. Trends in the prevalence of common ocular conditions and comparison of ophthalmic outpatient utilisation related to these conditions in children with and without various types of disabilities: analysis of nationwide population-based data from Taiwan, 2014-2019. BMJ Open. Oct 13, 2023;13(10):e073411. [FREE Full text] [CrossRef] [Medline]
  22. Lyon DW, Goss DA, Horner D, Downey JP, Rainey B. Normative data for modified Thorington phorias and prism bar vergences from the Benton-IU study. Optometry. Oct 2005;76(10):593-599. [CrossRef] [Medline]
  23. Andersen T, Jeremiah M, Thamane K, Littman-Quinn R, Dikai Z, Kovarik C, et al. Implementing a school vision screening program in Botswana using smartphone technology. Telemed J E Health. Feb 2020;26(2):255-258. [CrossRef] [Medline]
  24. Eksteen S, Eikelboom RH, Kuper H, Launer S, Swanepoel DW. Prevalence and characteristics of hearing and vision loss in preschool children from low income South African communities: results of a screening program of 10,390 children. BMC Pediatr. Jan 05, 2022;22(1):22. [FREE Full text] [CrossRef] [Medline]
  25. Walker M, Duvall A, Daniels M, Doan M, Edmondson LE, Cheeseman EW, et al. Effectiveness of the iPhone GoCheck Kids smartphone vision screener in detecting amblyopia risk factors. J AAPOS. Feb 2020;24(1):16.e1-16.e5. [CrossRef] [Medline]
  26. D'Souza H, Kun A, Martinson S, Bejarano L, McCole S. The positive predictive value of photoscreening devices for amblyogenic conditions. J AAPOS. Dec 2021;25(6):342.e1-342.e4. [CrossRef] [Medline]
  27. GoCheck Kids Streamlines Vision Screening for Head Start Programs. GoCheck Kids. 2023. URL: https:/​/www.​gocheckkids.com/​resources/​gocheck-kids-streamlines-vision-screening-for-head-start-programs [accessed 2024-03-15]


D: diopter
PD: prism diopter
SE: spherical equivalent


Edited by A Mavragani; submitted 07.12.23; peer-reviewed by S Bonfanti; comments to author 06.02.24; revised version received 16.02.24; accepted 29.02.24; published 04.04.24.

Copyright

©Zheng Wang, John Kempen, Gang Luo. Originally published in JMIR Formative Research (https://formative.jmir.org), 04.04.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.