Background: Cardiovascular disease (CVD) is the leading cause of death in women in India. Early identification is crucial to reducing deaths. Hypertensive disorders of pregnancy (HDP) and gestational diabetes mellitus (GDM) carry independent risks for future CVD, and antenatal care is a window to screen and counsel high-risk women. In rural India, community health workers (CHWs) deliver antenatal and postnatal care. We developed a complex intervention (SMARThealth Pregnancy) involving mobile clinical decision support for CHWs and evaluated it in a pilot cluster randomized controlled trial (cRCT).
Objective: The aim of the study is to co-design a theory-informed intervention for CHWs to screen, refer, and counsel pregnant women at high risk of future CVD in rural India and evaluate its feasibility and acceptability.
Methods: In phase 1, we used qualitative methods to explore community priorities for high-risk pregnant women in rural areas of 2 diverse states in India. In phase 2, informed by behavior change theory and human-centered design, we used these qualitative data to develop the intervention components and implementation strategies for SMARThealth Pregnancy in an iterative process with end users. In phase 3, using mixed methods, we evaluated the intervention in a cRCT with an embedded qualitative substudy across 4 primary health centres: 2 in Jhajjar district, Haryana, and 2 in Guntur district, Andhra Pradesh.
Results: SMARThealth Pregnancy embedded a total of 15 behavior change techniques and included (1) community awareness programs; (2) targeted training, including point-of-care blood pressure and hemoglobin measurement; and (3) mobile clinical decision support for CHWs to screen women in their homes. The intervention focused on 3 priority conditions: anemia, HDP, and GDM. The evaluation involved a total of 200 pregnant women, equally randomized to intervention or enhanced standard care (control). Recruitment was completed within 5 months, with minimal loss to follow-up (4/200, 2%) at 6 weeks postpartum. A total of 4 primary care doctors and 54 CHWs in the intervention clusters took part in the study. Fidelity to intervention practices was 100% prepandemic. Over half the study population was affected by moderate to severe anemia at baseline. The prevalence of HDP (2.5%) and GDM (2%) was low in our study population. Results suggest a possible improvement in mean hemoglobin (anemia) in the intervention group, although an adequately powered trial is needed. The model of home-based care was feasible and acceptable for pregnant or postpartum women and CHWs, who perceived improvements in quality of care, self-efficacy, and professional recognition.
Conclusions: SMARThealth Pregnancy is an innovative model of home-based care for high-risk pregnant women during the transitions between antenatal and postnatal care and adult health services. The use of theory and co-design during intervention development facilitated acceptability of the intervention and implementation strategies. Our experience has informed the decision to initiate a larger-scale cRCT.
Trial Registration: ClinicalTrials.gov NCT03968952; https://clinicaltrials.gov/ct2/show/NCT03968952
International Registered Report Identifier (IRRID): RR2-10.3389/fgwh.2021.620759
India has witnessed an epidemiological transition to noncommunicable diseases (NCDs) over the last 3 decades . Cardiovascular disease (CVD) is the leading cause of death in women in India [ ], and rural women are particularly vulnerable due to limited health literacy and health care access. Pregnancy-related conditions including hypertensive disorders of pregnancy (HDP) and gestational diabetes mellitus (GDM) are independent risk factors for future cardiometabolic disorders (CMDs), including type 2 diabetes mellitus and CVD [ - ]. Pregnancy is a time of increased receptivity of women to behavior change [ ]. Early identification of at-risk pregnant women, preventative measures, and counseling about the likelihood of future cardiometabolic complications may help slow progression to CVD and reduce mortality.
Several reviews have demonstrated the role of mobile health (mHealth) technologies in improving maternal and neonatal health services [, ]. mHealth interventions have the potential to improve equity and access to timely, affordable antenatal care (ANC) [ - ]; support self-management in relation to GDM [ ] and gestational weight gain [ ]; and support women in low-resource settings [ ]. Benefits to perinatal care extend to both patients and clinicians [ ]; however, there is limited evidence of impact on health outcomes [ ], cost-effectiveness, and implementation within rural settings [ ].
In India, community health workers (CHWs), known as accredited social health activists (ASHAs) and auxiliary nurse midwives (ANMs), deliver ANC and postnatal care (PNC) to women living in rural villages. ASHAs are educated to a secondary school level and serve a population of approximately 1000 people. They visit pregnant women in their homes and work closely with ANMs in subcenters to refer high-risk cases to the nearest primary care center (staffed by a primary care doctor) or secondary care facility (for specialist support), for which there are significant workforce shortages . Task sharing with CHWs using mHealth technology to provide clinical decision support in rural India has been shown to be feasible for detection, referral, and management of NCDs in nonpregnant adults [ , ] and for HDP [ - ]. There is, however, a paucity of high-quality evidence to guide postnatal management in low-resource settings of women following a high-risk pregnancy, including those with multimorbidity. Innovative solutions are required to address the needs of rural women, particularly during the transitions between ANC and PNC and adult health services.
We, therefore, developed a complex intervention, SMARThealth Pregnancy, building upon the Systematic Medical Appraisal Referral and Treatment in India (SMARThealth India) program , to improve care for rural pregnant women with high-risk conditions that placed them and their baby at immediate risk during pregnancy and at future risk of CMDs. Our objectives were to (1) co-design a theory-informed complex intervention and implementation strategies for CHWs to screen, refer, and counsel pregnant women in their homes using established clinical guidelines and (2) evaluate the feasibility and acceptability of implementation and preliminary effectiveness of the intervention for CHWs and pregnant women. We worked across 2 diverse districts of rural India—the Jhajjar district, Haryana, and the Guntur district, Andhra Pradesh.
Ethics approvals for the study were obtained from the Oxford Tropical Research Ethics Committee (OxTREC references: 501-19 [usability study] and 22-19 [pilot study]) and the George Institute India Ethics Committee (references: 03/2019 and 010/2019), with trial registration (ClinicalTrials.gov NCT03968952) and oversight by a steering committee. Participant information sheets were shared both verbally and in written format in local languages, and written informed consent was obtained from all participants.
Development of the SMARThealth Pregnancy Intervention
The design and development of SMARThealth Pregnancy occurred in 3 phases, guided by the methodological principles of human-centered design (inspiration, ideation, and implementation) [, ]. First, we conducted in-depth contextual work at both study sites to explore local priorities for care, the sociocultural practices around childbirth and the postpartum period, and the components required for a complex intervention [ ]. This previously published qualitative study highlighted 3 key priority areas identified by the communities in relation to high-risk pregnant women (anemia, HDP, and GDM).
Second, the capability, opportunity, and motivation model of behavior change (COM-B)/behavior change wheel framework  was used, which outlines 3 interacting domains that affect behavior change: capability refers to a physical and psychological capacity to engage in an activity; opportunity refers to the physical and social factors that influence behavior change; and motivation refers to both automatic impulses and reflective processes that direct behavior. We mapped qualitative data arising from early contextual work [ ] to identify barriers to the capabilities, opportunities, and motivations of CHWs and pregnant women in relation to improving care for anemia, HDP, and GDM [ ]. We then selected intervention functions and behavior change techniques [ ] most likely to be effective in overcoming targeted barriers and leading to improved care for high-risk pregnant women. Behavior change techniques are the “active ingredients” of behavior change interventions and are outlined in an extensive taxonomy [ ]. Intervention functions include education, persuasion, incentivization, coercion, training, restriction, environmental restructuring, modeling, and enablement [ ]. For example, CHWs and pregnant women lacked knowledge (psychological capability) of the serious consequences of anemia in pregnancy. We overcame this barrier through (1) an awareness program on high-risk pregnancies (education), (2) targeted education and training of CHWs (training), and (3) provision of point-of-care testing and clinical decision support for CHWs to refer and counsel women at home (enablement). presents an overview of the final intervention components.
Development of Mobile Clinical Decision Support System
Plain language rules were developed using established, evidence-based, country-specific clinical guidelines [- ]. Guideline flowcharts were used to determine (1) input variables, for example, patient ID, date of birth, weight, height, last menstrual period, and hemoglobin (Hb); (2) calculated variables, for example, age, BMI, and estimated date of delivery; and (3) output recommendations, for example, “This woman has evidence of severe hypertension. Call ambulance and refer patient to hospital urgently.” Clinical and statistical validation of the algorithms was conducted in accordance with the George Institute for Global Health’s established protocol for SMARThealth platforms, using a 2-step process [ ]. In step 1 (clinical validation), a deidentified data set of 200 pregnant women’s blood pressure (BP) values and pulse and Hb values, covering a range of clinical scenarios, was created. An independent senior clinician made expert recommendations based on the clinical guideline algorithms in all 200 cases. There was a 100% fit between the clinician and the rules engine outputs for the data set. Step 2 (statistical validation) involved comparison with an independently coded, randomly generated data set of 10,000 patients to include a wide range of case scenarios for all the input variables contained within the algorithms using SAS (version 9.4; SAS Institute). Outputs generated from the clinical decision support system and SAS were compared in an iterative process until there was a 100% match between the expected and actual output data.
Clinical decision support involved a 4-step process: patient registration, past obstetric and medical history, BP and Hb measurements, results of oral glucose tolerance test (OGTT) for GDM, and referral and counseling advice. A traffic light system was used to highlight readings that were of concern requiring immediate referral and management (red), moderate concern requiring referral (amber or yellow), or normal values (green) and to highlight missing ANC practices ().
We conducted 4 rounds of iterative usability testing with end users (CHWs and primary care doctors) using “mock” cases at both study districts to determine visit completion times, “clicks” to completion, and “think aloud” feedback and discussions, and we refined the prototype app before evaluation . The front-end screens are illustrated in .
The mHealth platform used the Android operating system, was delivered through a 7-inch mobile tablet, and was available in English, Hindi, and Telugu languages. The app used minimal data (kilobytes), worked offline, and synchronized with low-band connectivity. Data entered by CHWs were confidentially uploaded to a patient record using Open MRS software (Open-MRS)  to a secure server based at the George Institute for Global Health, India, which could synchronize to a sister tablet held by the primary care doctor at the local primary health center (PHC).
Evaluation of SMARThealth Pregnancy
Guided by the Medical Research Fellowship framework for complex interventions , we conducted a prospective, parallel, unblinded cluster randomized controlled trial (cRCT) with 1:1 allocation in Jhajjar, Haryana, and Guntur, Andhra Pradesh (ClinicalTrials.gov NCT03968952) [ ] (see CONSORT checklist in ). Clusters were defined as PHCs, including all affiliated health professionals. The full study protocol outlining the sample size and inclusion and exclusion criteria was developed using the CONSORT 2010 statement extension for randomized pilot and feasibility trials and has been previously published [ ]. The study took place between October 2019 and December 2020 and involved 4 PHC clusters: 2 in Jhajjar district, Haryana, and 2 in Guntur district, Andhra Pradesh. The aims of the study were to determine the feasibility and acceptability of the SMARThealth Pregnancy intervention and identify any barriers to implementation in a real-world setting ahead of a larger clinical trial.
Randomization, Recruitment, and Consent
PHCs meeting the inclusion criteria in the 2 study districts were stratified by geographical location and population size. A random number generator was used by an independent, blinded statistician (LB) to randomize 1 PHC in each state to the SMARThealth Pregnancy intervention and 1 to the control group (enhanced standard care). Written informed consent was obtained at the cluster level from the PHC administrative lead prior to randomization.
Eligible participants in the last trimester of pregnancy (28 and 36 weeks gestation) were identified by CHWs and recruited with written informed consent in their local language by a member of the study team. Women in the intervention group consented to sharing their antenatal records and having their BP and Hb measured by an ASHA at each of the 3 study visits. Women in the control group consented to share their ANC record and have BP and Hb measured by an independent team member at baseline and at 6 weeks postpartum (end-line visit). For the qualitative substudy, individual informed consent was obtained from CHWs and pregnant or postpartum women prior to interviews and focus group discussions (FGDs).
Intervention Group Practices
CHWs in the intervention group underwent targeted training delivered over five 3-hour sessions (2.5 days), followed by 2 supervised home visits with a member of the field team, and a 1-day refresher session. CHWs were provided with a training handbook with case scenarios including what to do if the technology failed and underwent role plays for home visits. CHWs were trained to measure BP using the CRADLE VSA Blood Pressure Monitor (APEC)  and Hb using the handheld TrueHb Hemometer (Wrig Nanosystems Pvt Ltd) [ ]. Guideline-based blood glucose testing for GDM involved a nonfasting OGTT delivered to the woman at home, followed by the CHW measuring a 2-hour capillary blood glucose level at the primary care subcenter [ ]. Primary care doctors were also trained to use the SMARThealth Pregnancy mHealth platform and received individual refresher training on high-risk pregnancy conditions in a 2-hour session. The SMARThealth Pregnancy practices are outlined in .
Intervention visits occurred at 3 strategic time points during and after pregnancy: an antenatal visit (28- to 36-week gestation) to detect high-risk cases prior to delivery and 2 postpartum visits, the first in week 1 to detect early postnatal complications and the second in week 6 to detect women with anemia or ongoing high BP or blood glucose who could then be linked to relevant government programs. Intervention visits were in addition to standard ANC and PNC.
All women were encouraged to attend the PHC after each home visit. Women requiring referral to secondary care were provided with a paper referral card by the primary care doctor and accompanied by the ASHA for visits to primary and/or secondary care.
Control Group Practices
Control group participants received “enhanced” standard care, which included the awareness program in addition to routine ANC and PNC delivered by CHWs, as it was deemed ethically appropriate to provide the information on high-risk pregnancies and subsequent health to improve the overall well-being of pregnant women in the study districts.
The awareness program delivered to both intervention and control groups consisted of a 30-minute talk during the Village Health and Nutrition Days event and distribution of leaflets outlining the importance of attending ANC, the importance of identifying and treating anemia, HDP, and GDM in pregnancy and some of the long-term sequelae of these including their impact on the risk of future CMDs. An end-line data case report form was completed by a member of the research team for both the intervention and control groups.
Study Outcomes and Analysis
The primary outcomes were to determine the feasibility and acceptability of the intervention and its implementation strategies, including recruitment of PHCs and participants, retention at 6-week postpartum, and fidelity to intervention practices. These data were used to understand patterns of recruitment and feasibility of conducting a larger cRCT. Secondary outcomes included clinical end points (BP and Hb): determining the prevalence of moderate to severe anemia (Hb <10.0 g/dL), HDP, and GDM within the study population. End of study BP and Hb clinical outcome data were collected primarily with the aim of assessing the feasibility of collecting these measures as potential clinical end points in a larger trial and to provide the CIs around these continuous variables for the intraclass correlation coefficient calculation ahead of a definitive trial. Descriptive statistics were used to reflect the above outcomes and compiled using SPSS (version 27; IBM Corp).
To explore the acceptability of the intervention to CHWs and pregnant women, we conducted a qualitative substudy to explore the factors influencing the implementation and integration of the intervention into the daily work of CHWs. A purposive sample of pregnant or postpartum women and CHWs from the intervention group at each study site were approached to share their experiences of SMARThealth Pregnancy during the pilot study. Topic guides were developed for in-depth interviews (IDIs) and FGDs and piloted with the field team. SN conducted the IDIs and FGDs with a local research assistant, who provided translation support in the local languages. Discussions were audio recorded with consent, and transcripts were professionally transcribed into English. Data were analyzed using a framework analysis guided by normalization process theory (NPT), which addresses how interventions become embedded into the daily work of health care professionals .
Effects of COVID-19 on Study
The pilot study started in October 2019, and India underwent a national lockdown for 2 months from March 24, 2020, because of the COVID-19 pandemic. This delayed recruitment at the control site in Andhra Pradesh and prevented the collection of end-line clinical outcome data in Haryana during April and May 2020. As screening pregnant women for high-risk conditions was deemed an essential service during the pandemic, ASHAs were permitted to conduct socially distanced home visits and telephone follow-up of postpartum women.
All PHC leads approached to participate in the study agreed to be involved. A total of 4 primary care doctors, 10 ANMs, and 44 ASHAs at the intervention clusters participated. The time to recruit 50 pregnant women at each PHC cluster (N=200) ranged from 50 to 128 days (including a 60-day national lockdown), with a recruitment rate of 10 to 17 pregnant women (in their third trimester of pregnancy) per month. Recruitment was completed within 5 months across all 4 PHCs. All eligible women who were approached agreed to participate in the study.
Retention and Postpartum Follow-Up
Four women (4/200, 2%) in the control group were lost to follow-up (2 at each study site). These 4 women moved out of the area to their mother’s village postpartum. There was no loss to follow-up in the intervention group (). In Andhra Pradesh, 44% (22/50) of women in the intervention group saw a private obstetrician in the first 2 weeks postpartum, mostly (21/22) following a cesarean section. In Haryana, only 34% (17/50) of women saw a doctor in the first 2 weeks postpartum. No participant saw a doctor either privately or through government services from 2 weeks postpartum to the final 6-week postpartum visit. During this time, ASHAs were their only contact within the health system.
Acceptability: Fidelity to Intervention Practices
Fidelity to intervention practices (in line with the study protocol) was evaluated through the completeness and timing of data entries into the mHealth platform. Prior to the global pandemic, ASHAs at both study sites completed all the first and second intervention visits per protocol (100% entries completed in full and on time). Due to COVID-19 social distancing restrictions, measurements of BP and Hb were not permitted at some study clusters during the pandemic. As a result, end-line BP and Hb clinical outcome data were not available for 22 of 100 participants in the intervention group and 34 of 100 participants in the control group. Where the end-line measurements were permitted, all ASHAs delivered the intervention in keeping with the study protocol (100% fidelity to intervention practices).
Clinical End Points
Both intervention and control groups were comparable at baseline with regard to sociodemographic data (). Pregnant women participants on average had completed 12 years of schooling with comparable mean age, weight, and baseline Hb and BP.
|Intervention, mean (SD)||Control, mean (SD)||P value|
|Baseline demographic data|
|Age (years)||23.5 (3.5)||24.0 (3.6)||.32|
|BMI (kg/m2)||22.6 (4.0)||22.1 (4.1)||.38|
|Years of schooling||12.2 (3.7)||12.4 (4.0)||.71|
|Number of people in household||4.9 (2.1)||4.8 (1.9)||.72|
|Hba at antenatal booking visit (g/dL)||9.6 (1.4)||9.4 (1.4)||.31|
|Baseline study visit Hb (g/dL)||9.9 (1.7)||9.6 (1.7)||.21|
|Baseline systolic BPb||108 (11.3)||108 (12.4)||>.99|
|Baseline diastolic BP||70 (8.5)||70 (9.0)||>.99|
|End-line clinical outcome data|
|End-line visit Hb (g/dL)||11.1 (1.7)||10.3 (1.7)||.01|
|End-line systolic BP||110 (11.6)||112 (13.4)||.35|
|End-line diastolic BP||72 (8.2)||73 (11.9)||.57|
bBP: blood pressure.
Prevalence of 3 Main High-Risk Conditions
The prevalence of moderate to severe anemia (Hb<10 g/dL) was high at both study sites. At baseline (third trimester of pregnancy): 47% (47/100) in the intervention group and 58% (58/100) in the control group. The study prevalence of HDP was 2.5% (5/200) and GDM was 2% (4/200).
End-Line Clinical Data
At end line, the intervention group had a mean Hb (11.1, SD 1.7 g/dL) within normal range, in comparison with the mean Hb in the control group (10.3 SD 1.7 g/dL; indicative of postpartum anemia). BP values at end line were similar between groups, although this exploratory analysis did not adjust for clustering.
Screening for GDM
At recruitment, 82% (163/200) of women had been screened for GDM before 28-week gestation; however, only 19% (37/200) reported having an OGTT (the gold standard test). Women who had not had an OGTT were offered one after recruitment, in line with government of India guidance . All participants in the intervention group had an OGTT. Nevertheless, only 2% (4/200) of the study population were diagnosed with GDM. All 4 women diagnosed with GDM saw private obstetricians who did not reinforce the ASHAs’ advice for postpartum GDM follow-up as per government guidelines and were not offered further OGTT testing or ongoing medication by their health care providers, once their blood glucose levels had normalized after delivery.
Qualitative Substudy: Acceptability of the mHealth Platform
A total of 61 participants, including CHWs (n=56) and pregnant or postpartum women (n=5), took part in 5 FGDs and 7 IDIs. Data were analyzed using NPT, which outlines 4 main constructs in relation to the implementation of an intervention. First, the sense-making work done by ASHAs and women to understand the value, impact, and importance of the intervention and a new set of practices (coherence); second, the relational work between ASHAs and the wider community to engage with and sustain the intervention practices (cognitive participation); third, the operational work CHWs undertook to implement the intervention (collective action); and finally, the reflective practices of CHWs in relation to the intervention that enabled it to become embedded in their daily work (reflexive monitoring).
CHWs were able to understand the value of the intervention practices in relation to previous ways of working (coherence). They felt that the intervention had improved their skills and through provision of mobile clinical decision support, the quality of the care they could deliver to women at home and had also improved their knowledge and confidence in their abilities (self-efficacy).
Previously ANMs used to do Hb or BP tests.... Now, since we are doing it, our knowledge improved. We did not know about this in-depth...we are very happy.
[ASHA focus group, Andhra Pradesh]
In particular, the intervention changed the nature of the relationships with other health professionals and pregnant women, with ASHAs gaining recognition of their skills from ANMs and primary care doctors, as well as heightened status within their communities (cognitive participation).
Now, we also know to measure BP, Hb.... Other people ask if the tests can be done to them too.... Now they want the tests to be done to them too!... Now we have some value in the village.... Now, people at least recognise us in our area.
[ASHA focus group, Haryana]
ASHAs particularly valued the mHealth platform, the traffic light system, and the visibility of clinical data to recall information and past medical history more easily. They reported that the mHealth platform was easy to use and had improved the quality of care they provided during home visits by providing ASHAs with the ability to give targeted advice to women at home during and after their pregnancy through mobile clinical decision support.
When we go back to that patient we are able to see the data which we had filled previously and at any point in time we can go back to the first visit and check and to the second visit and check. So it helps us to retain the data and to see it instantly.
ANMs also noticed an improvement in their skills and knowledge in relation to GDM.
We got to know [about GDM] only after you came.... We used to know about Hb and BP but we never used to ask about Diabetes.
[ANM, Andhra Pradesh]
The operationalization of community-based screening for GDM flattened the professional hierarchy between ANMs and ASHAs, who were required to work together to deliver OGTTs in the community (collective action). Both ANMs and ASHAs could see the value of working more as a team and appreciated acquiring the skills to deliver OGTTs in the community as part of their gold standard care for the rural population.
Previously...OGTT test was only done in private hospitals. Not all private hospitals had that too, madam! They used to conduct in only in few, selective, big corporate hospitals used to do it.... Tests like OGTT are very useful.
[ANM focus group, Andhra Pradesh]
ASHAs gained confidence (self-efficacy) in using the equipment, which was reflected in their greater knowledge of high-risk conditions in pregnancy, which in turn, influenced the pregnant women’s understanding of these conditions and improved the perceived quality of care received as part of government services.
I really like the ASHA worker because many things I don’t know about the pregnancy and I now know about these things because of ASHA workers.... It’s very nice...and these are done in a timely manner, and they have taken good care of me. They have taken care of us by doing blood tests....all are things very good.
Before pregnancy I didn’t know about the ASHA workers. After pregnancy I know them.... Seriously, the facilities here are very good. I appreciate all the things [they are doing] and it’s very good for me.
[Postpartum woman, Haryana]
ASHAs felt the SMARThealth Pregnancy intervention added value to home visits and could be integrated into their daily work without a perceived increase in workload.
It is a part of the work, but we get to know more information because of this.
During the study, ASHAs formed peer support groups to help each other in conducting home visits (reflexive monitoring). This led to reflective practice, problem-solving, and an ability to “learn” through using the mHealth platform.
ANM: They don’t ask us for any help on this.... They have good understanding. They discuss among 4-5 ASHA workers as a group, if there is any issue related to Tab or instrument. They are solving the problem by themselves.
[ANM group, Andhra Pradesh]
The SMARThealth Pregnancy was well received by all cadres of CHWs and by pregnant or postpartum women. It empowered ASHAs to provide care at home and counsel women. Pregnant women perceived the technology and level of care provided by ASHAs as high quality and this, in turn, elevated the status of ASHAs within their communities and among other health professionals. These factors led to the embedding of the intervention into their daily work and reflected the acceptability toward new ways of working.
Principal Results and Comparison With Prior Work
Our study demonstrated that the SMARThealth Pregnancy intervention and implementation strategies were both feasible and acceptable to end users. Recruitment and retention of PHCs and participants to the pilot cRCT are feasible ahead of a larger clinical trial—recruitment being completed in under 5 months during the pandemic, with minimal loss to follow-up (4/200, 2%). Feasibility of the implementation strategies was reflected by high levels of fidelity and engagement with intervention practices. ASHAs and pregnant or postpartum women engaged strongly with the intervention (100% fidelity to intervention practices prepandemic) and expressed their ability to (1) learn about high-risk pregnancies from the mHealth platform, (2) share this learning with women within their communities (diffusion of knowledge), and (3) with each other, through peer support groups. The mHealth platform improved the perceived self-efficacy of ASHAs in relation to delivering home-based care to pregnant women, and both health care workers and women perceived an improvement in quality of perinatal care, skills (BP and Hb measurement), and professional recognition within their communities. The results suggest a possible improvement in mean Hb (anemia) in the intervention group; however, the significance of this needs to be interpreted with caution as the analysis did not adjust for clustering and would need to be confirmed in an adequately powered trial.
These findings reflect some of the methodological approaches adopted in the design and development of SMARThealth Pregnancy. First, sustained engagement with communities and health care workers at study sites through in-depth contextual work helped build trust between the research team and local communities. Early community engagement and stakeholder involvement are important for the timely and successful implementation of new interventions and the recruitment and retention of study participants [- ]. The early contextual work at both study sites meant that the priorities of rural women and health care workers were integrated into the design of the intervention through human-centered approaches. As ASHAs and primary care doctors co-designed SMARThealth Pregnancy, they found it easy to navigate, implement, and integrate into their daily work, which was instrumental to the intervention’s acceptability.
Second, we adopted a theory-informed approach to intervention development, using the COM-B/behavior change wheel framework. The intervention addressed the barriers to behavior change of pregnant women and CHWs by improving their capabilities, opportunities, and motivations in relation to screening, referral, and counseling for high-risk conditions in pregnancy. Improved self-efficacy perceived by ASHAs in the qualitative study was a consequence of addressing their psychological and physical capabilities to perform BP and Hb testing at home and interpret readings through the mHealth platform. Furthermore, providing ASHAs with the physical and social opportunities (clinical decision support and BP/Hb devices) to conduct home visits improved their legitimacy and enhanced social and professional recognition. These factors are supported by the wider literature and impact CHW motivation  and performance [ ].
The prevalence of moderate to severe anemia in pregnant women at baseline was high (47/100, 47% in intervention group and 58/100, 58% in control group). These findings are consistent with the wider literature [, - ]. Although clinical effectiveness was beyond the scope of this pilot study, we demonstrated a possible reduction in anemia (improved Hb) in the intervention group at end line. This finding may have been due to improvement in the knowledge of anemia among women and their households resulting from the ASHAs’ counseling during home visits, as highlighted in the qualitative substudy. The prevalence of HDP and GDM at our study sites (5/200, 2.5% and 4/200, 2%, respectively) was lower than that quoted in other studies [ , - ]. This may reflect seasonal variations in BP or differing age and socioeconomic status [ - ] and arise from the variety of screening criteria and tests used to diagnose GDM in other studies [ - ]. Age-adjusted prevalence of GDM may be more in keeping with our findings [ ], and the low prevalence we report may reflect the levels of poverty and rurality of our study population. Finally, embedding complex interventions into the daily work of health care professionals occurs as a result of people working individually and collectively to implement and integrate a new set of practices [ ], requiring cooperation, buy-in, and ongoing commitment of health care workers and beneficiaries [ ]. Health care workers shape how an intervention is delivered by the meaning they attribute to the intervention, which may differ across individuals, groups, and contexts [ , ]. NPT explained the factors contributing to the acceptability and embedding of SMARThealth Pregnancy into the daily work of ASHAs. ASHAs demonstrated understanding of the differences between previous ways of working, recognized the value of the mHealth platform, renegotiated their professional roles with ANMs and doctors, and adopted a team-based approach to health care delivery with regards to GDM screening as a result of the intervention. Furthermore, the qualitative substudy highlighted that ASHAs did not see SMARThealth Pregnancy as a burden in terms of workload, which contributed to its perceived value.
Our study was conducted during the COVID-19 pandemic. During this time, ASHAs were the only health service contact for pregnant and postpartum women in our study sites. Our study demonstrated that ASHAs are well placed to deliver postpartum interventions and offer health-related counseling to high-risk pregnant rural women at home when provided with adequate support. Our model of task sharing to deliver home-based point-of-care testing for anemia and BP was seen as very valuable to women and the community in our study. Task sharing has been identified as a method of meeting workforce shortages in rural areas [- ]. We have demonstrated that providing ASHAs with the tools to engage in effective task sharing has the potential to improve perceived quality of care, improve self-efficacy of CHWs, and encourage learning for both CHWs and patients.
Strengths and Limitations
We have presented a robust and innovative approach to theory-informed intervention development and evaluation to address the immediate and long-term needs of high-risk pregnant women in relation to 3 priority areas. Our findings have informed the need for a larger trial. Limitations of our study relate to disruptions in study procedures as a result of the 2020 pandemic, which limited our end-line clinical outcome data collection. Any significant differences in end-line clinical data would need to be confirmed through an adequately powered trial, adjusting for clustering, which was beyond the scope of this pilot study. We further envisaged that women would visit their primary care doctor after each study visit to strengthen the links with government services and the PHC; however, in practice, women bypassed primary care and sought obstetricians in secondary care directly, particularly in the postpartum period, when there are cultural taboos related to women leaving their homes for 40 days. Due to the fragmented nature of PNC, women received inconsistent advice, particularly relating to future risks of CMDs for women with GDM. This highlighted the importance of whole-systems approaches to education and training of health care workers to advise high-risk pregnant women, and the need to involve secondary care providers in community-level interventions to reinforce evidence-based follow-up of high-risk pregnant women beyond the immediate postpartum period.
SMARThealth Pregnancy is a feasible and acceptable multifaceted complex intervention to support CHWs to deliver home-based care for high-risk pregnant women in the context of 2 diverse states in rural India. The intervention resulted in a model of task sharing for the integrated ANC, PNC, and ongoing care of women. Our successful pilot study has informed the decision to proceed with a definitive trial of clinical effectiveness using the SMARThealth Pregnancy approach to integrate pregnancy and NCD care. The goal is an effective, affordable, and acceptable model of integrated care that uses pregnancy as an opportunity to improve women’s lifelong health.
We would like to acknowledge all the dedicated health care workers and field teams in India who participated in this study, and the software development teams at the George Institute for Global Health, India and Australia, including Nirosha Yeddalapudi, Bhanu Bangari, David Choy, Manohan Sinnadurai, and Ruth Webster. SN was supported by a Medical Research Fellowship Clinical Research Training Fellowship (MR/R017182/1). The study was funded by the George Institute for Global Health, India.
The data sets generated and analyzed during this study are not publicly available due to restricted permissions within the districts involved in the study but are available from the corresponding author upon reasonable request.
SN was responsible for the design, development, and evaluation of the SMARThealth Pregnancy intervention, conceptualized the pilot study, and wrote the first draft of the paper. SN, ER, AMA, AP, VA, DP, and VJ were involved in the implementation of the study in India and provided input into the study protocol. LB provided statistical support for the study. SK, RN, LH, and JH provided overall supervision and comments on the study protocol and oversight of the study. All authors provided feedback on the draft paper.
Conflicts of Interest
CONSORT-eHEALTH checklist (V 1.6.1).PDF File (Adobe PDF File), 431 KB
- Prabhakaran D, Jeemon P, Sharma M, Roth GA, Johnson C, Harikrishnan S, et al. The changing patterns of cardiovascular diseases and their risk factors in the states of India: the Global Burden of Disease Study 1990–2016. Lancet Global Health 2018 Dec;6(12):e1339-e1351 [CrossRef]
- Norton R, Peters S, Jha V, Kennedy S, Woodward M. Women's health: a new global agenda. Oxford Martin School. 2016. URL: https://www.oxfordmartin.ox.ac.uk/downloads/briefings/women%27s-health.pdf [accessed 2023-06-27]
- Bellamy L, Casas J, Hingorani AD, Williams D. Type 2 diabetes mellitus after gestational diabetes: a systematic review and meta-analysis. Lancet 2009 May 23;373(9677):1773-1779 [CrossRef] [Medline]
- Bellamy L, Casas J, Hingorani AD, Williams DJ. Pre-eclampsia and risk of cardiovascular disease and cancer in later life: systematic review and meta-analysis. BMJ 2007 Nov 01;335(7627):974 [CrossRef]
- Skjaerven R, Wilcox AJ, Klungsoyr K, Irgens LM, Vikse BE, Vatten LJ, et al. Cardiovascular mortality after pre-eclampsia in one child mothers: prospective, population based cohort study. BMJ 2012 Nov 27;345:e7677 [CrossRef]
- Tobias DK, Stuart JJ, Li S, Chavarro J, Rimm EB, Rich-Edwards J, et al. Association of history of gestational diabetes with long-term cardiovascular disease risk in a large prospective cohort of US women. JAMA Intern Med 2017 Dec 01;177(12):1735-1742 [http://europepmc.org/abstract/MED/29049820] [CrossRef] [Medline]
- Brown MC, Best KE, Pearce MS, Waugh J, Robson SC, Bell R. Cardiovascular disease risk in women with pre-eclampsia: systematic review and meta-analysis. Eur J Epidemiol 2013 Feb 9;28(1):1-19 [CrossRef]
- van den Heuvel JF, Groenhof TK, Veerbeek JH, van Solinge WW, Lely AT, Franx A, et al. eHealth as the next-generation perinatal care: an overview of the literature. J Med Internet Res 2018 Jun 05;20(6):e202 [http://www.jmir.org/2018/6/e202/] [CrossRef] [Medline]
- Amoakoh-Coleman M, Borgstein AB, Sondaal SF, Grobbee DE, Miltenburg AS, Verwijs M, et al. Effectiveness of mHealth interventions targeting health care workers to improve pregnancy outcomes in low- and middle-income countries: a systematic review. J Med Internet Res 2016 Aug 19;18(8):e226 [CrossRef]
- Tumuhimbise W, Atukunda E, Ayebaza S, Katusiime J, Mugyenyi G, Pinkwart N, et al. Maternal health-related barriers and the potentials of mobile health technologies: qualitative findings from a pilot randomized controlled trial in rural Southwestern Uganda. J Family Med Prim Care 2020;9(7):3657 [CrossRef]
- Nyati-Jokomo Z, Dabengwa IM, Makacha L, Nyapwere N, Dube YP, Chikoko L, et al. RoadMApp: a feasibility study for a smart travel application to improve maternal health delivery in a low resource setting in Zimbabwe. BMC Pregnancy Childbirth 2020 Aug 31;20(1):501 [CrossRef]
- Musiimenta A, Tumuhimbise W, Mugyenyi G, Katusiime J, Atukunda E, Pinkwart N. A mobile phone-based multimedia application could improve maternal health in rural Southwestern Uganda: mixed methods study. OJPHI 2020 Jul 08;12(1):e8 [CrossRef]
- Adesina N, Dogan H, Green S, Tsofliou F. Effectiveness and usability of digital tools to support dietary self-management of gestational diabetes mellitus: a systematic review. Nutrients 2021 Dec 21;14(1):10 [CrossRef]
- Farzandipour M, Nabovati E, Anvari S, Vahedpoor Z, Sharif R. Phone-based interventions to control gestational weight gain: a systematic review on features and effects. Inform Health Soc Care 2018 Nov 27:1-16 [CrossRef] [Medline]
- Dansharif AR, Iyawa GE, Owoseni A, Iyawa R. mHealth for self-management in pregnancy: perceptions of women in low-resource settings. Procedia Comput Sci 2021;181:738-745 [CrossRef]
- Nagraj S, Hinton L, Praveen D, Kennedy S, Norton R, Hirst J. Women's and healthcare providers’ perceptions of long-term complications associated with hypertension and diabetes in pregnancy: a qualitative study. BJOG 2019 Aug 16;126(S4):34-42 [CrossRef]
- He J, Irazola V, Mills KT, Poggio R, Beratarrechea A, Dolan J, HCPIA Investigators. Effect of a community health worker-led multicomponent intervention on blood pressure control in low-income patients in Argentina: a randomized clinical trial. JAMA 2017 Sep 19;318(11):1016-1025 [http://europepmc.org/abstract/MED/28975305] [CrossRef] [Medline]
- Praveen D, Patel A, McMahon S, Prabhakaran D, Clifford GD, Maulik PK, et al. A multifaceted strategy using mobile technology to assist rural primary healthcare doctors and frontline health workers in cardiovascular disease risk management: protocol for the SMARTHealth India cluster randomised controlled trial. Implement Sci 2013 Nov;8:137 [http://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-8-137] [CrossRef] [Medline]
- Magee LA, Nathan H, Adetoro OO, Bellad MB, Goudar SS, Lee T, Clip Trials Working Group. 256. The incidence of pregnancy hypertension in the Community Level Interventions for Pre-eclampsia (CLIP) trials—population-level data from Mozambique, Nigeria, India and Pakistan. Pregnancy Hypertens 2018 Oct;13:S36 [CrossRef]
- Qureshi R, Sheikh S, Hoodbhoy Z, Sharma S, Vidler M, Payne BA, Clip Trials Working Group. 254. Community Level Interventions for Pre-eclampsia (CLIP) in Pakistan: a cluster randomised controlled trial. Pregnancy Hypertens 2018 Oct;13:S35 [CrossRef]
- Sevene E, Munguambe K, Sacoor C, Vala A, Boene H, Sharma S, Clip Trials Working Group. 255 Community Level Interventions for Pre-eclampsia (CLIP) in Mozambique: a cluster randomised controlled trial. Pregnancy Hypertens 2018 Oct;13:S36 [CrossRef]
- Bellad MB, Goudar SS, Mallapur AA, Charantimath US, Katageri GS, Sharma S, Clip Trials Working Group. 251. Community Level Interventions for Pre-eclampsia (CLIP) in India: a cluster randomised controlled trial. Pregnancy Hypertens 2018 Oct;13:S35 [CrossRef]
- Norman D. The four fundamental principles of human-centered design and application. jnd.org. 2019. URL: https://jnd.org/the-four-fundamental-principles-ofhuman-centered-design/ [accessed 2023-06-27]
- 24 I. Design kit: the human-centered design toolkit. IDEO.org. 2023 Jun 27. URL: https://www.ideo.com/post/design-kit [accessed 2021-03-17]
- Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci 2011;6:42 [http://www.implementationscience.com/content/6//42] [CrossRef] [Medline]
- Nagraj S. SMARThealth pregnancy: the development & evaluation of a complex intervention using mobile clinical decision support to screen, refer and manage pregnant women at high risk of future cardiometabolic disorders in rural India. Oxford University Research Archive (ORA). 2021. URL: https://ora.ox.ac.uk/objects/uuid:95219f9d-3821-4dd4-9204-0f2eacc9deef [accessed 2023-06-27]
- Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol 2008 May;27(3):379-387 [CrossRef] [Medline]
- Diagnosis & management of gestational diabetes mellitus technical and operational guidelines. Maternal Health Division Ministry of Health & Family Welfare Government of India. 2018. URL: https://nhm.gov.in/New_Updates_2018/NHM_Components/RMNCH_MH_Guidelines/Gestational-Diabetes-Mellitus.pdf [accessed 2023-06-27]
- A programme by Ministry of Health and UNICEF. Anemia Mukt Bharat. 2023. URL: https://anemiamuktbharat.info/ [accessed 2023-06-27]
- Bhatt B, Gupta M. Hypertensive disorders of pregnancy: good clinical practice recommendations 2019. FOGSI-GESTOSIS-ICOG. 2019. URL: https://www.fogsi.org/wp-content/uploads/gcpr/hdp-fogsi-gestosis-icog-gcpr-2019.pdf [accessed 2023-06-27]
- WHO recommendations for prevention and treatment of pre-eclampsia and eclampsia. World Health Organization. 2011. URL: https://apps.who.int/iris/bitstream/handle/10665/44703/9789241548335_eng.pdf?sequence=1 [accessed 2023-06-27]
- Nathan HL, Vousden N, Lawley E, de Greeff A, Hezelgrave NL, Sloan N, et al. Development and evaluation of a novel Vital Signs Alert device for use in pregnancy in low-resource settings. BMJ Innov 2018 Sep 19;4(4):192-198 [CrossRef]
- Praveen D, Patel A, Raghu A, Clifford GD, Maulik PK, Mohammad Abdul A, et al. SMARTHealth India: development and field evaluation of a mobile clinical decision support system for cardiovascular diseases in rural India. JMIR mHealth uHealth 2014 Dec 08;2(4):e54 [CrossRef]
- Open MRS Software. OPEN MRS. 2023. URL: https://openmrs.org [accessed 2023-06-27]
- Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008 Sep 29;337(sep29 1):a1655 [CrossRef]
- SMARThealth Pregnancy: feasibility & acceptability of a complex intervention for high-risk pregnant women in rural India. ClinicalTrials.gov. 2019. URL: https://clinicaltrials.gov/ct2/show/NCT03968952 [accessed 2023-06-27]
- Nagraj S, Kennedy SH, Jha V, Norton R, Hinton L, Billot L, et al. SMARThealth Pregnancy: feasibility and acceptability of a complex intervention for high-risk pregnant women in rural India: protocol for a pilot cluster randomised controlled trial. Front Glob Womens Health 2021 May 28;2:620759 [CrossRef]
- TrueHb Hemometer. Wrig Nanosystems. URL: https://truehb.com [accessed 2023-05-23]
- Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med 2010 Oct 20;8(1):63 [CrossRef]
- Minimum quality standards and indicators for community engagement. UNICEF. 2018. URL: https://www.unicef.org/mena/media/8401/file/19218_MinimumQuality-Report_v07_RC_002.pdf.pdf [accessed 2023-05-23]
- Harris J, Croot L, Thompson J, Springett J. How stakeholder participation can contribute to systematic reviews of complex interventions. J Epidemiol Community Health 2015 Oct 16;70(2):207-214 [CrossRef]
- Tindana PO, Singh JA, Tracy CS, Upshur REG, Daar AS, Singer PA, et al. Grand challenges in global health: Community engagement in research in developing countries. PLoS Med 2007 Sep 11;4(9):e273 [CrossRef]
- Molyneux S, Bull S. Consent and community engagement in diverse research contexts: reviewing and developing research and practice. J Empir Res Hum Res Ethics 2013 Oct 01;8(4):1-18 [CrossRef]
- Willis-Shattuck M, Bidwell P, Thomas S, Wyness L, Blaauw D, Ditlopo P. Motivation and retention of health workers in developing countries: a systematic review. BMC Health Serv Res 2008 Dec 04;8(1):1-8 [CrossRef]
- Gopalan SS, Mohanty S, Das A. Assessing community health workers’ performance motivation: a mixed-methods approach on India's Accredited Social Health Activists (ASHA) programme. BMJ Open 2012 Sep 27;2(5):e001557 [CrossRef]
- Daru J, Zamora J, Fernández-Félix BM, Vogel J, Oladapo OT, Morisaki N, Tunçalp, et al. Risk of maternal mortality in women with severe anaemia during pregnancy and post partum: a multilevel analysis. Lancet Glob Health 2018 May;6(5):e548-e554 [CrossRef]
- Finkelstein JL, Kurpad AV, Bose B, Thomas T, Srinivasan K, Duggan C. Anaemia and iron deficiency in pregnancy and adverse perinatal outcomes in Southern India. Eur J Clin Nutr 2019 Jul 11;74(1):112-125 [CrossRef]
- Nguyen PH, Scott S, Avula R, Tran LM, Menon P. Trends and drivers of change in the prevalence of anaemia among 1 million women and children in India, 2006 to 2016. BMJ Glob Health 2018 Oct 19;3(5):e001010 [CrossRef]
- Qureshi RN, Sheikh S, Hoodbhoy Z, Sharma S, Vidler M, Payne BA, et al. Community-level interventions for pre-eclampsia (CLIP) in Pakistan: a cluster randomised controlled trial. Pregnancy Hypertens 2020 Oct;22:109-118 [CrossRef]
- Magee LA, Sharma S, Nathan HL, Adetoro OO, Bellad MB, Goudar S, CLIP Study Group. The incidence of pregnancy hypertension in India, Pakistan, Mozambique, and Nigeria: a prospective population-level analysis. PLoS Med 2019 Apr;16(4):e1002783 [https://dx.plos.org/10.1371/journal.pmed.1002783] [CrossRef] [Medline]
- Bellad MB, Vidler M, Honnungar NV, Mallapur A, Ramadurg U, Charanthimath U, et al. Maternal and newborn health in Karnataka State, India: the community level interventions for pre-eclampsia (CLIP) trial's baseline study results. PLoS ONE 2017 Jan 20;12(1):e0166623 [CrossRef]
- Ye C, Ruan Y, Zou L, Li G, Li C, Chen Y, et al. The 2011 survey on hypertensive disorders of pregnancy (HDP) in China: prevalence, risk factors, complications, pregnancy and perinatal outcomes. PLoS One 2014;9(6):e100180 [https://dx.plos.org/10.1371/journal.pone.0100180] [CrossRef] [Medline]
- 53 MB, Amorim M, Katz L. Hypertension, pregnancy and weather: is seasonality involved? Rev Assoc Méd Bras 2014;60(2):105-110 [CrossRef]
- Rohr Thomsen C, Brink Henriksen T, Uldbjerg N, Milidou I. Seasonal variation in the hypertensive disorders of pregnancy in Denmark. Acta Obstet Gynecol Scand 2020 Feb 04;99(5):623-630 [CrossRef]
- Mohan V, Uma R, Usha S. Screening for gestational diabetes in India: where do we stand? J Postgrad Med 2015;61(3):151 [CrossRef]
- Li KT, Naik S, Alexander M, Mathad JS. Screening and diagnosis of gestational diabetes in India: a systematic review and meta-analysis. Acta Diabetol 2018 Mar 26;55(6):613-625 [CrossRef]
- Bhavadharini B, Uma R, Saravanan P, Mohan V. Screening and diagnosis of gestational diabetes mellitus—relevance to low and middle income countries. Clin Diabetes Endocrinol 2016 Jun 1;2(1):13 [CrossRef]
- Swaminathan G, Swaminathan A, Corsi DJ. Prevalence of gestational diabetes in India by individual socioeconomic, demographic, and clinical factors. JAMA Netw Open 2020 Nov 09;3(11):e2025074 [CrossRef]
- May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology 2009 Jun 15;43(3):535-554 [CrossRef]
- May CR, Cummings A, Girling M, Bracher M, Mair FS, May CM, et al. Using Normalization Process Theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review. Implementation Sci 2018 Jun 7;13(1):80 [CrossRef]
- Maier CB, Aiken LH. Task shifting from physicians to nurses in primary care in 39 countries: a cross-country comparative study. Eur J Public Health 2016 Aug 02;26(6):927-934 [CrossRef]
- Anand TN, Joseph LM, Geetha AV, Prabhakaran D, Jeemon P. Task sharing with non-physician health-care workers for management of blood pressure in low-income and middle-income countries: a systematic review and meta-analysis. Lancet Glob Health 2019 Jun;7(6):e761-e771 [CrossRef]
- Seidman G, Atun R. Does task shifting yield cost savings and improve efficiency for health systems? A systematic review of evidence from low-income and middle-income countries. Hum Resour Health 2017 Apr 13;15(1):29 [CrossRef]
|ANC: antenatal care|
|ANM: auxiliary nurse midwife|
|ASHA: accredited social health activist|
|BP: blood pressure|
|CHW: community health worker|
|CMD: cardiometabolic disorder|
|cRCT: cluster randomized controlled trial|
|CVD: cardiovascular disease|
|FGD: focus group discussion|
|GDM: gestational diabetes mellitus|
|HDP: hypertensive disorders of pregnancy|
|IDI: in-depth interview|
|mHealth: mobile health|
|NCD: noncommunicable disease|
|NPT: normalization process theory|
|OGTT: oral glucose tolerance test|
|PHC: primary health center|
|PNC: postnatal care|
Edited by A Mavragani; submitted 17.11.22; peer-reviewed by J Florez-Arango, E Nabovati, A Hadianfard; comments to author 12.05.23; revised version received 01.06.23; accepted 13.06.23; published 20.07.23Copyright
©Shobhana Nagraj, Stephen Kennedy, Vivekananda Jha, Robyn Norton, Lisa Hinton, Laurent Billot, Eldho Rajan, Ameer Mohammed Abdul, Anita Phalswal, Varun Arora, Devarsetty Praveen, Jane Hirst. Originally published in JMIR Formative Research (https://formative.jmir.org), 20.07.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.