Published on in Vol 9 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/71595, first published .
External Exposome Factors and Adverse Heart Failure Outcomes in the OneFlorida+ Network: Retrospective Cohort Study

External Exposome Factors and Adverse Heart Failure Outcomes in the OneFlorida+ Network: Retrospective Cohort Study

External Exposome Factors and Adverse Heart Failure Outcomes in the OneFlorida+ Network: Retrospective Cohort Study

1Department of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, 1889 Museum Road, DSIT 6004, Gainesville, FL, United States

2Department of Epidemiology, College of Public Health and Health Professions and College of Medicine, University of Florida, Gainesville, FL, United States

3Department of Medicine, College of Medicine, University of Florida, Gainesville, FL, United States

4Division of Clinical Pharmacy, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California, San Diego, La Jolla, CA, United States

5Department of Biostatistics and Health Data Science, School of Medicine, Indiana University, Indianapolis, IN, United States

6Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN, United States

7Department of Medicine, Melvin and Bren Simon Comprehensive Cancer Center, Indiana University, Indianapolis, IN, United States

8Indiana University Health, Indianapolis, IN, United States

Corresponding Author:

Jingchuan Guo, MD, PhD


Background: Heart failure (HF) readmission rates vary across geographic regions in the United States, yet the impact of external exposome factors, such as contextual-level social determinants of health (SDoH), on adverse HF outcomes is not well understood.

Objective: This study aims to examine the association between external exposome factors and the risk of HF readmission and all-cause mortality using a data-driven approach.

Methods: We conducted a retrospective cohort study using electronic health record (EHR) data from the OneFlorida+ Network, including patients hospitalized for HF (HHF) from 2016 to 2022. A total of 1308 external exposome factors, covering a wide range of SDoH (eg, economic stability, education, health care access, natural and built environments, and social context), were linked to patients’ EHR data based on their county-level residential location. Patients were followed for 1 year after their first HHF to capture readmission and mortality events. We applied the least absolute shrinkage and selection operator regularization to preselect candidate variables, followed by a 2-phase external exposome-wide association study using mixed-effects logistic regression to identify key factors associated with the composite outcome of 1-year HF readmission and mortality.

Results: Among 63,940 patients with HF (n=30,475, 48% women; mean age 65, SD 14 years), higher maximum temperature in May was significantly associated with increased risk of the composite outcome (adjusted odds ratio [aOR] 1.04, 95% CI 1.02-1.06; P<.001). Subgroup analyses showed consistent associations across age, sex, race, socioeconomic status, and rural or urban strata.

Conclusions: Using a data-driven approach, we found that elevated maximum temperature in May (late spring) was significantly associated with HF readmission and mortality in Florida. Further investigations are warranted to uncover the intricate mechanisms through which extreme heat potentially influences HF outcomes.

JMIR Form Res 2025;9:e71595

doi:10.2196/71595

Keywords



Background

Heart failure (HF) is a significant public health challenge in the United States, being the second most common reason for hospital admissions. It accounts for over 4.4 million cases leading to hospitalization annually, with health care costs surpassing US $31 billion [1]. Despite advances in treatment and management strategies, HF remains a chronic and progressive condition with limited prospects for a cure [2]. For patients hospitalized with HF, readmission rates and mortality serve as key quality indicators, reflecting the efficacy of both inpatient treatment and postdischarge care [3,4]. Approximately 55% of adult patients with HF are readmitted within one year, and the one-year mortality rate is about 25% [5-7].

Large geographic variation exists in the prevalence of HF and the incidence of complications [8], suggesting that the environment may play a critical role in the disease course. Extensive research has delineated clinical predictors of HF hospitalization trajectories; however, less clearly defined is the role of contextual-level socioeconomic, built, and natural environments as modifiable upstream factors impacting patients’ hospitalization patterns and mortality risk [9-13]. Such contextual factors are increasingly recognized to influence health outcomes and serve as a critical source of information to develop policy interventions designed to improve population health management and value-based care [14,15]. While previous studies have identified multiple contextual exposures associated with HF outcomes in the natural, built, and social environments [9-13], these studies only focused on a subset of preselected environmental factors. In addition, these studies assessed these factors in isolation without considering the totality of the environment or the external exposome [16]. Significant knowledge gaps remain regarding the combined effects of multiple environmental exposures on cardiovascular health, and there is a need for a more comprehensive approach that considers the full spectrum of external factors an individual is exposed to over a lifetime.

The external exposome-wide association study (ExWAS) framework addresses this need by providing a systematic and efficient approach to screen hundreds of environmental exposures simultaneously, offering an opportunity to identify novel environmental factors associated with HF outcomes [17,18].

Objective

In this study, we applied the ExWAS framework to identify novel external exposome factors associated with HF readmission and mortality [16,18-20]. We used electronic health records (EHRs) to examine the association between the external exposome and the risk of HF admission and mortality. Specifically, we integrated data on a wide range of external exposome factors, including economic stability, access to and quality of education, health care access, the natural environment, and the neighborhood and built environment surrounding patients who were hospitalized for heart failure (HHF). A more nuanced understanding of which external exposome factors influence adverse HF outcomes is critical to tailor care coordination, transitional support, and preventive services to patients, ultimately helping clinicians and health care systems reduce the HF burden.


Data Source and Study Population

We conducted a retrospective cohort study using 2016‐2022 EHRs from the OneFlorida+ Clinical Research Network [21]. OneFlorida+ Clinical Research Network is one of the largest statewide clinical data repositories, encompassing data from 13 unique health care systems that collectively serve approximately half of Florida’s population (~17.2 million individuals), covering all 67 Florida counties [22]. OneFlorida+ data are racially and ethnically diverse, with a mixture of rural-urban populations, reflecting national demographic changes, thus enhancing the generalizability of our study [22,23]. In addition, OneFlorida+ is linked with the National Death Index, allowing for mortality status tracking of its patients [22]. These longitudinal, patient-level data were chosen to enable a comprehensive analysis of HF adverse outcomes by leveraging extensive clinical and demographic information across a large, diverse population in Florida.

The study cohort included patients aged ≥18 years who had at least one HHF between January 1, 2016, and January 31, 2021. We excluded individuals missing a residential history (county), patients residing outside of Florida, and those with less than one year of health care encounter history before the first observed HHF. HHF was defined as a primary admission diagnosis with HF, identified using ICD-10 (International Classification of Diseases, Tenth Revision) codes (I50.x, I11.0, I13.0, I13.2, I97.13, and I09.81) [24]. This algorithm was previously validated against discharge summary or medical record by Thygesen et al [24], with a positive predictive value of 100% (95% CI 92.9‐100) based on primary diagnoses.

The index date was defined as the date of the patient’s first HHF recorded in the EHR during the study period. We followed each patient for one year after their index hospitalization until death or the end of the study period, whichever occurred first.

Study Outcome

Our primary outcome was a composite of HF readmission or all-cause mortality within one year after the index date, defined as HF readmission or death, whichever occurred first. We included death as part of the composite outcome to account for competing risks. In HF studies, patients who die before a potential readmission are no longer at risk for readmission, which could bias readmission risk estimates. By incorporating death into the composite outcome, we provide a more accurate estimate of the true burden of HF, capturing both readmission and mortality risks. HF readmission was identified using International Classification of Diseases, Ninth Revision: Clinical Modification (ICD-9-CM) and International Classification of Diseases, Tenth Revision: Clinical Modification (ICD-10-CM) codes as mentioned in the “Data Source and Study Population” section. All-cause mortality was identified by death records in OneFlorida+ EHR, which was linked with the National Death Index. Our secondary outcome was HF readmission alone within one year after the index date.

Exposures of Interest

Our exposures of interest included 1308 contextual-level exposome factors obtained from 11 well-validated sources, including the Agency for Healthcare Research and Quality [25], County Health Roadmap [26], Local Area Unemployment Statistics [27], economic resilience [28], US Cancer Statistics [29], Dartmouth Health [30], Air Quality Index [31], Air Quality System [31], Local Area Unemployment Statistics [27], religion [32], water [33], and social capital [34]. We categorized these factors into 6 domains, inspired by the Healthy People 2030 framework [35] (refer to Table 1) social and community context (eg, food access), neighborhood and built environment (eg, hospital density), natural environment (eg, temperature), health care access and quality (eg, insurance), education access and quality (eg, graduation rate), and economic stability (eg, income). These contextual-level exposome factors were temporospatially linked to each patient’s EHR data based on their residential histories at the county level, using Federal Information Processing Standard codes.

Table 1. Summary of external exposome measures included in our retrospective cohort, exposome‑wide analysis.
Category and data sourceaTime periodNumber of variables
Economic stability
Agency for Healthcare Research and Quality2009‐201988
County Health Roadmap2009‐201910
Local Area Unemployment Statistics20194
Economic resilience20153
Education access and quality
Agency for Healthcare Research and Quality2009‐201919
County Health Roadmap2009‐20192
Health care access and quality
US Cancer Statistics20188
Agency for Healthcare Research and Quality2009‐2019451
County Health Roadmap2009‐201954
Dartmouth Health2009‐20198
Natural environment
Agency for Healthcare Research and Quality2009‐201997
Neighborhood and built environment
Agency for Healthcare Research and Quality2009‐2019117
Air Quality Index2009‐201915
Air Quality System2009‐201914
County Health Roadmap2009‐201918
Local Area Unemployment Statistics2009‐20192
Religion20103
Water2017242
Social and community context
Social capital2009‐201413
Agency for Healthcare Research and Quality2009‐2019138
County Health Roadmap2009‐20192

aAll data sources are spatially scaled at the county level.

Covariates

Covariates were measured during the lookback period (1 year before the index HHF). Covariates were selected based on previous studies [36-39] and clinical experience. These included age, race/ethnicity (non-Hispanic White, non-Hispanic Black, Hispanic, and others), sex, HF subtype (HF with reduced vs preserved ejection fraction), and comorbidities (chronic obstructive pulmonary disease [COPD], myocardial infarction, anemia, diabetes, cancer, and the use of an implantable cardioverter-defibrillator [ICD], cardiac resynchronization therapy [CRT], or both), as well as medication use (sacubitril/valsartan, sodium-glucose cotransporter-2 inhibitors, nitrates [isosorbide mononitrate, nitroglycerin, isosorbide dinitrate], loop diuretics, and angiotensin-converting enzyme inhibitors). Comorbidities were identified using ICD-9-CM or ICD-10-CM diagnosis and procedure codes (Table S1 in Multimedia Appendix 1) [9,40-43]. Medication use was identified from patient prescription records.

Area Deprivation Index

The Area Deprivation Index (ADI) is a metric developed to assess the level of socioeconomic disadvantage in a given geographic area [44]. It was initially created by researchers at the University of Wisconsin-Madison and has become widely used in health research to understand how neighborhood-level socioeconomic factors influence health outcomes. The ADI provides a composite score based on several indicators, capturing various dimensions of deprivation, such as education, employment, housing quality, and income [44]. The ADI is a continuous value, with higher scores indicating areas with greater socioeconomic disadvantage. We converted it to a dichotomized variable, with the top 50% ADI defined as high deprivation. Each patient’s ADI was linked at the patient level, based on their Federal Information Processing Standard code.

Statistical Analysis

In the initial stage of our analysis, we conducted data preprocessing for the contextual-level external exposome factors (Figure S1 in Multimedia Appendix 1). We performed normalization transformations on all continuous variables using the bestNormalize package [45] in R statistical software (version 3.6.1; R Development Core Team), which supports various transformation methods, including logarithmic, square root, exponential, arcsinh, Box-Cox, and Yeo-Johnson transformations. The optimal transformation method was selected based on the Pearson P statistics. Next, we examined the correlation among variables and removed highly correlated predictors (correlation >0.9) to reduce redundancy. We then used the least absolute shrinkage and selection operator (LASSO) for variable selection to identify key contextual-level variables [46]. The LASSO model was fit using the glmnet package [47], with cross-validation to determine the optimal regularization parameter (λ). To retain more variables, we used Elastic Net regularization, combining Ridge and LASSO penalties (α=.01). Cross-validation identified λ.min, the lambda value that yielded the minimum cross-validated error, which was then used to refit the model. We retained variables with nonzero coefficients in the final model, indicating significant predictors identified by LASSO. This approach effectively reduced multicollinearity while preserving model interpretability. The final set of selected variables was stored for subsequent analysis. Details of the selected transformations and parameters for preselected external exposome variables are provided in Table S2 in Multimedia Appendix 1. Furthermore, we standardized all continuous variables to a z score (mean 0, SD 1). The missingness rate for all contextual-level exposome factors and covariates of interest in our model was restricted to <50% [48]. Variables with >50% missingness were excluded for further analysis to avoid biased results and maintain reliability, as extensive missing data can limit the effectiveness of imputation and compromise study validity [49-52]. We imputed missing data for all external exposome factors and covariates using either the median or mode value, depending on the variable type [53].

We then used a 2-phase ExWAS approach, as presented in Figure S1 in Multimedia Appendix 1, to identify key contextual-level factors associated with 1-year HF readmission or mortality [20,54]. In phase 1, we randomly divided the entire dataset into discovery (50%) and replication (50%) sets. We then tested the association of each external exposome factor with our composite outcome using mixed-effects logistic regression models, adjusting for covariates in both sets. Mixed-effect models were fitted for each external exposome factor, adjusting for all potential confounders (age, race, sex, history of heart failure with preserved ejection fraction (HFpEF), myocardial infarction, COPD, anemia, diabetes, cancer, and the presence of ICD and/or CRT-D; prescription history of sacubitril/valsartan, sodium-glucose cotransporter-2 inhibitors, nitrates, loop diuretics, and angiotensin-converting enzyme inhibitors), with population size set as the offset and a random intercept by county. To address the issue of multiple testing, we applied the Benjamini-Hochberg procedure to restrict the false discovery rate at a 5% level [55]. Variables with false discovery rate–adjusted P values (or q values) <.05 in both the discovery and replication sets were deemed significant in phase 1. We then assessed the pairwise Pearson correlations among these variables to further reduce collinearity. For variable pairs with absolute correlation coefficients exceeding 0.7, we retained the variable with the lower mean absolute correlation across all variables [56]. In phase 2, we constructed a mixed-effects logistic regression model incorporating all remaining significant variables identified in phase 1, along with all covariates of interest, including age, race, sex, comorbidities, and medication history. We reported the results of this model using adjusted odds ratios (aORs) with corresponding 95% CI for variables that remained significant (q<0.05) in phase 2.

All analyses were conducted using the R statistical software (version 3.6.1; R Development Core Team). Subgroup analyses were performed based on race (ie, White, Black, and so on), sex (female and male), age (≥65 and <65 years), residential region (rural and urban), ADI level (low deprivation and high deprivation), and COVID-19 period (prepandemic: January 2016 to February 2020; pandemic: March 2020 to January 2021).

Ethical Considerations

We obtained ethics approval from the University of Florida Institutional Review Board (202201080) before abstracting data. This study used retrospective, deidentified patient EHR data from the OneFlorida+ Network. Informed consent was waived by the review boards due to the retrospective nature of this research. No patients were directly recruited, and no individual compensation was provided. All data used complied with relevant patient privacy regulations, and no identifiable individuals are depicted in any figures or other study materials.


This study is reported following the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) guidelines for cohort studies. Our study cohort consisted of a total of 63,937 patients with an index HHF, of whom 30,475 (47.7%) were women, with a mean age of 65 (SD 14) years (Figure 1, Table 2, Checklist 1).

Figure 1. Patient flowchart. dx: diagnosis.
Table 2. Patient characteristics, by race and ethnicity, among patients hospitalized with heart failure in the OneFlorida+ Network.
VariableOverall (n=63,940)aHispanic (n=12,380)aNHBb (n=17,853)aNHWc (n=27,484)aOther (n=6223)aP valued
Age (years), mean (SD)65 (14)68 (15)61 (15)68 (13)65 (14)<.001
Female, n (%)30,475 (47.7)5872 (47.4)9024 (50.5)12,766 (46.4)2813 (45.2)<.001
OneFlorida+ Network, n (%)<.001
 A22,816 (35.7)3535 (28.6)5139 (28.8)9834 (35.8)4308 (69.2)
 B11,558 (18.1)2811 (22.7)2353 (13.2)5599 (20.4)795 (12.8)
 C10,119 (15.8)387 (3.1)3851 (21.6)5538 (20.2)343 (5.5)
 D7807 (12.2)3942 (31.9)2710 (15.2)1036 (3.8)119 (1.9)
 E6078 (9.5)941 (7.6)1791 (10.0)3092 (11.2)254 (4.1)
 Other5562 (8.7)764 (6.2)2009 (11.2)2385 (8.7)404 (6.5)
Anemia, n (%)30,547 (47.8)6169 (49.8)9212 (51.6)12,505 (45.5)2661 (42.8)<.001
COPDe, n (%)23,309 (36.4)4269 (34.5)5636 (31.6)11,395 (41.5)2009 (32.3)<.001
Diabetes, n (%)32,615 (51.0)7194 (58.1)9655 (54.1)12,817 (46.6)2949 (47.4)<.001
HFpEFf, n (%)33,407 (52.2)6424 (51.9)9128 (51.1)14,695 (53.5)3160 (50.7)<.001
History of myocardial infarction, n (%)10,356 (16.2)2070 (16.7)2494 (14.0)4831 (17.6)961 (15.4)<.001
ICD and/or CRT-Dg, n (%)5114 (8.0)1072 (8.7)1397 (7.8)2228 (8.1)417 (6.7)<.001
Mechanical ventilation, n (%)5863 (9.2)1533 (12.4)1911 (10.7)1917 (7.0)502 (8.1)<.001
Cancer, n (%)7419 (11.6)1472 (11.9)1859 (10.4)3518 (12.8)570 (9.2)<.001
HFh readmission, n (%)21,442 (33.5)4418 (35.7)6847 (38.3)8194 (29.8)1983 (31.9)<.001
HF readmission or all-cause mortality, n (%)25,078 (39.2)4977 (40.2)7897 (44.2)10,063 (36.6)2141 (34.4)<.001

aValues are means (SDs) for continuous variables and counts (%) for categorical variables. Values of polytomous variables may not sum to 100% due to rounding.

bNHB: non-Hispanic Black.

cNHW: non-Hispanic White.

dP values are based on the Kruskal-Wallis rank sum test or Pearson chi-square test, as appropriate.

eCOPD: chronic obstructive pulmonary disease.

fHFpEF: heart failure with preserved ejection fraction.

gICD and/or CRT-D: implantable cardioverter defibrillator and/or cardiac resynchronization therapy defibrillator within 4 years before the index date.

hHF: heart failure.

A total of 33,407 out of the study cohort (52.2%) had HFpEF. Patient characteristics by race and ethnicity are detailed in Table 2. Notably, non-Hispanic Black patients were younger and more likely to have diabetes, anemia, and require mechanical ventilation compared to non-Hispanic White patients. During the one-year follow-up, 33.5% of patients were readmitted for heart failure, and an additional 5.7% died without a prior heart failure readmission, resulting in 39.2% experiencing either heart failure readmission or all-cause mortality. In other words, patients who were readmitted did not overlap with those who died within the follow-up period, indicating that each patient contributed to only one outcome category. After data preprocessing and LASSO variable selection, 96 of the initial 1308 external exposome factors were retained for the ExWAS analysis (refer to Table S2 in Multimedia Appendix 1). In phase 1 of the ExWAS analysis, we identified 3 variables (median income of grandparent householder and/or spouse responsible for grandchildren younger than 18 years, percentage of households not receiving food stamps/Supplemental Nutrition Assistance Program (SNAP) with income below the poverty level, and maximum temperature in May) that were significantly associated with the composite outcome of HHF and death in both the discovery and replication sets (Table 3).

Table 3. Results from the external exposome-wide association study (ExWAS) in phase 1.
Exposure variableCategoryTransformationPhase 1, discovery setPhase 1, replication setPhase 2
ORa (95% CI)q-valueORa (95% CI)q-valueORa (95% CI)q-value
Monthly (May) maximum temperature (°F)Neighborhood and built environmentNo transform1.06 (1.03-1.10)2.94E-031.04 (1.02-1.06)3.67E-051.04 (1.02-1.06)6.57E-05
Median income of grandparent householder and/or spouse responsible for grandchildren <18 years (US dollars, inflation-adjusted to data file year)Economic stabilitysqrt_x0.95 (0.92-0.98)3.86E-020.96 (0.94-0.98)5.42E-030.98 (0.96-1.00)7.64E-02
Percentage of households not receiving food stamps/SNAPb with income below the poverty levelEconomic stabilityYeo-Johnson1.05 (1.02-1.07)4.77E-021.05 (1.03-1.07)3.67E-051.02 (1.00-1.04)8.84E-02

aOR: odds ratio.

bSNAP: Supplemental Nutrition Assistance Program.

A visual summary of the phase 1 results is presented in Figure S3 in Multimedia Appendix 1 using a volcano plot. This figure illustrates the significance and aOR of the tested variables, with a solid dot indicating the variables that met the significance threshold in both sets. Some categories had zero significant factors, indicating no statistical significance for those exposures in both sets. To address the collinearity among the identified temperature-related variables, we calculated the mean absolute correlation between each pair of variables (Figure S4 in Multimedia Appendix 1).

In phase 2, all significant variables from phase 1 (median income of grandparent householder and/or spouse responsible for grandchildren younger than 18 years, percentage of households not receiving food stamps/SNAP with income below the poverty level, and maximum temperature in May) were incorporated into a multivariable mixed-effect binomial regression model, adjusting for all covariates (age, race, sex, history of HFpEF, myocardial infarction, COPD, anemia, diabetes, cancer, and the presence of ICD and/or CRT-D). Only the maximum temperature recorded in May for the county where the patient resides maintained its statistical significance in the phase 2 analysis, with an aOR of 1.04 (95% CI 1.02-1.06) (Table 3).

Although we only retained the May maximum temperature in the final model, we found that some other monthly temperature variables were also associated with adverse HF outcomes (Table S3 in Multimedia Appendix 1). Our final model retained a single temperature variable based on LASSO regularization, which prioritized predictive strength while mitigating multicollinearity. As such, the broader dynamics of temperature patterns and cumulative heat exposure warrant further exploration in future studies.

Subgroup analyses were conducted to examine the association between May maximum temperature and the composite outcome of 1-year HF readmission and mortality, stratified by race, sex, age group, COVID-19 pandemic period, rurality, and ADI. In our subgroup analysis of the association between May maximum temperature and the outcome, we observed consistent trends across most subgroups, although not all were statistically significant. Among racial groups, the aORs were statistically significant for White (aOR 1.07, 95% CI 1.04-1.09) and Black patients (aOR 1.08, 95% CI 1.03-1.14), indicating a meaningful association in these populations. However, the association was not statistically significant for Hispanic (aOR 1.04, 95% CI 0.99-1.10) or other race groups (aOR 1.02, 95% CI 0.96-1.08). Both female (aOR 1.06, 95% CI 1.03-1.09) and male (aOR 1.06, 95% CI 1.03-1.09) subgroups showed statistically significant associations with the outcome, as did both age groups: individuals aged <65 years (aOR 1.06, 95% CI 1.02-1.09) and those aged ≥65 years (aOR 1.06, 95% CI 1.04-1.09) showed similar effect sizes. Regional differences were also significant, with both urban (aOR 1.06, 95% CI 1.03-1.08) and rural regions (aOR 1.08, 95% CI 1.02-1.15) displaying associations with the outcome. For ADI, individuals in areas of low deprivation showed a significant association (aOR 1.14, 95% CI 1.04-1.26), and those in areas of high deprivation also exhibited a statistically significant association (aOR 1.07, 95% CI 1.03-1.12). In addition, the COVID-19 period analysis indicated a significant association both before the pandemic (aOR 1.06, 95% CI 1.04-1.09) and after the pandemic began (aOR 1.05, 95% CI 1.02-1.09). This detailed breakdown suggests that a higher maximum temperature in May was consistently linked to an increased risk of the adverse composite outcomes for patients with HF, independent of their race, age, or socioeconomic status (SES) (Table 4; Figure 2).

Table 4. Results from multivariate logistic regression and subgroup analysis for monthly (May) maximum temperature (Fahrenheit).
Variable and subgroupAdjusted ORa (95% CI)
Overall1.04 (1.02-1.06)
Race
White1.07 (1.04-1.09)
Black1.08 (1.03-1.14)
Hispanic1.04 (0.99-1.10)
Other1.02 (0.96-1.08)
Sex
Female1.06 (1.03-1.09)
Male1.06 (1.03-1.09)
Age (years)
<651.06 (1.02-1.09)
≥651.06 (1.04-1.09)
Region
Urban1.06 (1.03-1.08)
Rural1.08 (1.02-1.15)
ADIb
Low deprivation1.14 (1.04-1.26)
High deprivation1.07 (1.03-1.12)
COVID-19
After pandemic1.05 (1.02-1.09)
Before pandemic1.06 (1.04-1.09)

aOR: odds ratio.

bADI: Area Deprivation Index.

Figure 2. Results for multivariate logistic regressions and subgroup analysis for monthly (May) maximum temperature (Fahrenheit). ADI: Area Deprivation Index; OR: odds ratio.

Furthermore, we tested the association between May maximum temperature and the 1-year readmission outcome and observed similar trends, with an aOR of 1.05 (95% CI 1.03-1.07). These results suggest a consistent association between elevated May temperatures and adverse outcomes in patients with HF, reinforcing the robustness of elevated temperature as a positive risk factor for higher HF-related adverse outcomes.


Principal Findings

Using the standard 2-phase EWAS-MLR approach, we assessed the association of 1308 external exposome variables in relation to 1-year HF readmission and mortality, leveraging real-world data. We discovered that an elevated maximum May temperature was significantly associated with an increased risk of HF readmission and mortality in Florida.

Concerns have been raised about the interaction between extreme temperatures and factors such as SES, urban-rural differences, and greenspace availability. Populations in higher-SES areas may experience less impact from high temperatures due to better access to air conditioning and health care, mitigating some of the heat’s effects [57]. To explore this, we conducted subgroup analyses by SES (using the ADI) and by urban versus rural areas. Our results showed that none of the subgroup variables, including sex, rurality, SES, and COVID-19 period, significantly modified the association between temperature and HF outcomes. This consistency suggests that temperature exerts a direct, uniform impact on HF one-year readmission and mortality, regardless of socioeconomic differences. Additional subgroup analysis revealed that higher maximum temperatures in May were consistently associated with an increased risk of HF 1-year readmission and mortality across most groups, with significant associations observed among White and Black patients, both sexes, and age groups. This consistency suggests that elevated May temperatures pose a broad risk to patients with HF, largely independent of demographic or socioeconomic factors.

Comparison With Prior Work

To our knowledge, this retrospective cohort study is the first to evaluate the impact of a comprehensive array of contextual-level external exposome factors, derived from patients’ residential histories, on HF 1-year readmission and mortality among patients with HHF. Our findings align with previous studies on the impact of temperature and climate on cardiovascular disease (CVD) outcomes, which have consistently highlighted a complex relationship, with both extreme heat and cold temperatures being associated with increased risks of various CVD adverse outcomes [58,59]. For example, a study by Lopez et al [58] found that mortality in chronic HF exhibits a seasonal pattern, with a 13.9% higher all-cause mortality rate in winter than in summer. On the other hand, Chan et al [60] found that an average 1°C increase in daily mean temperature above 28.2°C was associated with a 1.8% increase in mortality, with higher vulnerability observed among women, men younger than 75 years, individuals in low-SES districts, those with unknown residence, married people, and deaths from cardiovascular and respiratory infections. However, differences emerge in the magnitude of risk associated with specific temperature thresholds, which can vary by geographic location, population acclimatization, and study methodologies [59,61-63]. Our findings align with previous studies that an increasing level of heat significantly elevates the risk of CVD-related mortality and morbidity, with pronounced risks for residents of tropical climates [62]. Considering Florida’s subtropical environment, which experiences relatively mild winters, the impact of low temperatures on HF outcomes in this setting may be limited.

The potential biological plausibility behind the impact of heat on adverse outcomes of patients with HF can be attributed to several mechanisms. Heat exposure can lead to dehydration and increased blood viscosity, placing additional strain on the cardiovascular system [64]. It can also induce systemic inflammation and oxidative stress, which are known contributors to atherosclerosis and other CVDs [64,65]. Furthermore, heat can exacerbate the body’s stress response, increasing heart rate and blood pressure, thereby imposing further risk on individuals with pre-existing cardiovascular conditions [66]. However, previous research by Nam et al [67] has highlighted that increased potassium use during summer months showed a protective effect against all-cause mortality increases with higher temperatures. Understanding these mechanisms is crucial for developing strategies to mitigate adverse outcomes in patients with HHF residing in high-temperature environments.

Limitations

This study has limitations. First, the generalizability of our findings may be limited due to the regional focus of the study. The majority of our cohort population resided in Florida, and as such, our observations may not readily extend to other states with different climatic conditions. Our study did not reveal a notable impact of cold temperatures, as prior studies have, which is likely attributable to Florida’s lack of low-temperature winters [63,68]. Future studies using nationally representative data sources should investigate the consistency of these associations across more diverse environmental settings. Second, the EHR data are limited to individuals who made health care encounters within the participating networks, so there would be a chance that we failed to capture HF readmission or mortality that occurred outside of the participating health care systems, which would lead to misclassification in the nonoutcome group. To minimize loss to follow-up for longer-term outcomes, we limited the study follow-up period to one year. Considering that the observed association remains significant despite potential misclassification in the nonoutcome group, this suggests that the effect of maximum temperature in May on adverse HF outcomes may be even stronger than reported, underscoring its potential impact on HR-related adverse outcome risk. Third, we acknowledge that using county-level exposures may overlook intracounty variations that could provide more localized environmental and social insights into HR outcomes. Unfortunately, our data were not available at a finer spatial granularity, such as ZIP code or census tract, which may have limited our ability to detect these localized effects. Future studies with access to more detailed geographic data could offer deeper insights into the impact of environmental exposures on HR, allowing for targeted interventions at the community level. Fourth, our selection of external exposome factors may not fully encompass the wide range of social determinants of health that impact adverse HF outcomes. Future studies could enhance understanding by incorporating additional environmental variables, such as walkability and data from the EPA’s Smart Location Database, to provide a more comprehensive view of how the built environment influences health outcomes. Furthermore, our analysis was limited to exposure data available only through 2019, which prevented us from including pandemic-era data (2020‐2022) for variables such as employment, economic resilience, and air quality. Due to a typical 2‐5-year delay in accessing contextual social risk data, we believe these contextual social factors likely remained relatively stable over this short period, minimizing potential effects on our findings. In addition, our effect of the exposome is not quantified as aggregated exposure. While an aggregate exposure approach—combining individual- and contextual-level measures—would ideally capture a more comprehensive picture of the factors affecting cardiovascular outcomes, implementing such a method typically requires a preselected study cohort and prospective data collection. This process can be costly, time-intensive, and may restrict both the sample size and the generalizability of findings. Moreover, measuring temperature by the maximum temperature in May limits our ability to capture the day-to-day and month-to-month temperature fluctuations, which could affect HF outcomes. As a result, our study may not fully reflect the nuanced relationship between short-term temperature variation and adverse health outcomes. Furthermore, as an observational study, our analysis is inherently limited in its ability to rule out unmeasured confounding factors, which may influence the observed associations. Although we have applied rigorous statistical methods and adjusted for known confounders, the possibility of residual confounding remains. Future research, including randomized controlled trials or studies with more comprehensive confounder adjustment, could provide stronger causal evidence.

Conclusions

In summary, in a cohort of HHF patients from OneFlorida+ Network, we identified that elevated maximum temperatures in May were consistently associated with an increased risk of 1-year HF readmission and mortality. This association remained significant across various subgroups, including race, sex, age, SES, and urban-rural residence, suggesting that high temperatures in late spring pose a uniform risk to patients with HF, regardless of demographic or socioeconomic background. Our study has important implications for the impact of global warming and environmental factors on HF outcomes. Given the projected increases in global temperatures, further investigations are warranted to uncover the intricate mechanisms through which extreme heat potentially influences adverse HF outcomes and to develop targeted strategies to mitigate these risks in affected populations. Clinicians should be aware of temperature-related risk, particularly in regions with pronounced seasonal temperature variations, and consider environmental conditions when planning HF management and follow-up care.

Acknowledgments

This research was supported in part by the American Foundation for Pharmaceutical Education (AFPE) through the Pre-Doctoral Fellowship in Health Outcomes Disparities. The authors thank AFPE for its support in advancing this work.

Data Availability

The datasets generated or analyzed during this study are not publicly available, due to the OneFlorida+ electronic health record data containing protected health information, but are available from the corresponding author on reasonable request. Access is granted under a data use agreement and requires institutional review board approval.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Supplementary tables and figures.

DOCX File, 212 KB

Checklist 1

STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) checklist.

PNG File, 13 KB

  1. Heidenreich PA, Albert NM, Allen LA, et al. Forecasting the impact of heart failure in the United States: a policy statement from the American Heart Association. Circ Heart Fail. May 2013;6(3):606-619. [CrossRef] [Medline]
  2. What is heart failure? National Heart, Lung, and Blood Institute (NHLBI). 2022. URL: https://www.nhlbi.nih.gov/health/heart-failure [Accessed 2024-02-12]
  3. Rasmussen M, Prado A, Hominal MA, et al. Global variations in heart failure etiology, management, and outcomes. JAMA. May 16, 2023;329(19):1650. [CrossRef]
  4. Al-Omary MS, Khan AA, Davies AJ, et al. Outcomes following heart failure hospitalization in a regional Australian setting between 2005 and 2014. ESC Heart Fail. Apr 2018;5(2):271-278. [CrossRef] [Medline]
  5. Al-Omary MS, Davies AJ, Evans TJ, et al. Mortality and readmission following hospitalisation for heart failure in Australia: a systematic review and meta-analysis. Heart Lung Circ. Aug 2018;27(8):917-927. [CrossRef] [Medline]
  6. Lan T, Liao YH, Zhang J, et al. Mortality and readmission rates after heart failure: a systematic review and meta-analysis. TCRM. Dec 2021;17:1307-1320. [CrossRef]
  7. Parizo JT, Kohsaka S, Sandhu AT, Patel J, Heidenreich PA. Trends in readmission and mortality rates following heart failure hospitalization in the veterans affairs health care system from 2007 to 2017. JAMA Cardiol. Sep 1, 2020;5(9):1042-1047. [CrossRef] [Medline]
  8. Casper M, Nwaise I, Croft JB, Hong Y, Fang J, Greer S. Geographic disparities in heart failure hospitalization rates among medicare beneficiaries. J Am Coll Cardiol. Jan 26, 2010;55(4):294-299. [CrossRef] [Medline]
  9. Su A, Al’Aref SJ, Beecy AN, Min JK, Karas MG. Clinical and socioeconomic predictors of heart failure readmissions: a review of contemporary literature. Mayo Clin Proc. Jul 2019;94(7):1304-1320. [CrossRef] [Medline]
  10. Foraker RE, Rose KM, Suchindran CM, Chang PP, McNeill AM, Rosamond WD. Socioeconomic status, medicaid coverage, clinical comorbidity, and rehospitalization or death after an incident heart failure hospitalization. Circ: Heart Failure. May 2011;4(3):308-316. [CrossRef]
  11. Philbin EF, Dec GW, Jenkins PL, DiSalvo TG. Socioeconomic status as an independent risk factor for hospital readmission for heart failure. Am J Cardiol. Jun 15, 2001;87(12):1367-1371. [CrossRef] [Medline]
  12. Greenberg BH, Abraham WT, Albert NM, et al. Influence of diabetes on characteristics and outcomes in patients hospitalized with heart failure: a report from the Organized Program to Initiate Lifesaving Treatment in Hospitalized Patients with Heart Failure (OPTIMIZE-HF). Am Heart J. Aug 2007;154(2):277. [CrossRef] [Medline]
  13. Sarma S, Mentz RJ, Kwasny MJ, et al. Association between diabetes mellitus and post‐discharge outcomes in patients hospitalized with heart failure: findings from the EVEREST trial. European J of Heart Fail. Feb 2013;15(2):194-202. [CrossRef]
  14. Zinman B, Wanner C, Lachin JM, et al. Empagliflozin, cardiovascular outcomes, and mortality in type 2 diabetes. N Engl J Med. Nov 26, 2015;373(22):2117-2128. [CrossRef] [Medline]
  15. Inzucchi SE, Zinman B, Fitchett D, et al. How does empagliflozin reduce cardiovascular mortality? Insights from a mediation analysis of the EMPA-REG OUTCOME trial. Diabetes Care. Feb 2018;41(2):356-363. [CrossRef] [Medline]
  16. Wild CP. The exposome: from concept to utility. Int J Epidemiol. Feb 2012;41(1):24-32. [CrossRef] [Medline]
  17. Li Y, Hu H, Zheng Y, et al. Impact of contextual-level social determinants of health on newer antidiabetic drug adoption in patients with type 2 diabetes. IJERPH. 2023;20(5):4036. [CrossRef] [Medline]
  18. Hu H, Zheng Y, Wen X, et al. An external exposome-wide association study of COVID-19 mortality in the United States. Sci Total Environ. May 2021;768(144832):144832. [CrossRef]
  19. Niedzwiecki MM, Walker DI, Vermeulen R, Chadeau-Hyam M, Jones DP, Miller GW. The exposome: molecules to populations. Annu Rev Pharmacol Toxicol. Jan 6, 2019;59:107-127. [CrossRef] [Medline]
  20. Hu H, Zhao J, Savitz DA, Prosperi M, Zheng Y, Pearson TA. An external exposome-wide association study of hypertensive disorders of pregnancy. Environ Int. Aug 2020;141:105797. [CrossRef] [Medline]
  21. Data. OneFlorida+ Clinical Research Network. URL: https://onefloridaconsortium.org/data/ [Accessed 2023-10-04]
  22. Hogan WR, Shenkman EA, Robinson T, et al. The OneFlorida Data Trust: a centralized, translational research data infrastructure of statewide scope. J Am Med Inform Assoc. Mar 15, 2022;29(4):686-693. [CrossRef] [Medline]
  23. Integrated data repository research services, clinical and translational science institute. University of Florida Health. URL: https://idr.ufhealth.org/ [Accessed 2024-02-28]
  24. Thygesen SK, Christiansen CF, Christensen S, Lash TL, Sørensen HT. The predictive value of ICD-10 diagnostic coding used to assess Charlson comorbidity index conditions in the population-based Danish National Registry of Patients. BMC Med Res Methodol. May 28, 2011;11(1):83. [CrossRef] [Medline]
  25. Social determinants of health database. Agency for Healthcare Research and Quality. URL: https://www.ahrq.gov/sdoh/data-analytics/sdoh-data.html [Accessed 2024-10-04]
  26. Building power for health and equity. County Health Rankings & Roadmaps. URL: www.countyhealthrankings.org [Accessed 2025-07-18]
  27. Tables and maps. U.S. Bureau of Labor Statistics. URL: https://www.bls.gov/lau/tables.htm [Accessed 2025-07-18]
  28. Economic resilience of US counties during the great recession. The Northeast Regional Center for Rural Development. URL: https://aese.psu.edu/nercrd/community/economicresilience [Accessed 2023-10-04]
  29. Download data tables. United States Cancer Statistics, CDC. 2023. URL: https://www.cdc.gov/cancer/uscs/dataviz/download_data.htm [Accessed 2023-10-04]
  30. Dartmouth Atlas DATA. URL: https://data.dartmouthatlas.org/ [Accessed 2023-10-04]
  31. Air Quality Statistics Report. United States Environmental Protection Agency. URL: https://www.epa.gov/outdoor-air-quality-data/air-quality-statistics-report [Accessed 2023-10-04]
  32. US Religion Census. URL: https://www.usreligioncensus.org/ [Accessed 2023-10-04]
  33. Pesticide National Synthesis Project. US Geological Survey (USGS). URL: https://water.usgs.gov/nawqa/pnsp/data/ [Accessed 2023-10-04]
  34. County-level measure of social capital. The Northeast Regional Center for Rural Development. URL: https://aese.psu.edu/nercrd/community/social-capital-resources [Accessed 2023-10-04]
  35. Social Determinants of Health. Office of Disease Prevention and Health Promotion. URL: https://health.gov/healthypeople/priority-areas/social-determinants-health [Accessed 2023-10-18]
  36. Ponce SG, Norris J, Dodendorf D, Martinez M, Cox B, Laskey W. Impact of ethnicity, sex, and socio-economic status on the risk for heart failure readmission: the importance of context. Ethn Dis. 2018;28(2):99-104. [CrossRef] [Medline]
  37. Lick D, Mulhem E. Mortality and hospital readmission rates for heart failure among patients of middle eastern ancestry compared to non-Middle Eastern Whites in Southeast Michigan. J Immigrant Minority Health. Aug 2023;25(4):835-840. [CrossRef]
  38. Roshanghalb A, Mazzali C, Lettieri E. Multi-level models for heart failure patients’ 30-day mortality and readmission rates: the relation between patient and hospital factors in administrative data. BMC Health Serv Res. Dec 30, 2019;19(1):1012. [CrossRef] [Medline]
  39. Curtis LH, Greiner MA, Hammill BG, et al. Early and long-term outcomes of heart failure in elderly persons, 2001-2005. Arch Intern Med. Dec 8, 2008;168(22):2481-2488. [CrossRef] [Medline]
  40. Bristow MR, Saxon LA, Boehmer J, et al. Cardiac-resynchronization therapy with or without an implantable defibrillator in advanced chronic heart failure. N Engl J Med. May 20, 2004;350(21):2140-2150. [CrossRef] [Medline]
  41. Cardiovascular. Abbott. URL: https:/​/www.​cardiovascular.abbott/​content/​dam/​bss/​divisionalsites/​cv/​cv-live-site/​hcp/​reimbursement/​crm/​Pacemaker%20CRT-P_Procedures_v2.​pdf [Accessed 2024-01-02]
  42. Cohen SS, Roger VL, Weston SA, et al. Evaluation of claims‐based computable phenotypes to identify heart failure patients with preserved ejection fraction. Pharmacology Res & Perspec. Dec 2020;8(6):e00676. [CrossRef]
  43. Chronic conditions data warehouse. Chronic Conditions Data Warehouse. URL: https://www2.ccwdata.org/web/guest/data-dictionaries [Accessed 2024-01-05]
  44. Neighborhood Atlas. URL: https://www.neighborhoodatlas.medicine.wisc.edu/ [Accessed 2021-05-25]
  45. Peterson RA. Finding optimal normalizing transformations via bestNormalize. R J. 2021;13(1):310. [CrossRef]
  46. Tibshirani R. Regression shrinkage and selection via the Lasso. J R Stat Soc Series B Stat Methodol. Jan 1, 1996;58(1):267-288. [CrossRef]
  47. Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate escent. J Stat Softw. 2010;33(1):1-22. [CrossRef] [Medline]
  48. Segar MW, Hall JL, Jhund PS, et al. Machine learning-based models incorporating social determinants of health vs traditional models for predicting in-hospital mortality in patients with heart failure. JAMA Cardiol. Aug 1, 2022;7(8):844-854. [CrossRef] [Medline]
  49. Little RJA, Rubin DB. Statistical Analysis with Missing Data. 1st ed. Wiley; 2002. [CrossRef] ISBN: 978-0-471-18386-0
  50. Pedersen AB, Mikkelsen EM, Cronin-Fenton D, et al. Missing data and multiple imputation in clinical epidemiological research. Clin Epidemiol. 2017;9(157–166):157-166. [CrossRef] [Medline]
  51. Enders CK. Littlee TD, editor. Applied Missing Data Analysis. Guilford Press; 2010. ISBN: 978-1-60623-639-0
  52. Graham JW. Missing data analysis: making it work in the real world. Annu Rev Psychol. 2009;60(549–576):549-576. [CrossRef] [Medline]
  53. Sun M, Engelhard MM, Bedoya AD, Goldstein BA. Incorporating informatively collected laboratory data from EHR in clinical prediction models. BMC Med Inform Decis Mak. Jul 24, 2024;24(1):206. [CrossRef] [Medline]
  54. Agier L, Portengen L, Chadeau-Hyam M, et al. A systematic comparison of linear regression–based statistical methods to assess exposome-health associations. Environ Health Perspect. Dec 2016;124(12):1848-1856. [CrossRef] [Medline]
  55. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B Stat Methodol. Jan 1, 1995;57(1):289-300. [CrossRef]
  56. Vatcheva KP, Lee M, McCormick JB, Rahbar MH. Multicollinearity in regression analyses conducted in epidemiologic studies. Epidemiology (Sunnyvale). Apr 2016;6(2):227. [CrossRef] [Medline]
  57. Motairek I, Makhlouf MHE, Rajagopalan S, Al-Kindi S. The exposome and cardiovascular health. Can J Cardiol. Sep 2023;39(9):1191-1203. [CrossRef] [Medline]
  58. Lopez PD, Cativo-Calderon EH, Otero D, Rashid M, Atlas S, Rosendorff C. The impact of environmental factors on the mortality of patients with chronic heart failure. Am J Cardiol. May 1, 2021;146(48–55):48-55. [CrossRef] [Medline]
  59. Moghadamnia MT, Ardalan A, Mesdaghinia A, Keshtkar A, Naddafi K, Yekaninejad MS. Ambient temperature and cardiovascular mortality: a systematic review and meta-analysis. PeerJ. Aug 4, 2017;5:e3574. [CrossRef]
  60. Chan EYY, Goggins WB, Kim JJ, Griffiths SM. A study of intracity variation of temperature-related mortality and socioeconomic status among the Chinese population in Hong Kong. J Epidemiol Community Health. Apr 2012;66(4):322-327. [CrossRef] [Medline]
  61. Liu C, Yavar Z, Sun Q. Cardiovascular response to thermoregulatory challenges. Am J Physiol Heart Circ Physiol. Dec 1, 2015;309(11):H1793-H1812. [CrossRef] [Medline]
  62. Liu J, Varghese BM, Hansen A, et al. Heat exposure and cardiovascular health outcomes: a systematic review and meta-analysis. Lancet Planet Health. Jun 2022;6(6):e484-e495. [CrossRef] [Medline]
  63. Escolar V, Lozano A, Larburu N, et al. Impact of environmental factors on heart failure decompensations. ESC Heart Fail. Dec 2019;6(6):1226-1232. [CrossRef] [Medline]
  64. Gostimirovic M, Novakovic R, Rajkovic J, et al. The influence of climate change on human cardiovascular function. Arch Environ Occup Health. Oct 2, 2020;75(7):406-414. [CrossRef]
  65. Sverdlov AL, Figtree GA, Horowitz JD, Ngo DTM. Interplay between oxidative stress and inflammation in cardiometabolic syndrome. Mediators Inflamm. 2016;2016:8254590. [CrossRef] [Medline]
  66. Crandall CG, Wilson TE. Human cardiovascular responses to passive heat stress. Compr Physiol. Jan 2015;5(1):17-43. [CrossRef] [Medline]
  67. Nam YH, Bilker WB, Leonard CE, Bell ML, Hennessy S. Outdoor temperature and survival benefit of empiric potassium in users of furosemide in US Medicaid enrollees: a cohort study. BMJ Open. Feb 18, 2019;9(2):e023809. [CrossRef] [Medline]
  68. Danesh Yazdi M, Wei Y, Di Q, et al. The effect of long-term exposure to air pollution and seasonal temperature on hospital admissions with cardiovascular and respiratory disease in the United States: a difference-in-differences analysis. Sci Total Environ. Oct 15, 2022;843(156855):156855. [CrossRef] [Medline]


ADI: Area Deprivation Index
aOR: adjusted odds ratio
COPD: chronic obstructive pulmonary disease
CRT: cardiac resynchronization therapy
CVD: cardiovascular disease
EHR: electronic health record
ExWAS: external exposome-wide association study
HF: heart failure
HFpEF: heart failure with preserved ejection fraction
HHF: hospitalized for heart failure
ICD: implantable cardioverter-defibrillator
ICD-10: International Classification of Diseases, Tenth Revision
ICD-10-CM: International Classification of Diseases: Tenth Revision: Clinical Modification
ICD-9-CM: International Classification of Diseases: Ninth Revision: Clinical Modification
LASSO: least absolute shrinkage and selection operator
SES: socioeconomic status
SNAP: Supplemental Nutrition Assistance Program
STROBE: Strengthening the Reporting of Observational Studies in Epidemiology


Edited by Amaryllis Mavragani; submitted 22.01.25; peer-reviewed by Dino Miric; final revised version received 24.05.25; accepted 25.05.25; published 25.08.25.

Copyright

© Wenxi Huang, Stephen E Kimmel, Mustafa Ahmed, Steven M Smith, Yao An Lee, Lanting Yang, Inmaculada Hernandez, Jiang Bian, Jingchuan Guo. Originally published in JMIR Formative Research (https://formative.jmir.org), 25.8.2025.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.