Background: Many researchers have aimed to develop chronic health surveillance systems to assist in public health decision-making. Several digital health solutions created lack the ability to explain their decisions and actions to human users.
Objective: This study sought to (1) expand our existing Urban Population Health Observatory (UPHO) system by incorporating a semantics layer; (2) cohesively employ machine learning and semantic/logical inference to provide measurable evidence and detect pathways leading to undesirable health outcomes; (3) provide clinical use case scenarios and design case studies to identify socioenvironmental determinants of health associated with the prevalence of obesity, and (4) design a dashboard that demonstrates the use of UPHO in the context of obesity surveillance using the provided scenarios.
Methods: The system design includes a knowledge graph generation component that provides contextual knowledge from relevant domains of interest. This system leverages semantics using concepts, properties, and axioms from existing ontologies. In addition, we used the publicly available US Centers for Disease Control and Prevention 500 Cities data set to perform multivariate analysis. A cohesive approach that employs machine learning and semantic/logical inference reveals pathways leading to diseases.
Results: In this study, we present 2 clinical case scenarios and a proof-of-concept prototype design of a dashboard that provides warnings, recommendations, and explanations and demonstrates the use of UPHO in the context of obesity surveillance, treatment, and prevention. While exploring the case scenarios using a support vector regression machine learning model, we found that poverty, lack of physical activity, education, and unemployment were the most important predictive variables that contribute to obesity in Memphis, TN.
Conclusions: The application of UPHO could help reduce health disparities and improve urban population health. The expanded UPHO feature incorporates an additional level of interpretable knowledge to enhance physicians, researchers, and health officials' informed decision-making at both patient and community levels.
International Registered Report Identifier (IRRID): RR2-10.2196/28269
Enhanced health surveillance systems for chronic disease support could mitigate factors that contribute to the incline of morbidity and mortality of diseases such as obesity. Obesity is linked to increased overall mortality and has reached pandemic proportions, being responsible for approximately 2.8 million deaths annually [, ]. Obesity represents an excessive and abnormal accumulation of body fat, which leads to adverse health effects that impose a health and financial toll on individuals and society [ ]. More than half of the US population has at least one chronic condition, and 27% are living with multimorbidity [ ]. These conditions cause more than 1.7 million deaths per year in the United States, where obesity is associated with the top leading causes of death (eg, diabetes, heart disease, stroke, and cancer) [ ].
Neighborhood factors such as socioenvironmental determinants of health (SDoH) significantly contribute to these statistics [- ]. Implementation of an intelligent health surveillance platform that incorporates SDoH can improve preparedness, prevention, and management of this obesity pandemic by assisting in the implementation of effective treatment and interventions.
Health surveillance involves the “ongoing systematic collection, analysis, and interpretation of data essential to the planning, implementation, and evaluation of public health practice, closely integrated with the timely dissemination of these data to those who need to know” . Researchers have aimed to develop chronic health surveillance systems to assist in chronic health decision-making [ - ]. The World Health Organization (WHO) developed a conceptual framework for an Urban Public Health Observatory (UPHO) comprised of 3 domains: mission, governance, and knowledge and intelligence, the latter of which incorporates a data management component [ ]. This framework from WHO therefore provides a strategic model for health surveillance.
Many current digital health solutions and electronic health record (EHR) systems lack the ability to incorporate machine learning algorithms into their decision-making process, and even if they do, the algorithms used do not have appropriate capabilities to explain the suggested decisions and actions to human users . Machine learning approaches, so-called black-box statistics, should be trustworthy, transparent, interpretable, and explainable when making decisions in the clinical or health science setting [ - ]. A system’s explanation constitutes its interpretability [ , - ]. Explainable AI (XAI) increases the intelligence delivered to the user by providing explanations, thereby enhancing the interpretability of outcomes and findings. Researcher efforts have been shifting toward applying algorithms that can aid in explaining the results of machine learning models. For instance, the SHAP (Shapley Additive Explanations) analysis [ ] is an approach that assigns each model feature an importance score for making a particular prediction. Compared to traditional feature importance analyses, the novelty of SHAP lies in its ability to assess importance at the individual patient level. In this paper, we propose a novel approach to explainability that uses knowledge graphs as a semantic infrastructure explainable by design and enriches those graphs with results from machine learning algorithms as metrics and scores. The semantic causal relationships on the graph provide contextual knowledge around a population, and the metrics support those relationships, which provides 2 levels of evidence: knowledge level and statistical level.
We implement a UPHO platform as a knowledge-based surveillance system that provides better insight to improve decision-making by incorporating SDoH and providing XAI and interpretability functions . Our UPHO consists of 3 layers: data, analytics, and application. In this work, we refine the initial design by incorporating data management, knowledge, and intelligence domains ( ) that are in alignment with the conceptual model by WHO and a focus on the semantics layer.
The objectives of this article are to (1) expand UPHO by incorporating a semantics layer, (2) cohesively employ machine learning and semantic/logical inference to provide measurable evidence and detect pathways that lead to undesirable health outcomes, (3) provide clinical case scenarios and design case studies on identifying SDoH associated with obesity prevalence, and (4) provide a dashboard design that demonstrates the use of UPHO in the context of obesity, using the provided case scenario.
shows the expansion of the UPHO to incorporate the semantics layer. In the following section, we provide a detailed description of the UPHO platform expansion design.
Data Management Domain
The data management domain comprises the data layer. The UPHO collects population-level health and SDoH data and individual-level clinical and demographic data from EHRs through regional registries.
To obtain population-level health data, we used the US Centers for Control and Prevention (CDC) 500 Cities Behavior Risk Factors Surveillance System, which includes data regarding chronic diseases and their behavioral risk factors . These variables are model-based estimates of crude prevalence among adults aged ≥18 years in 2018. We extracted variables pertaining to obesity, lack of physical activity, lack of insurance, and diabetes mellitus at the census tract level.
We extracted population-level SDoH variables that pertain to food insecurity, transportation, and socioeconomic stability at zip code, census tract, census block, and census block group levels from the US Census Bureau 2018 American Community Survey  and the US Department of Agriculture Research Atlas [ ].
Knowledge and Intelligence Domain
The analytics layer pulls raw data from different sources in the data layer and analyzes it to classify it, predict new relations, conduct spatial pattern detection, and calculate new metrics. The analytics layer also performs feature engineering by deriving new metrics and using them to enrich the original data sets.
The stages of the UPHO semantics layer are shown in. In the knowledge representation and axiomatization stages, we use semantic web technologies to develop several domain and application ontologies from relevant domains of interest to provide necessary contextual knowledge. Ontologies are systematic representations of knowledge that can be used to integrate and analyze large amounts of heterogeneous data, thereby allowing classification of knowledge [ ]. In those ontologies, we define concept hierarchies and rule axioms by using existing domain knowledge, such as the WHO/CDC guidelines, and federal and local sources. We develop new ontologies by reusing several existing domain ontologies. For this study, we adopted concepts, properties, and axioms from 5 different ontologies that we used in our prior work [ - ], specifically (1) disease ontology (DO) [ ] (eg, obesity, diabetes); (2) the Childhood Obesity Prevention (Knowledge) Enterprise (COPE) ontology [ ] that defines SDoH concepts such as socioeconomic issues (eg, food deserts, income) and behavioral issues (eg, lack of physical activity, purchasing preference); (3) geographical information system ontology (GISO) [ ] (eg, zip code, census tract); (4) health indicators ontology (HIO) [ ]; and (5) the adverse childhood experiences (ACEs) ontology (ACESO), which defines concepts related to ACEs, health outcomes (eg, mental and physical health), interventions, and SDoH, including axioms that define issues like lack of transportation (eg, limited access to a vehicle and limited access to public transit) and food and how they affect routine follow-up activities (eg, missing medical appointments) [ ].
We start our semantic analysis using concepts defined in our ontologies and web services to align concepts to actual data resources, allowing us to construct a population knowledge graph structure that abides by an ontology and contains both data and concepts . We enrich that knowledge graph using a logical reasoner that uses facts derived from existing knowledge, new knowledge extracted from the analytics layer, and the generic rule axioms defined in the domain ontologies that trigger specific actions under certain conditions.
An effective explainable system accounts for the target user group (eg, physician, researcher). Knowledge of the end user is very important for the delivery of decisions, recommendations, and actions. Each analytics and semantics layer contains an explainability component that can be leveraged in the uppermost health applications layer. To maintain features such as data integration, XAI, and interpretability, we must achieve interoperability by using semantics and ontologies. Explanations adaptable to the user can decrease errors in interpretation by enhancing the interpretability of outcomes and findings.
The UPHO platform can be used as a basis to develop several applications, some of which we have already developed, including dashboards , mobile health (mHealth) apps [ ], digital assistants, and recommender systems [ ]. In this article, we leverage the UPHO to implement a dashboard for real-time surveillance. By accessing dynamic knowledge discovered through the UPHO, the dashboard can provide real-time early warnings that are based both on content and context. The platform is accessible to policymakers, physicians, researchers, public health officials, and the public.
The following sections present 2 clinical case scenarios that focus on a physician and a researcher as users to demonstrate the methodology used in the knowledge and intelligence domain layers and the corresponding dashboard design in the application.
Scenario 1: A physician seeks an effective intervention for an adult African American patient diagnosed with obesity. The physician focuses on how SDoH in the patient’s neighborhood can influence the doctor’s management plans.
Scenario 2: A researcher investigating the impact of SDoH on obesity seeks an effective intervention for the adult obese populations in Memphis, TN.
Analytics Layer: Machine Learning Model Development
We trained a machine learning–based support vector regression (SVR) machine model [, ]. We linked CDC 500 Cities population-level obesity and behavior data [ ] to the population-level social DoH [ , ] data set at the census tract level in Memphis, TN. We analyzed 8 features and used a Spearman rank test to assess the positive or negative relationship between each feature. We used a variance inflation factor (VIF) to detect multicollinearity between features. To examine patient neighborhood-level exposure, we used SHAP analysis. shows the summary statistics for features considered for this study. We trained our support vector model on the 85% of randomly selected training data and tested the model on the 15% of remaining data to ensure the generalizability of the model, and we applied the linear kernel function. We scaled our data to have a mean of zero and standard deviation of one. We applied the grid search optimization method to seek optimal hyperparameters to improve model performance using the Caret package in R software (R Foundation for Statistical Computing) [ ]. In addition, to avoid overfitting 5-fold cross-validation was applied to the training data set. We used root mean square error (RMSE) and R2 to evaluate the performance of the model.
|Features||Operationalization||Original, mean (SD)||Training, mean (SD)||Test, mean (SD)|
|Obesity||Model-based estimate for crude prevalence of obesity among adults aged ≥18 years, 2018||37.50 (7.84)||37.42 (7.54)||37.97 (6.95)|
|Low access to supermarket||Count of low income population more than half mile from a supermarket in the census tract||1382.20 (108.37)||1345.68 (967.83)||1616.17 (1120.23)|
|Black||Percentage of population that is Black or African American||63.17 (32.70)||62.22 (33.04)||63.72 (31.88)|
|Poverty||Percentage of population living below the federal poverty line||28.65 (16.28)||28.27 (16.18)||31.06 (17.06)|
|Unemployment||Percentage of unemployed population||15.73 (9.31)||15.97 (9.67)||14.16 (6.52)|
|High school diploma||Percentage of population 25 years or older without high school diploma||10.38 (6.59)||10.23 (6.70)||11.35 (5.89)|
|Lack of physical activity||Model-based estimate for crude prevalence of lack of physical activity among adults aged ≥18 years, 2018||36.16 (9.80)||35.97 (9.79)||37.34 (9.99)|
|Crime||Crime rate per thousand people||350.20 (126.26)||160.99 (337.65)||111.93 (80.40)|
|Lack of access to insurance||Model-based estimate for crude prevalence of lack of insurance among adults aged ≥18 years, 2018||20.21 (6.78)||20.10 (6.81)||20.88 (6.67)|
Semantics Layer: Knowledge Graph Generation
We followed the following ordered steps to generate the semantics layer knowledge graph from concepts defined in our domain ontologies.
- We use concepts, relations, and axioms from domain ontologies to construct a preliminary population knowledge graph. For our scenario, we start by adding a dummy node that represents either a patient or a population ( ). We begin connecting that node to concepts like disease, risk factors, physical characteristics, etc. For example, obesity falls into the disease type represented by the isA relation in , where isA reflects a subtype. For instance, SDoH isA RiskFactr, and lackOfTransporation is an SDoH subtype. These different hierarchies are encoded in the ACESO ontology. We also add a prefix before each type to reflect the namespace where that concept is defined (eg, the term DO:Disease reflects that the concept disease is defined in the DO). Relations can also reflect the properties of a node. For example, a patient livesIn 38127, which isA zip code, and that zip code has 8 census tracts of the type CensusTract, defined in the GISO ontology.
- We populate the generated graph structure with evidence from the data layer. For instance, our data set contains a variable that shows the prevalence of obesity as a percentage metric in specific neighborhoods. We use that information to add edges to our graph that link obesity (as a disease) to prevalence (as a metric).
- We further enrich and refine the initial graph by performing knowledge engineering using the logical reasoner ( ) and feature engineering using the results from the analytics layer. The logical reasoner uses a set of rule axioms to perform logical inference on concepts already existing in the graph. For instance, our COPE ontology encodes epidemiological causal axioms that link SDoH to negative health outcomes. shows how we encode the generic axioms R1-R3. When we combine those generic rule axioms with facts about a specific census tract, we can infer all the risk factors associated with living in that census tract, eg, knowing the facts F1 can tell us that the population living in that area may be exposed to risk factors that lead to obesity.
- After performing the logical inference on the initial graph structure, we incorporate new nodes and edges in the graph corresponding to new concepts (eg, the lackOfPhysicalActivity concept from the COPE ontology) or new relations (eg, isExposedTo). The knowledge graph refinement is an iterative process, so we can repeat step 2 until we reach a stable state of the graph after which we can populate the graph with more evidence from our engineered data that we pull from the analytics layer. For that purpose, we use the population-level data about SDoH risk factors collected from US Census, CDC, and USDA. For instance, to capture the lack of physical activity we use the CDC 500 Cities data set. The machine learning analysis performed by the analytics layer provides edges that pertain to prediction (eg, isPredictorOf, ). The final knowledge graph is shown in , which provides a generic view of all possible assumptions we can make about this patient or population.
- To gather the most important information from this graph, a user can trace a specific pathway based on both logical inference and machine learning results. The red arrows in reflect the pathway in our scenario.
Encoding axioms as general rules, initial facts, or new facts derived from feature engineering or logical reasoning.
Generic rule axioms
- COPE:lackOfPhysicialActivity leadsTo DO:Obesity (R1)
- %ObesityPrevalence:Metric isHealthIndicatorFor DO:Obesity (R2)
- Obesity:Disease isRiskFactorOf Diabetes:Disease (R3)
- individual:Patient livesIn “10300”:CensusTract (F1)
- “10300”:CensusTract has “49”:%PopWLackOfPhysicialActivity (F2)
- “10300”:CensusTract has “21”:%PopNoHighSchoolDiploma (F3)
- “10300”:CensusTract has “60”:%UnderPovertyLine (F4)
- “10300”:CensusTract has “46”:%ObesityPrevalence (F5)
Feature engineered through multivariate analysis
- %PopWLackOfPhysicialActivity:Metric isPredictorOf ObesityPrevalence:Metric [using F2-F5] (F6)
- individual:Patient isExposedTo LackPhysicalActivity:PhysicalCharacteristic [using F1 and F2] (F7)
- individual:Patient shouldBeScreenedFor Diabetes:Disease [using R1, R2, R3, F6, F7]
No ethics review board assessment was required for this study because we used publicly available data.
Machine Learning Analysis
The significant Spearman rank coefficient and VIF of the 7 features included in this study are shown in. Any feature exhibiting a VIF of greater than 10 was removed. For the SVR model results, we obtained an RMSE of 0.312 for the training set and 0.203 for the test set, while the R2 for the training set was 0.91 and that for the testing data set was 0.95 . Since the model provides similar results for training and test data sets, the proposed model does not overfit. The SVR feature importance results range on a scale of 0 to 100, and the greater the score, the most important the feature ( ). We found that the percentage of the population lacking physical activity, percentage of population below poverty level, percentage of population without high school diploma, percentage of population unemployed, and percentage of Black population were the most important variables when predicting obesity prevalence in Memphis, TN.
shows SHAP’s value plot of feature contribution at the patient neighborhood level (census tract: 10300), which indicates the most important features such as the percentage of the population that lack physical activity and the percentage of population below the poverty level, from the point of view of the prediction of obesity prevalence in the patient neighborhood. The lack of physical activity and poverty had the largest positive (increased) contributions to obesity prevalence. On the other hand, the population of low income and more than a half-mile from the supermarket showed a negative (decreased) contribution but was the least important variable when predicting the patient neighborhood obesity prevalence. The knowledge extracted from our analysis will be used to detect the obesity prevalence pathways, which are defined by the top 5 most important features.
|Features||Spearman rank coefficient||VIFa|
|Low access to supermarket||0.37||1.70|
|No high school diploma||0.81||3.55|
|Lack of physical activity||0.92||8.82|
aVIF: variance inflation factor.
|Features||SVRa feature importance|
|Low access to supermarket||4.39|
|No high school diploma||73.41|
|Lack of physical activity||100|
aSVR: support vector regression.
UPHO: Dashboard Design
Use Case Scenarios
In this section, we describe the semantics feature provided by UPHO through a proof-of-concept prototype that will display the different features of the expanded system by implementing the clinical scenarios described in the previous section.
First, the user will sign into the UPHO platform dashboard, which will determine their specific role and establish the proper access permissions. The user will make the selections from the following menu items:
- S1. Select an outcome of interest (eg, obesity prevalence, cancer,)
- S2. Select analytics aim
- S3. Select level of analysis and enter address/location (patient’s address [patient-level], city, county, or state [population-level])
- S4. Select geographical level of granularity (eg, zip code, census tract)
- S5. Select SDoH domain-specific risk factors
After making these selections, the system will present on-demand explanations of risk level calculations, based on the selected level of geographic granularity.
The physician selects “obesity prevalence” as the outcome of interest (S1), and “causal pathway analysis” (S2) as the analytics aim, “patient-level” as the level of interest (entering patient’s address, S3), and “census tract” as the geographical level of granularity (S4). The system provides risk-level calculations and descriptive statistics based on the census tract of the patient’s address. The physician also has the option to select a particular SDoH of interest in S5, in which case the system will highlight these nodes in the graph. Finally, the user selects “Explore” to generate the results and a corresponding knowledge graph. These results are tailored to the user’s interest in patient-level analysis and provide an explanative overview of the analysis results (A). The system also allows the user to hover over pathways and nodes to explore explanative knowledge ( B, 5C) and offers a summary of recommendations and knowledge ( D).
Here the researcher has access to more features. The researcher explores the causal pathway analysis aim in a population-level analysis and enters Memphis, TN, as a location of interest at the census tract–level (S1-S3), as shown in, and the system provides risk-level calculations for the city of Memphis, TN. The researcher also has access to regression plots ( , A), which reflect the selection in S5. In section B, the system reports the results from the SVR machine model and provides explanations for each feature included in the model ( , B). In section C, the explanation pane presents a knowledge graph showing results tailored to the user’s interest in population-level analysis ( , C). The researcher can also hover over pathways and nodes for knowledge ( , C, a, b, and c), like the physician in scenario 1. The system also offers the researcher a summary of recommendations and knowledge ( , C, d).
The graph part of the dashboard can serve as a tool for researchers and physicians to semantically explain the recommendations that we made about a specific patient or population. The current version of the graph provides 2 different visual cues, as follows.
- Tracing pathways on the graph provides visual cues. The red arrows in show the edges that are part of a causal pathway that leads from risk factors to negative health outcomes for the specific patient, zip code, or census tract. While this path is specific to the selected patient or population, it can be used as a generic metapath. For example, Individual livesIn CensusTract→representsA Neighborhood→hasPhysicalCharacteristic→RiskFactorFor Disease. Depending on the level of sophistication desired, the user can trace paths on the graph and click on certain nodes or edges to obtain more insights, including statistically derived evidence or semantically inferred knowledge. They can also track the sources of that knowledge including the ontologies used.
- Clicking on a node or edge on the graph displays analysis results or knowledge. The user can hover over a certain edge (eg, lackOfPhysicalActivityisPredictorOfObesityPrevalence; B) to obtain an explanation of the data that show lackOfPhysical activity in the patient’s census tract leads to an increase in the prevalence of obesity. Similarly, the user can hover over a metric node (eg, percentage of the population below the poverty line, C) to explain that this patient lives in a neighborhood in which nearly 61% of the population lives below the poverty line, compared to the average in their city, county, or state.
UPHO’s metrics can be implemented into the backend of EHR systems (eg, Epic), and the results of those metrics can be rendered on the EHR interface in the form of risk scores on dashboards with severity indicators based on thresholds. Physicians can examine these metrics at the population level or individual patient level. UPHO can alternatively be used in a standalone approach by allowing a physician to extract more details about a single patient by providing the patient’s address or a population of patients by providing their city, state, or county. The input is coded to a geographical level of granularity that can be aligned with the population-level data to gain insights into the patient’s environment.
Previous studies provided evidence that socially disadvantaged communities are disproportionately affected by chronic diseases such as obesity [- ], which is a risk factor for developing diabetes, heart disease, and cancer. The significance of UPHO lies in its ability to provide a multifaceted surveillance system design that serves as an apparatus for actualizing effective interventions, addressing concerns in health disparities, providing awareness to the public, and equipping health officials with a surveillance system that will improve population health decision-making and planning [ ]. Using the semantics layer, the UPHO platform provides contextual knowledge by reusing several ontologies focusing on public health (eg, diseases, transportation, geography).
The incorporation of semantics provides the user with an additional layer of explainability and interpretability, which could decrease errors in intervention or treatment due to misinterpretation or misunderstanding. The semantics layer can also use ontologies to overcome the challenge of scattered data sources, thereby assisting in the achievement of interoperability, which will be used to maintain features such as data integration, XAI, and interpretability. We apply logical reasoners to extract and supply knowledge despite limited data.
Similar chronic disease surveillance systems [- ] have offered approaches to assist in the efforts of improving chronic disease surveillance. Several published systems do not incorporate SDoH data [ - ]. One did not provide an implementation of the systematic framework [ ] and several of them did not include XAI as a feature.
We followed the conceptual framework for UPHOs  and sought to improve the quality of disease surveillance by incorporating advances in AI and Bog Data, including interactive dashboard design, explainability, data integration, and interoperability, and incorporation of multimodal SDoH data. Developing a multidimensional scalable surveillance system to monitor and detect trends and deliver rapid early warnings and recommendations could assist health officials, physicians, and researchers in mitigating a health crisis such as the ongoing COVID-19 pandemic [ ].
One of the major limitations of UPHO is that it collects population data so that neighborhood or population assumptions are made for an individual in a clinical setting. For instance, individuals or patients who live in a particular population or neighborhood might not have the same characteristics as other individuals residing in the same neighborhood or population. However, our platform provides an end-to-end approach to examining the environment one resides and incorporates information that is important for the implementation of effective interventions for a given disease.
The future work will be focusing on the further development of the UPHO platform, so it can enable timely, insight-driven decisions and inform immediate or long-term health policy responses  to current and future public health crises.
This study leveraged semantic technology and presented a proof-of-concept prototype design for our knowledge-based surveillance system, UPHO, which aims to reduce health disparities and improve population health. The expanded feature incorporates another level of interpretable knowledge needed to inform physicians, researchers, and health officials’ decision-making process at the community level. Incorporating XAI helps with the explainability and interpretability of the relevant data, information, and knowledge. Users who are not equipped with domain knowledge could extract common sense knowledge from a system that incorporates XAI . We as humans need a clear visualization and understanding of relationships between parameters in a system to make informed decisions. The lack of understandability and explainability in the health care and public health domains often leads to poor transparency, lack of accountability, and ultimately lower quality of care and biased health policies [ ]. Thus, the incorporation of semantics and XAI can improve fairness, accountability, transparency, and trust in health care and public health.
The funding for this study is provided by the University of Tennessee Health Science Center.
Conflicts of Interest
- Obesity 2021. Geneva: World Health Organization URL: https://www.who.int/news-room/facts-in-pictures/detail/6-facts-on -obesity [accessed 2021-09-09]
- Abdelaal M, le Roux CW, Docherty NG. Morbidity and mortality associated with obesity. Ann Transl Med 2017 Apr;5(7):161 [FREE Full text] [CrossRef] [Medline]
- Health and economic costs of chronic diseases. Atlanta: Centers for Disease Control and Prevention; 2021 Jun 23. URL: https://www.cdc.gov/chronicdisease/about/costs/index.htm [accessed 2021-09-09]
- Boersma P, Black LI, Ward BW. Prevalence of multiple chronic conditions among US adults, 2018. Prev Chronic Dis 2020 Sep 17;17:E106 [FREE Full text] [CrossRef] [Medline]
- Lee A, Cardel M, Donahoo W. Social and environmental factors influencing obesity. In: Feingold K, Anawalt B, Boyce A, editors. Endotext. South Dartmouth: MDText.com, Inc; 2000.
- Suglia SF, Shelton RC, Hsiao A, Wang YC, Rundle A, Link BG. Why the neighborhood social environment is critical in obesity prevention. J Urban Health 2016 Feb 15;93(1):206-212 [FREE Full text] [CrossRef] [Medline]
- Reidpath DD, Burns C, Garrard J, Mahoney M, Townsend M. An ecological study of the relationship between social and environmental determinants of obesity. Health Place 2002 Jun;8(2):141-145. [CrossRef]
- Yusuf ZI, Dongarwar D, Yusuf RA, Bell M, Harris T, Salihu HM. Social determinants of overweight and obesity among children in the United States. Int J MCH AIDS 2020 Dec 28;9(1):22-33 [FREE Full text] [CrossRef] [Medline]
- Thacker S, Berkelman R. Public health surveillance in the United States. Epidemiol Rev 1988;10:164-190. [CrossRef] [Medline]
- Rotmensch M, Halpern Y, Tlimat A, Horng S, Sontag D. Learning a health knowledge graph from electronic medical records. Sci Rep 2017 Jul 20;7(1):5994 [FREE Full text] [CrossRef] [Medline]
- Sheth P, Anantharam P, Thirunarayan K. kHealth: proactive personalized actionable information for better healthcare. 2014 Presented at: 40th Int’l Conf Very Large Databases Workshop Personal Data Analytics in the Internet of Things (PDA@IOT); 2014; online.
- Chari S, Qi M, Agu N, Seneviratne O, McCusker J. Making study populations visible through knowledge graphs. Lecture Notes Comput Sci 2019:53-68. [CrossRef]
- Seneviratne O, Rashid S, Chari S. Knowledge integration for disease characterization: a breast cancer example. Int Semantic Web Conf 2018:223-238. [CrossRef]
- Gyrard A, Manas G, Saeedeh S, Krishnaprasad T, Amit S. Personalized health knowledge graph. ISWC 2018 Contextualized Knowledge Graph Workshop 2018:1 [FREE Full text]
- Shaban-Nejad A, Lavigne M, Okhmatovskaia A, Buckeridge DL. PopHR: a knowledge-based platform to support integration, analysis, and visualization of population health data. Ann N Y Acad Sci 2017 Jan 17;1387(1):44-53. [CrossRef] [Medline]
- Castillo-Salgado C. Developing an academia-based public health observatory: the new global public health observatory with emphasis on urban health at Johns Hopkins Bloomberg School of Public Health. Cad. Saúde Pública 2015 Nov;31(suppl 1):286-293. [CrossRef]
- Caiaffa WT, Friche AAL, Dias MAS, Meireles AL, Ignacio CF, Prasad A, et al. Developing a conceptual framework of urban health observatories toward integrating research and evidence into urban policy for health and health equity. J Urban Health 2014 Feb 22;91(1):1-16 [FREE Full text] [CrossRef] [Medline]
- Doshi-Velez F, Kim B. Towards a rigorous science of interpretable machine learning. Mach Learn 2017:2. [CrossRef]
- Battaglia W, Hamrick J. Relational inductive biases, deep learning, and graph networks. 2018. URL: https://arxiv.org/abs/1806.01261 [accessed 2022-06-27]
- Angelov PP, Soares EA, Jiang R, Arnold NI, Atkinson PM. Explainable artificial intelligence: an analytical review. WIREs Data Mining Knowl Discov 2021 Jul 12;11(5):1. [CrossRef]
- Rosenfeld A, Richardson A. Explainability in human–agent systems. Auton Agent Multi-Agent Syst 2019 May 13;33(6):673-705. [CrossRef]
- Biemann C. What do we need to build explainable AI systems for the medical domain?. 2017. URL: https://arxiv.org/abs/1712.09923 [accessed 2022-06-27]
- Lundberg M, Lee S. A unified approach to interpreting model predictions. Proc Adv Neural Inf Proc Syst 2017:4768-4777 [FREE Full text]
- Brakefield WS, Ammar N, Olusanya OA, Shaban-Nejad A. An Urban Population Health Observatory system to support COVID-19 pandemic preparedness, response, and management: design and development study. JMIR Public Health Surveill 2021 Jun 16;7(6):e28269 [FREE Full text] [CrossRef] [Medline]
- 500 cities project: 2016 to 2019. Atlanta: Centers for Disease Control and Prevention; 2020 Dec 08. URL: https://www.cdc.gov/places/about/500-cities-2016-2019/index.html [accessed 2021-09-20]
- About the ACS. U. S. Census Bureau. 2021 Jan 04. URL: https://www.census.gov/programs-surveys/acs/about.html [accessed 2021-09-20]
- Economic Research Service: data sources. U.S. Department of Agriculture. URL: https://www.ers.usda.gov/topics/farm- economy/farm-sector-income-finances/data-sources/ [accessed 2021-09-20]
- Haendel MA, Chute CG, Robinson PN. Classification, ontology, and precision medicine. N Engl J Med 2018 Oct 11;379(15):1452-1462. [CrossRef]
- Shaban-Nejad A, Buckeridge D, Dubé L. COPE: Childhood obesity prevention [knowledge] enterprise. Artific Intell Med 2011:225-229. [CrossRef]
- Brenas JH, Shin EK, Shaban-Nejad A. Adverse childhood experiences ontology for mental health surveillance, research, and evaluation: advanced knowledge representation and semantic web techniques. JMIR Ment Health 2019 May 21;6(5):e13498 [FREE Full text] [CrossRef] [Medline]
- Schriml LM, Arze C, Nadendla S, Chang YW, Mazaitis M, Felix V, et al. Disease Ontology: a backbone for disease semantic integration. Nucleic Acids Res 2012 Jan 12;40(D1):D940-D946 [FREE Full text] [CrossRef] [Medline]
- Shaban-Nejad A, Okhmatovskaia A, Izadi MT, Naderi N, Mondor L, Jauvin C, et al. PHIO: a knowledge base for interpretation and calculation of public health indicators. Stud Health Technol Inform 2013;192:1207. [Medline]
- Ehrlinger L. Towards a definition of knowledge graphs. 2016. URL: http://ceur-ws.org/Vol-1695/paper4.pdf [accessed 2022-06-27]
- Ammar N, Bailey JE, Davis RL, Shaban-Nejad A. Using a personal health library-enabled mHealth recommender system for self-management of diabetes among underserved populations: use case for knowledge graphs and linked data. JMIR Form Res 2021 Mar 16;5(3):e24738 [FREE Full text] [CrossRef] [Medline]
- Ammar N, Shaban-Nejad A. Explainable artificial intelligence recommendation system by leveraging the semantics of adverse childhood experiences: proof-of-concept prototype development. JMIR Med Inform 2020 Nov 04;8(11):e18752 [FREE Full text] [CrossRef] [Medline]
- Awad M, Khanna R. Support vector regression. In: Efficient Learning Machines: Theories, Concepts, and Applications for Engineers and System Designers. online: apress; 2015:67-80.
- Drucker H, Burges C, Kaufman L, Smola A, Vapnik V. Support vector regression machines. 1997. URL: http://papers.neu rips.cc/paper/1238-support-vector-regression-machines.pdf [accessed 2022-06-27]
- Kuhn M. Building predictive models in R using the caret package. J Stat Soft 2008;28(5):1-26. [CrossRef]
- Shaban-Nejad A, Michalowski M, Brownstein J, Buckeridge D. Guest editorial explainable AI: towards fairness, accountability, transparency and trust in healthcare. IEEE J Biomed Health Inform 2021 Jul;25(7):2374-2375. [CrossRef]
|ACE: adverse childhood experience|
|ACESO: adverse childhood experiences ontology|
|CDC: US Centers for Control and Prevention|
|COPE: Childhood Obesity Prevention (Knowledge) Enterprise|
|DO: disease ontology|
|EHR: electronic health record|
|GISO: geographical information system ontology|
|HIO: health indicators ontology|
|mHealth: mobile health|
|RMSE: root mean square error|
|SDoH: socioenvironmental determinants of health|
|SHAP: Shapley Additive Explanations|
|SVR: support vector regression|
|UPHO: Urban Population Health Observatory|
|VIF: variance inflation factor|
|WHO: World Health Organization|
|XAI: explainable artificial intelligence|
Edited by A Mavragani; submitted 29.12.21; peer-reviewed by S Mukherjee, J Ye, D Surian; comments to author 13.04.22; revised version received 03.05.22; accepted 07.06.22; published 20.07.22Copyright
©Whitney S Brakefield, Nariman Ammar, Arash Shaban-Nejad. Originally published in JMIR Formative Research (https://formative.jmir.org), 20.07.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.