Published on in Vol 6, No 1 (2022): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/27550, first published .
Toward Data-Driven Radiation Oncology Using Standardized Terminology as a Starting Point: Cross-sectional Study

Toward Data-Driven Radiation Oncology Using Standardized Terminology as a Starting Point: Cross-sectional Study

Toward Data-Driven Radiation Oncology Using Standardized Terminology as a Starting Point: Cross-sectional Study

Original Paper

1Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland

2Department of Radiation Oncology, University Hospital Zurich, University of Zurich, Zurich, Switzerland

3Luzerner Kantonsspital, Luzern, Switzerland

Corresponding Author:

Nikola Cihoric, MD

Inselspital

Bern University Hospital

University of Bern

Freiburgstrasse 18

Bern, 3010

Switzerland

Phone: 41 31 632 26 32

Email: nikola.cihoric@gmail.com


Background: The inability to seamlessly exchange information across radiation therapy ecosystems is a limiting factor in the pursuit of data-driven clinical practice. The implementation of semantic interoperability is a prerequisite for achieving the full capacity of the latest developments in personalized and precision medicine, such as mathematical modeling, advanced algorithmic information processing, and artificial intelligence approaches.

Objective: This study aims to evaluate the state of terminology resources (TRs) dedicated to radiation oncology as a prerequisite for an oncology semantic ecosystem. The goal of this cross-sectional analysis is to quantify the state of the art in radiation therapy specific terminology.

Methods: The Unified Medical Language System (UMLS) was searched for the following terms: radio oncology, radiation oncology, radiation therapy, and radiotherapy. We extracted 6509 unique concepts for further analysis. We conducted a quantitative analysis of available source vocabularies (SVs) and analyzed all UMLS SVs according to the route source, number, author, location of authors, license type, the lexical density of TR, and semantic types. Descriptive data are presented as numbers and percentages.

Results: The concepts were distributed across 35 SVs. The median number of unique concepts per SV was 5 (range 1-5479), with 14% (5/35) of SVs containing 94.59% (6157/6509) of the concepts. The SVs were created by 29 authors, predominantly legal entities registered in the United States (25/35, 71%), followed by international organizations (6/35, 17%), legal entities registered in Australia (2/35, 6%), and the Netherlands and the United Kingdom with 3% (1/35) of authors each. Of the total 35 SVs, 16 (46%) did not have any restrictions on use, whereas for 19 (54%) of SVs, some level of restriction was required. Overall, 57% (20/35) of SVs were updated within the last 5 years. All concepts found within radiation therapy SVs were labeled with one of the 29 semantic types represented within UMLS. After removing the stop words, the total number of words for all SVs together was 56,219, with a median of 25 unique words per SV (range 3-50,682). The total number of unique words in all SVs was 1048, with a median of 19 unique words per vocabulary (range 3-406). The lexical density for all concepts within all SVs was 0 (0.02 rounded to 2 decimals). Median lexical density per unique SV was 0.7 (range 0.0-1.0). There were no dedicated radiation therapy SVs.

Conclusions: We did not identify any dedicated TRs for radiation oncology. Current terminologies are not sufficient to cover the need of modern radiation oncology practice and research. To achieve a sufficient level of interoperability, of the creation of a new, standardized, universally accepted TR dedicated to modern radiation therapy is required.

JMIR Form Res 2022;6(1):e27550

doi:10.2196/27550

Keywords



Background

It is a globally accepted concept that data-driven medicine leads to better, safer, and more affordable care. In addition, it is perceived that it is not achievable without the free exchange of data among all members of a health care enterprise [1-3]. From a technical perspective, we have witnessed significant advances in the last decade. More than 160 exabytes of data are seamlessly exchanged among different systems via the internet every day [4]. At its core, internet communication relies on standardized data formats, such as Internet Message Format, XML, and JavaScript Object Notation. Security is ensured through robust encryption algorithms and authentication services, such as the OAuth protocol. Various industries have used the advantages of digitalization to simplify, accelerate, and standardize their work processes. However, data interoperability in health care has yet to reach its full potential [3].

The surge of health care digitalization in the United States during the last decade, supported by 36 billion dollars of government stimulation packages, failed to deliver on the promise of health care advancements. Mainstream media describe the current state of eHealth care records in the United States as an “unholy mess” [5,6]. Conversely, reports on software failures, safety, and security issues in scientific journals are scarce because of entrenched secrecy policies and so-called gag clauses that prevent physicians and researchers from publishing [7]. Furthermore, this flawed digitalization has resulted in a dramatic rise in burnout symptoms among health care workers. At least one serious symptom of burnout is recorded in 70% of physicians, a situation that is partly attributable to problems with software usability, user-unfriendly interfaces, one-size-fits-all software approaches, and foremost—to the lack of interoperability [1,8].

Contemporary health care information systems require multiple low-level manual operations, such as copy-pasting information from one interface to another, which often results in erroneous and repetitive work. Furthermore, the lack of interoperability, along with other design issues, is recognized as one of the main reasons for preventable medical errors, preventing the efficient conduct of clinical research and medical education [9-13].

The Healthcare Information and Management Systems Society defines interoperability as the ability of different information systems, devices, and applications to access, exchange, integrate, and cooperatively use data in a coordinated manner within and across organizational, regional, and national boundaries. Furthermore, interoperability is divided into four distinct levels: foundational, structural, semantic, and organizational. The American Standard Code for Information Interchange, Unicode (an information technology standard for the consistent encoding, representation, and handling of text), World Wide Web Consortium, and Health Level Seven govern foundational and structural interoperability levels. Transfer protocols and file formats used in communication are well established and standardized [14].

Organizational interoperability concerns policies, laws, regulations, and ethical considerations that span form individual actors, across health care facilities and service providers, all the way to state and international levels. The interoperability levels mentioned above are difficult to influence within a daily clinical or research routine. Foundational and technical standards necessary for clinical data exchange are well covered by the Fast Healthcare Interoperability Resources [15], a set of rules describing data formats and elements for exchanging electronic health records. Organizational interoperability refers to the willingness and ability of organizations to transfer data, which in health care are heavily regulated by the authorities that are hard to influence (by ordinary clinicians or researchers).

The semantic interoperability (SI) level is important for patients and clinicians. SI, as defined by the Healthcare Information and Management Systems Society, is a property of systems that share data with unambiguous meanings. More precisely, SI is defined as the underlying models and codification of the data, including the use of data elements with standardized definitions from publicly available value sets and coding vocabularies, providing a shared understanding and meaning to the user [16,17]. Clinical dictionaries, terminologies, or coding systems are structured lists of terms and phrases paired with their definitions or, eventually, codes. Their purpose is to describe the care and treatment of patients unambiguously. Recently, new types of lexical resources, such as ontologies and graph analytic tools, have emerged. They play a significant role in knowledge organization and management, for example, in genome-based research or enterprise business development [18,19].

Objective

The need for standardized communication in radiation oncology has been well recognized and described by several authors and groups [20-22]. However, little is known about the availability of dedicated radiation oncology lexical resources. This study aims to evaluate the current state of radiation oncology-specific terminology as a prerequisite for data-driven radiation oncology.


Goals

The primary goal of the project was to quantitatively evaluate existing radiation therapy-specific source vocabularies (SVs) available in the Unified Medical Language System (UMLS). Secondary goals were the lexical analysis of SVs and qualitative analysis, which was done to verify whether the existing terminology resources (TRs) were sufficient to cover radiation therapy needs.

Definition of TRs

There is no clear distinction between existing terminology and lexical resources that can be acquired via literature or general internet research. For this project, we defined TR as any comprehensive resource found within UMLS SVs, such as a vocabulary, taxonomy, thesaurus, coding system, ontology, or any other type.

Material for Research

UMLS [23] was used as the basis for this study. To the best of our knowledge, UMLS is the most comprehensive repository of biomedical terminologies developed and maintained by the United States National Library of Medicine [23]. It consists of 216 vocabulary items (last reviewed: May 4, 2020) in English (151/216, 70% of content) and other languages that contribute to a total of 15,479,756 concept names and synonyms. After individual registration and acceptance of an individual licensing agreement (by NC), UMLS-registered users can search content through an HTML, a web-based graphical user, or an application programming interface. Data records are accessible for download in JavaScript Object Notation format.

Methodology

We aimed to cover the terms specific to radiation therapy. To maximize sensitivity and specificity we searched UMLS on June 15, 2020, for the following terms: radiation therapy, 6030 concepts; radiotherapy, 479 concepts; radiation oncology, 58 concepts; and radio oncology, 0 concepts. In total, 6567 concepts were retrieved and exported, together with metadata in the JavaScript Object Notation format. We designed a denormalized database to facilitate further analysis. For this work, we downloaded the following data points from the UMLS server:

  • Unique concept identifier—a code value that uniquely identifies a single concept;
  • Route Source—an entity that has authored the TR;
  • Name—a string chosen to represent the concept as a whole;
  • Definition of a concept:
    • Atoms—the smallest unit of naming in a source (a specific string with specific code values and identifiers from a specific source);
  • Semantic type—a category of a concept assigned by the UMLS.

We analyzed all SVs according to the route source, number, author, location of the author, license type, lexical density of TR, and semantic types.

The data on TR authors were searched within the UMLS website or by general internet search (via Google) if the data were not available. We recorded the country where the legal residence of the authors was registered in the official state company register. International organization was defined as an institution drawing membership from at least 3 states and having activities in several states.

Licensing was categorized into two main groups: free TR, where no use restriction applied, and restricted TR, where any use was limited under conditions specified in the license agreement. Further evaluation of licensing types and terms of use was beyond the scope of this study.

Word is defined as a combination of characters representing a spoken sound that can be uttered in isolation with objective or practical meaning. The lexical density of a TR serves as a measure of the structure and complexity of communication. It is defined as the ratio of the total number of words that describe all concepts within a TR and the number of unique words used to describe the concepts. The word propagation index was used as a measure of the importance of a word and was expressed as the number of SVs that contained this word.

Data processing and lexical analysis were performed using Python (version 3.7; Python Software Foundation) and Python library Natural Language Toolkit (version 3.5).

The systematic review of other biomedical terminology services and repositories, such as Open Biological and Biomedical Ontology Foundry [24] or BioPortal [25], was beyond the scope of this work.


Overview

A total of 6567 concepts were retrieved from UMLS. After the removal of duplicate entries, 6509 unique concepts were selected for further analysis.

The concepts were distributed across 35 SVs. The median number of unique concepts was 5 per SV (range 1-5479 concepts per TR). Of the SVs, 14% (5/35) contained 94.59% (6157/6509) of all the concepts. The SVs were International Classification of Diseases, Tenth Revision Procedure Coding System (5479/6509, 84.18% of concepts), Systematized Nomenclature of Medicine-Clinical Terms (United States; 326/6509, 5.01% of concepts), Current Procedural Terminology (142/6509, 2.18% of concepts), MedDRA (115/6509, 1.77% of concepts), and MEDCIN (95/6509, 1.46% of concepts). The remaining 5.41% (352/6509) of concepts were contained in 86% (30/35) of SVs. All data are presented in Multimedia Appendix 1.

The SVs were created by 29 individual authors. The US National Library of Medicine was the author of (4/29, 14%) SVs. The National Center for Health Statistics and the Centers for Medicare and Medicaid Services, National Cancer Institute Enterprise Vocabulary Services, and the College of American Pathologists or International Health Terminology Standards Development Organization contributed 7% (2/35) of SVs each. Other 26 authors contributed with 3% (1/35) SV each. An overview of SVs is presented in Multimedia Appendix 2.

Vocabulary Sources

The authors of the SVs were predominantly legal entities registered in the United States (25/35, 71%), followed by international organizations (6/35, 17%) and legal entities registered in Australia (2/35, 6%), the Netherlands, and the United Kingdom (1/35, 3%). Of the total SVs, (16/35, 46%) did not have any restriction on use, whereas the remaining (19/35, 54%) SVs had some level of restriction. Of the 35 SVs, 20 (57%) were updated within the last 5 years (Multimedia Appendix 3).

All concepts found in RT SVs were labeled with one of 29 semantic types (Multimedia Appendix 4), which accounted for 21.8% (29/133) of all semantic types available in UMLS. Of the total concepts, 94.05% (6122/6509) were classified by UMLS as terms describing a therapeutic or preventive procedure according to the scheme for classification of semantic types.

After removing the stop words, the total number of words for all SVs was 56,219, with a median of 25 unique words per TR (range 3-50,682). The total number of unique words in all SVs was 1048, with a median of 19 unique words per vocabulary (range 3-406). The lexical density for all concepts in all SVs was zero (0.02 rounded to 2 decimals; Multimedia Appendix 5). Median lexical density per unique TR was 0.7 (range 0.0-1.0). The median maximal length of all concepts expressed as the total number of words for all TR was 8 (range, 3-28). The median minimal length of all concepts expressed as the total number of words for all TRs was 3 (range 1-10). All results are shown in Table 1.

Of the total words, 677 were unique to only one TR, whereas four words were present in multiple SVs: radiation was present in 31, therapy in 28, radiotherapy in 18, and procedure in 11 SVs. We did not identify any TR specifically dedicated to radiation therapy.

Table 1. Properties of source vocabularies.
Vocabulary
resource
Total number of all wordsTotal number of unique wordsLexical density of the vocabulary resourceAverage length
of the concept
Median length of the conceptMaximal length of the conceptMinimal length of the concept
ATCa551.05555
CCSb331.03333
CHVc331.03333
ICD10AMAEd12121.06675
ICD9CMe771.04452
MTHICD9f991.09999
NANDA-Ig441.04444
NCI_CPTACh331.03333
SNMi771.07777
PCDSj980.99999
NICk34300.9118188
ICD10CMl970.85554
ALTm25190.888143
ICD-10n25190.865142
CCPSSo750.74443
ICNPp640.73333
PDQq27180.75683
ICD10AMr29190.76674
ICPC2ICD10ENGs19120.63252
MSHt52320.63342
SPNu24140.65564
CSPv740.64443
HCPCSw97540.614132210
SNMIx71360.56785
MTHy2651320.544231
HL7V3.0z46200.476104
NCI Thesaurus2791150.444141
Read Codes61220.44353
MEDCIN4881750.455102
UMDaa312970.35592
SNOMEDCT_USab14204060.344102
LOINCac365960.388192
MedDRAad409840.24482
Current Procedural
Terminology
13982280.2109283
ICD10PCSae50,6821750.099152
Median25190.75583
Minimal330.03231
Maximal50,6824061.014132810

aATC: Anatomical Therapeutic Chemical Classification System.

bCCS: Clinical Classifications Software.

cCHV: Consumer Health Vocabulary.

dICD10AMAE: International Classification of Diseases and Related Health Problems, Tenth Revision, Australian Modification, Americanized English Equivalents.

eICD9CM: International Classification of Diseases, Ninth Revision, Clinical Modification Entry Terms.

fMTHICD9: Metathesaurus Names International Classification of Diseases, Ninth Revision, Clinical Modification Entry Terms.

gNANDA-I: NANDA-I Taxonomy.

hNCI_CPTAC: Clinical Proteomic Tumor Analysis Consortium.

iSNM: The Systematized Nomenclature of Medicine, Second Edition.

jPCDS: Patient Care Data Set.

kNIC: Nursing Interventions Classification.

lICD10CM: International Classification of Diseases, Tenth Revision, Clinical Modification.

mALT: Alternative Billing Concepts.

nICD-10: International Classification of Diseases, Tenth Revision.

oCCPSS: Clinical Problem Statements.

pICNP: International Classification for Nursing Practice.

qPDQ: Physician Data Query.

rICD10AM: International Classification of Diseases, Tenth Revision, Australian Modification.

sICPC2ICD10ENG: International Classification of Primary Care-International Classification of Diseases, Tenth Revision Thesaurus.

tMSH: Medical Subject Headings.

uSPN: Standard Product Nomenclature.

vCSP: CRISP Thesaurus.

wHCPCS: Healthcare Common Procedure Coding System.

xSNMI: The Systemized Nomenclature of Human and Veterinary Medicine.

yMTH: Metathesaurus Names.

zHL7V3.0: Health Level Seven version 3.0.

aaUMD: Universal Medical Device Nomenclature System.

abSNOMEDCT_US: The Systematized Nomenclature of Medicine-Clinical Terms, US Edition.

ac LOINC: Logical Observations Identifiers, Names, Codes.

adMedDRA: Medical Dictionary for Regulatory Activities.

aeICD10PCS: The International Classification of Diseases, Tenth Revision, Procedure Coding System.


Principal Findings

To the best of our knowledge, this is the first study to evaluate the state of standardized SVs dedicated to radiation therapy. Although our search of UMLS retrieved a large number of unique concepts distributed across 35 SVs, none of them was identified as a dedicated TR for radiation oncology. However, such a dedicated TR, providing standardized terms for modern radiation therapy and being widely adopted, is a prerequisite for achieving interoperability. The existing SVs are concentrated on describing different radiation therapy techniques, most probably for reimbursement coding purposes.

An important milestone in the standardization of radiation therapy communication was published by the International Commission on Radiation Units and Measurements report 50, 62, and 83. The International Commission on Radiation Units and Measurements 83 provides the information necessary to standardize techniques and procedures and harmonize the prescribing, recording, and reporting of intensity-modulated radiation therapy. The most significant achievements were made in the recommendation of the definition, selection, and delineation of the radiation therapy volumes along with dose prescription to the volumes and dose-volume reporting recommendations [22]. However, the International Commission on Radiation Units and Measurements 83 does not go beyond a high-level abstract and conceptual description of the target and risk volumes, whereas the specific anatomy of the patient was not subject to standardization.

Furthermore, the American Society for Radiation Oncology (ASTRO) and the American Association of Physicists in Medicine have recognized the need for a unified and standardized terminological approach to radiation therapy. Members of both societies published several papers and recommendations concerning standardized approaches in naming conventions for radiation therapy [13,20,26-28].

The authors of the ASTRO white paper, published in 2016, have argued that the standardized terminology approach in dose prescription will facilitate accurate communication among providers to support safe practice and guide product developers in creating software consistent with the best standard of practice [21]. To avoid common pitfalls of standardization efforts [29], the working group limited their efforts to standardize the central prescription items concerning how the prescribed dose is specified. They suggested standardization of key elements for prescription, such as treatment site, delivery method, dose per fraction, fraction number, total dose, and a special field named other elements. They commented on the previous work of other groups such as the American College of Radiology–ASTRO Practice Parameter for Radiation Oncology [28], the ASTRO Accreditation Program for Excellence Standard [27], and ASTRO recommendation for documenting intensity-modulated radiation therapy [26]. The authors of the white paper rightfully argued that although thoughtfully developed, the proposals will be hard to implement in the modern environment. Some items are not sufficiently precise, and other concepts are difficult to define as our field evolves.

The most challenging and intellectually demanding process is the formalization of treatment sites. Frequently, radiation therapy volumes span several distinct anatomical entities and consist of numerous anatomical regions. For example, treatment volumes for head and neck cancer traditionally consist of macroscopic tumors or former tumor sites that span several anatomical entities of the digestive tract and respiratory organs. In malignancies of pelvic origin, it is common to have part volumes extending to the abdominal region or lower extremities (eg, paraaortic volumes or partially in the upper extremities in vulvar cancer). Large tumors of any histology, such as sarcomas or metastatic diseases, sometimes create geometric forms that are very difficult to intuitively define using standard anatomical descriptors, such as lymph node levels or anatomical organ boundaries. An additional level of complexity is added through time-dependent changes in volume shapes and the introduction of subvolumes, which receive a different dose synchronously (eg, simultaneous integrated boost).

Further important work in the domain of RT vocabulary standardization has been done by the American Association of Physicists in Medicine Task Group 263. Their 2018 published report provides a detailed overview of scientific literature, previous achievements, contemporary practice, and some future directions related to nomenclature standardization [20]. The main output of this report is the development of a nomenclature system for target volumes, organs at risk, and dose-volume histogram metrics with the goal of straightforward adoption in current practice. In contrast to all previous initiatives for structure standardization, this nomenclature was developed by an assembly of stakeholders in radiation oncology, including multiple societies (eg, ASTRO, the European Society for Radiotherapy and Oncology, and others), disciplines, and vendors, ensuring broad endorsement and use of the nomenclature. A major drawback of this approach was the intention to primarily accommodate and serve the manufacturers of radiation therapy software and hardware, and not patients or physicians. By doing so, we are risking repeating the major historical mistakes, which have brought us to our current position. Patients, physicians, or payers must have clearer and understandable naming conventions designed according to their needs.

In this light, we must consider the newest development in the legislative environment in the United States formalized in the 21st-Century Cures Act, signed into law on December 13, 2016, which is designed to help accelerate medical product development and bring innovations and advances to patients who need them faster and more efficiently. The act finally results in the ONC’s Cures Act Final Rule, which supports seamless and secure access, exchange, and use of eHealth information. However, good initiatives and their formulation within legal boundaries sometimes collide with reality. The last surge of digitalization in the United States ended in the complete lockdown of information within vendor software. Furthermore, this led to a phenomenon popularly known as a death by a thousand clicks [5], which resulted in a health care crisis and unprecedented burnout rate among physicians [8].

We acknowledge the limitations of this study. As the most important limitation, we acknowledge the missing review of ontological repositories such as BioPortal or OBO Foundry. Furthermore, we reviewed only UMLS. It is possible that there are some TRs in other languages that we are not aware of. Despite this limitation, we believe that this analysis provides a realistic overview of the current state of terminologies developed specifically for radiation oncology. Cross-sectional analysis is important, even if negative.

Conclusions

Cancer is still one of the leading causes of death and morbidity globally, and oncological research comprises approximately one-quarter of the complete biomedical clinical research portfolio [30]. Radiation oncology will be used in at least 50% of cancer patients for treatment or palliation, is an important contributor to survival and symptom control, and is an essential part of streaming toward precise and personalized medicine [31,32]. However, without meaningful digitalization and high data availability, we may not achieve the desired effects. To achieve the promise of digitalization in the clinical environment, we need SI in practice [1]. The basis for SI is shared TR. We need to establish an agile, productive, and progressive way for communication among all actors in radiation therapy and beyond through the development of dedicated radiation therapy-specific virtual reality.

Authors' Contributions

NC was responsible for the design of the study. ASW helped with data classification and preparation. NC prepared the data and created a draft of the manuscript with MP and EVB. DMA critically reviewed the manuscript and provided significant inputs. All other authors evaluated the results together with NC and contributed to the writing of the manuscript sufficiently to be stated as coauthors. All authors have reviewed and approved the final version of the manuscript.

Conflicts of Interest

NC is the founder of a Wemedoo AG, Sumpfstrasse 24, 6312 Steinhausen, Switzerland, a clinical information company. However, there are no conflicts of interest related to this work.

Multimedia Appendix 1

A complete database used for analysis.

XLSX File (Microsoft Excel File), 240 KB

Multimedia Appendix 2

Overview of the source vocabularies.

DOCX File , 19 KB

Multimedia Appendix 3

A number of lexical resources published according to last year’s update.

DOCX File , 144 KB

Multimedia Appendix 4

A number of terms per Unified Medical Language System semantic type category.

DOCX File , 116 KB

Multimedia Appendix 5

A number of words per source vocabulary.

DOCX File , 131 KB

  1. Pronovost P, Johns M, Palmer S, Bono R, Fridsma D, Gettinger A, et al. Procuring interoperability: achieving high-quality, connected, and person-centered care. National Academy of Medicine. 2018.   URL: https:/​/nam.​edu/​procuring-interoperability-achieving-high-quality-connected-and-person-centered-care/​ [accessed 2021-10-21]
  2. Mandl KD, Kohane IS. No small change for the health information economy. N Engl J Med 2009 Mar 26;360(13):1278-1281. [CrossRef]
  3. Mandel J, Kreda D, Mandl K, Kohane I, Ramoni RB. SMART on FHIR: a standards-based, interoperable apps platform for electronic health records. J Am Med Inform Assoc 2016 Sep;23(5):899-908 [FREE Full text] [CrossRef] [Medline]
  4. Cisco Annual Internet Report (2018–2023) White Paper. 2020.   URL: https:/​/www.​cisco.com/​c/​en/​us/​solutions/​collateral/​executive-perspectives/​annual-internet-report/​white-paper-c11-741490.​html [accessed 2021-10-21]
  5. Schulte F, Fry E. Death by a thousand clicks: where electronic health records went wrong. Fortune Magazine. 2019.   URL: https://khn.org/news/death-by-a-thousand-clicks/ [accessed 2021-10-21]
  6. Rosenbaum L. Transitional chaos or enduring harm? The EHR and the disruption of medicine. N Engl J Med 2015 Oct 22;373(17):1585-1588. [CrossRef]
  7. Frank JN. Congress is final hurdle in removing EHR 'gag clauses'. Med Econ 2015 Nov 25;92(22):57. [Medline]
  8. Jha A, Li K, Iliff A, Chaoui A, Defossez S, Bombaugh M, et al. A crisis in health care: a call to action on physician burnout. Massachusetts Medical Society MHaHA, Harvard TH Chan School of Public Health, and Harvard Global Health Institute. 2019.   URL: https://psnet.ahrq.gov/issue/crisis-health-care-call-action-physician-burnout [accessed 2021-10-22]
  9. Wenger N, Méan M, Castioni J, Marques-Vidal P, Waeber G, Garnier A. Allocation of internal medicine resident time in a Swiss hospital: a time and motion study of day and evening shifts. Ann Intern Med 2017 Jan 31;166(8):579. [CrossRef]
  10. Friedberg M, Chen P, Van Busum K, Aunon F, Pham C, Caloyeras J, et al. Factors affecting physician professional satisfaction and their implications for patient care, health systems, and health policy. Rand Health Q 2014;3(4):1 [FREE Full text]
  11. Sinsky CA, Beasley JW, Simmons GE, Baron RJ. Electronic health records: design, implementation, and policy for higher-value primary care. Ann Intern Med 2014 May 20;160(10):727. [CrossRef]
  12. Classen DC, Bates DW. Finding the meaning in meaningful use. N Engl J Med 2011 Sep;365(9):855-858. [CrossRef]
  13. Meeks DW, Smith MW, Taylor L, Sittig DF, Scott JM, Singh H. An analysis of electronic health record-related patient safety concerns. J Am Med Inform Assoc 2014 Nov 01;21(6):1053-1059 [FREE Full text] [CrossRef] [Medline]
  14. Berners-Lee T, Fielding R, Frystyk H. Hypertext Transfer Protocol - HTTP/1.0. Network Working Group. 1996.   URL: https://www.w3.org/Protocols/rfc1945/rfc1945 [accessed 2021-10-22]
  15. Bender D, Sartipi K. HL7 FHIR: an Agile and RESTful approach to healthcare information exchange. In: Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.: IEEE; 2013 Presented at: 26th IEEE International Symposium on Computer-Based Medical Systems; June 20-22, 2013; Porto, Portugal. [CrossRef]
  16. Interoperability in healthcare. HIMSS.   URL: https://www.himss.org/resources/interoperability-healthcare [accessed 2021-10-22]
  17. Parker B. Introducing ANSI-X3.138-1988: a standard for information resource dictionary system (IRDS). In: Proceedings of the Second Symposium on Assessment of Quality Software Development Tools. 1992 Presented at: Second Symposium on Assessment of Quality Software Development Tools; May 27-29, 1992; New Orleans, LA, USA p. 90-99. [CrossRef]
  18. Gene Ontology Consortium. Gene Ontology Consortium: going forward. Nucleic Acids Res 2015 Jan;43(Database issue):1049-1056 [FREE Full text] [CrossRef] [Medline]
  19. Uschold M, King M, Moralee S, Zorgios Y. The enterprise ontology. Knowl Eng Rev 1998 Mar 01;13(1):31-89. [CrossRef]
  20. Mayo CS, Moran JM, Bosch W, Xiao Y, McNutt T, Popple R, et al. American Association of Physicists in Medicine Task Group 263: standardizing nomenclatures in radiation oncology. Int J Radiat Oncol Biol Phys 2018 Mar 15;100(4):1057-1066 [FREE Full text] [CrossRef] [Medline]
  21. Evans SB, Fraass BA, Berner P, Collins KS, Nurushev T, O'Neill MJ, et al. Standardizing dose prescriptions: an ASTRO white paper. Pract Radiat Oncol 2016 Nov;6(6):369-381. [CrossRef] [Medline]
  22. ICRU Members. Prescribing, recording, and reporting photon-beam Intensity-Modulated Radiation Therapy (IMRT). J ICRU 2010 Apr 01;10(1):1-3. [CrossRef]
  23. Bodenreider O. The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res 2004 Jan 01;32(Database issue):267-270 [FREE Full text] [CrossRef] [Medline]
  24. Smith B, Ashburner M, Rosse C, Bard J, Bug W, Ceusters W, et al. The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol 2007 Nov 7;25(11):1251-1255 [FREE Full text] [CrossRef] [Medline]
  25. Whetzel P, Shah N, Noy N, Dai B, Dorf M, Griffith N, et al. BioPortal: ontologies and integrated data resources at the click of a mouse. Nat Prec 2009 Oct 16:1. [CrossRef]
  26. IMRT Documentation Working Group, Holmes T, Das R, Low D, Yin FF, Balter J, FASTRO. American Society of Radiation Oncology recommendations for documenting intensity-modulated radiation therapy treatments. Int J Radiat Oncol Biol Phys 2009 Aug 01;74(5):1311-1318. [CrossRef] [Medline]
  27. APEx standards. American Society for Radiation Oncology (ASTRO). 2018.   URL: https://www.astro.org/Daily-Practice/Accreditation/About-APEx/APEx-Standards [accessed 2021-10-22]
  28. ACR–ASTRO practice parameter for radiation oncology. Radiation Oncology. 2014.   URL: https://www.acr.org/-/media/ACR/Files/Practice-Parameters/radonc.pdf?la=en [accessed 2021-10-22]
  29. Cargill CF. Why standardization efforts fail. J Electron Publ 2011;14(1):A. [CrossRef]
  30. Hirsch BR, Califf RM, Cheng SK, Tasneem A, Horton J, Chiswell K, et al. Characteristics of oncology clinical trials: insights from a systematic analysis of ClinicalTrials.gov. JAMA Intern Med 2013 Jun 10;173(11):972-979. [CrossRef] [Medline]
  31. Hanna T, Shafiq J, Delaney G, Vinod S, Thompson S, Barton M. The population benefit of evidence-based radiotherapy: 5-Year local control and overall survival benefits. Radiother Oncol 2018 Feb;126(2):191-197 [FREE Full text] [CrossRef] [Medline]
  32. Chargari C, Soria J, Deutsch E. Controversies and challenges regarding the impact of radiation therapy on survival. Ann Oncol 2013 Jan;24(1):38-46 [FREE Full text] [CrossRef] [Medline]
  33. Wemedoo.   URL: https://wemedoo.com/ [accessed 2021-11-18]


ASTRO: American Society for Radiation Oncology
SI: semantic interoperability
SV: source vocabulary
TR: terminology resource
UMLS: Unified Medical Language System


Edited by G Eysenbach; submitted 28.01.21; peer-reviewed by F Lanfranchi, I Spasic; comments to author 10.05.21; revised version received 05.09.21; accepted 18.09.21; published 19.01.22

Copyright

©Nikola Cihoric, Eugenia Vlaskou Badra, Anna Stenger-Weisser, Daniel M Aebersold, Matea Pavic. Originally published in JMIR Formative Research (https://formative.jmir.org), 19.01.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.