This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.
Background
Patient attitudes and behavior are critical to understand owing to the increasing role of patient choice. There is a paucity of investigation into the perceived credibility of online information and whether such information impacts how patients choose their surgeons.
Objective
The purpose of this study was to explore the attitudes and behavior of patients regarding online information and orthopedic surgeon selection. Secondary purposes included gaining insight into the relative importance of provider selection factors, and their association with patient age and education level.
Methods
This was a cross-sectional study involving five multispecialty orthopedic surgery groups. A total of 329 patients who sought treatment by six different orthopedic surgeons were asked to anonymously answer a questionnaire consisting of 25 questions. Four questions regarded demographic information, 10 questions asked patients to rate the importance of specific criteria regarding the selection of their orthopedic surgeon (on a 4-point Likert scale), and 6 questions were designed to determine patient attitude and behaviors related to online information.
Results
Patient-reported referral sources included the emergency room (29/329, 8.8%), friend (42/329, 12.8%), insurance company (47/329, 14.3%), internet search/website (28/329, 8.5%), primary care physician (148/329, 45.0%), and other (34/329, 10.3%). Among the 329 patients, 130 (39.5%) reported that they searched the internet for information before their first visit. There was a trend of increased belief in online information to be accurate and complete in younger age groups (P=.02). There was an increased relative frequency in younger groups to perceive physician rating websites to be unbiased (P=.003), provide sufficient patient satisfaction information (P=.01), and information about physician education and training (P=.03). There was a significant trend for patients that found a surgeon’s website to be useful (P<.001), with the relative frequency increased in younger age groups.
Conclusions
This study shows that insurance network, physician referrals, appointment availability, and office location are important to patients, whereas advertising and internet reviews by other patients were considered to be not as helpful in choosing an orthopedic surgeon. Future studies may seek to identify obstacles to patients in integrating online resources for decision-making and strategies to improve health-seeking behaviors.
Health literacy is a complex concept, defined by both the Institute of Medicine and the World Health Organization as incorporating cognitive and social skill sets that are distilled through patient experiences and are necessary to obtain, understand, and apply information to make appropriate health decisions [1,2]. Health organizations have underscored the importance of health literacy as an essential component of patient-centered care [3,4]. Consequently, a rich body of literature established factors that influence health care choices [4-8] and investigated trends in health care consumerism [9-11].
Online tools and information are postulated to disrupt the traditional patient-physician relationship and traditional metrics of health care assessment with the expanded use of social media and physician rating websites (PRWs) [9,12-15]. Physician websites, social media venues, and online review sites are the most common spaces in which patients can discover information about physicians and their practices [16]. Previous studies sought to investigate online patient behavior and classify the information posted online by patients [11,13,17-19]. The rating scales on PRWs were found to be inaccurate and with significant limitations; as such, concerns regarding malignment of consumer satisfaction and quality were raised because health care incentives are not aligned as in other consumer industries [17,20,21]. Roughly 59% of US respondents indicated that they believed that the information on PRWs is either somewhat or very important [22], despite the documented disparity between conventional quality metrics and crowd-sourced online reviews [20,21,23,24]. Thus, it remains unclear why patients use these platforms and if this information influences their behavior [4].
The impact of misinformed or uniformed patients is consequential [25-30]. Limited health literacy has been associated with low patient satisfaction, worse patient outcomes, and higher costs [31,32]. In orthopedic surgery, there is a unique form of health literacy and a more sophisticated skill set required for making informed decisions [33-35]. Decision-making has been found to not be strictly rational but is rather a complex and heterogenous process that is distilled through patient preferences, values, and social influences [5,36]. Improved understanding of these influences on patient decision-making may identify actionable opportunities to practice patient-centered care. To our knowledge, there is a paucity of investigations eliciting how patient attitudes and behaviors related to information online influence provider selection factors. Considering that such information may be of low quality and inaccurate [23,37], it is important to explore if online research alters a patient’s decision-making for provider selection.
Accordingly, the aim of this study was to define the internet sources that patients are using to research their orthopedic surgeons and to quantify the importance placed on those findings. In addition, we investigated the demographic variables that may influence the reliance on internet websites, and further aimed to define the importance of other variables involved in choosing an orthopedic surgeon. The purpose of this study was to explore the attitudes and behavior of patients regarding online information and its influence on establishing care with an orthopedic surgeon. Secondary purposes included a description of the relative importance of provider selection factors, and their association with patient age and education level.
Methods
We performed a cross-sectional survey of patients at orthopedic offices in Las Vegas, Nevada. The study group included six orthopedic surgeon practices screening patients in their clinics. Subspecialties included were foot and ankle, hand, spine, and sports medicine. The surveys were completed by patients that were seen at the clinics over the course of 3 months. This study was approved by OptiWest institutional review board. Strengthening the Reporting of Observation studies in Epidemiology (STROBE) and Statistical Analyses and Methods in the Published Literature (SAMPL) reporting guidelines were followed during the study design and manuscript preparation to ensure methodologic quality and transparent reporting [38,39].
Consent from each patient was obtained before participation. The survey was confidential and anonymous, with no identifiers linked to individual responses. All participants completed the survey.
The survey consisted of seven questions, which aimed to gauge patient opinion and define patient behavior (see Multimedia Appendix 1). The survey asked patients to report their demographics, attitudes, and behaviors. Three questions documented patient demographics: patient age, education level, and frequency of internet use. One question prompted patients to rate specific orthopedic surgeon selection criteria [6-8,36] on a 4-point Likert scale ranging from 1 defined as “not important” to 4 defined as “very important.” Two questions polled patient opinion regarding internet patient reviews and if patient satisfaction equates to a successful treatment outcome. One question assessed the patient’s use of websites prior to their clinic visit. The participants completed their surveys in person and responses were kept anonymous. Notably, the survey is not a validated questionnaire of a measure of a specific outcome but rather represents a survey of questions. This article reports the results of the descriptive analysis of the responses for an exploratory investigation into patient beliefs, behaviors, and trends.
Respondents were grouped into the following age ranges: 18-25, 26-35, 36-45, 46-55, 56-65, and 76-85 years. Respondents were stratified based on their highest level of education: elementary/middle school, high school, some college, bachelor’s degree, master’s degree, and doctoral degree. A trained medical assistant or research assistant explained each question to the participants while administering the survey.
Basic descriptive statistics were analyzed using MedCalc Software. Ordinal Likert-scale data are reported using median for central tendency and frequencies, and Kendall τ was used to analyze associations. Associations are reported as the correlation coefficient with a precision estimate (95% CI) [40]. The Cochran-Armitage test was used for analysis of categorical variables [41,42], which is considered to be more powerful than the χ2 test to assess trends in proportions and frequencies. The statistical significance level was set at P<.05.
Results
Between July 2017 and August 2017, all 329 patients that were administered the survey completed the survey. Table 1 delineates the distribution of patients that completed the survey according to the subspecialty of the orthopedic surgeon they were consulting. The majority of patients reported daily baseline internet use (227/329, 69.0%), followed by 2-3 times per week (23/329, 7.0%) and 4-5 times per week (20/329, 6.1%). The histogram of the number of patients that responded according to age group and stratified by the highest education level is shown in Figure 1.
Survey participants stratified by orthopedic subspecialty (N=324; subspecialties were not documented by 5 patients).
Subspecialty
Patients, n (%)
Spine
150 (46.3)
Sport
119 (36.7)
Hand
33 (10.2)
Foot and ankle
22 (6.8)
Respondent age and highest education stratification of all participants (N=329).
The patient-reported referral source was the emergency room (29/329, 8.8%), friend (42/329, 12.8%), insurance company (47/329, 14.3%), internet search/website (28/329, 8.5%), primary care physician (PCP; 148/329, 45.0%), and other (34/329, 10.3%). Among the 329 patients, 130 (39.5%) reported that they had searched the internet for information about the surgeon before their first visit. The majority of these patients had visited the surgeon’s website (63/130, 48.5%), followed by the website of the office or surgical group (35/130, 26.9%). Other websites visited included webmd.com (34/130, 26.2%), yelp.com (26/130, 20.0%), healthgrades (21/130, 16.2%), ratemd.com (20/130, 15.4%), and the Nevada medical board website (7/130, 5.4%).
The ranking of important factors in selecting the orthopedic surgeon is displayed in Figure 2 as well as the association of these factors with age and level of education. Patient age was significantly associated with office location (P=.05), physician recommendation (P<.001), internet reviews (P<.001), and advertising sources (P=.01). Patient education level was significantly associated with out-of-pocket costs (P=.05), availability (P<.001), office location (P<.001), online appointment booking (P=.004), surgeon training (P=.002), and advertisement sources (P<.001). Patients reported insurance coverage (260/329, 79.0%), out-of-pocket costs (217/329, 66.0%), availability (184/329, 55.9%), and recommendation by another physician as “very important” (score of 4). Surgeon advertising was rated 1 (not important) by 204 (62.0%) of the 329 patients. The frequency at which internet reviews were deemed to be important ranged between 21% and 29% in each category. The institution where the surgeon trained was only deemed to be very important for 82 (24.9%) and as moderately important for 99 (30.1%) of the 329 respondents.
Relative importance of orthopedic surgeon selection factors, and their associations with patient age and education level.
The attitudes of patients toward online information are summarized in Table 2. The highest frequency of patients indicated that they found the surgeon’s website to be useful. Among the factors included in the questionnaire, the lowest number of patients indicated that online information is accurate and complete. There were no significant associations found between patient education groups in regard to their online information or PRW beliefs.
Attitude toward online information (“is it important?”) (N=329).
Question
Yes, n (%)
Age P value
Education P value
Online information is accurate and complete
40 (12.2)
.02
.99
PRWa is unbiased
131 (39.8)
.003
.32
PRW has complicated rate information
95 (28.9)
.09
.21
Ongoing or previous litigation claims
80 (24.3)
.24
.52
PRW shows patient satisfaction
138 (41.9)
.01
.95
PRW indicates education and training
147 (44.7)
.03
.58
Surgeon website useful
189 (57.4)
<.001
.18
aPRW: physician rating website.
Significant trends were found in beliefs regarding online information and PRWs between age groups (Figure 3). There was a trend of increased belief in online information to be accurate and complete in the younger age groups (P=.02). There was an increased relative frequency in younger groups to perceive PRWs to be unbiased (P=.003), provide sufficient patient satisfaction information (P=.01), and information about physician education and training (P=.03). There was also a significant trend for patients that found the surgeon’s website to be useful (P<.001), with the relative frequency increased in younger age groups.
Trends in relative frequency of patient perceptions. Each subgraph, further categorized by age, shows if a specific factor influences the patient’s selection of orthopedic surgeons.
DiscussionPrincipal Findings
Only 28 of the 329 patients (8.5%) that completed the survey selected their orthopedic surgeon using internet search/websites. Notably, 205 (62.3%) patients were referred to their orthopedic surgeon from health care–related sources (emergency room, insurance company, and PCP), with the highest percentage of patients (148/329, 45.0%) referred by their PCP. Correspondingly, the data reflected the generally low importance of patient-oriented advertisements, with 204 patients (62.0%) giving this factor a rating of 1 (not important). Our data indicate that patients are value-oriented, and rated insurance coverage (260/329, 79.0%) and out-of-pocket costs (189/329, 57.4%) as very important factors. Only 130 of the 329 patients (39.5%) conducted an internet search prior to their first visit. Notably, there were significant trends observed for younger patient groups believing online information to be accurate and complete, as well as having more favorable attitudes toward PRWs in providing sufficient and unbiased information (Figure 3).
Despite the rapid expansion of online information available to patients, our data indicate that patients do not use this information to actively engage in their care. This conclusion is in support of previously published findings [43,44]. Patients also did not seek to learn about provider medical knowledge, litigation, or patient satisfaction. Patient satisfaction was purported to be a quality-of-care surrogate metric, considering the complex interplay of social, demographic, cultural, and cognitive factor interactions that influence satisfaction. The multidimensional assessment of quality was lost and deemed inappropriate [21]. Rothenfluh et al [45] suggested that one reason for this may be the perceived inability to assess physician quality even if informed by available information online, demonstrating that patients differ in decision-making between hotel selection and provider selection due to reduced trust in incorporating online information about physicians. Nevertheless, we found that 40% of patients utilized internet sources for information before their clinic visit compared to only 24% of patients reporting such use among those visiting an outpatient orthopedic clinic surveyed in 2002 [46]. Integration of online information is likely lagging in utilization, and future research should seek to delineate the causal factors or barriers.
Our data imply that surgeons should focus on their relationships with community physician referral sources. This was previously highlighted in a study on referrals to plastic surgeons [47] showing that 82% of patients felt that a recommendation from another physician was very important to moderately important, which was a statistically significant result across all age groups. Important factors influencing the choice of a foot and ankle surgeon were identified as insurance network and recommendations (family, friend, physician) [4]. Our data provide corroboratory support to these factors as important influences on patient decision-making. Further, the external validity of the findings can be compared among studies. In another study, important factors for patient selection of their surgeon and hospital for total joint arthroplasty were ranked on a 5-point Likert scale [6]. All three aforementioned reports [4,46,47] indicated that professional reputation is critical. Similarly, recommendations by other physicians and insurance companies had a significant impact on women selecting their obstetrician/gynecologist [44]. Future studies should evaluate whether there is a difference between how much patients weigh primary care versus urgent/emergent care referrals, other orthopedic surgeons’ opinions, and other medical providers in the community.
The correlation patterns found in this study were surprising and warrant attention. Age and education level have been proposed to influence health literacy, noting that patients with a graduate degree are 130 times more likely to have adequate health literacy (P=.01) [48]. Less than college-level education was previously identified as an independent predictor of limited musculoskeletal health literacy with a relative risk of 1.40 [49]. Our data demonstrated different statistically significant associations that had nonconsequential effect sizes. Importantly, this is not the first study to report younger age to be significantly associated with increased use and increased perceived usefulness of online information [50,51].
This survey was not without its limitations. The survey was administered to a convenience sample of limited size. Thus, the sample size of patients is underpowered, although the study was open to all patients at a large private practice setting in an anonymous fashion. Similarly, the selection bias within our sample cannot be ascertained. Another major flaw is the lack of a comparison group, which adds further sample bias. The surveys were also administered over time, with variability in practice settings, providers, and survey administrators, which could introduce recording and recall bias. Although we were unable to precisely determine the population percentage captured, the survey was administered in multiple locations and to multiple specialties of orthopedics to increase sample diversity. Our survey is not a standardized or validated questionnaire; thus, response bias may have been introduced. Nevertheless, our goal was to describe a macroscopic phenomenon rather than to deduce a causative process.
Conclusions
This study shows that insurance network, physician referrals, appointment availability, and office location are important to patients, whereas advertising and internet reviews by other patients are not as helpful in choosing an orthopedic surgeon. Our data do not support consensus ideas regarding consumer autonomy and patient agency in health care. Future studies may seek to identify obstacles to patients in integrating online resources for decision-making and strategies to improve health-seeking behaviors.
Patient survey.
AbbreviationsPCP
primary care physician
PRW
physician rating website
SAMPL
Statistical Analyses and Methods in the Published Literature
STROBE
Strengthening the Reporting of Observation studies in Epidemiology
The authors thank Shanthan Challa, MD, for final drafting of the article, and assistance with manuscript review and submission.
None declared.
Institute of Medicine (US) Committee on Health LiteracyNielsen-BohlmanLPanzerAKindigDHealth literacy: a prescription to end confusion. Executive Summary2004Washington, DCNational Academies PressLiuCWangDLiuCJiangJWangXChenHJuXZhangXWhat is the meaning of health literacy? A systematic review and qualitative synthesisFam Med Community Health20200582e00035110.1136/fmch-2020-00035132414834fmch-2020-000351PMC7239702Institute of Medicine (US) Committee on Quality of Health Care in AmericaCrossing the quality chasm: a new health system for the 21st century2001Washington, DCNational Academies PressManningBTBohlDDSaltzmanBMCotterEJWangKCEpleyCTVermaNNColeBJBachBRFactors influencing patient selection of an orthopaedic sports medicine physicianOrthop J Sports Med20170858232596711772441510.1177/23259671177244152885617010.1177_2325967117724415PMC5570120BühnSHolstiegeJPieperDAre patients willing to accept longer travel times to decrease their risk associated with surgical procedures? A systematic reviewBMC Public Health2020021920125310.1186/s12889-020-8333-53207561510.1186/s12889-020-8333-5PMC7031936BozicKJKaufmanDChanVCCaminitiSLewisCFactors that influence provider selection for elective total joint arthroplastyClin Orthop Relat Res20130647161865187210.1007/s11999-012-2640-923065331PMC3706672ReuterJMHutyraCAPolitzerCSCalixteCCScottDJAttarianDEMatherRCCharacterizing patient preferences surrounding total knee arthroplastyJB JS Open Access2018122034e001710.2106/JBJS.OA.18.0001730882052JBJSOA-D-18-00017PMC6400515YahandaATLafaroKJSpolveratoGPawlikTMA systematic review of the factors that patients use to choose their surgeonWorld J Surg201601401455510.1007/s00268-015-3246-72636288010.1007/s00268-015-3246-7BernsteinDMesfinAPhysician-review websites in orthopaedic surgeryJBJS Rev20200383e015810.2106/JBJS.RVW.19.001583222463601874474-202003000-00011EmmertMSanderUPischFEight questions about physician-rating websites: a systematic reviewJ Med Internet Res20130201152e2410.2196/jmir.236023372115v15i2e24PMC3636311VelascoBTChienBKwonJYMillerCPOnline ratings and reviews of American orthopaedic foot and ankle surgeonsFoot Ankle Spec20200222131434910.1177/193864001983236330795702DuymusTMKaradenizHÇaçanMAKömürBDemirtaşAZehirSAzboyInternet and social media usage of orthopaedic patients: a questionnaire-based surveyWorld J Orthop201702188217818610.5312/wjo.v8.i2.17828251069PMC5314148HongYALiangCRadcliffTAWigfallLTStreetRLWhat do patients say about doctors online? A systematic review of studies on patient online reviewsJ Med Internet Res201948214e1252110.2196/12521CurryELiXNguyenJMatzkinEPrevalence of internet and social media usage in orthopedic surgeryOrthop Rev (Pavia)2014080863548310.4081/or.2014.548325317312PMC4195991SchulzPJRothenfluhFInfluence of health literacy on effects of patient rating websites: survey study using a hypothetical situation and fictitious doctorsJ Med Internet Res20200406224e1413410.2196/1413432250275v22i4e14134PMC7171560CallTHillockRProfessionalism, social media, and the orthopaedic surgeon: what do you have on the internet?Technol Health Care201725353153910.3233/THC-17129628128772THC1296LaguTHannonNSRothbergMBLindenauerPKPatients' evaluations of health care providers in the era of social networking: an analysis of physician-rating websitesJ Gen Intern Med20100925994294610.1007/s11606-010-1383-020464523PMC2917672ArthurJREtzioniDSchwartzAJCharacterizing extremely negative reviews of total joint arthroplasty practices and surgeons on yelp.comArthroplast Today2019065221622010.1016/j.artd.2019.02.00931286047S2352-3441(19)30018-4PMC6588800HaeberleHSBartschatNINavarroSMRooneyPWRosneckJWestermannRWRamkumarPNHip arthroscopy: a social media analysis of patient perceptionOrthop J Sports Med20190676232596711985418810.1177/23259671198541883124543210.1177_2325967119854188PMC6582302ChangJTHaysRDShekellePGMacLeanCHSolomonDHReubenDBRothCPKambergCJAdamsJYoungRTWengerNSPatients' global ratings of their health care are not associated with the technical quality of their careAnn Intern Med20060502144966567210.7326/0003-4819-144-9-200605020-0001016670136144/9/665ShirleyEDSandersJOMeasuring quality of care with patient satisfaction scoresJ Bone Joint Surg Am201610059819e8310.2106/JBJS.15.012162770785798/19/e83HanauerDAZhengKSingerDCGebremariamADavisMMPublic awareness, perception, and use of online physician rating sitesJAMA20140219311773473510.1001/jama.2013.283194245495551829975BurnMBLintnerDMCosculluelaPEVarnerKELibermanSRMcCullochPCHarrisJDPhysician rating scales do not accurately rate physiciansOrthopedics20180701414e445e45610.3928/01477447-20180409-0629658974GaoGGMcCulloughJSAgarwalRJhaAKA changing landscape of physician quality reporting: analysis of patients' online ratings of their physicians over a 5-year periodJ Med Internet Res20120224141e3810.2196/jmir.200322366336v14i1e38PMC3374528GaissmaierWGigerenzerGGigerenzerGGrayJAMWhen misinformed patients try to make informed health decisionsBetter doctors, better patients, better decisions: envisioning health care2011Boston, MAMIT PressWegwarthOGigerenzerGThe barrier to informed choice in cancer screening: statistical illiteracy in physicians and patientsRecent Results Cancer Res201821020722110.1007/978-3-319-64310-6_1328924688BachmannLMGutzwillerFSPuhanMASteurerJSteurer-SteyCGigerenzerGDo citizens have minimum medical knowledge? A surveyBMC Med2007053151410.1186/1741-7015-5-14175400241741-7015-5-14PMC1894984GigerenzerGWegwarthOFeufelMMisleading communication of riskBMJ20101012341c483010.1136/bmj.c483020940219GigerenzerGGalesicMWhy do single event probabilities confuse patients?BMJ20120111344e24510.1136/bmj.e24522236599GigerenzerGMataJFrankRPublic knowledge of benefits of breast and prostate cancer screening in EuropeJ Natl Cancer Inst20090902101171216122010.1093/jnci/djp23719671770djp237PMC2736294StormacqCVan den BrouckeSWosinskiJDoes health literacy mediate the relationship between socioeconomic status and health disparities? Integrative reviewHealth Promot Int20191001345e1e1710.1093/heapro/day062301075645068634BenjaminRMImproving health by improving health literacyPublic Health Rep2010125678478510.1177/00333549101250060221121221PMC2966655RosenbaumAJPauzeDPauzeDRobakNZadeRMulliganMUhlRLHealth literacy in patients seeking orthopaedic care: results of the Literacy in Musculoskeletal Problems (LIMP) projectIowa Orthop J20153518719226361464PMC4492130CrepeauAEMcKinneyBIFox-RyvickerMCastelliJPennaJWangEDProspective evaluation of patient comprehension of informed consentJ Bone Joint Surg Am201110059319e11410.2106/JBJS.J.0132522005875TsahakisJMIssarNMKadakiaRJArcherKRBarzykTMirHRHealth literacy in an orthopaedic trauma patient population: improving patient comprehension with informational interventionJ Orthop Trauma201404284e75e7910.1097/BOT.0b013e3182a6692123899766VictoorADelnoijDMJFrieleRDRademakersJJDJMDeterminants of patient choice of healthcare providers: a scoping reviewBMC Health Serv Res201208221227210.1186/1472-6963-12-272229135491472-6963-12-272PMC3502383CassidyJTBakerJFOrthopaedic patient information on the world wide web: an essential reviewJ Bone Joint Surg Am2016021798432533810.2106/JBJS.N.011892688868398/4/325von ElmEAltmanDGEggerMPocockSJGøtzschePCVandenbrouckeJPSTROBE InitiativeThe Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studiesLancet2007102037095961453145710.1016/S0140-6736(07)61602-X18064739S0140-6736(07)61602-XIndrayanAReporting of basic statistical methods in biomedical journals: improved SAMPL guidelinesIndian Pediatr20200128571434810.1007/s13312-020-1702-4BraselKHaiderAHaukoosJPractical guide to survey researchJAMA Surg20200401155435135210.1001/jamasurg.2019.4401319951492759264ArmitagePTests for linear trends in proportions and frequenciesBiometrics19550911337510.2307/3001775CochranWGSome methods for strengthening the common χ 2 testsBiometrics19541210441710.2307/3001616MenendezMEvan HoornBTMackertMDonovanEEChenNCRingDPatients with limited health literacy ask fewer questions during office visits with hand surgeonsClin Orthop Relat Res20170547551291129710.1007/s11999-016-5140-52779680210.1007/s11999-016-5140-5PMC5384911SetoodefarMTabeshHTaraFEslamiSHeshmati NabaviFValizadeh ZareNTaheriSHRajabzadeh MoghaddamMREtminaniKMeasurement model of women's preferences in obstetrician and gynecologist selection in the private sector: exploratory and confirmatory factor analysisInt J Community Based Nurs Midwifery2020048215016310.30476/IJCBNM.2020.82278.104932309456IJCBNM-8-2PMC7153421RothenfluhFGermeniESchulzPJConsumer decision-making based on review websites: are there differences between choosing a hotel and choosing a physician?J Med Internet Res20160616186e12910.2196/jmir.558027311623v18i6e129PMC4929347BeallMSBeallMSGreenfieldMLVHBiermannJSPatient Internet use in a community outpatient orthopaedic practiceIowa Orthop J20022210310712180601PMC1888381NowakLIWashburnJHPatient sources of information and decision factors in selecting cosmetic surgeonsHealth Mark Q1998154455410.1300/J026v15n04_0310185452YimCKShumateLBarnettSHLeitmanIMHealth literacy assessment and patient satisfaction in surgical practiceAnn Med Surg (Lond)20181135252810.1016/j.amsu.2018.08.02230263114S2049-0801(18)30181-XPMC6156741NobackPCSeetharamanMTantigateDStrauchRJRosenwasserMPVossellerJTPrevalence and risk factors of limited musculoskeletal health literacy in the outpatient setting: a logistic regression modelJ Am Acad Orthop Surg201905152710e491e49810.5435/JAAOS-D-17-0071230320731BurrusMTWernerBCStarmanJSKurkisGMPierreJMDiduchDRHartJMPatient perceptions and current trends in internet use by orthopedic outpatientsHSS J20171013327127510.1007/s11420-017-9568-2289832219568PMC5617824KoenigSNadarajahVSmudaMPMeredithSPackerJDHennRFPatients' use and perception of internet-based orthopaedic sports medicine resourcesOrthop J Sports Med20180969232596711879646910.1177/23259671187964693026389610.1177_2325967118796469PMC6149032