Original Paper
Abstract
Background: Patients with limited English proficiency (LEP) are at a higher risk of poor health outcomes and are less likely to use telehealth than English-speaking patients. To date, there is no formal evaluation of inpatient (IP) telehealth user experience of patients and their families by language preference during visits with their clinicians.
Objective: This study aims to compare the experiences of English- and Spanish-speaking patients and their families using IP telehealth, as well as to evaluate the experience of Spanish interpreters providing services through IP telehealth.
Methods: We prospectively administered a survey to English- and Spanish-speaking patients and their families who used IP telehealth from October 1, 2020, to March 31, 2021. We performed semistructured phone interviews of hospital-based Spanish interpreters who provided services through IP telehealth.
Results: A total of 661 surveys were administered, with completion rates of 18% (112/621) in English and 62% (25/40) in Spanish. On a 10-point scale, the overall satisfaction of Spanish speakers (median 10, IQR 10-10) was higher than that of English speakers (median 9, IQR 8-10; P=.001). Both English- and Spanish-speaking patients used IP telehealth for visits with their primary IP care team, subspecialty consultants, and other clinicians. Hospital tablets were used more often than personal devices, and only English-speaking patients used personal laptops. Patients and their families encountered challenges with log-in, team coordination with multiple users, and equipment availability. Interpreters encountered challenges with audio and video quality, communication, safety, and Wi-Fi access.
Conclusions: Both English- and Spanish-speaking patients reported high satisfaction using IP telehealth across multiple disciplines despite the workflow challenges identified by interpreters. Significant investment is needed to provide robust infrastructure to support use by all patients, especially the integration of multiple users to provide interpreter services for patients with LEP.
doi:10.2196/34354
Keywords
Introduction
Health care delivery required redesign during the COVID-19 pandemic. Given the limited availability of personal protective equipment, several aspects of health care were transformed to safely deliver high-quality care from a distance [,]. Critical to this redesign was the expansion of telehealth. Although telehealth use in inpatient (IP) settings is not new [-], it previously had poor market penetration due to strict regulation and low rates of reimbursement that varied by state [,]. IP telehealth expansion during the pandemic was used to support infection control practices, including minimizing personal protective equipment use and the surge of patient demand on hospital systems [-].
Beyond infection control, there were simultaneous, ongoing public health crises illuminated during the COVID-19 pandemic, which included health inequity []. Equity is a core component of health care access and quality and should be explicitly considered during system design and quality improvement []. The legal expectation to provide language access across all federal programs, including health care, originated from the Civil Rights Act and has been expanded under Section 1557 of the Affordable Care Act [,]. Successful telehealth implementation is critical to addressing health inequity, which includes linguistic barriers. Patients with limited English proficiency (LEP) have increased risks of poor health outcomes, adverse hospital events, and 30-day emergency department revisits compared to English-proficient patients []. Although non–English language preference is associated with higher interest in ambulatory video visits, having LEP is associated with a lower likelihood of ambulatory or urgent care video visits [-].
We previously described the rapid implementation of an IP telehealth program to facilitate IP care during the COVID-19 pandemic []. Prior evaluation of patient satisfaction with IP telehealth has shown high satisfaction with COVID-19 medical units, rehabilitation, and psychiatric partial hospitalization [-]. However, there has not yet been a formal evaluation of IP telehealth user experience by language preference. The experience of users with LEP is dependent on the seamless integration of interpreters; thus, to support this population, we also need to support the interpreter workflow. Our objective is to compare the experiences of English- and Spanish-speaking patients and their families using IP telehealth, as well as to evaluate the experience of Spanish interpreters providing services through IP telehealth.
Methods
Study Setting and Data Collection
This prospective survey study was conducted at Boston Children’s Hospital, an academic quaternary care pediatric facility in Boston, Massachusetts. We conducted a mixed methods study of quantitative patient survey data and qualitative interpreter interview data.
Evaluation of the Experience of Patients and Their Families Using IP Telehealth
An 8-question survey () was developed via REDCap (REDCap Consortium) and modified based on the institution’s outpatient virtual visit survey. The survey was reviewed and edited by the health literacy team to ensure accessible language use. The survey was translated into Spanish by Boston Children’s Hospital Interpreter Services.
Patients and their families who used IP telehealth from October 1, 2020, to March 31, 2021, were identified by crossreferencing reports from the videoconferencing software with IP encounters in the enterprise data warehouse. We further filtered the report by selecting all patients with English or Spanish as their primary language. Language in this study is defined as the preferred language listed in the patient’s electronic health record. Emails and phone numbers were used for survey distribution. Use of IP telehealth in dialysis, operating rooms, and radiological imaging were excluded as these visit types could not be linked to specific patient encounters. Patients with email listings were sent the survey in their listed language. Patients without email listings were called via phone, and the survey was administered in their listed language by author LP or a trained Spanish interpreter. Due to an initially low Spanish survey response rate and fewer email listings, starting from December 1, 2020, all surveys were administered by phone to patients with Spanish listed as their preferred language. Survey results of de-identified patients were downloaded from REDCap.
Evaluation of the Experience of Interpreters Providing Services Through IP Telehealth
The hospital has a dedicated interpreter services department with 23 staff members available either in person or by phone or videoconferencing, in addition to external interpreters via contracted agencies. During the COVID-19 pandemic, interpreters initially transitioned to remote work exclusively, but during the study period, they were available in person and remotely. Clinicians typically contacted interpreters by paging to arrange a meeting time. With the launch of an IP telehealth initiative, clinicians were instructed to provide a telehealth meeting link to the interpreter when requesting services. There is also a virtual interpreter system provided by a third-party vendor via tablets on wheels in each hospital unit; however, this system was not integrated with IP telehealth at the time of this study. We conducted semistructured phone interviews of 5 hospital-based Spanish interpreters who provided services through IP telehealth to assess their experience with the program and how it may be improved. The semistructured interview guide consisted of the following questions: (1) What issues did you experience during the IP telehealth session? (2) What do you like about IP telehealth? and (3) What are the opportunities for IP telehealth improvement? Responses were reported to include a representative sample and were categorized inductively.
Ethical Considerations
This project was part of a larger quality improvement effort at Boston Children’s Hospital and was thus deemed exempt from Institutional Review Board review by the Department of Pediatrics Performance Excellence Group.
Statistical Analysis
Medians and IQRs were calculated for continuous variables. A P value of .05 was considered statistically significant. Wilcoxon rank sum test with continuity correction was performed.
Results
Evaluation of the Experience of Patients and Their Families Using IP Telehealth
Of the 8422 unique patients admitted to the hospital during the study period, 505 (6%) had Spanish listed as their preferred language. Of these 505 unique Spanish-speaking patients, 40 (7.9%) used IP telehealth during the study period. A total of 661 eligible patients were identified and administered the survey, with completion rates of 18% (112/621) in English and 62% (25/40) in Spanish. On a 10-point scale, the overall satisfaction of Spanish speakers (median 10, IQR 10-10) was higher than that of English speakers (median 9, IQR 8-10; P=.001). On a 10-point scale, the median scores for how well they felt their questions were answered during their visit were equal: 10 (IQR 10-10) for Spanish speakers and 10 (IQR 9-10) for English speakers (P=.03). Both English- and Spanish-speaking patients reported IP telehealth visits with their primary IP care team, subspecialty consultants, and other clinicians (
Table 1).
Hospital tablets were used more often than personal devices, and notably, only English-speaking patients used personal laptops (Table 2).
Of patient and family respondents with Spanish listed as their preferred language, 80% (20/25) reported using an interpreter during their visit. Feedback on how to make the system easier to use was most frequently regarding log-in, team coordination with multiple users including interpreters, and equipment availability (Table 3). We coded the responses into categories.
| Telehealth visit type | English-speaking respondentsa (n=112), n (%) | Spanish-speaking respondentsa (n=25), n (%) |
| Primary inpatient care team | 54 (48) | 12 (48) |
| Specialist consult | 50 (45) | 12 (48) |
| Other | 48b (43) | 9c (36) |
aThe sum of each column is greater than the number of respondents because the survey question permitted multiselect answers. The denominator for each cell is the number of respondents.
bOther telehealth visit types for English-speaking respondents included behavioral health therapy, child life, dietician, music therapy, nasogastric pump instructions, parent calling patient, patient calling provider from outside facility, patient unsure of type, pet therapy, and social work.
cOther telehealth visit types for Spanish-speaking respondents included dietician, music therapy, patient unsure of type, pet therapy, and social work.
| Device type | English-speaking respondents (n=112), n (%) | Spanish-speaking respondents (n=25), n (%) | All respondents (N=137), n (%) |
| Hospital tablet | 50 (45) | 14 (56) | 64 (47) |
| Personal phone or tablet | 36 (32) | 11 (44) | 47 (34) |
| Personal laptop | 26 (23) | 0 (0) | 26 (19) |
| Categories for improvement | Responses, n (%) |
| Log-in | 8 (15) |
| Multiple users/team coordination | 5 (10) |
| Equipment availability | 3 (6) |
| Privacy | 3 (6) |
| Poor internet connection | 2 (4) |
| Patient engagement | 2 (4) |
| “Unreliable” interpreter | 1 (2) |
| Audio quality | 1 (2) |
| Advertising | 1 (2) |
| Positive comments | 26 (50) |
Evaluation of the Experience of Interpreters Providing Services Through IP Telehealth
Feedback categories derived from phone interviews with Spanish interpreters include audio and video quality, communication, safety, and Wi-Fi access (Table 4).
| Category | Sentiment | Illustrative quote |
| General | Positive |
|
| Safety | Positive |
|
| Audio quality | Constructive |
|
| Communication | Constructive |
|
| Video quality | Constructive |
|
| Wi-Fi access | Constructive |
|
Discussion
Principal Findings
We found that the patients in this sample had high satisfaction with IP telehealth, but Spanish-speaking patients’ median satisfaction scores were higher than those of English speakers despite the workflow challenges identified by interpreters. Broad use cases of IP telehealth were present for both language groups, including visits with the primary IP care team, specialty consultants, social workers, and dieticians. Overall, hospital tablets were used more than personal devices, especially by Spanish-speaking patients. This finding suggests the need for further investment in dedicated hospital devices. Survey respondents provided useful feedback that was shared in departmental educational sessions and can inform future improvements (eg, regarding session log-in and audio and video quality with multiple team members).
Notably, interpreters expressed appreciation for the opportunity to deliver care from a distance during the COVID-19 pandemic. This finding highlights the value of IP telehealth as a tool to ensure staff safety from infectious diseases.
Comparison With Prior Work
Previous literature on IP telehealth implementation has described a broad range of use cases and patient satisfaction that is comparable to in-person care [-]. Our study adds to this literature by specifically addressing the experience of patients and their families who have LEP. The positive experience reported by Spanish speakers in our survey aligns with prior work in ambulatory settings that shows high interest in telehealth among non–English speakers [].
Spanish-speaking patients primarily using hospital tablets and not personal laptops emphasizes the importance of investing in IP telehealth infrastructure for patients with LEP []. In one paper, narratives of patients with LEP who experience social isolation while hospitalized highlight the importance of careful tablet technology implementation to address communication barriers []. Other hospital systems describe the use of Amazon Echo Show devices, laptops on wheels, and tablets on wheels as part of telehealth [,]. Carts with the ability to pan and tilt, hands-free voice-activated command devices, and supplementary speakers may also help address the audio and video quality challenges noted by survey respondents.
Similar to previous findings, we found that work-arounds for integrating multiple users to include interpreters compromised audio and video quality []. Literature has shown better communication outcomes for interpreters connected by video than by phone, further supporting the need for robust infrastructure, including integrated interpreter services, to support IP telehealth initiatives [].
Limitations
This study has limitations, particularly the switch to phone-administered surveys for Spanish-speaking patients due to a low response rate and fewer email listings than English-speaking patients. The use of phone surveys may introduce acquiescence or conformity bias, which may explain the higher median satisfaction score among Spanish-speaking respondents than English-speaking respondents. Satisfaction may also be inflated due to a perceived lack of anonymity or a fear of disapproval from health care professionals [,]. In addition, language preference as documented in the electronic health record may not accurately identify patients with LEP. This could lead to miscategorization, affecting both our survey response rate and survey results. Our mixed methods approach meant that the interpreters—a small cohort—were interviewed, whereas the larger cohort of patients received the structured survey. Survey data have limitations that include inflexibility and lack of depth, which we attempted to address by including textboxes for open-ended questions. Finally, our findings may not apply to patients who speak languages other than English and Spanish, although this institution supports 15 languages through in-house interpreters and more than 100 languages through externally contracted interpreter services.
Conclusions
Both English- and Spanish-speaking patients reported high satisfaction using IP telehealth across multiple disciplines despite the workflow challenges identified by interpreters. Significant investment is needed to provide robust infrastructure to support use by all patients, especially the integration of multiple users to provide interpreter services for patients with LEP.
Acknowledgments
We would like to give special thanks to Boston Children’s Hospital Interpretation Services for administering surveys to Spanish-speaking patients and their families.
Conflicts of Interest
None declared.
References
- Livingston E, Desai A, Berkwits M. Sourcing personal protective equipment during the COVID-19 pandemic. JAMA 2020 May 19;323(19):1912-1914. [CrossRef] [Medline]
- Rational use of personal protective equipment for coronavirus disease (COVID-19) and considerations during severe shortages. World Health Organization. 2020. URL: https://www.who.int/publications/i/item/rational-use-of-personal-protective-equipment-for-coronavirus-disease-(covid-19)-and-considerations-during-severe-shortages [accessed 2022-03-25]
- McSwain SD, Marcin JP. Telemedicine for the care of children in the hospital setting. Pediatr Ann 2014 Feb;43(2):e44-e49. [CrossRef] [Medline]
- Assimacopoulos A, Alam R, Arbo M, Nazir J, Chen D, Weaver S, et al. A brief retrospective review of medical records comparing outcomes for inpatients treated via telehealth versus in-person protocols: is telehealth equally effective as in-person visits for treating neutropenic fever, bacterial pneumonia, and infected bacterial wounds? Telemed J E Health 2008 Oct;14(8):762-768. [CrossRef] [Medline]
- Okita AL, Molina Tinoco LJ, Patatas OHG, Guerreiro A, Criado PR, Gabbi TVB, et al. Use of smartphones in telemedicine: comparative study between standard and teledermatological evaluation of high-complex care hospital inpatients. Telemed J E Health 2016 Sep;22(9):755-760. [CrossRef] [Medline]
- DeVido J, Glezer A, Branagan L, Lau A, Bourgeois JA. Telepsychiatry for inpatient consultations at a separate campus of an academic medical center. Telemed J E Health 2016 Jul;22(7):572-576. [CrossRef] [Medline]
- Georgesen C, Karim SA, Liu R, Moorhead A, Falo LD, English JC. Inpatient eDermatology (teledermatology) can help meet the demand for inpatient skin disease. Telemed J E Health 2020 Jul;26(7):872-878. [CrossRef] [Medline]
- Dorsey ER, Topol EJ. State of telehealth. N Engl J Med 2016 Jul 14;375(2):154-161. [CrossRef] [Medline]
- Adler-Milstein J, Kvedar J, Bates DW. Telehealth among US hospitals: several factors, including state reimbursement and licensure policies, influence adoption. Health Aff (Millwood) 2014 Feb;33(2):207-215. [CrossRef] [Medline]
- Chou E, Hsieh YL, Wolfshohl J, Green F, Bhakta T. Onsite telemedicine strategy for coronavirus (COVID-19) screening to limit exposure in ED. Emerg Med J 2020 Jun;37(6):335-337 [FREE Full text] [CrossRef] [Medline]
- Using telehealth to expand access to essential health services during the COVID-19 pandemic. Centers for Disease Control and Prevention. 2020 Jun 10. URL: https://www.cdc.gov/coronavirus/2019-ncov/hcp/telehealth.html#anchor_1591720077356%0A [accessed 2022-01-12]
- Pilosof NP, Barrett M, Oborn E, Barkai G, Pessach IM, Zimlichman E. Inpatient telemedicine and new models of care during COVID-19: hospital design strategies to enhance patient and staff safety. Int J Environ Res Public Health 2021 Aug 08;18(16):8391 [FREE Full text] [CrossRef] [Medline]
- Health equity. Centers for Disease Control and Prevention. 2022 Mar 21. URL: https://www.cdc.gov/coronavirus/2019-ncov/community/health-equity/index.html [accessed 2022-03-25]
- Diamond LC, Jacobs EA, Karliner L. Providing equitable care to patients with limited dominant language proficiency amid the COVID-19 pandemic. Patient Educ Couns 2020 Aug;103(8):1451-1452 [FREE Full text] [CrossRef] [Medline]
- Chen AH, Youdelman MK, Brooks J. The legal framework for language access in healthcare settings: Title VI and beyond. J Gen Intern Med 2007 Nov;22 Suppl 2:362-367 [FREE Full text] [CrossRef] [Medline]
- Section 1557 of the Patient Protection and Affordable Care Act. U.S. Department of Health & Human Services. 2021 May 10. URL: https://www.hhs.gov/civil-rights/for-individuals/section-1557/index.html [accessed 2022-02-01]
- Rawal S, Srighanthan J, Vasantharoopan A, Hu H, Tomlinson G, Cheung AM. Association between limited English proficiency and revisits and readmissions after hospitalization for patients with acute and chronic conditions in Toronto, Ontario, Canada. JAMA 2019 Oct 22;322(16):1605-1607 [FREE Full text] [CrossRef] [Medline]
- Hsiao V, Chandereng T, Lankton RL, Huebner JA, Baltus JJ, Flood GE, et al. Disparities in telemedicine access: a cross-sectional study of a newly established infrastructure during the COVID-19 pandemic. Appl Clin Inform 2021 May;12(3):445-458 [FREE Full text] [CrossRef] [Medline]
- Chunara R, Zhao Y, Chen J, Lawrence K, Testa PA, Nov O, et al. Telemedicine and healthcare disparities: a cohort study in a large healthcare system in New York City during COVID-19. J Am Med Inform Assoc 2021 Jan 15;28(1):33-41 [FREE Full text] [CrossRef] [Medline]
- Khoong EC, Butler BA, Mesina O, Su G, DeFries TB, Nijagal M, et al. Patient interest in and barriers to telemedicine video visits in a multilingual urban safety-net system. J Am Med Inform Assoc 2021 Feb 15;28(2):349-353 [FREE Full text] [CrossRef] [Medline]
- Hron JD, Parsons CR, Williams LA, Harper MB, Bourgeois FC. Rapid implementation of an inpatient telehealth program during the COVID-19 pandemic. Appl Clin Inform 2020 May;11(3):452-459 [FREE Full text] [CrossRef] [Medline]
- Zimmerman M, Benjamin I, Tirpak JW, D'Avanzato C. Patient satisfaction with partial hospital telehealth treatment during the COVID-19 pandemic: comparison to in-person treatment. Psychiatry Res 2021 Jul;301:113966 [FREE Full text] [CrossRef] [Medline]
- Tenforde AS, Hefner JE, Kodish-Wachs JE, Iaccarino MA, Paganoni S. Telehealth in physical medicine and rehabilitation: a narrative review. PM R 2017 May;9(5S):S51-S58. [CrossRef] [Medline]
- Legler S, Diehl M, Hilliard B, Olson A, Markowitz R, Tignanelli C, et al. Evaluation of an intrahospital telemedicine program for patients admitted With COVID-19: mixed methods study. J Med Internet Res 2021 Apr 29;23(4):e25987 [FREE Full text] [CrossRef] [Medline]
- Vilendrer S, Patel B, Chadwick W, Hwa M, Asch S, Pageler N, et al. Rapid deployment of inpatient telemedicine in response to COVID-19 across three health systems. J Am Med Inform Assoc 2020 Jul 01;27(7):1102-1109 [FREE Full text] [CrossRef] [Medline]
- Ong SY, Stump L, Zawalich M, Edwards L, Stanton G, Matthews M, et al. Inpatient telehealth tools to enhance communication and decrease personal protective equipment consumption during disaster situations: a case study during the COVID-19 pandemic. Appl Clin Inform 2020 Oct;11(5):733-741 [FREE Full text] [CrossRef] [Medline]
- Webber EC, McMillen BD, Willis DR. Health care disparities and access to video visits before and after the COVID-19 pandemic: findings from a patient survey in primary care. Telemed J E Health 2021 Aug 27 [FREE Full text] [CrossRef] [Medline]
- Kucirek NK, Thomas NJ, Norman JS, Athavale P, Jaradeh K, Hsiang EY, et al. Stories from COVID-19 reveal hospitalized patients with limited English proficiency have always been uniquely prone to social isolation. J Gen Intern Med 2021 Mar;36(3):786-789 [FREE Full text] [CrossRef] [Medline]
- Lion KC, Brown JC, Ebel BE, Klein EJ, Strelitz B, Gutman CK, et al. Effect of telephone vs video interpretation on parent comprehension, communication, and utilization in the pediatric emergency department: a randomized clinical trial. JAMA Pediatr 2015 Dec;169(12):1117-1125 [FREE Full text] [CrossRef] [Medline]
- Yeheskel A, Rawal S. Exploring the 'patient experience' of individuals with limited English proficiency: a scoping review. J Immigr Minor Health 2019 Aug;21(4):853-878 [FREE Full text] [CrossRef] [Medline]
- Page KR, Flores-Miller A. Lessons we've learned - Covid-19 and the undocumented Latinx community. N Engl J Med 2021 Jan 07;384(1):5-7. [CrossRef] [Medline]
Abbreviations
| IP: inpatient |
| LEP: limited English proficiency |
Edited by A Mavragani; submitted 27.10.21; peer-reviewed by B Patel, E Khoong; comments to author 08.01.22; revised version received 17.02.22; accepted 10.03.22; published 19.04.22
Copyright©Lily Payvandi, Chase Parsons, Fabienne C Bourgeois, Jonathan D Hron. Originally published in JMIR Formative Research (https://formative.jmir.org), 19.04.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.