Published on in Vol 6, No 6 (2022): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/32874, first published .
Patient and Health Professional Perceptions of Telemonitoring for Hypertension Management: Qualitative Study

Patient and Health Professional Perceptions of Telemonitoring for Hypertension Management: Qualitative Study

Patient and Health Professional Perceptions of Telemonitoring for Hypertension Management: Qualitative Study

Original Paper

Division of Primary Care and Population Health, Stanford School of Medicine, Palo Alto, CA, United States

*these authors contributed equally

Corresponding Author:

Juliana Baratta, MS

Division of Primary Care and Population Health

Stanford School of Medicine

3180 Porter Drive

Palo Alto, CA, 94304

United States

Phone: 1 5858807040

Email: jbaratta@alumni.stanford.edu


Background: Hypertension is the most prevalent and important risk factor for cardiovascular disease, affecting nearly 50% of the US adult population; however, only 30% of these patients achieve controlled blood pressure (BP). Incorporating strategies into primary care that take into consideration individual patient needs, such as remote BP monitoring, may improve hypertension management.

Objective: From March 2018 to December 2018, Stanford implemented a precision health pilot called Humanwide, which aimed to leverage high-technology and high-touch medicine to tailor individualized care for conditions such as hypertension. We examined multi-stakeholder perceptions of hypertension management in Humanwide to evaluate the program’s acceptability, appropriateness, feasibility, and sustainability.

Methods: We conducted semistructured interviews with 16 patients and 15 health professionals to assess their experiences with hypertension management in Humanwide. We transcribed and analyzed the interviews using a hybrid approach of inductive and deductive analysis to identify common themes around hypertension management and consensus methods to ensure reliability and validity.

Results: A total of 63% (10/16) of the patients and 40% (6/15) of the health professionals mentioned hypertension in the context of Humanwide. These participants reported that remote BP monitoring improved motivation, BP control, and overall clinic efficiency. The health professionals discussed feasibility challenges, including the time needed to analyze BP data and provide individualized feedback, integration of BP data, technological difficulties with the BP cuff, and decreased patient use of remote BP monitoring over time.

Conclusions: Remote BP monitoring for hypertension management in Humanwide was acceptable to patients and health professionals and appropriate for care. Important challenges need to be addressed to improve the feasibility and sustainability of this approach by leveraging team-based care, engaging patients to sustain remote BP monitoring, standardizing electronic medical record integration of BP measurements, and finding more user-friendly BP cuffs.

JMIR Form Res 2022;6(6):e32874

doi:10.2196/32874

Keywords



Background

Hypertension is the most prevalent and important risk factor for cardiovascular disease, affecting 1 in 4 adults worldwide [1]. According to the Centers for Disease Control and Prevention, in 2014, hypertension was the underlying cause of death of 410,000 Americans, with >1100 deaths each day [2]. Nearly half of US adults are hypertensive, with a blood pressure (BP) >130/80 mm Hg. If left untreated, hypertension increases the risk of heart attack, stroke, kidney disease, and Alzheimer disease [3]. The risk of these adverse consequences can be mitigated through BP reduction by adhering to hypertension treatment, including behavior modification (eg, low-sodium diet and regular exercise) and taking medication, as recommended by the American Heart Association (AHA) guidelines [2].

Adherence to hypertension treatment has been associated with reductions of 35% to 40% in stroke incidence, 20% to 25% in myocardial infarction incidence, and 50% in heart failure incidence [4]. However, only 54% of US patients with hypertension have controlled BP [5]. Challenges to achieving controlled BP include failure to respond to medication, treatment side effects leading to subpar adherence, and lack of engagement in preventive behaviors such as adopting a healthy diet and increasing physical activity [6,7]. Thus, there is a need to advance hypertension management through individualized approaches that engage patients.

Precision health is an emerging approach to patient-centered care [8] that incorporates patients’ variations in genes, environment, and behavioral lifestyle to construct personalized treatment and prevention approaches [9]. From a population health perspective, precision health can improve prevention of heart disease by defining subgroups of patients with hypertension that may benefit from specific therapies [6]. For the individual patient, hypertension management using precision health can enable better targeting of personalized treatment options by identifying high-risk patients or those in early disease stages in the hopes of averting negative outcomes in the future [10]. Previous research has shown that remote BP monitoring combined with health coaching [11] or pharmacist management [12] improves BP control by providing consistent and accurate BP data to both patients and physicians, which is then used to inform the selection of more effective treatment options [13]. Remote BP monitoring has also been shown to empower patients in relation to managing their hypertension [14] and improve the patient-clinician alliance [15].

As a result of the COVID-19 pandemic, there is an even greater clinical need for remote BP monitoring for hypertension management, as reflected by recent policies. On March 20, 2020, the Food and Drug Administration issued an enforcement policy for the expedited use and availability of digital remote monitoring equipment to facilitate patient monitoring during COVID-19 [16]. Although this policy is only to remain in effect during the pandemic, recent uptakes of remote BP monitoring may be sustained owing to support from other policies. For example, in 2019, the National Committee for Quality Assurance updated the hypertension quality measure to allow BP readings to be taken using remote patient monitoring devices and telehealth encounters to satisfy certain components of the quality measure [17]. The use of home BP measurement is also recommended for the ongoing diagnosis and treatment of hypertension in both the 2020 International Society of Hypertension Global Hypertension Practice Guidelines [18] and the 2017 American College of Cardiology and AHA Blood Pressure Guidelines [19].

As a result, remote BP monitoring is becoming increasingly important for hypertension management and, more broadly, in population health programs. Despite recommendations, adoption is precluded by mediators and moderators of remote BP monitoring integration, including the usability of the digital health tools, ease of clinical workflow incorporation, and availability of technical support [20]. Research is still needed to identify the best practices to sustain remote BP monitoring by overcoming barriers on both the patient side (ie, reductions in motivation) and the clinic side, such as the high costs of hardware maintenance and related software for digital health monitoring [21].

Objectives

Stanford conducted a precision health pilot, Humanwide, to assess the feasibility of embedding a precision health model in a community-based primary care clinic [10]. The goal of Humanwide was to deliver precision health through a combination of “high tech and high touch” care via the use of genetic and pharmacogenomic testing, digital health monitoring, and intensive one-on-one health coaching in the context of team-based primary care [22]. To our knowledge, this is the first implementation of a multipronged precision health delivery model integrated into a primary care clinic. Considering the continuing implementation hurdles that BP management poses and the potential of precision health in this space of patient care, the purpose of this analysis was to formally assess the implementation outcomes of feasibility, acceptability, appropriateness, and sustainability [23] of hypertension management via Humanwide and examine multi-stakeholder perceptions of this approach.


Overview

The implementation of Humanwide took place between March 2018 and December 2018. Patient participation in this study was entirely optional. After enrollment in the pilot study, patient information was shared securely with researchers (NS and CBJ), who then contacted patients to determine their interest in participating in the evaluation. Before conducting the interviews, the evaluation team obtained the participants’ verbal consent. The participants were made aware that the interviews would be confidential and in no way affect their care. Interviews and transcripts were only accessed by the external evaluation team and not by Humanwide health professionals. Audio and transcription files were maintained in Health Insurance Portability and Accountability Act–compliant box files. The deidentified aggregate findings were shared with health professionals and Humanwide team members.

Overview of Humanwide Pilot

Humanwide entailed four components that were added to standard primary care: (1) a baseline wellness visit to assess patient lifestyle, demographics, and socioenvironmental health factors, with follow-up health coaching visits as needed; (2) digital health remote biometric monitoring through the HealthKit app (Apple Inc) [24], including Bluetooth-enabled home scale glucometer, BP cuff for intermittent remote BP readings via the Withings device and app [25], and pedometer; (3) family history assessment and follow-up genetic testing for patients identified from the assessment as at risk for breast cancer, familial hypercholesterolemia, or Lynch syndrome; and (4) pharmacogenomic testing to examine a patient’s likely response to a given class of drugs given their genetic makeup [10]. Implementing these components required care coordination across multiple physicians and specialists, medical assistants (MAs), a pharmacist, a behavioral health practitioner, a registered nurse, and a genetics counselor. The inclusion criteria were (1) adults aged >18 years, (2) seeing a health professional at the pilot study clinic, (3) having a smartphone (to take part in the digital health component), and (4) having time to participate. Health professionals recruited patients that they felt could benefit from Humanwide components, such as medically complex patients managing more than one chronic illness. Attention was given to recruiting diverse patients with respect to age, race and ethnicity, gender, and medical complexities. Primary care health professionals invited 69 patients to participate in Humanwide, and 50 (72%) enrolled. The 19 (28%) patients who declined enrollment reported lack of time as their main reason for nonenrollment.

Interviews and Data Collection

All patients and health professionals involved with Humanwide were eligible for interviews, and patient recruitment for interviews occurred simultaneously during Humanwide enrollment. Health professionals in the primary clinic and specialists outside of the clinic who were contributing to patient care as part of the pilot were included in the interviews. Patients and health professionals were recruited for interviews via convenience sampling. We tracked roles (ie, primary care physician [PCP], nurse, or pharmacist) to aim for a purposive sample.

We developed a semistructured interview guide to assess the implementation outcomes of feasibility, appropriateness, and acceptability of Humanwide [23]. Interview questions assessed perceptions of each pilot component—genetic testing, pharmacogenomics, digital health, and health coaching—and addressed recommendations for future implementation of Humanwide with respect to hypertension management. As the interviews were semistructured, if a patient mentioned hypertension or remote BP monitoring, the questions were then phrased to assess how the pilot components affected their hypertension management (see Table 1 for a summary of the interview guide questions pertaining to hypertension). A total of 3 researchers trained in qualitative methods (NS, JB, and CBJ) conducted audio-recorded interviews in person in a private conference room or over the phone. To the researchers’ knowledge, no other individuals were present during the interviews. Patient interviews ranged from 17 to 36 minutes (mean 25, SD 6.7 minutes). Health professional interviews ranged from 22 to 60 minutes (mean 45, SD 13.9 minutes). No financial or other compensation was provided for participating in the interviews.

Table 1. Summary interview guide for health professionals.
CategoryQuestion
  • Precision health and hypertension
  • What was your experience like with hypertension management in Humanwide?
  • Remote blood pressure monitoring
  • Which parts of remote blood pressure monitoring worked well? Which parts did not work well?
  • What kind of expectations did receiving blood pressure data place on you?
  • Genetic testing and pharmacogenomics
  • Can you tell us if and how genetic or pharmacogenomic testing affected hypertension management?
  • Health coaching
  • Can you tell us if and how one-on-one health coaching affected hypertension management?
  • Implementation feasibility and sustainability
  • What are your thoughts about the sustainability of hypertension management in Humanwide? What would make this approach more sustainable?

Data Analysis

We used a hybrid qualitative approach integrating a priori and emergent themes [26]. A priori subjects of interest included hypertension, digital health, pharmacogenomics, genetic testing, and health coaching. Emergent themes were identified via thematic analysis, which involved careful reading and rereading of the transcripts in line with the inductive approach [26]. The analysis involved 3 steps. First, JB read all patient and health professional transcripts using NVivo 11 software (QSR International) and coded them using the a priori subjects of interest [27]. Second, JB extracted emergent themes from all transcripts with input from the full authorship team. Third, emergent themes were assessed in relation to the following implementation science outcomes based on Proctor et al [23]: acceptability (satisfaction with various aspects), appropriateness (perceived fit), feasibility (suitability for everyday use and ability to be carried out considering resources, training, and staff), and sustainability (facilitators and barriers to spread). Coding questions and novel emergent codes were discussed during weekly meetings with CBJ, NS, and JB over the course of 4 months. In total, 2 researchers (CBJ and NS) conducted quality checks and verified a final coding schema that included codes for a priori concepts and constructs as well as emergent themes.

Ethics Approval

This study was given a nonresearch determination and Human Subjects Research Exemption protocol 43279 by the Stanford Institutional Review Board.


Participants

Of the 50 patients in Humanwide, 16 (32%) participated in the qualitative evaluation. The interviewed patients were diverse—50% (8/16) were non-White, and 56% (9/16) were women (Table 2)—and representative of the 50 patients enrolled based on race and ethnicity, gender, and age. Patients who explicitly referenced hypertension, remote BP monitoring, or both in their interviews were included in the analysis (10/16, 63%). We interviewed 11 health professionals in the Humanwide pilot clinic, including 9 (82%) PCPs, 1 (9%) pharmacist, and 1 (9%) registered nurse; interviews referencing hypertension or BP monitoring were included in the analysis (6/11, 55%). We also interviewed 4 key informant specialist medical doctors (MDs) involved in the pilot whose practices were outside the primary care clinic. The key informants were a cardiovascular geneticist, a pharmacogenomic specialist, a physician expert in biomedical informatics, and a physician specializing in the management of chronic medical conditions, particularly hypertension (Table 3).

Table 2. Patient characteristics (N=16).
CharacteristicPatients, n (%)
Age (years)

30 to 393 (19)

40 to 496 (38)

50 to 595 (31)

60 to 692 (13)
Race and ethnicity

White8 (50)

Asian5 (31)

Other3 (19)
Gender

Men7 (44)

Women9 (56)
Table 3. Health professional characteristics (N=10).
CharacteristicHealth professionals, n (%)
Profession

Primary care physician4 (40)

Specialist medical doctor4 (40)

Pharmacist1 (10)

Nurse1 (10)
Gender

Women7 (70)

Men3 (30)

Emergent Qualitative Themes

Overall, the remote BP monitoring component of Humanwide was the only component that the patients mentioned as contributing to hypertension management. Other components (ie, health coaching, pharmacogenomics, and genetic testing) were not mentioned in conjunction with hypertension management. The participants reported that remote BP monitoring led to mixed increases in patient motivation, enhanced patient-clinician engagement, and improved patient hypertensive management. The participants discussed varied efficiency with remote BP monitoring, and the health professionals were overwhelmed by unfiltered BP data and by providing individualized feedback. The health professionals proposed solutions to these barriers, including managing data through electronic medical record (EMR) settings and leveraging team-based care. Table 4 summarizes the themes that emerged from the analysis along with illustrative quotes from the interviews mapped to implementation outcomes.

Table 4. Themes and illustrative examples mapped to implementation outcomes.
Implementation outcome and emergent themeIllustrative examples
Acceptability

Increased patient motivation“I figure if I am measuring my blood pressure on a regular basis and I am noticing that it is high, it should be a mental kick in the head that says ‘Oh hey, I am going to do something about this.’” [Patient 8]

Increased patient-clinician engagement“I think the key thing that it does is it builds that relationship. If I have to see you in three months, you’re not going to think about doing your blood pressure. Maintaining, pushing a little more of, ‘How are you doing? What’s going on?’ Just trying to understand that. I think our goal was to try to be more engaged in their lives outside of clinic.” [Health professional 4, PCPa]
Appropriateness

Remote blood pressure monitoring perceivably improves patient hypertensive management“And also some days I feel like really dizzy and like I am about to faint so then I immediately check my blood pressure to see if it is normal because sometimes I feel like my heart is pounding very fast, so anything that I feel that is not right or something is different, I immediately check to see my blood pressure.” [Patient 5]

Efficiency with remote blood pressure monitoring“Just because we were able to access how things are at home. We could see what their blood pressure looks like at home versus in the clinic. It saves a lot of time when you’re meeting with patients cause you have all that information ahead of time.” [Health professional 11, specialist MDb]
Feasibility

Efficiency with remote blood pressure monitoring“Then I can show them the data, hey, look my blood pressure monitor taken this day is this, taken this day is this. Yeah I like the application itself. The application piece is good. It keeps my historical data.” [Patient 7]

Technical difficulties with blood pressure cuff“You have to make sure your bluetooth is on and then you have to make sure everything pairs and sometimes with the blood pressure cuff it will like go through the whole thing where it is squeezing and whatever and then it will be like, oh, error, it did not read.” [Patient 6]

Time lost“But it does put that added burden back on me to look through it [BPc readings]. I’m getting five to ten trackers, tracking notices, now every single day. The patients have those tracking information back for me. But if I’m trying to look at everything, which...that’s my goal, then it’s too much.” [Health professional 1, PCP]
Sustainability

Managing data through EMRd settings“EPIC has some tools to visualize data in general and it is incorporated in those same views. Just as a normal PC doc would visualize BP data um same basic kind of mechanisms and dashboards. But I think it is an area of active discussion and debate. Like are the tools for health professionals and patients to interact with their data are they as good as they could be and how can we make them more useful.” [Health professional 13, specialist MD]

Sustaining patient motivation“I think we’re trying with the digital health, and I think we’ll continue to try. I think, again, it has huge benefit for the people that will do it. I think we need to figure out how to get people to do it, but I think it still has great potential.” [Health professional 5, PCP]

Need for team-based care“I think our goal was to try to be more engaged in their lives outside of clinic. That was one of the purposes of these things. How do we do that? Do we need more support doing that? Could an MAe do that?” [Health professional 2, PCP]

aPCP: primary care physician.

bMD: medical doctor.

cBP: blood pressure.

dEMR: electronic medical record.

eMA: medical assistant.

Implementation Outcomes

Overall, remote BP monitoring was acceptable and appropriate for hypertension management, whereas other components (ie, health coaching, pharmacogenomics, and genetic testing) were not mentioned as contributing to hypertension care. The patients and health professionals reported some barriers to feasibility and sustainability but recommended solutions to overcome these concerns for future implementation.

Acceptability
Overview

The use of remote BP monitoring to facilitate hypertension management was acceptable to most patients (13/16, 81%) and health professionals (8/10, 80%) and led to increased patient-health professional engagement; however, acceptance was mixed as not all patients with hypertension used it. On the positive side, the patients enjoyed receiving individualized feedback and treatment guidance from physicians; in some cases, this improved the patients’ motivation to make lifestyle modifications and engage in remote BP monitoring. In contrast, there were several technological glitches with the wireless Bluetooth BP cuff used, and it was thus not deemed an acceptable device in the long term by patients or health professionals.

Mixed Patient Motivation

The patients perceived remote BP monitoring with the wireless Bluetooth cuff as one of the main contributors to motivation, although maintenance was difficult for some (3/16, 19%). Patients with hypertension reported an improved desire to make behavioral changes such as implementing a routine exercise regimen. They described how seeing their BP measurements made them more conscientious of their health, which increased their motivation for self-management. The patients also reported an increased sense of accountability to their health professional, which further contributed to motivation:

I mean the attention from the medical staff and the fact that it is there in the app [on my smart phone] is going to make me become more efficient at [blood pressure monitoring].
[Patient 7]

The patients perceived health professional feedback as the “cue to take action” (patient 3) to adhere to treatment.

Despite increased patient motivation, the health professionals reported that patients did not sustain remote BP monitoring:

The [challenge] of Humanwide is that it probably requires some thought on how to adequately coach patients so that they feel really engaged in the use of wearables.
[Health professional 12, specialist MD]

A total of 13% (2/15) of the health professionals discussed that, as patients with hypertension controlled their BP, they sometimes stopped using the cuff because they felt less incentivized. In addition, the health professionals mentioned that some patients who needed remote BP monitoring did not participate:

It’s insightful to me that it’s just really hard to get buy-in for that [blood pressure cuff]...For those that are interested, it’s great, but it’s very few.
[Health professional 2, PCP]

A few (3/15, 20%) health professionals discussed not having the bandwidth to reach out to all patients with hypertension who were less engaged in remote BP monitoring; instead, the health professionals capitalized on patients who were engaged using a “nudge-based approach” (health professional 12), “frequent touches” (health professional 4), and “targeted management plans” (health professional 6).

Appropriateness
Overview

The health professionals and patients perceived remote BP monitoring to be appropriate based on their experiences of improved hypertension management and patient-health professional engagement, with fewer clinic visits. The health professionals reported that diagnosing patients with masked hypertension with the help of remote BP monitoring allowed patients to incorporate lifestyle changes earlier to achieve BP control. In addition, the health professionals reported titrating the medications of patients with hypertension faster because of remote BP monitoring, potentially leading to moderate improvements in overall clinic efficiency. Most patients with hypertension (15/16, 94%) enjoyed the digital health component and found it helpful to achieve controlled BP because they became more aware of their BP and knowledgeable of how to take part in their treatment.

Increased Patient-Clinician Engagement

The use of remote BP monitoring appeared to promote patient-clinician engagement and treatment adherence. The health professionals kept in touch with patients by providing individualized feedback on BP data. A patient mentioned the following:

My doctor called me and noted that my blood pressure was higher than it should be and let me know about that, that I need to take action on it.
[Patient 8]

The patients with hypertension noted that they really “enjoyed” (patient 3) and “appreciated” (patient 6) receiving feedback from the clinical care team. In addition, the patients perceived this feedback as helpful for achieving their behavioral goals.

The health professionals similarly implied that the increased connection with their patients improved patient understanding of and adherence to their treatment regimen:

We have a tighter relationship. When I reach out, it’s not like I saw them last year. They’ll maybe listen a little bit more. We’ll have a little bit more of a conversation.
[Health professional 10, pharmacist]

Most health professionals (12/15, 80%) mentioned that receiving the BP data placed an expectation on them to reach out to their patients to provide feedback.

Improved Patient Hypertensive Management

The participants perceived improved hypertensive management as a result of remote BP monitoring. The participants reported that remote BP monitoring improved “awareness of what was going on at home” (patient 3), as best described by a patient:

Now that there is an application and a digital record that allows me to be more conscientious, “Oh wow, it has been a week, or it has been 4 days, or it has been 3 days,” and, you know, that is now in my mind being more attentive about checking my blood pressure.
[Patient 7]

The health professionals mentioned at-home BP data serving as a “checkpoint” (health professional 11) to ensure that patients were well-managed. A total of 20% (3/15) of the health professionals noted that some patients had normal BP in the clinic but elevated BP out of the clinic:

Individuals who never had a diagnosis of hypertension were getting blood pressure measurements in the range that would meet the criteria for hypertension as a diagnosis, and then they were able to...make lifestyle changes that were very tailored to them, that then reduced their blood pressure, and prevented hypertension.
[Health professional 6, PCP]

Home BP monitoring was coupled with regular measurements in the clinic to help ensure accuracy and precision between home and clinic BP measurements.

Feasibility
Overview

There were concerns regarding the long-term feasibility of hypertension management in Humanwide because of the following barriers: (1) limitations of the BP cuff, including limited sizing, which may have led to inaccurate results for those with high BMI; (2) technical difficulties because of wireless connectivity issues; (3) time lost sifting through overwhelming amounts of BP measurements in the EMR; and (4) the number of health professionals needed to provide individualized feedback to patients. Unfortunately, the patients and health professionals became frustrated with the BP cuff’s technological issues, which led to drops in engagement with remote BP monitoring throughout the pilot. The health professionals also reported significant time lost reading through patient BP data to identify clinically actionable measurements. Although the health professionals believed that providing individualized feedback was beneficial to patients, they felt it was not sustainable unless they used MAs or pharmacists to share this responsibility.

Mixed Efficiency With Remote BP Monitoring

There were mixed reports on the efficiency in managing patients with hypertension as a result of remote BP monitoring. Although some participants felt that remote BP monitoring made it easier to track BP and contributed to increased clinic efficiency, others mentioned technological glitches reducing efficiency and motivation. The patients reported that the wireless Bluetooth feature of the BP cuff saved time and made tracking BP data easy:

Yeah I like the application itself. The application piece is good. It keeps my historical data.
[Patient 1]

A health professional ratified the value of this wireless Bluetooth technology considering the BP reads auto-populate the patient’s app and medical chart:

I don’t have to call my patient asking them to read back some blood pressures, and conversely I know when they are not recording their blood pressures.
[Health professional 13, specialist MD]

This example illustrates the potential of remote BP monitoring to improve health professionals’ awareness of patient progress and inform individualized treatment.

The health professionals also discussed that having patient BP data before a clinic visit saved time and made the visit more productive. The health professionals implied that it improved clinic efficiency as it took fewer visits to stabilize patients on their medication:

I think we’re able to titrate them quicker, to make the blood pressure medicine changes quicker than we would having to come into the office every three to six months. So, we get them to goal quicker.
[Health professional 2, PCP]

Of the 15 health professionals, 9 (60%) corroborated that they became “pretty efficient in terms of the workflow” (health professional 4) since implementing remote BP monitoring.

Although the participants discussed increased efficiency with remote BP monitoring, many expressed concerns over technological glitches with the wireless Bluetooth BP cuff. The patients mentioned difficulties with the BP readings not syncing to their EMR and the cuff not taking measurements:

They are a little glitchy. The blood pressure cuff is probably the easiest [remote monitoring digital health tool] to use but there are several steps involved.
[Patient 6]

The health professionals echoed this sentiment, reporting that patients did not regularly monitor BP because of glitches with the technology:

They [patients] get frustrated when they put the cuff on, and it doesn’t work. They don’t want to do it.
[Health professional 2, PCP]

Technological difficulties also affected health professional workflow because the health professionals often had to help patients troubleshoot over the phone or schedule a patient visit:

With the BP cuff, sometimes there were technical issues and they [patients] kind of knew to ask me or I gave them resources to call.
[Health professional 11, specialist MD]

Indeed, the pilot intake process included a full hour with an MA entirely devoted to troubleshooting digital health devices. The patients mentioned needing to adjust their arm position for the cuff to work, and a patient required an additional office visit for guidance.

Sustainability
Overview

The health professionals mentioned several concerns related to the sustainability of remote BP monitoring as part of hypertension management. They discussed the negative impacts on the sustainability of remote BP workflows and patient motivation and engagement from feasibility issues: BP cuff technical glitches reducing motivation for patients, health professional time lost sifting through BP measurements, and time constraints limiting health professionals’ individualized feedback to patients. According to patient and health professional interviewees, the patients measured their BP daily, especially during the first half of the intervention period (March 2018 to July 2018), with a gradual drop in frequency of BP measurements in the latter half of the pilot.

The health professionals suggested several solutions to overcome feasibility and sustainability issues, including using a different wireless Bluetooth cuff in the future, providing patients with more information or guidance on how to properly use the cuff, better leveraging team-based care, and enabling measurement of BP data through automated EMR settings. Ideally, guidance for BP cuff use would be accessed outside the clinic through video tutorials or on-demand technological support. EMR settings could be adjusted such that health professionals receive an alert only when a patient’s BP is above a certain cutoff. A final suggestion was to incorporate artificial intelligence (AI)-based BP cuffs that would only surface alarming BP measurements. Overall, a great deal of care coordination, technological improvements, and approaches to sustain remote BP monitoring needs to be addressed to achieve long-term sustainability.

Overwhelmed by Unfiltered Data and Providing Individualized Feedback

The health professionals received a deluge of BP data in the EMR from remote monitoring and reported time lost as a result of reviewing these data and following up with patients:

I have to respond to them or do something with the information. But it’s now turning out to be five to ten every single day that I’m getting. And obviously I think it’s useful, which is why I’m doing it. But at some point, I’m gonna say, “This is just too much.”
[Health professional 2, PCP]

The health professionals reported that providing tailored feedback to patients was appropriate for hypertension management but acknowledged that the current workflow, where health professionals are solely responsible for communication, might not be acceptable in the long term. Conversely, several health professionals implied that daily communication with patients was worth their time even though there were no shortcuts:

You can’t just say, “Do this,” which is fine. I mean, you have to understand that it’s just not going to be a quick [fix]. I mean, it’s that relationship, right? You’re building that relationship.
[Health professional 2, PCP]

A health professional even felt that daily communication was sustainable:

The frequent touches and the frequent follow-up is very doable.
[Health professional 4]

Health Professional Proposed Solutions

Managing Data Through EMR Settings

The health professionals managed BP data through EMR settings to reduce extra time spent sifting through BP measurements by setting “overs and unders” (health professional 12) so they would only be notified when a patient’s BP was too high or low. Another strategy included setting the EMR to receive BP data every 2 weeks. The health professionals reported that it was not feasible to check BP measurements in real time. A health professional emphasized advising patients with hypertension to seek emergency help as they normally would if they encountered alarming BP measurements in conjunction with signs and symptoms of a hypertension emergency. If the patients were experiencing high BP measurements in isolation, they were advised to reach out to their PCP for potential medication adjustments or follow-up visits.

A few health professionals (3/15, 20%) also suggested developing graphical displays of BP measurements over time that could be visualized within the EMR to capture trends, outliers, and average BP values:

Graphical displays are the most meaningful for the health professional who is looking at it [BP data]. Most of my colleagues, when we are in clinic, we look at the graphical trend over time and we look at the average.
[Health professional 6, PCP]

Optimal visualization of BP data via the EMR remains an area of “active discussion and debate” (health professional 13).

Need for Team-Based Care

Many health professionals emphasized the importance of team-based care to enable successful hypertension management. A total of 40% (6/15) of the health professionals mentioned using MAs and pharmacists when treating patients with hypertension and the importance of everyone working at the top of their license. To best integrate remote BP monitoring, 13% (2/15) of the health professionals discussed needing to alter the typical patient-health professional model:

If you just apply technology to existing workflows and models you are not necessarily going to have better outcomes. You need to figure out, “What care models do these new technologies enable?” And it is things like centralization and different care team members interacting differently to data.
[Health professional 13]

The health professionals expressed that not all health care systems will have the resources to implement remote BP monitoring and individualized health professional feedback. However, a health professional discussed the potential for web-based patient management with the help of remote BP monitoring:

We are trying to build on top of that kind of precision health approach with a protocolized team-based strategy for remote patient monitoring and appropriate care referral, with the thought being that most physicians or health professionals may have difficulty seeing their patients more regularly than 3 months just because access is limited.
[Health professional 12, specialist MD]

The health professionals also mentioned the ability of remote BP monitoring to reduce patient visits and, therefore, increase clinic efficiency.


Principal Findings

This study explored emergent themes along with facilitators and barriers to hypertension management in the first reported precision health pilot study integrated into a primary care setting. The participants reported that remote BP monitoring led to improvements in patient treatment adherence and lifestyle behavior changes. These accounts are similar to those of previous studies showing improved medication management and adoption of lifestyle changes in patients using remote BP monitoring and health coaching [28,29]. The purpose of this evaluation was to assess the implementation outcomes for the Humanwide precision health pilot to inform future expansion of the intervention.

Most health professionals (9/15, 60%) stated that remote BP measurements are helpful for managing patients with hypertension as they are “actionable” and “are providing a new source of ground truth” (health professional 16, specialist MD). The AHA similarly recommends remote BP monitoring for a more comprehensive view of patients’ BP control [30]. Other benefits of remote BP monitoring coupled with office BP measurements include better prediction of cardiovascular morbidity and mortality, improved patient understanding of hypertension management leading to better treatment adherence, and increased detection of BP variability [31].

The health professionals mentioned difficulty in obtaining patient buy-in to start remote BP monitoring. PCPs from a recent qualitative study suggested patient education sessions to enhance patient engagement by emphasizing how remote BP monitoring can be a source of individual empowerment in clinical care [32]. Another study proposed a model based on the business process management paradigm to empower patients by setting negotiated health goals and providing consistent lines of communication between the patient and their health care team to help trigger initial engagement in remote BP monitoring [33].

Along with the difficulty in encouraging patients to initially engage in remote BP monitoring, there were concerns that motivation was not sustainable in the long term. Some patients reportedly stopped using their cuff near the end of the pilot, potentially because they achieved BP control. However, patients who achieve well-controlled hypertension should continue monitoring their BP on a semiregular basis [30]. Common patient-level moderators of BP control include self-efficacy, self-awareness, and education [34]. Self-monitoring of lifestyle behaviors (eg, diet, physical activity, and sleep) tends to be an effective tool for changing behavior but may be less well-suited for maintaining behavior as it is challenging to do so in the long term [31]. Although some studies show that remote BP monitoring combined with telehealth counseling could improve adherence to hypertension care [35], most patients (14/16, 88%) did not report engaging in health coaching sessions. We believe that this lack of engagement was potentially due to greater interest in the more novel pilot components of genetic testing, pharmacogenomic testing, and Bluetooth devices. Although the participants did receive genetic and pharmacogenomic testing, the results of these tests did not significantly affect their hypertension management or treatment regime.

Tools to improve long-term engagement in BP monitoring are needed, and future strategies could include a more systematized nudge-based approach in which health professionals regularly provide patients feedback based on their BP measurements. Future work could also explore a combination of remote BP monitoring, health professional feedback, and engaging patients’ social support members (ie, family and friends), much like an intervention currently being studied at Penn Family Care [36].

At the health care system level, physicians had several suggestions to address the barriers that surfaced, including leveraging team-based care to sift through patient BP measurements and buoy individualized feedback to patients, AI-based tools to surface clinically relevant data, and improved BP cuff technology. A recent meta-analysis showed that multicomponent strategies, including team-based care and medication titration by a nonphysician (ie, an MA or pharmacist), were most effective for systolic BP reduction compared with other interventions [37]. A study found that most patients are interested in using AI-based tools in their care [38], which may someday include an AI-based algorithm in development that differentiates clinically relevant BP measurements from outliers and extraneous data [39]. In addition, the AHA recently called for improved BP cuff technology and a set of clear standards on how to use these cuffs, echoing this study’s issue with technical glitches with the BP cuffs used [40]. Bluetooth-enabled BP cuffs can allow clinicians to monitor patterns in patients’ BP data. However, there are several access barriers to consider, including the need for a smartphone app to connect the Bluetooth BP cuff and consistent Wi-Fi, which may not be affordable for all patients or available in rural areas [41]. Future research is needed to explore patients’ and health professionals’ perceptions of Bluetooth-enabled BP cuffs relative to manual BP cuffs for home monitoring. In addition, implementation science research is necessary to determine whether Bluetooth-enabled BP cuffs can be implemented in various settings given their cost and mixed feasibility.

The COVID-19 pandemic has surfaced a clinical need and demand for remote BP monitoring. According to a study published by the AHA, BP control worsened in both men and women at the onset of the COVID-19 pandemic [42]. A recent qualitative study found that PCPs believe that remote BP monitoring can improve hypertension management, but successful implementation requires improving patient acceptance and seamless integration into clinical workflows [32]. We would expect remote BP monitoring to become the gold standard based on this evaluation and previous research. For remote BP monitoring to be accessible and sustainably used, there would need to be improvements in BP data visualization and EMR incorporation [43], Bluetooth technology [44], insurance coverage of Bluetooth BP cuff technology [45], and team-based care [46].

Strengths and Limitations

Several limitations should be noted for interpreting the study findings, including testing in a single clinic, the small number of patients and health professionals interviewed, and the absence of quantitative data to assess actual patient changes in BP. Of the 50 patients in the Humanwide pilot, 34 (68%) were not interviewed because of our convenience sampling method. This method has known limitations, including lack of generalization, inability to represent subpopulations accurately, and bias toward people who will participate [47]. To account for these biases, we attended to demographics of the sample, making a purposive attempt to include perspectives from a variety of roles for clinicians and determining that our demographic balance for patients would include all groups of interest.

Thematic saturation has been systematically assessed in previous qualitative studies, with determinations that thematic saturation was reached in 2 studies at 12 interviews [48,49]. As previously mentioned, our sample sizes for health professionals and patients were relatively small (n=15 and n=16). On the basis of previous work with saturation and our assessment of no novel themes regarding BP, we found our patient data set to represent thematic saturation. Our clinician data set confirmed the themes from the patient data set. This agreement between data sets is a strong indicator through data triangulation [50] that our findings represent thematic saturation of BP perspectives in this pilot. All patients who mentioned remote BP monitoring or hypertension (10/16, 63%) were included in the data analysis. This study highlights the experiences of multiple stakeholders, including patients and health professionals, to inform the future dissemination of hypertension management in Humanwide and precision health more broadly.

Conclusions

We found that, of the 4 components of Humanwide (pharmacogenomics, genetic testing, digital health, and health coaching), digital health via remote BP monitoring was reported to be the most impactful for hypertension management from the perspective of both patients and health professionals. Despite the barriers, remote BP monitoring is promising, as reflected by enhanced patient-health professional engagement, perceived improvements in patient care, and increased clinic efficiency. Future recommendations to overcome barriers include the integration of patient BP data into the EMR, automated ways of monitoring and identifying actionable BP measurements, leveraging team-based care to facilitate data monitoring and individualized feedback, and tools to increase sustained patient use.

Acknowledgments

The authors would like to thank all the patients and health professionals for participating in the Humanwide pilot. Humanwide was funded by the Stanford School of Medicine Dean’s Office and implemented by Stanford Primary Care in Santa Clara. The Stanford School of Medicine Dean’s Office was not a part of the qualitative analysis, including the interpretation of the data, the writing of the manuscript, and the decision to submit the manuscript for publication. No public funding was used for the activities reported in this manuscript. The evaluations reported in this manuscript were financially supported by Stanford Health Care. The manuscript contents are solely the responsibility of the authors and do not necessarily represent the official views of Stanford Health Care, an entity affiliated with but not part of the Stanford School of Medicine where the Evaluation Sciences Unit resides.

Data Availability

Supporting data are available on request. Please contact the corresponding author.

Conflicts of Interest

JB, CBJ, NS, MW, and LGR are affiliated with the Evaluation Sciences Unit. MM is currently a practicing health professional in the Stanford Health Care system.

  1. Perkovic V, Huxley R, Wu Y, Prabhakaran D, MacMahon S. The burden of blood pressure-related disease. Hypertension 2007 Dec;50(6):991-997. [CrossRef]
  2. Nearly half of U.S. adults could now be classified with high blood pressure, under new definitions. American Heart Association News.   URL: https:/​/www.​heart.org/​en/​news/​2018/​05/​01/​nearly-half-of-us-adults-could-now-be-classified-with-high-blood-pressure-under-new-definitions [accessed 2022-05-03]
  3. High blood pressure fact sheet. Centers for Disease Control and Prevention.   URL: https://www.cdc.gov/bloodpressure/facts.htm [accessed 2022-05-03]
  4. Law MR, Morris JK, Wald NJ. Use of blood pressure lowering drugs in the prevention of cardiovascular disease: meta-analysis of 147 randomised trials in the context of expectations from prospective epidemiological studies. BMJ 2009 May 19;338:b1665 [FREE Full text] [CrossRef] [Medline]
  5. Underlying cause of death 1999-2020. Centers for Disease Control and Prevention.   URL: https://wonder.cdc.gov/wonder/help/ucd.html [accessed 2022-05-03]
  6. Savoia C, Volpe M, Grassi G, Borghi C, Agabiti Rosei E, Touyz R. Personalized medicine-a modern approach for the diagnosis and management of hypertension. Clin Sci (Lond) 2017 Nov 15;131(22):2671-2685 [FREE Full text] [CrossRef] [Medline]
  7. Hajjar I, Kotchen TA. Trends in prevalence, awareness, treatment, and control of hypertension in the United States, 1988-2000. JAMA 2003 Jul 09;290(2):199-206. [CrossRef] [Medline]
  8. What is precision medicine? MedlinePlus.   URL: https://ghr.nlm.nih.gov/primer/precisionmedicine/definition [accessed 2022-05-03]
  9. Bíró K, Dombrádi V, Jani A, Boruzs K, Gray M. Creating a common language: defining individualized, personalized and precision prevention in public health. J Public Health (Oxf) 2018 Dec 01;40(4):e552-e559. [CrossRef] [Medline]
  10. Mahoney MR, Asch SM. Humanwide: a comprehensive data base for precision health in primary care. Ann Fam Med 2019 May 13;17(3):273 [FREE Full text] [CrossRef] [Medline]
  11. Tucker KL, Sheppard JP, Stevens R, Bosworth HB, Bove A, Bray EP, et al. Self-monitoring of blood pressure in hypertension: a systematic review and individual patient data meta-analysis. PLoS Med 2017 Sep 19;14(9):e1002389 [FREE Full text] [CrossRef] [Medline]
  12. Margolis KL, Asche SE, Dehmer SP, Bergdall AR, Green BB, Sperl-Hillen JM, et al. Long-term outcomes of the effects of home blood pressure telemonitoring and pharmacist management on blood pressure among adults with uncontrolled hypertension: follow-up of a cluster randomized clinical trial. JAMA Netw Open 2018 Sep 07;1(5):e181617 [FREE Full text] [CrossRef] [Medline]
  13. Parati G, Dolan E, McManus RJ, Omboni S. Home blood pressure telemonitoring in the 21st century. J Clin Hypertens (Greenwich) 2018 Jul 13;20(7):1128-1132 [FREE Full text] [CrossRef] [Medline]
  14. Fletcher BR, Hinton L, Hartmann-Boyce J, Roberts NW, Bobrovitz N, McManus RJ. Self-monitoring blood pressure in hypertension, patient and provider perspectives: a systematic review and thematic synthesis. Patient Educ Couns 2016 Feb;99(2):210-219. [CrossRef] [Medline]
  15. Lv N, Xiao L, Simmons ML, Rosas LG, Chan A, Entwistle M. Personalized hypertension management using patient-generated health data integrated with electronic health records (empower-h): six-month pre-post study. J Med Internet Res 2017 Sep 19;19(9):e311 [FREE Full text] [CrossRef] [Medline]
  16. Enforcement policy for non-invasive remote monitoring devices used to support patient monitoring during the coronavirus disease 2019 (COVID-19) public health emergency (revised). U.S. Food and Drug Administration.   URL: https:/​/www.​fda.gov/​regulatory-information/​search-fda-guidance-documents/​enforcement-policy-non-invasive-remote-monitoring-devices-used-support-patient-monitoring-during [accessed 2022-05-03]
  17. HEDIS for hypertension. California Heath & Wellness.   URL: https://www.cahealthwellness.com/newsroom/hedis-for-hypertension-.html [accessed 2022-05-03]
  18. Unger T, Borghi C, Charchar F, Khan NA, Poulter NR, Prabhakaran D, et al. 2020 International society of hypertension global hypertension practice guidelines. Hypertension 2020 Jun;75(6):1334-1357. [CrossRef]
  19. Whelton PK, Carey RM, Aronow WS, Casey DE, Collins KJ, Dennison Himmelfarb C, et al. 2017 ACC/AHA/AAPA/ABC/ACPM/AGS/APhA/ASH/ASPC/NMA/PCNA guideline for the prevention, detection, evaluation, and management of high blood pressure in adults: a report of the American college of cardiology/American heart association task force on clinical practice guidelines. J Am Coll Cardiol 2018 May 15;71(19):e127-e248 [FREE Full text] [CrossRef] [Medline]
  20. Palacholla RS, Fischer N, Coleman A, Agboola S, Kirley K, Felsted J, et al. Provider- and patient-related barriers to and facilitators of digital health technology adoption for hypertension management: scoping review. JMIR Cardio 2019 Mar 26;3(1):e11951 [FREE Full text] [CrossRef] [Medline]
  21. Omboni S, Panzeri E, Campolo L. E-health in hypertension management: an insight into the current and future role of blood pressure telemonitoring. Curr Hypertens Rep 2020 Jun 06;22(6):42. [CrossRef] [Medline]
  22. Brown-Johnson CG, Safaeinili N, Baratta J, Palaniappan L, Mahoney M, Rosas LG, et al. Implementation outcomes of Humanwide: integrated precision health in team-based family practice primary care. BMC Fam Pract 2021 Feb 02;22(1):28 [FREE Full text] [CrossRef] [Medline]
  23. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health 2011 Mar 19;38(2):65-76 [FREE Full text] [CrossRef] [Medline]
  24. Technology HealthKit. Apple Developer Documentation.   URL: https://developer.apple.com/documentation/healthkit [accessed 2022-05-03]
  25. Blood pressure monitors. Withings.   URL: https://www.withings.com/us/en/blood-pressure-monitors [accessed 2022-05-03]
  26. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Method 2016 Nov 29;5(1):80-92. [CrossRef]
  27. AlYahmady HH, Al Abri SS. Using Nvivo for data analysis in qualitative research. Int Interdisciplinary J Educ 2013;2(2):181-186. [CrossRef]
  28. Donahue KE, Tillman J, Halladay JR, Cené CW, Hinderliter A, Cummings DM, et al. Lessons learned from implementing health coaching in the heart healthy lenoir hypertension study. Prog Community Health Partnersh 2016;10(4):559-567. [CrossRef] [Medline]
  29. Postel-Vinay N, Bobrie G, Savard S, Persu A, Amar L, Azizi M, et al. Home blood pressure measurement and digital health: communication technologies create a new context. J Hypertens 2018 Nov;36(11):2125-2131. [CrossRef] [Medline]
  30. Get the most out of home blood pressure monitoring. Mayo Clinic.   URL: https:/​/www.​mayoclinic.org/​diseases-conditions/​high-blood-pressure/​in-depth/​high-blood-pressure/​art-20047889 [accessed 2022-05-03]
  31. George J, MacDonald T. Home blood pressure monitoring. Eur Cardiol 2015 Dec;10(2):95-101 [FREE Full text] [CrossRef] [Medline]
  32. Gondi S, Ellis S, Gupta M, Ellerbeck E, Richter K, Burns J, et al. Physician perceived barriers and facilitators for self-measured blood pressure monitoring- a qualitative study. PLoS One 2021 Aug 20;16(8):e0255578 [FREE Full text] [CrossRef] [Medline]
  33. Ruiz-Fernández D, Marcos-Jorquera D, Gilart-Iglesias V, Vives-Boix V, Ramírez-Navarro J. Empowerment of patients with hypertension through BPM, IoT and remote sensing. Sensors (Basel) 2017 Oct 04;17(10):2273 [FREE Full text] [CrossRef] [Medline]
  34. Etminani K, Tao Engström A, Göransson C, Sant'Anna A, Nowaczyk S. How behavior change strategies are used to design digital interventions to improve medication adherence and blood pressure among patients with hypertension: systematic review. J Med Internet Res 2020 Apr 09;22(4):e17201 [FREE Full text] [CrossRef] [Medline]
  35. Omboni S. Connected health in hypertension management. Front Cardiovasc Med 2019 Jun 13;6:76 [FREE Full text] [CrossRef] [Medline]
  36. Remote monitoring and social support for hypertension management (SupportBP). ClinicalTrials.   URL: https://clinicaltrials.gov/ct2/show/NCT03416283 [accessed 2022-05-03]
  37. Mills KT, Obst KM, Shen W, Molina S, Zhang H, He H, et al. Comparative effectiveness of implementation strategies for blood pressure control in hypertensive patients. Ann Intern Med 2017 Dec 26;168(2):110. [CrossRef]
  38. Tran V, Riveros C, Ravaud P. Patients' views of wearable devices and AI in healthcare: findings from the ComPaRe e-cohort. NPJ Digit Med 2019 Jun 14;2(1):53 [FREE Full text] [CrossRef] [Medline]
  39. The health care benefits of combining wearables and AI. Harvard Business Review.   URL: https://hbr.org/2019/05/the-health-care-benefits-of-combining-wearables-and-ai [accessed 2022-05-03]
  40. Muntner P, Shimbo D, Carey RM, Charleston JB, Gaillard T, Misra S, et al. Measurement of blood pressure in humans: a scientific statement from the American heart association. Hypertension 2019 May;73(5):e35-e66 [FREE Full text] [CrossRef] [Medline]
  41. Goldberg EM, Levy PD. New approaches to evaluating and monitoring blood pressure. Curr Hypertens Rep 2016 Jun;18(6):49 [FREE Full text] [CrossRef] [Medline]
  42. Laffin LJ, Kaufman HW, Chen Z, Niles JK, Arellano AR, Bare LA, et al. Rise in blood pressure observed among US adults during the COVID-19 pandemic. Circulation 2022 Jan 18;145(3):235-237. [CrossRef]
  43. McGreevey JD, Mallozzi CP, Perkins RM, Shelov E, Schreiber R. Reducing alert burden in electronic health records: state of the art recommendations from four health systems. Appl Clin Inform 2020 Jan 01;11(1):1-12 [FREE Full text] [CrossRef] [Medline]
  44. Piper MA, Evans CV, Burda BU, Margolis KL, O'Connor E, Whitlock EP. Diagnostic and predictive accuracy of blood pressure screening methods with consideration of rescreening intervals: a systematic review for the U.S. preventive services task force. Ann Intern Med 2015 Feb 03;162(3):192-204. [CrossRef]
  45. CMS expands coverage of Ambulatory Blood Pressure Monitoring (ABPM). Centers for Medicare & Medicaid Services.   URL: https:/​/www.​cms.gov/​newsroom/​press-releases/​cms-expands-coverage-ambulatory-blood-pressure-monitoring-abpm [accessed 2022-05-03]
  46. Lee NS, Anastos-Wallen R, Chaiyachati KH, Reitz C, Asch DA, Mehta SJ. Clinician decisions after notification of elevated blood pressure measurements from patients in a remote monitoring program. JAMA Netw Open 2022 Jan 04;5(1):e2143590 [FREE Full text] [CrossRef] [Medline]
  47. Andrade C. The inconvenient truth about convenience and purposive samples. Indian J Psychol Med 2021 Jan 17;43(1):86-88 [FREE Full text] [CrossRef] [Medline]
  48. Ando H, Cousins R, Young C. Achieving saturation in thematic analysis: development and refinement of a codebook. Comprehensive Psychol 2014 Feb 20;3:03.CP.3.4. [CrossRef]
  49. Guest G, Bunce A, Johnson L. How many interviews are enough? Field Methods 2016 Jul 21;18(1):59-82. [CrossRef]
  50. Johnson M, O'Hara R, Hirst E, Weyman A, Turner J, Mason S, et al. Multiple triangulation and collaborative research using qualitative methods to explore decision making in pre-hospital emergency care. BMC Med Res Methodol 2017 Jan 24;17(1):11 [FREE Full text] [CrossRef] [Medline]


AHA: American Heart Association
AI: artificial intelligence
BP: blood pressure
EMR: electronic medical record
MA: medical assistant
MD: medical doctor
PCP: primary care physician


Edited by A Mavragani; submitted 18.08.21; peer-reviewed by B Green, J Edwards, L Weinert; comments to author 11.01.22; revised version received 07.03.22; accepted 13.04.22; published 10.06.22

Copyright

©Juliana Baratta, Cati Brown-Johnson, Nadia Safaeinili, Lisa Goldman Rosas, Latha Palaniappan, Marcy Winget, Megan Mahoney. Originally published in JMIR Formative Research (https://formative.jmir.org), 10.06.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.