Published on in Vol 8 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/63068, first published .
The Impact and Wider Implications of Remote Consultations for General Practice in Norway: Qualitative Study Among Norwegian Contract General Practitioners

The Impact and Wider Implications of Remote Consultations for General Practice in Norway: Qualitative Study Among Norwegian Contract General Practitioners

The Impact and Wider Implications of Remote Consultations for General Practice in Norway: Qualitative Study Among Norwegian Contract General Practitioners

Original Paper

1General Practice Research Unit, Department of Public Health and Nursing, Norwegian University of Science and Technology, Trondheim, Norway

2Norwegian Center for E-health Research, University Hospital of North Norway, Tromsø, Norway

Corresponding Author:

Børge Lønnebakke Norberg, MD

General Practice Research Unit

Department of Public Health and Nursing

Norwegian University of Science and Technology

PO Box 8905

Trondheim, 7491

Norway

Phone: 47 73598859

Email: borge.norberg@ntnu.no


Background: The digital shift toward remote consultations in general practice needs ongoing monitoring to understand its impact on general practice organizations and the wider health care system.

Objective: This study aimed to explore how remote consultations impact on contracted general practitioner (GP) practices and how GPs perceive the implications of this uptake for the overall health care system.

Methods: In total, 5 focus groups were conducted with a total of 18 GPs from all 4 health regions of Norway in 2022. The material was subjected to Braun and Clarke’s thematic analysis.

Results: The analysis yielded six themes: (1) the design of novel effective clinical pathways: remote consultations empower GPs to tailor new effective clinical trajectories, blending modalities to address diverse needs across clinical episodes—from initial triage, through investigations to case closure; (2) increased workday flexibility: remote consultations introduce variability into daily work, allowing GPs to adjust patient contact intensity, and leading to a less stressful work-home balance; (3) erosion of organizational boundaries: easy remote access to GPs appears to reduce patients’ tolerance for minor illness and self-care, hindering effective gatekeeping and shifting GPs’ focus from proactive to more reactive work, increasing work-related stress; (4) degradation of clinical shrewdness: confronted with an increasing amount of unsorted and trivial remote inquiries, GPs observe challenges in detecting and prioritizing serious cases; (5) dilemmas related to responsibility, ethics, and legislation: remote consultations highlight a tension for contract GPs between legal responsibilities and ethical obligations, with implications for patients with limited health literacy; this may entail suboptimal evaluation or delayed treatment—potentially contributing to increased health care inequity; and (6) retaining clinical core values in a changing world. Overall, GPs affirm that remote consultations have come to stay and describe efforts to effectively manage the advantages and disadvantages inherent in such interactions to safeguard clinical effectiveness and organizational sustainability of primary health care.

Conclusions: The widespread adoption of remote consultations in the Norwegian contract GP scheme fundamentally reshapes the dynamics of GP work and the overall health care system. Awareness and proactive management of these changes are essential for maintaining sustainable, high-quality primary health care.

JMIR Form Res 2024;8:e63068

doi:10.2196/63068

Keywords



The COVID-19 pandemic catalyzed a rapid digital shift in the way consultations are provided to patients in general practice around the world [1-4]. The conventional practice of physically visiting a general practitioner (GP) has undergone transformations with the advent of remote modalities, including video, text-based, and telephone consultations [5-10] (Textbox 1).

Textbox 1. Facts about remote consultations and the contract general practitioner scheme in Norway.

Remote consultations

This study examines 3 types of remote consultations—video, telephone, and text-based. Video and telephone consultations are real-time and synchronous, conducted through phones, tablets, or computers. In contrast, text-based consultations are asynchronous, written exchanges between the patient and doctor. Typically, text consultations start as the patient submits a free-text request, sometimes accompanied by a predefined questionnaire.

During the COVID-19 lockdown in Norway, remote consultations surged, accounting for nearly two-thirds of all general practitioner (GP) consultations. As of 2024, they have stabilized at 20%-25% of all consultations [11]. Video consultations, however, remain relatively uncommon [12], while telephone and text consultations continue to be widely used, partly explainable by the reimbursement system [13]. Video consultation technology is increasingly integrated with patient record systems [13]. Use of remote consultations is not mandatory for GPs; each GP decides whether to offer text, video, or telephone consultations, and a small percentage opt out of 1 or more of these options.

In Norway, 80% of patients use a national digital health portal, Helsenorge, for booking appointments, prescription renewals, and text consultations with the GP [14].

In general, patients choose the consultation method [11]. Telephone and video appointments are often triaged but usually scheduled for the same day. Non-urgent face-to-face consultations usually have a waiting period of 2 days to 3 weeks [11,14]. GPs are required to respond to text consultations within 5 working days, but many respond sooner. As a result, remote consultations generally offer quicker access compared with physical appointments [11].

The Norwegian Contract General Practitioner Scheme

Norway’s health care system is founded on the principles of universal access, decentralization, and continuity of care. Since 2001, all Norwegian citizens have had the option to enroll with a GP or change their enrollment—a choice exercised by 99% of the population [15]. This system is designed to ensure continuity of care, with GPs acting as coordinators of municipal services and gatekeepers to specialized care. Contract GPs typically work in groups of 3-8 doctors, supported by health secretaries and occasional nurses. As of 2024, Norway has 5391 contract GPs, each responsible for a defined patient list, typically consisting about 1000 citizens. GP centers are open from 8 AM to 4 PM on weekdays and GPs often take part in evening and night emergency shifts in their municipality or region [15].

A contract GP in Norway typically manages clinical episodes of care [16] through a sequential approach in multiple steps. This process may include triage, history taking, clinical examination, a period of observation, supplementary tests (like blood tests or imaging), specialist referrals, result review, treatment planning, follow-up, and episode closure.

The income system for contract GPs varies. Approximately 20% are on fixed salaries. The remaining 80% operate on a semiprivate basis under regulated contract agreements [15]. They receive a fixed annual payment per patient to help cover practice expenses. In addition, they are reimbursed per consultation, with extra fees for specific procedures such as electrocardiogram tests, minor surgeries, and talking therapy. GPs also charge out-of-pocket fees from patients, typically around 230 NOK (US $21) per consultation (whether physical, text, telephone, or video) up to an annual cap of 3165 NOK (US $286) per citizen (for essential medical expenses), and costs beyond this cap are generally covered [17].

In addition to the well-established public GP scheme, a few fully private providers offer medical services at the patient’s expense. This includes private digital health companies that offer consultations exclusively through video or text. While private health insurance in Norway remains limited, it is gradually expanding. Due to the well-reputed contract-GP system and a long-standing GP shortage, GPs generally have minimal concern about losing patients to private competitors for purely financial reasons [11,14,15].

This shift brings forth numerous opportunities and challenges in both clinical and organizational realms. Consensus remains elusive regarding the appropriateness of remote consultations for specified reasons for contact [7-9]. Existing research, partly predating the COVID-19 era, points to context-related variations in the suitability of remote consultations [7-9,18,19], for instance, where the consultation in question fits within a clinical episode—understood as a consecutive, thematically related series of clinical contacts [16]. Some studies have highlighted the higher suitability of remote consultations when the patient and presented health issue are known beforehand [5,7,20-22]. In many instances, face-to-face consultations are seen as the preferred option when feasible [22,23].

GPs acknowledge that remote consultations have a multifaceted impact across the various levels of health care [24-26]. The health services can be viewed as an ecological system [27], emphasizing how changes at one level have ripple effects across the entire system. In a systems perspective, remote consultations can be discussed in relation to individual encounters (micro level), local practice organization (meso level), and the overarching health care system and a broader sociocultural context (macro level) [5,22-25].

At the consultation (micro) level, text consultations have been proven effective for several purposes such as simple inquiries, elucidating diagnostic workup plans and test results, monitoring of chronic conditions over time, and extending sick leave [18,19,28-33]. During the pandemic, GPs documented the appropriateness and safety of telephone and video consultations for triage in acute and subacute settings [34-40], with subsequent findings supporting their suitability for follow-up on chronic issues and administrative purposes [5,41,42]. Attempts to analyze relationship building in remote consultations have yielded mixed results [6-10]. Uncritical adoption of remote consultations may compromise clinical observations and cause patients to withhold crucial information from their doctors [20,21,43,44]. This could result in missing vital details and, consequently, less precise diagnoses [7,10,44,45].

At the practice organization (meso) level, the digital shift has been shown to increase the workload for both GPs and auxiliary personnel, extending working hours and generating a higher volume of requests [1,24,25], thereby heightening stress levels and limiting opportunities for teaching clinicians [9,10,24]. However, GP offices also experience greater flexibility in how patients can contact their physician, and, in some instances, there is reduced triage work for support staff [5-7,20] and generally improved efficiency [1].

At the wider system (macro) level, recent research has explored potential challenges of remote consultations on health care system dynamics, including overmedicalization and reduced opportunities for addressing social determinants of health [5,21,24,25,46,47]. The heightened accessibility of GPs through remote consultations could reduce the barrier for patient-initiated contact [24,25,44,45], raising concerns about GPs’ time allocation [20] and potentially undermining their pivotal gatekeeping role [24,48]. Uncertainty persists regarding whether remote consultations will result in disparities in access to digital services [48-53].

An essential question is how the use of remote consultations will stabilize in the “new normal” after the COVID-19 pandemic [6-10]. Since implementation was expedited by a natural experiment, understanding the changes that have occurred becomes imperative [1-4]. Unforeseen changes may have transpired [18,19,37,54]. Gaining more knowledge about the potentials and pitfalls associated with the use of remote consultations in various clinical and organizational contexts is vital.

This study is part of a larger project aimed at investigating the ramifications of remote consultations [55]. In an associated paper, we will explore the microlevel dynamics of doctor-patient communication in remote consultation. The objective of this paper is to explore how remote consultations impact on GPs’ practices (meso level) and what implications the GPs see for the health care system (macro level). Our exploration focuses on GPs’ overall experiences with remote consultations. All 3 remote modalities were discussed (Textbox 1). We did not aim to specifically disentangle the discussion into individual modalities, rather the aim of this study was to address the new practice normal in the wake of the digital shift.


Overview

We conducted a qualitative focus group study involving 18 Norwegian contract GPs. Focus groups were chosen as a suitable method for examining attitudes, experiences, and areas where existing knowledge is limited, allowing for the exploration of tentative and potentially conflicting viewpoints [56-60]. We strived to follow the Standards for Reporting Qualitative Research (consolidated criteria for reporting qualitative research [COREQ]) guidelines, refer to the checklist in Table S1 in Multimedia Appendix 1.

Our research team included 2 contract GPs (BLN and BA) with experience in remote consultations, a former GP who is now a full-time professor in behavioral sciences in medicine (LOG), and 2 digital health researchers (PZ and EK) with a background in engineering and economics, respectively. LOG and BA are senior members of a GP research unit, bringing an academic perspective on general practice, particularly in areas such as continuity of care, patient-centered communication, and relational trust. BLN also has experience as a lecturer in clinical communication for medical students.

Recruitment Procedures

For the focus group discussions, we used purposive sampling to recruit experienced contract GPs who were familiar with remote consultations. Potential participants were contacted through phone and email, targeting a diverse range of geographical locations, including both urban and rural municipalities. We also aimed to represent different income models within the contract GP scheme, including fixed salary, subsidized positions, and capitation-based (paid per capita) systems.

Participants were drawn from two sources—3 focus groups were composed of GPs from preexisting postgraduate educational groups, while the other 2 consisted of individually recruited GPs. All but one of the GPs approached agreed to participate. While some participants had previous professional connections with members of the research team, there were no personal relationships that could compromise the integrity of the data. The inclusion of preexisting educational groups, where participants had established relational trust and experience in discussing complex professional matters, was viewed as a positive factor that facilitated open dialogue.

Initially, we planned to conduct 4 focus groups. However, after preliminary analysis of the first 4 sessions, a fifth group was added to enhance information power [57-60]. Following the initial contact, participants were provided with written information detailing the study’s purpose, data management practices, and withdrawal procedures (“Appendix S2” Multimedia Appendix 1). No participants were excluded or chose to withdraw from the study.

A summary of participant characteristics is presented in Table S2 in Multimedia Appendix 1.

Data Collection

The focus group interviews were conducted between January 15 and April 20, 2022, that is, after the lifting of all pandemic-related restrictions in the Norwegian health care sector. In total, 3 sessions were held in person at local medical centers, while 2 were conducted remotely through the Microsoft Teams platform, facilitating the participation of GPs from rural areas and various other regions of Norway. All interviews were conducted in Norwegian.

Before each recorded session, participants were reminded of the voluntary nature of their involvement and provided informed consent (Appendix S2 in Multimedia Appendix 1). They were instructed to ensure the anonymization of any patient-related information discussed during the sessions. In addition, participants submitted deidentified demographic information about themselves and their practices.

Moderators BLN and BA led the interviews using a semistructured interview guide, collaboratively developed by BLN, BA, and LOG. The guide incorporated open-ended, flexible questions (“Appendix 1” in Multimedia Appendix 1) and was informed by the research team’s previous work on remote consultations [4,20], which provided a solid foundation of physician insights that shaped the thematic focus. The guide was pilot-tested with 2 GPs and 2 nonmedical PhD students with experience in qualitative research.

Each focus group session lasted between 95 and 120 minutes, was audio-recorded, and subsequently transcribed verbatim. Participants received a reimbursement of approximately 1000 NOK (US $90), reflecting about half the typical rate for 2 hours of clinical consultation work.

Data Analysis

Reflexive thematic analysis, as outlined by Braun and Clarke [56-58], was used to identify patterns of meaning across the data. The initial stages of analysis were conducted independently by LOG and BLN, with LOG performing manual coding and BLN using NVivo software (Lumivero) for digital processing. Throughout the process, BLN and LOG compared and discussed their findings, followed by collaborative sessions with BA. Relatively early in the analytic process, it was decided to include a fifth focus group to strengthen the information power, particularly regarding a perceived lack of emotional exchange during remote consultations.

The primary analytic approach was inductive, derived directly from the data, though it was inevitably shaped by the researchers’ professional backgrounds. Preliminary themes and potential candidates for final themes were shared with the entire research team and reviewed with input from 2 external project collaborators (refer to the Acknowledgments section). At this stage, significant revisions were made to the thematic framework. In the final phases of analysis and manuscript preparation, regular discussions among all authors helped to challenge individual understandings and assumptions, thereby strengthening the validity and relevance of our work.

Ethical Considerations

All participants provided written informed consent before their involvement in the study. As the research was conducted with health care professionals and did not involve patients or the handling of sensitive health information, it did not fall under the purview of requiring approval from the Regional Committees for Medical and Health Research Ethics, in accordance with the Norwegian Act on Medical and Health Research §2 and §4. The data management procedures received approval from the Norwegian Center for Research Data (NSD/SIKT; reference 531672). Interview data were securely stored and managed in compliance with national and institutional data protection regulations. Throughout the transcription and publication processes, personal and demographic details were anonymized to prevent the indirect identification of participating GPs.


Overview

In all focus groups, GPs noted that remote consultations had led them to adopt new organizational methods in their daily clinical routines (ie, at meso- and macro-organizational levels) compared with prepandemic times, indicating a permanent shift. There was general agreement that remote consultations entail both promising potentials and pitfalls, and that we are still early in defining their optimal use. Our analysis of the impact of remote consultations in contract GP practices resulted in 6 themes.

Design of Novel Effective Clinical Pathways

A central topic was how remote consultations facilitate the design of effective clinical pathways, referring to a sequence of contacts unfolding over time throughout an episode of care (as described in Textbox 1). All GPs experienced that access to remote consultations broadens the range of options for deliberate cultivation of this well-proven approach: taking each step as needed and adjusting if necessary—a hallmark of good general practice, based on unrestricted access and continuity of care.

I find that the balance and adaptability between in-person consultations and electronic communication methods, such as phone calls and other digital platforms, work seamlessly for my needs.
[ID7]

Diverse ways of designing clinical trajectories were discussed in the focus groups. There was general agreement that the new remote modalities, including video and attachment of photos to text consultations, improve triage of severity across distances in acute or semiacute cases. GPs in rural areas were particularly satisfied with this advance and felt that considerable travel time and resources were saved. In this context, several respondents specifically mentioned the possibility of visually evaluating a feverish child’s overall condition and responsiveness, enhancing the GP’s ability to give targeted advice and safely prioritize.

In relation to nonacute matters where several contacts are often involved, the GPs’ opinions differed regarding “optimal” trajectory design. Some GPs preferred to start by a “remote first” consultation, simply to get a brief overview.

You can unlock the potential remotely and then schedule subsequent consultations, often physical ones requiring physical examinations or blood tests, in advance of new remote sessions.
[ID2]

Some GPs discussed what we in the analytic phase came to designate an “early, effortless commencement” phenomenon. Well-selected, suitable, and nonacute reasons for contact can be digitally launched rapidly and smoothly, with less total effort than before.

I experienced this as an advantage, because it has become possible to handle things that are not acutely urgent, but which must be dealt with earlier than the first available regular consultation appointment.
[ID5]

In contrast to this, other GPs clearly preferred a “physical first” consultation, with the potential for remote follow-up, if needed. GPs who preferred the “physical first” approach reflected further on the advantages of getting a comprehensive “feeling” for the case before advancing further. They argued that this will reduce the risk of missing relevant contextual or complicating factors and thereby increase effectiveness in a longer perspective.

I like to start with a physical consultation to sense the non-verbal clues and include the wider context.
[ID16]

Before the digital shift in 2020 which introduced both new remote modalities and reimbursement of remote consultations, most GPs had been accustomed to losing contact with their patients when they underwent treatment organized by other carers or institutions. Examples include patients who undergo chemotherapy for cancer or a rehabilitation program after a severe disease or accident. Such periods typically entail critical periods with a substantial risk of frustrations, complications, and back-lashes for the patient. Many GPs described how remote consultations had given possibilities to apply their knowledge of their patients as persons to follow up and encourage in such instances. A related gain with remote consultations was described as maintaining continuity of care and offering advice to patients despite temporary geographical separation for other reasons, for example, retired patients on long-term holiday and young people with established medical conditions who move away to study.

Another finding related to the design of effective clinical pathways can be referred to as “just-in-time consultations.” The GPs themselves did not explicitly use this term, but the phenomenon was described in several instances. It refers to how remote consultations facilitate contact with vulnerable or unstable patients with limited stress tolerance and recurrent risk of mental collapse—by one GP contract metaphorically referred to as my “house of cards-patients.” For these patients, a lot is at stake. High accessibility and short, remote consultations can sometimes counteract a downward spiral of anxiety and suffering, reducing the risk of emergency calls and even acute hospital admissions.

Low-threshold video consultations work well for such patients: We make an agreement allowing them to contact me via video, even if we do not have an appointment. When I notice they have made contact, I call them back.
[ID17]

Increased Practice Flexibility

GPs in all groups agreed that variation during the day is important for work-related well-being. They described different aspects of this variation. For a start, regarding reasons for contact and levels of clinical complexity, a mixture of “simple” and “heavy” issues can be optimal.

I have numerous 30-minute physical consultations delving into psychiatric matters extensively. This can become quite burdensome at times. However, since they receive weekly follow-ups, strategically incorporating simpler topics in between on remote sessions, proves to be perfectly manageable.
[ID7]

In addition to this, GPs described how remote consultations give opportunities to vary and regulate the mental and emotional intensity of contact during the working day.

When I put on a headset and engage in phone calls, I find myself walking around the room, listening intently, stretching, and occasionally gazing out onto the pedestrian street below. For me, these phone calls serve as a brief respite in my day-to-day routine. The patients appreciate this approach, and I personally find it to be an enriching aspect of my daily routines.
[ID9]

Interestingly, the GPs held differing experiences regarding the degree of mental and emotional investment associated with different types of remote consultations. Some described contact on video as a significant relief in contrast to physical encounters, while some found video just as demanding.

Another reported advantage was related to safeguarding the GPs’ professional integrity in encounters with highly demanding patients, who repeatedly attempt to push the doctor’s limits. GPs felt able to make professionally solid but unpopular decisions and end discussions more effectively, with the use of remote consultations. In some instances, it could even be a question of personal safety for the GP.

I recently had a remote consultation that I was relieved was not in person. The patient showed aggressive behavior and, in the end, despite his demands for medication, I concluded that it was not appropriate. His reaction was quite intense, leaving me grateful for the distance provided by the remote setting.
[ID1]

A final, welcomed aspect of flexibility associated with remote consultations was improved work-from-home possibilities. The stress of having to finish the working day before the closure of the kindergarten can be diminished as most GPs have established an additional, digital working station at home.

Erosion of Organizational Boundaries

GPs in all focus groups described how remote consultations had come to affect the entire “ecology” of their clinical practices. Overall, patient inquiries have become more frequent, and more often than before with limited medical relevance. Referring to the seminal paper “Ecology of medical care” by White et al [27], known through undergraduate or postgraduate education to numerous Norwegian GPs, participants described how patients’ ability to self-care seems to be on the decrease.

I am concerned about the trend towards overuse and medicalization where an increasing number of all patients being aware of one or another symptom, who previously might have sought advice from friends or family, now choose to contact their doctor instead of adopting a wait-and-see approach.
[ID18]

It appears as if the traditional “wait and see” phase between symptom debut and health contact is often abandoned.

…many symptoms currently presented to the GP are self-limiting and would have resolved themselves before ever necessitating a consultation with the doctor in a pre-digital era.
[ID5]

Upon further discussion in the groups, it became clear that the feeling of being overflowed by banalities pertained particularly to text-based consultations, which bypass conventional appointment triage, previously performed by health secretaries. This has clear consequences for the GP’s professional roles and responsibilities.

It is particularly noteworthy with these text-based e-consultations; they bypass any secretarial screening or triage process and land directly in my inbox. Only I see them. It is remarkable that as an individual, you have a direct line to a named person within the public healthcare system. One can only speculate on the outcomes if similar direct access were available in other sectors of the welfare system.
[ID5]

Feeling that even more of their daily work becomes dominated by issues of minor medical relevance, GPs noted that their position as essential, qualified professional actors in the health care frontline is under siege.

We GPs become limitless and must answer absolutely everything. It deprives people of the ability to take care of themselves, for things that they should not bother the health services for.
[ID8]

Once unfiltered requests reach the GP’s desk, it becomes a challenge to close cases, even seemingly trivial ones. GPs feel obliged to provide some sort of safety net, as remote consultations entail an increasing risk of missing critical issues that would most likely have caught the GP’s attention in a physical meeting. The threshold for follow-up decreases, even in trivial cases.

We automatically schedule patients for an appointment to discuss these results.
[ID2]

Although participants noted that remote consultations can make it easier for a GP to reject what they see as unwarranted requests as noted above, a different phenomenon was reported when it came to decision-making in “gray-zone areas” entailing uncertainty. Clinical judgment can definitely be harder to apply when you are not in the same room as the patient, and the GP might tend to “give in” due to unavoidable uncertainty. This could for instance be the case for drug prescriptions and sick-leave certificates.

I am concerned that the digital shift contributes to increased medicalization because it lowers the threshold for contacting the GP. Consequently, as a GP, one might not give as much thought before suggesting medication.
[ID18]

A particularly challenging phenomenon related to text consultations was eagerly discussed, referring to what a GP metaphorically called “the undetonated inbox.” As text consultations enter Norwegian GPs’ inboxes without any screening or triage, they may include serious and acute problems, although the electronic submission system informs patients that text consultations are not for urgent matters.

I have encountered patients reporting chest pain via text consultations, necessitating urgent admission to the hospital’s emergency room.
[ID 11]

Many GPs agreed that the unpredictability associated with the inbox has come to represent a new kind of work stress. One coping mechanism involves prioritizing control over the inbox above other pertinent tasks, not only during the workday but also extending into personal time, which can disrupt the work-home balance.

This has been the worst part of text consultations: If I do not check the inbox and come to work on Monday morning, there might be 120 messages in the inbox [including reports and prescriptions].
[ID13]

Before the rapid digitalization in 2020, GPs were used to having some time and space to reflect on recent consultations and plan future activities proactively. After the implementation of text consultations, several GPs noted that their practice style had become reactive and restrained.

Discussing “the undetonated inbox” phenomenon and the urge to monitor the inbox, some GPs shared advice to take more control.

To cope with this abundance of remote consultations [not seen by health secretaries] … I mostly wait a couple of days. At least with those who “need” something of minor medical importance quickly. This is an important thing for creating sustainability if you are going to become accustomed to utilizing it.
[ID12]

Degradation Of Clinical Shrewdness

Associated with eroded organizational and professional boundaries, several GPs discussed a risk that they might gradually become less shrewd in their demanding role as generalist clinicians in the frontline of the health care system. In a stream of unsorted and increasingly trivial problems, their capacity to maintain focus and perform the core task of spotting serious health problems and prioritizing the right patients for further investigation and potential referral might become blunted.

I believe that as more people reach out to us, the more serious cases of illness may become diluted, resulting in fewer noticeable instances, and we might miss detecting issues when they eventually arise.
[ID18]

Remote consultations entail less informative encounters and, over time, more superficial relationships, the GPs explain. To function optimally, a GP needs a minimum of physical encounters with a person to be able to develop an “intuitive” ability to distinguish whether a next, vague, problem is trivial or indicative of something serious. Present in the same room, the doctor will have learned to appreciate the patient’s usual appearance and habitus as a baseline for future evaluations.

[Based on physical encounters] I have utilized it to develop an intuition, a gut feeling, over time. It is as if I have become a bloodhound for illness: I can ‘sense’ cancer. And as a result, I also find myself ‘sensing’ illness while conversing with patients over the phone and during video calls.
[ID13]

The dilemmas related to the maturation of clinical competence-building are also, according to the participants, relevant for the training of new GPs:

If clinical newcomers dive directly into the digital world; are doctors losing the ability to detect cancer remotely?
[ID14]

Dilemmas Related to Responsibility, Ethics, and Legislation

Participants in all focus groups explored the boundary between formal directives and requirements on the one side and their personal sense of moral obligation on the other. The GPs felt that optimal quality of care is not ensured as long as patients remain free to select consultation type (text, telephone, or video consultation) by themselves.

...it is not necessarily the patients who should decide what needs to be done to investigate this properly. I have thought a lot about it, especially regarding these text-based consultations. It is imperative to stress that certain needs cannot be adequately met remotely and may require in-person attention for optimal outcomes.
[ID5]

Although citizens in general carry responsibility for contacting the health care system in a reasonable manner, the GPs feel personal responsibility for their listed patients. By directive, a Norwegian GP is obliged to respond to text consultations within 5 working days. But as previously noted, many of them feel drawn toward their inbox to prevent delays in urgent situations. Aware that several of their listed patients have limited health literacy, the GPs fear “user errors.” A feeling of moral duty to act may arise, even while being away from work.

Then the patient began sending text consultations expressing suicidal thoughts, and at that moment, I was not physically present. It was deeply concerning, prompting me to involve the entire medical center and dispatch the police to check on his well-being at his residence.
[ID13]

There was general concern among GPs that access to new digital services is likely to favor the digitally competent, leaving patients who require physical consultations behind on the priority list. Several participants associated the digital shift with the “Inverse Care Law” [51, 52] phenomenon, wondering who in society will benefit and who might be left behind in the digital future.

Initially, the respondents discussed that remote consultations will be more used by the young and healthiest who presumably are most digitally competent. However, further out in the discussions, the viewpoints became more nuanced. What one GP formulated as a future “digital care law” will not necessarily in general impede access for people with low education or socioeconomic status. According to many of the GPs’ experiences, most people from deprived social backgrounds have sufficient digital equipment and competence to book and perform remote consultations, and some even tend to do so frequently. What social deprivation entails, in this perspective, is a shortage of resourceful relational networks and practical health literacy. This contributes to limited ability to self-care and an inclination to access the health care system in an impulsive and inefficient manner. Although such patients may prefer simplified remote consultations, this preference may compromise long-term care quality.

The schedule is heavily burdened by tasks that don’t add value or patient care. How do we prioritize our time as a GP? [...] These patients steal a lot of my time...
[ID14]

Concurrently, as a consequence, GPs fear their attention may be diverted from proactive initiatives and essential care for patients with genuine health care needs and low digital proficiency—often stemming from cognitive issues, old age, language barriers, or other factors.

Retaining Clinical Core Values in a Changing World

This final theme emerged late in our analytical process. As depicted in Figure 1, we assign it a central, unifying position. All focus groups debated how remote consultations, for better or for worse, impact on the “new normal” state of general practice in overly complex ways. As said, they compared it with an ecosystem, where introduction of change in one arena (eg, the introduction of text consultations) appears to induce a range of consequences; direct and indirect, intended and nonintended, positive and negative. Ultimately, these changes are likely to affect care quality and patient safety, GPs’ time prioritizations, working style and well-being, job or home interface, and citizens’ access to equitable, high-quality health care. None of the focus groups came close to unequivocal conclusions regarding the overall impact. All groups, however, reached a consensus that there is no realistic or even desirable alternative to providing digital care in the context of the contract GP scheme.

Figure 1. Main themes. GP: general practitioner.
If we do not do remote consultations, we will lose “the gold” in the contract GP scheme.
[ID15]

All groups, at some point, referred to the well-known metaphor among Norwegian contract GPs, namely “the gold of general practice.” Continuity of care is a central feature of this treasure. The GPs noted how consultations for relatively minor problems can contribute meaningfully to the establishment of a well-functioning doctor-patient relationship, as the doctor gets to know each individual patient’s general health status and ways of dealing with problems and challenges. In this context, the interviewed GPs expressed concern about being outmaneuvered by private health care providers operating outside the GP contract scheme, who claim to “ease the burden” on the system by managing the simplest cases on a large scale. The contract GPs hardly saw this as a threat to their personal business income (refer to explanation in Textbox 1). Rather, they viewed such all-private competitors as a threat to care quality, especially for inexperienced or mentally vulnerable patients in need of a stable and trustworthy contact and coordinator in the health care system. To avoid losing patients, the contract GPs discussed how they made compromises. Feeling obligated to meet societal and patient expectations, they sometimes gave in to “please the customer,” even if it meant conducting more remote consultations than they found clinically optimal.

We might gradually cede ground to alternative healthcare providers. I believe this would be unfortunate because, in terms of the quality of remote consultations, they heavily rely on the familiarity established through our longstanding patient-provider relationship, which is fundamental in our contract GP scheme.
[ID11]

Throughout the discussions, it was evident how the GPs were concerned with establishing “a new normal” with good equilibrium between physical and remote consultations. Facing this challenge, the GPs appeared open-minded and proactive, combining interest and optimism with high demands for critical reflection. The question is not whether, but how, to optimally implement remote consultations.

I'm adapting to my new way of working... What I find most challenging about remote communication methods is the multitude of possibilities they present, which I am determined not to overlook. On the contrary, I thoroughly enjoy engaging in them...
[ID12]

Principal Findings

This qualitative focus group study provides insights into how remote consultations impact on contracted GP practices in Norway and how GPs perceive the implications of this uptake for the overall health care system and the core values of the discipline. On the positive side, remote consultations empower GPs to tailor effective clinical trajectories, seamlessly blending modalities to address diverse needs across clinical episodes—from initial triage to case closure. Remote consultations also introduce a welcome variability in daily routines. However, ease of access may unintentionally reduce patients’ tolerance for minor ailments and self-care. It may also compromise GPs’ ability to effectively detect and prioritize illness cases in genuine need of professional evaluation, that is, impede effective gatekeeping and equitable delivery of health care. Dilemmas arising at the intersection between GPs’ formally regulated responsibilities and self-perceived ethical obligations in the context of remote consultations contribute to increased work stress.

Comparison With Previous Work

Reflecting on the Findings in Light of Existing Literature

Our study’s results align with Greenhalgh and colleagues’ [5] micro, meso, and macro-level analysis of remote consultations. These levels help us observe, assess, and explore new aspects within this framework.

Optimizing Episodes of Health Care by Integrating Remote Consultations

While many previous studies have addressed remote consultations as triage tools [36,38,39] or isolated communicative events [6-10,24], our study underscores the importance of optimizing their use according to their specific roles and functions within a clinical trajectory (at a meso level)—in line with World Health Organization’s recommendations [61]. Departing from the “episode” concept which describes a series of linked clinical contacts [16], we document how a contemporary episode can play out on diverse platforms, leveraging the unique strengths and weaknesses of different consultation modalities. Previous literature on the role of remote consultations in clinical pathway design is limited. A study from secondary health services emphasizes a general potential for efficiency [62], and another discusses the role of the GP and the operationalization of email consultations [28]. We provide in this study novel perspectives on medical trajectory design, in the context of the contract GP scheme, with increasing awareness among GPs when and how remote consultations should be used. Our findings point to some specific potentials for improved GP-patient proximity and continuity of care. We note how remote consultations facilitate what we call the “effortless commencement phenomenon” for semiacute cases and “just-in-time consultations” with unstable patients in addition to the more self-evident gain of maintaining contact despite geographical distance. We believe that such aspects—pertaining to continuity of care, clinical problem-solving, and GP-patient relationships—deserve further exploration [44]. GPs and patients across different countries may benefit from guidance from authorities regarding the desirable use of remote consultations.

An interesting finding in our study pertains to ergonomic advantages. It shows how GPs can benefit from strategic alternation between different consultation modalities during the workday based on their personal assessment of each modality’s intensity and requirements, combined with individual patient characteristics. Our findings are supported by previous studies that have concentrated on alleviating daily pressures [24,25]. However, the new-found flexibility also has its downsides at the level of work-related health. While facilitating working from home, when necessary, it may also intrude on doctors’ ability to relax and recover.

The Strained Gatekeeper

A fundamentally important question related to the overall impact of remote consultations pertains to quality. From previous research, it is well-documented that increased workload correlates with reduced self-care among GPs [6,24,63,64], including cognitive effects. This pressure may compromise the GP gatekeeper function [65,66], potentially increasing the burden on secondary health services [65]. In the context of assessment quality, there is ongoing debate about whether remote consultations serve as substitutes for, complements to, or precede traditional in-person consultations [22,24,34]. Our findings suggest that the rise in digital care, particularly text consultations, appears to reduce patients’ tendency to wait before seeking medical attention. In addition, text consultations seem to be carried out increasingly in addition to in-person consultations. Here there is room for more in-depth exploration.

All the focus groups delved further on the perceived decline in self-care capability among patients and a decreased threshold for seeking medical attention. Consistent with Barsky’s [64] assertions in the seminal 1988 paper “The paradox of health,” the participants of our study thought the digital transition in the middle of a pandemic had accelerated a societal trend toward heightened awareness of bodily symptoms and alarm regarding illness. Limited research explores how increased contacts and decreased disease incidence impact GPs’ judgment and gatekeeping quality. However, some studies suggest the deterioration of clinical skills as a result of reduced hands-on experience [5,34,54,63]. Our findings highlight challenges in identifying serious illnesses from sequences of digital inquiries evaluated under time pressure. Clinical reasoning and responsible risk management are context-dependent [67,68], and remote consulting as such has been shown to increase cognitive demands [69]. So-called clinical intuition (“gut feeling”) can be valuable in diagnostics [70]. Our findings align with previous research on the fallacies of clinical interpretations as a consequence of changed expectations [71,72]. Deliberate training and optimal working conditions appear important to combat clinical bluntness and safeguard quality.

The Digital Care Law Revisited

As already noted, previous studies on remote consultations have evoked Hart’s seminal paper “The Inverse Care Law” from 1971 [51], extending it to a “Digital Inverse Care Law” [52,73]. Existing research primarily concentrates on digital exclusion [74,75]; however, a recent paper by Dakin and colleagues [76] explores the phenomenon of patients creating insufficient digital presentations: These may lead to misdirection or deprioritization in remote consultation triage. Thereby, Dakin’s paper validates our finding that in relatively affluent societies where most people are literate and have access to digital tools, more subtle processes than simple digital exclusion should be anticipated in relation to inequities in digital access to quality care. From this macro viewpoint, our GPs expressed apprehension that social deprivation associated with low health literacy could lead to uncritical use of remote consultations, resulting in frequent health care contacts, albeit with suboptimal quality. Concomitantly and indirectly, other patients’ access to care is hampered. Faced with a flow of incoming requests, the GP’s attention may furthermore be diverted away from proactive care for patients with significant medical needs who hesitate or struggle to access the system [1,6,63]. Together, these dilemmas add to an emerging list of potentially overlooked ethical dimensions associated with remote consultations [26].

Although our study did not specifically aim to decipher the pros and cons of different consultation modalities, it highlights important context-dependent phenomena, for instance how text consultations allow patients direct access to their GPs without triage, in contrast to the booking systems for telephone or video consultations. This practice places additional strain on GPs and mirrors issues seen in the early use of telephone consultations [24,37]. The critical role of health secretaries in triage and counseling in primary care is likely underrecognized and inadequately documented [75]. We advocate for a strategic approach to triage of remote consultations to better identify patients most in need of medical attention [77,78].

A striking finding among the interviewed GPs is how they collectively strive to uphold the established core values of general practice [65,79]. Their willingness to engage in more remote consultations extends beyond the point that they deem professionally optimal—aiming to maintain continuity of care. The potential for excessive use must be carefully considered, balancing GPs’ management of clinical uncertainty with their commitment to equitable health services [5,55,78-80]. This is particularly crucial as patients may opt for care from other health care providers lacking continuity. Further ethical dilemmas regarding GPs’ legal responsibilities and ethical obligations in remote consultations complicate the situation in the strive for a new health care equilibrium.

Strengths And Limitations

A strength of this study lies in the successful recruitment of experienced GPs with diverse characteristics, including variations in gender, age, remuneration systems, and geographical backgrounds. While 2 of the 5 focus groups were conducted digitally, these sessions still yielded high-quality data, suggesting that the remote format was well-suited for our purpose. Furthermore, we note how our participants’ substantial clinical experience allowed them to decipher and articulate quite clearly the impact of the digital shift on their individual practices. While including GPs earlier in their careers might have introduced a broader range of perspectives on the here-and-now situation, it would not necessarily have increased our study’s information power regarding the impact of the digital shift, as outlined in the literature [81,82].

Third, the study was conducted in the period following the pandemic, after restrictions had been lifted. However, we cannot claim that a fully stable “new normal” has been established. For example, GPs were still receiving full remuneration for telephone consultations, comparable with video and text consultations, which may have influenced their continued use. Despite this, our participants engaged actively with the new modalities (video and text), leading to insightful discussions. Thus, while the situation may not fully represent a long-term norm, the study effectively captures a significant impact of the digital transition on the practice and services of contract GPs.

Finally, although our study is based on a GP contract scheme, we believe our findings have relevance to other health care systems with varying funding models and regulations. As a model for broader application, the study demonstrates how remote consultations can have far-reaching effects on a health care system as a whole. It highlights the necessity of closely monitoring these effects, both in terms of clinical services and clinicians’ daily practices. Such monitoring can evidently be strengthened by integrating direct patient or user perspectives.

Conclusion and Directions for the Future

We conclude that the widespread adoption of remote consultations in the Norwegian contract GP scheme is fundamentally reshaping the dynamics of GP work and the overall health care system. Contract GPs in Norway are working to balance the pros and cons of remote consultations, aiming to integrate them smoothly and designing novel medical trajectories. While remote consultations offer flexibility in daily routines, they may inadvertently reduce patients’ tolerance for minor ailments and self-care, potentially affecting GPs’ ability to prioritize serious cases. The consultation modality should be selected on the basis of perceived medical need and capacity rather than direct patient demand. Awareness and proactive management of the changes of digitalization are essential for maintaining sustainable, high-quality primary health care in accordance with the discipline’s core values. The main conclusion is that continuity in the doctor-patient relationship enhances the effectiveness of remote consultations and supports their broader integration into general practice.

Acknowledgments

We want to thank professors Chris Salisbury and Helen Atherton for important advice in the analysis and writing process.

The paper is part of a PhD project funded by Research Council of Norway (315404). Norberg also holds a part-time position at the Norwegian Centre for e-Health Research in Tromsø. The title of the umbrella project is “The large-scale implementation of e-consultations with the GP: a mixed-methods evaluation of the impact on health system, GPs and patients” [55].

Data Availability

The datasets generated and analyzed in this study are securely housed within approved NTNU Faculty repositories. Although they are not publicly accessible, requests for access to anonymized data will be considered on a case-by-case basis. The limitations on public data sharing are in accordance with Norwegian legislation governing data protection and privacy.

Authors' Contributions

All authors were involved in the design of the study. BLN developed the interview guide together with BA and LOG. BLN and BA moderated the focus groups interviews. BLN and LOG developed initial themes, gradually involving BA. PZ and EK contributed substantially to data analysis, interpretation of results, and writing. BLN wrote the first draft of the manuscript, while BA and LOG contributed to all phases of the writing process. All authors contributed actively to the later stages of the writing process and have accepted the final manuscript. ChatGPT was in some instances consulted to enhance linguistic or grammatical clarity but was in no instance used to generate original text.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Supplementary Material 1: Interview guide Supplementary Material 2: Information and consent scheme / Application for privacy and anonymity Table S1. Consolidated criteria for reporting qualitative studies (COREQ): 32-item checklist Table S2. Characteristics of participating GPs. Thick lines separate the five different focus groups.

DOCX File , 50 KB

  1. Royal College of General Practitioners. General Practice in the Post-COVID World: Challenges and Opportunities for General Practice. URL: https:/​/cached.​offlinehbpl.hbpl.co.uk/​NewsAttachments/​PGH/​General-Practice-post-Covid-RCGP.​pdf?utm_source=The%20King%27s%20Fund%20newsletters%20 [accessed 2024-09-06]
  2. James HM, Papoutsi C, Wherton J, Greenhalgh T, Shaw SE. Spread, scale-up, and sustainability of video consulting in health care: systematic review and synthesis Guided by the NASSS Framework. J Med Internet Res. 2021;23(1):e23775. [FREE Full text] [CrossRef] [Medline]
  3. Murphy M, Scott LJ, Salisbury C, Turner A, Scott A, Denholm R, et al. Implementation of remote consulting in UK primary care following the COVID-19 pandemic: a mixed-methods longitudinal study. Br J Gen Pract. 2021;71(704):e166-e177. [FREE Full text] [CrossRef] [Medline]
  4. Meurs M, Keuper J, Sankatsing V, Batenburg R, van Tuyl L. "Get Used to the Fact That Some of the Care Is Really Going to Take Place in a Different Way": general Practitioners' Experiences with E-Health during the COVID-19 Pandemic. Int J Environ Res Public Health. 2022;19(9):5120. [FREE Full text] [CrossRef] [Medline]
  5. Greenhalgh T, Shaw S, Wherton J, Vijayaraghavan S, Morris J, Bhattacharya S, et al. Real-world implementation of video outpatient consultations at macro, meso, and micro levels: mixed-method study. J Med Internet Res. 2018;20(4):e150. [FREE Full text] [CrossRef] [Medline]
  6. Hammersley V, Donaghy E, Parker R, McNeilly H, Atherton H, Bikker A, et al. Comparing the content and quality of video, telephone, and face-to-face consultations: a non-randomised, quasi-experimental, exploratory study in UK primary care. Br J Gen Pract. 2019;69(686):e595-e604. [CrossRef]
  7. Johnsen TM, Norberg BL, Kristiansen E, Zanaboni P, Austad B, Krogh FH, et al. Suitability of video consultations during the COVID-19 pandemic lockdown: cross-sectional survey among Norwegian general practitioners. J Med Internet Res. 2021;23(2):e26433. [FREE Full text] [CrossRef] [Medline]
  8. Car J, Koh GC, Foong PS, Wang CJ. Video consultations in primary and specialist care during the covid-19 pandemic and beyond. BMJ. 2020;371:m3945. [CrossRef] [Medline]
  9. Norberg BL, Getz LO, Johnsen TM, Austad B, Zanaboni P. General practitioners' experiences with potentials and pitfalls of video consultations in norway during the COVID-19 lockdown: qualitative analysis of free-text survey answers. J Med Internet Res. 2023;25:e45812. [FREE Full text] [CrossRef] [Medline]
  10. Greenhalgh T, Rosen R. Remote by default general practice: must we, should we, dare we? Br J Gen Pract. 2021;71(705):149-150. [CrossRef]
  11. The Norwegian Directorate of Health. Helsedirektoratet. E-Consultations With GPs. URL: https:/​/www.​helsedirektoratet.no/​statistikk/​statistikk-om-allmennlegetjenester/​e-konsultasjoner-hos-fastleger [accessed 2024-09-06]
  12. Wanderås MR, Abildsnes E, Thygesen E, Martinez SG. Hammering nails with a screwdriver: how GPs perceive video consultations. BJGP Open. 2024:BJGPO.2024.0010. [CrossRef]
  13. Assing Hvidt E, Atherton H, Keuper J, Kristiansen E, Lüchau EC, Lønnebakke Norberg B, et al. Low adoption of video consultations in post-COVID-19 general practice in northern Europe: barriers to use and potential action points. J Med Internet Res. 2023;25:e47173. [FREE Full text] [CrossRef] [Medline]
  14. National Online Health Services in Norway. URL: https://www.helsenorge.no [accessed 2024-09-06]
  15. Tikkanen R, Osborn R, Mossialos E, Djordjevic A, Wharton G. The commonwealth. International Health Care System Profiles - Norway. 2020. URL: https://www.commonwealthfund.org/international-health-policy-center/countries/norway [accessed 2024-09-06]
  16. Lamberts H, Hofmans-Okkes I. Episode of care: a core concept in family practice. J Fam Pract. 1996;42(2):161-167. [Medline]
  17. The Normal Tarif for GPs. URL: https://normaltariffen.legeforeningen.no [accessed 2024-09-06]
  18. Payne R, Clarke A, Swann N, van Dael J, Brenman N, Rosen R, et al. Patient safety in remote primary care encounters: multimethod qualitative study combining safety I and safety II analysis. BMJ Qual Saf. 2024;33(9):573-586. [FREE Full text] [CrossRef] [Medline]
  19. Li E, Tsopra R, Jimenez G, Serafini A, Gusso G, Lingner H, et al. General practitioners' perceptions of using virtual primary care during the COVID-19 pandemic: an international cross-sectional survey study. PLOS Digit Health. 2022;1(5):e0000029. [FREE Full text] [CrossRef] [Medline]
  20. Rosen R, Wieringa S, Greenhalgh T, Leone C, Rybczynska-Bunt S, Hughes G, et al. Clinical risk in remote consultations in general practice: findings from in-COVID-19 pandemic qualitative research. BJGP Open. 2022;6(3):BJGPO.2021.0204. [FREE Full text] [CrossRef] [Medline]
  21. Mughal F, Atherton H, Awan H, Kingstone T, Poppleton A, Silverwood V, et al. The impact of remote consultations on brief conversations in general practice. BJGP Open. 2022;6(2):BJGPO.2021.0199. [CrossRef]
  22. Mold F, Hendy J, Lai YL, de Lusignan S. Electronic consultation in primary care between providers and patients: systematic review. JMIR Med Inform. 2019;7(4):e13042. [CrossRef]
  23. Thiyagarajan A, Grant C, Griffiths F, Atherton H. Exploring patients' and clinicians' experiences of video consultations in primary care: a systematic scoping review. BJGP Open. 2020;4(1):bjgpopen20X101020. [CrossRef]
  24. Salisbury C, Murphy M, Duncan P. The impact of digital-first consultations on workload in general practice: modeling study. J Med Internet Res. 2020;22(6):e18203. [FREE Full text] [CrossRef] [Medline]
  25. Williams S, Barnard A, Collis P, Correia de Sousa J, Ghimire S, Habib M, et al. Remote consultations in primary care across low-, middle- and high-income countries: implications for policy and care delivery. J Health Serv Res Policy. 2023;28(3):181-189. [FREE Full text] [CrossRef] [Medline]
  26. Greenhalgh T, Rosen R, Shaw SE, Byng R, Faulkner S, Finlay T, et al. Planning and evaluating remote consultation services: a new conceptual framework incorporating complexity and practical ethics. Front Digit Health. 2021;3:726095. [FREE Full text] [CrossRef] [Medline]
  27. White KL, Williams TF, Greenberg BG. The ecology of medical care. Bull N Y Acad Med. 1996;73(1):187-205; discussion 206. [FREE Full text] [Medline]
  28. Atherton H, Boylan AM, Eccles A, Fleming J, Goyder CR, Morris RL. Email consultations between patients and doctors in primary care: content analysis. J Med Internet Res. 2020;22(11):e18218. [FREE Full text] [CrossRef] [Medline]
  29. Bakhai M, Atherton H. How to conduct written online consultations with patients in primary care. BMJ. 2021;372:n264. [CrossRef] [Medline]
  30. Mehrotra A, Paone S, Martich GD, Albert SM, Shevchik GJ. Characteristics of patients who seek care via eVisits instead of office visits. Telemed J E Health. 2013;19(7):515-519. [FREE Full text] [CrossRef] [Medline]
  31. Turner A, Morris R, Rakhra D, Stevenson F, McDonagh L, Hamilton F, et al. Unintended consequences of online consultations: a qualitative study in UK primary care. Br J Gen Pract. 2021;72(715):e128-e137. [CrossRef]
  32. Qi M, Cui J, Li X, Han Y. Influence of e-consultation on the intention of first-visit patients to select medical services: results of a scenario survey. J Med Internet Res. 2023;25:e40993. [FREE Full text] [CrossRef] [Medline]
  33. Rzewuska Díaz M, Locock L, Keen A, Melvin M, Myhill A, Ramsay C. Implementation of a web-based outpatient asynchronous consultation service: mixed methods study. J Med Internet Res. 2024;26:e48092. [CrossRef] [Medline]
  34. Greenhalgh T, Vijayaraghavan S, Wherton J, Shaw S, Byrne E, Campbell-Richards D, et al. Virtual online consultations: advantages and limitations (VOCAL) study. BMJ Open. 2016;6(1):e009388. [FREE Full text] [CrossRef] [Medline]
  35. Huibers L, Smits M, Renaud V, Giesen P, Wensing M. Safety of telephone triage in out-of-hours care: a systematic review. Scand J Prim Health Care. 2011;29(4):198-209. [FREE Full text] [CrossRef] [Medline]
  36. Eccles A, Hopper M, Turk A, Atherton H. Patient use of an online triage platform: a mixed-methods retrospective exploration in UK primary care. Br J Gen Pract. 2019;69(682):e336-e344. [CrossRef]
  37. McKinstry B, Watson P, Pinnock H, Heaney D, Sheikh A. Telephone consulting in primary care: a triangulated qualitative study of patients and providers. Br J Gen Pract. 2009;59(563):e209-e218. [CrossRef]
  38. Pope C, McKenna G, Turnbull J, Prichard J, Rogers A. Navigating and making sense of urgent and emergency care processes and provision. Health Expect. 2019;22(3):435-443. [FREE Full text] [CrossRef] [Medline]
  39. Payne RE, Clarke A. How and why are video consultations used in urgent primary care settings in the UK? A focus group study. BJGP Open. 2023;7(3):BJGPO.2023.0025. [CrossRef]
  40. Kleinschmidt L, Walendzik A, Wasem J, Höfer K, Nauendorf B, Brittner M, et al. Preference-based implementation of video consultations in urban and rural regions in outpatient care in Germany: protocol for a mixed methods study. JMIR Res Protoc. 2024;13:e50932. [FREE Full text] [CrossRef] [Medline]
  41. Ladds E, Khan M, Moore L, Kalin A, Greenhalgh T. The impact of remote care approaches on continuity in primary care: a mixed-studies systematic review. Br J Gen Pract. 2023;73(730):e374-e383. [CrossRef]
  42. Donaghy E, Atherton H, Hammersley V, McNeilly H, Bikker A, Robbins L, et al. Acceptability, benefits, and challenges of video consulting: a qualitative study in primary care. Br J Gen Pract. 2019;69(686):e586-e594. [CrossRef]
  43. Verma P, Kerrison R. Patients’ and physicians’ experiences with remote consultations in primary care during the COVID-19 pandemic: a multi-method rapid review of the literature. BJGP Open. 2022;6(2):BJGPO.2021.0192. [CrossRef]
  44. Wherton J, Greenhalgh T, Hughes G, Shaw SE. The role of information infrastructures in scaling up video consultations during COVID-19: mixed methods case study into opportunity, disruption, and exposure. J Med Internet Res. 2022;24(11):e42431. [FREE Full text] [CrossRef] [Medline]
  45. Parker RF, Figures EL, Paddison CA, Matheson JI, Blane DN, Ford JA. Inequalities in general practice remote consultations: a systematic review. BJGP Open. 2021;5(3):BJGPO.2021.0040. [CrossRef]
  46. Neves AL, Li E, Serafini A, Jimenez G, Lingner H, Koskela TH, et al. Evaluating the impact of COVID-19 on the adoption of virtual care in general practice in 20 countries (inSIGHT): protocol and rationale study. JMIR Res Protoc. 2021;10(8):e30099. [FREE Full text] [CrossRef] [Medline]
  47. Darley S, Coulson T, Peek N, Moschogianis S, van der Veer SN, Wong DC, et al. Understanding how the design and implementation of online consultations affect primary care quality: systematic review of evidence with recommendations for designers, providers, and researchers. J Med Internet Res. 2022;24(10):e37436. [FREE Full text] [CrossRef] [Medline]
  48. Norberg BL, Johnsen TM, Kristiansen E, Krogh FH, Getz LO, Austad B. Primary care gatekeeping during the COVID-19 pandemic: a survey of 1234 Norwegian regular GPs. BJGP Open. 2024;8(1):BJGPO.2023.0095. [CrossRef]
  49. Kidholm K, Jensen LK, Johansson M, Montori VM. Telemedicine and the assessment of clinician time: a scoping review. Int J Technol Assess Health Care. 2023;40(1):e3. [CrossRef]
  50. Mann C, Turner A, Salisbury C. Commissioned by the personalized care institute. The Impact of Remote Consultations on Personalized Care Evidence Briefing. 2021. URL: https:/​/arc-w.​nihr.ac.uk/​Wordpress/​wp-content/​uploads/​2021/​08/​Remote-consultation-briefing-website-final.​pdf [accessed 2024-09-06]
  51. Hart JT. The inverse care law. Lancet. 1971;1(7696):405-412. [FREE Full text] [CrossRef] [Medline]
  52. Davies AR, Honeyman M, Gann B. Addressing the digital inverse care law in the time of COVID-19: potential for digital technology to exacerbate or mitigate health inequalities. J Med Internet Res. 2021;23(4):e21726. [FREE Full text] [CrossRef] [Medline]
  53. Kristiansen E, Atherton H, Austad B, Bergmo T, Norberg BL, Zanaboni P. Older patients' experiences of access to and use of e-consultations with the general practitioner in Norway: an interview study. Scand J Prim Health Care. 2023;41(1):33-42. [FREE Full text] [CrossRef] [Medline]
  54. Dixon S, Frost L, Feder G, Ziebland S, Pope C. Challenges of safeguarding via remote consulting during the COVID-19 pandemic: a qualitative interview study. Br J Gen Pract. 2022;72(716):e199-e208. [CrossRef]
  55. with links to publications. Website for the Umbrella Project Funded by the Norwegian Research Council, URL: https:/​/ehealthresearch.​no/​en/​projects/​the-large-scale-implementation-of-e-consultations-with-the-gp-a-mixed-methods-evaluation-of-the-impact-on-health-system-gps-and-patients [accessed 2024-09-06]
  56. Braun V, Clarke V. Thematic Analysis: A Practical Guide. UK. SAGE Publications Ltd; 2021.
  57. Terry G, Hayfield N, Clarke V, Braun V. Thematic Analysis. In: Willig C, Stainton Rogers W, editors. The SAGE Handbook of Qualitative Research in Psychology. London. SAGE Publications Ltd; 2017.
  58. Braun V, Clarke V. Is thematic analysis used well in health psychology? A critical review of published research, with recommendations for quality practice and reporting. Health Psychol Rev. 2023;17(4):695-718. [CrossRef] [Medline]
  59. Kitzinger J. Qualitative research. Introducing focus groups. BMJ. 1995;311(7000):299-302. [FREE Full text] [CrossRef] [Medline]
  60. Hennink M, Kaiser BN. Sample sizes for saturation in qualitative research: a systematic review of empirical tests. Soc Sci Med. 2022;292:114523. [FREE Full text] [CrossRef] [Medline]
  61. Jandoo T. WHO guidance for digital health: what it means for researchers. Digit Health. 2020;6:2055207619898984. [FREE Full text] [CrossRef] [Medline]
  62. Calabrese A, D'Uffizi A, Levialdi Ghiron N, Berloco L, Pourabbas E, Proudlove N. Design and development of a digital diagnostic clinical pathway: evidence from an action research study. EJIM. 2024;27(9):94-126. [CrossRef]
  63. Yee V, Bajaj SS, Stanford FC. Paradox of telemedicine: building or neglecting trust and equity. The Lancet Digital Health. 2022;4(7):e480-e481. [CrossRef]
  64. Barsky AJ. The paradox of health. N Engl J Med. 1988;318(7):414-418. [CrossRef]
  65. Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83(3):457-502. [FREE Full text] [CrossRef] [Medline]
  66. Sandvik H, Hetlevik Ø, Blinkenberg J, Hunskaar S. Continuity in general practice as predictor of mortality, acute hospitalisation, and use of out-of-hours care: a registry-based observational study in Norway. Br J Gen Pract. 2022;72(715):e84-e90. [FREE Full text] [CrossRef] [Medline]
  67. Durning SJ, Artino AR. Situativity theory: a perspective on how participants and the environment can interact: AMEE guide no. 52. Medical Teacher. 2011;33(3):188-199. [CrossRef]
  68. Bates J, Ellaway RH. Mapping the dark matter of context: a conceptual scoping review. Med Educ. 2016;50(8):807-816. [CrossRef] [Medline]
  69. Ambrose L. Remote consulting: recognising the cognitive load. Br J Gen Pract. 2020;70(695):295-295. [CrossRef]
  70. Oliva-Fanlo B, March S, Gadea-Ruiz C, Stolper E, Esteva M. Prospective observational study on the prevalence and diagnostic value of general practitioners' gut feelings for cancer and serious diseases. J Gen Intern Med. 2022;37(15):3823-3831. [FREE Full text] [CrossRef] [Medline]
  71. Houben PH, van der Weijden T, Winkens B, Winkens RA, Grol RP. Pretest expectations strongly influence interpretation of abnormal laboratory results and further management. BMC Fam Pract. 2010;11(1):13. [FREE Full text] [CrossRef] [Medline]
  72. Levari DE, Gilbert DT, Wilson TD, Sievers B, Amodio DM, Wheatley T. Prevalence-induced concept change in human judgment. Science. 2018;360(6396):1465-1467. [CrossRef] [Medline]
  73. Alami H, Lehoux P, Shaw SE, Papoutsi C, Rybczynska-Bunt S, Fortin J. Virtual care and the inverse care law: implications for policy, practice, research, public and patients. Int J Environ Res Public Health. 2022;19(17):10591. [FREE Full text] [CrossRef] [Medline]
  74. Campanozzi LL, Gibelli F, Bailo P, Nittari G, Sirignano A, Ricci G. The role of digital literacy in achieving health equity in the third millennium society: a literature review. Front Public Health. 2023;11:1109323. [FREE Full text] [CrossRef] [Medline]
  75. Rodriguez JA, Shachar C, Bates DW. Digital inclusion as health care — supporting health care equity with digital-infrastructure initiatives. N Engl J Med. 2022;386(12):1101-1103. [CrossRef]
  76. Dakin FH, Rybczynska-Bunt S, Rosen R, Clarke A, Greenhalgh T. Access and triage in contemporary general practice: a novel theory of digital candidacy. Soc Sci Med. 2024;349:116885. [CrossRef] [Medline]
  77. Litchfield I, Burrows M, Gale N, Greenfield S. Understanding the invisible workforce: lessons for general practice from a survey of receptionists. BMC Prim Care. 2022;23(1):230. [FREE Full text] [CrossRef] [Medline]
  78. Enam A, Dreyer HC, De Boer L. Individuals' perceptions as a substitute for guidelines and evidence: interview study among clinicians on how they choose between in-person and remote consultation. JMIR Form Res. 2022;6(5):e35950. [FREE Full text] [CrossRef] [Medline]
  79. Sigurdsson JA, Beich A, Stavdal A. Our core values will endure. Scand J Prim Health Care. 2020;38(4):363-366. [FREE Full text] [CrossRef] [Medline]
  80. Campbell K, Greenfield G, Li E, O'Brien N, Hayhoe B, Beaney T, et al. The impact of virtual consultations on the quality of primary care: systematic review. J Med Internet Res. 2023;25:e48920. [CrossRef] [Medline]
  81. Tenny S, Brannan JM, Brannan GD. Qualitative study. StatPearls [Internet]. Treasure Island (FL). 2024;8(3). [Medline]
  82. Eysenbach G. CONSORT-EHEALTH: improving and standardizing evaluation reports of web-based and mobile health interventions. J Med Internet Res. 2011;13(4):e126. [FREE Full text] [CrossRef] [Medline]


COREQ: consolidated criteria for reporting qualitative research
GP: general practitioner


Edited by A Mavragani; submitted 10.06.24; peer-reviewed by M Mars, A Fosse; comments to author 21.08.24; revised version received 09.09.24; accepted 30.10.24; published 17.12.24.

Copyright

©Børge Lønnebakke Norberg, Bjarne Austad, Eli Kristiansen, Paolo Zanaboni, Linn Okkenhaug Getz. Originally published in JMIR Formative Research (https://formative.jmir.org), 17.12.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.