This paper is in the following e-collection/theme issue:

Development and Evaluation of Research Methods, Instruments and Tools (423) Electronic Health Records (961) Clinical Information and Decision Making (1315) Tools, Programs and Algorithms (237) Clinical Informatics (904) Design and Usability of Clinical Software and EHRs (242)

Published on in Vol 6, No 6 (2022): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/34141, first published .
Finding Primary Care—Repurposing Physician Registration Data to Generate a Regionally Accurate List of Primary Care Clinics: Development and Validation of an Open-Source Algorithm

Finding Primary Care—Repurposing Physician Registration Data to Generate a Regionally Accurate List of Primary Care Clinics: Development and Validation of an Open-Source Algorithm

Finding Primary Care—Repurposing Physician Registration Data to Generate a Regionally Accurate List of Primary Care Clinics: Development and Validation of an Open-Source Algorithm

Authors of this article:

Ian R Cooper1 Author Orcid Image ;   Cameron Lindsay1 Author Orcid Image ;   Keaton Fraser1 Author Orcid Image ;   Tiffany T Hill1 Author Orcid Image ;   Andrew Siu1 Author Orcid Image ;   Sarah Fletcher1 Author Orcid Image ;   Jan Klimas1, 2 Author Orcid Image ;   Michee-Ana Hamilton1 Author Orcid Image ;   Amanda D Frazer1 Author Orcid Image ;   Elka Humphrys1 Author Orcid Image ;   Kira Koepke1 Author Orcid Image ;   Lindsay Hedden3, 4 Author Orcid Image ;   Morgan Price1 Author Orcid Image ;   Rita K McCracken1 Author Orcid Image
Article Authors Cited by (2) Tweetations (27) Metrics

    Original Paper

    1Innovation Support Unit, Department of Family Practice, University of British Columbia, Vancouver, BC, Canada

    2British Columbia Centre on Substance Use, Vancouver, BC, Canada

    3Faculty of Health Sciences, Simon Fraser University, Burnaby, BC, Canada

    4British Columbia Academic Health Sciences Network, Vancouver, BC, Canada

    Corresponding Author:

    Rita K McCracken, MD, PhD

    Innovation Support Unit

    Department of Family Practice

    University of British Columbia

    3rd Floor David Strangway Building

    Vancouver, BC, V6T 1Z3

    Canada

    Phone: 1 604 827 4168

    Email: rita.mccracken@ubc.ca


    Background: Some Canadians have limited access to longitudinal primary care, despite its known advantages for population health. Current initiatives to transform primary care aim to increase access to team-based primary care clinics. However, many regions lack a reliable method to enumerate clinics, limiting estimates of clinical capacity and ongoing access gaps. A region-based complete clinic list is needed to effectively describe clinic characteristics and to compare primary care outcomes at the clinic level.

    Objective: The objective of this study is to show how publicly available data sources, including the provincial physician license registry, can be used to generate a verifiable, region-wide list of primary care clinics in British Columbia, Canada, using a process named the Clinic List Algorithm (CLA).

    Methods: The CLA has 10 steps: (1) collect data sets, (2) develop clinic inclusion and exclusion criteria, (3) process data sets, (4) consolidate data sets, (5) transform from list of physicians to initial list of clinics, (6) add additional metadata, (7) create working lists, (8) verify working lists, (9) consolidate working lists, and (10) adjust processing steps based on learnings.

    Results: The College of Physicians and Surgeons of British Columbia Registry contained 13,726 physicians, at 2915 unique addresses, 6942 (50.58%) of whom were family physicians (FPs) licensed to practice in British Columbia. The CLA identified 1239 addresses where primary care was delivered by 4262 (61.39%) FPs. Of the included addresses, 84.50% (n=1047) were in urban locations, and there was a median of 2 (IQR 2-4, range 1-23) FPs at each unique address.

    Conclusions: The CLA provides a region-wide description of primary care clinics that improves on simple counts of primary care providers or self-report lists. It identifies the number and location of primary care clinics and excludes primary care providers who are likely not providing community-based primary care. Such information may be useful for estimates of capacity of primary care, as well as for policy planning and research in regions engaged in primary care evaluation or transformation.

    JMIR Form Res 2022;6(6):e34141

    doi:10.2196/34141

    Keywords

    physicians, primary care; primary health care; health services accessibility; practice patterns, physicians; physicians’ offices; computing methodologies; algorithms 


    Improving access to primary care is on health agendas around the world [1]. This is likely linked to the finding that increasing supply of primary care physicians is associated with decreased mortality rates [2]. In Canada, primary care accessibility is a persistent challenge. The media regularly note a supposed family physician (FP) shortage [3] despite most provinces having the highest ever number of FPs per capita [4].

    Primary care is the first point of access to the health care system and provides longitudinal, person-focused care for most care needs across the lifespan [5,6]. The majority of primary care in Canada is still delivered by FPs at community-based outpatient clinics [7]. Currently, systematically identifying clinics versus individual physicians is difficult. This may be due to the ongoing reliance on funding of the majority of primary care services via individual physician remuneration [7-9] versus using a centralized system of service delivery, as is more commonly seen with other social services, such as public schools.

    Across North America, initiatives to transform primary care have addressed access to care by establishing primary care teams [7-11]. Coordinated, team-based care in a primary care clinic is recognized as a critical part of modernized care [12-15] and has begun to be seen in Canada. However, analyses of these transformations often still rely on using the individual physician as a unit of service delivery [16,17] despite indicators that FPs may work in multiple locations, in a combination of roles [18-20], and that clinic culture and organization may contribute to physicians’ behaviors that influence quality of care [21,22]. The primary care clinic, rather than the individual physician, is evolving as the main access point for many patients. Exclusive reliance on physician-centric metrics potentially fails to include the contribution of nonphysician team members to the accessibility and quality of patient care. Other regions have begun to frame descriptions of primary care features and outcomes using the clinic as the unit of analysis [8,23,24]. A comprehensive list of primary care clinic locations is necessary for the effective assessment of initiatives that aim to improve access and would provide a baseline from which to measure change. There is no complete list available in British Columbia; an environmental scan has provided a few partial lists of specific types of care provision (eg, locations funded by health authorities) and some local data sources relying on physician self-report and voluntary listing of clinics. Other health care regions face similar data challenges as well as a need to improve access to primary care [25-27].

    The objective of this study is to develop and verify an algorithm that uses a continually updated, public listing of individual physician license registration addresses to create an accurate region-wide listing of clinic locations where primary care is delivered.


    Overview

    This study describes the development, application, and verification of an algorithm applied to a physician license registration list in order to reliably generate an accurate list of primary care clinics. The Clinic List Algorithm (CLA) was developed by the primary care Innovation Support Unit at the University of British Columbia as part of a larger project examining primary care capacity and access measurement.

    Study Setting

    British Columbia, Canada, has a single-payer health system [7], and primary care is provided almost exclusively by FPs. In many regions, physicians must register with a licensing body (eg, provincial or territorial college of physicians and surgeons), declare their specialization qualification (eg, family medicine), and give an address at which they provide services [28]. These registrations may also include other useful information, such as date of graduation, medical school location, or additional demographic data. In Canada, registration lists are publicly available.

    Data Sources

    We used the following publicly available data sources to create the CLA.

    The Registry

    The College of Physicians and Surgeons of British Columbia (CPSBC) physician registry is the base to which we will apply additional data sets, processing actions, and verifying actions, and it is referred to in this paper as the Registry. It is updated continuously, is publicly accessible online, and can be requested from the CPSBC in a more accessible format [29]. The version accessed for this study is from September 2020.

    Additional Address Data

    The BC Ministry of Health publishes a comprehensive list of regional health authorities, broken down into Community Health Service Areas (CHSAs) [30]. We incorporated CHSAs because related health profiles exist detailing a community’s demographic, socioeconomic, and health and disease status. DataBC geolocation services information was used to add longitude and latitude coordinates to addresses, in accordance with their terms of service in British Columbia [31].

    Partial Lists of Specific Family Physician Workplaces
    Walk-in Clinic, Urgent and Primary Care Centre, and Hospital Lists

    These lists were accessed between September 2020 and March 2021. The BC Ministry of Health publishes a list of locations in British Columbia that “provide walk-in treatment services for people who have minor illnesses or injuries or injuries that do not require a visit to a hospital emergency department or an urgent care facility” [32]. Walk-in treatment services are a form of community-based primary care [33]. This walk-in clinic list is updated twice yearly, in December and June. The Ministry of Health also manages two other publicly available lists that identify all hospitals [34] and Urgent and Primary Care Centres (UPCCs) [35] in British Columbia. These are updated similarly to the walk-in clinic list. UPCCs have been available in British Columbia since 2019 and “provide a flexible resource to meet the urgent and primary health care need” in British Columbia [35].

    Corrections Facilities List

    We generated a list of corrections facilities in British Columbia from multiple sources of publicly available information. These facilities included federal and provincial institutions, as well as immigration and remand institutions. At these addresses, primary care services are delivered to people living in corrections facilities. This care is not accessible to members of the community.

    Long-term Care Facilities List

    We obtained a file of all registered long-term care facilities from the BC Office of the Seniors Advocate [36]. This registry is regularly updated and contains details for all BC long-term care homes in which there are publicly funded beds. Medical services provided in these locations require a patient to meet strict admission criteria and are not available to other community members.

    Variables

    The outcome of interest was an accurate list of primary care clinics. A clinic was defined as a location where primary care services are delivered by at least one FP registered to practice in British Columbia. Clinic locations were derived from the addresses provided by physicians who registered for a license to practice. The CLA was used to translate the physician registration addresses to primary care clinic locations (see Results section).

    Key Informants

    Members of the research team with intimate knowledge of the regional primary care system (RKM and IRC) were needed in helping to develop inclusion and exclusion criteria.

    Analytic Methods

    The complete software code used for this algorithm is published online on GitHub [37]. The software was developed using Python (version 3.7.7; Python Software Foundation) in conjunction with the following open-source libraries: NumPy, pandas, OpenPyXL, GeoPy, and RegEx. Figure 1 summarizes the steps and flow developed for the algorithm application process, and Multimedia Appendix 1 includes additional details about how each step was completed. The Results section describes the application of the CLA. Descriptive statistics were calculated using Microsoft Excel for Mac (version 16.61).

    ‎
    Figure 1. Clinic List Algorithm steps to generate the primary care location list using publicly available data sources.
    View this figure

    Ethics Approval

    This study is exempt from Research Ethics Board review, as the data used for this research falls under the criteria outlined in Article 2.2 of the Tri-Council Policy Statement.


    Step 1: Collect Publicly Available Data Sets—Environmental Scan (Manual)

    The data sources were collected and collated, including the Registry and additional address data. We plan to create regional service maps, and this level of location detail will facilitate that future work. Some addresses, almost exclusively post-office boxes, had to be reviewed individually and altered manually to allow them to be processed through the BC Address Geocoder. We then collected the following partial lists as sources for inclusion or exclusion: the walk-in clinic, UPCC, and hospital lists, which were accessed between September 2020 and March 2021, were generated; the corrections facilities list was generated; and the long-term care facilities list was requested.

    Step 2: Develop Clinic Inclusion and Exclusion Criteria (Manual)

    We established inclusion and exclusion criteria for the type 2 secondary data sources. Walk-in clinics and UPCCs were included. Hospitals, corrections facilities, and long-term care facilities were excluded. Key search terms were developed from author knowledge (RKM and IRC) and grey and published literature searches. Search terms are shown in Table 1.

    Table 1. Search terms used in filtering and sorting addresses from the Registry list of the College of Physicians and Surgeons of British Columbia to each of our working lists.
    Criteria and working listsaSearch termsb
    Inclusion criteria

    		Walk-in clinicNo search terms: list developed from walk-in clinic list

    		Urgent and primary careNo search terms: list developed from Urgent and Primary Care Centre list

    		FamilyFamily and (Med* or Clinic or Centre or Center or Associate* or Care or Practice)

    		First NationsFirst Nation* or First People* or Native or Aboriginal or Indigenous or {clinic-specific name}

    		Clinic or centerClinic* or Associate* or Center or Centre of Practice or Doctor*
    Exclusion criteria

    		HospitalHosp*: list developed from hospital list

    		Long-term careLodging or Lodge* or Manor or Senior or ALCc: list developed from long-term care list

    		CorrectionsCorrection* or Immigra* or Pretrial or Custody or Institution or Detention or Holding or Healing Village: list developed from corrections list

    		Sexual healthSexual or STId or STDe or {clinic specific name}

    		Women’s healthWom[a,e]n* or Menopause or Matern* or Birth* or Obstetric* or Gyne*

    		Virtual{organization-specific name} or Virtual or E[-]Health or Tele* or I[-]Health

    		AdministrativeAirport or Consulting or Admin* or Fraser Health Authority or First Nation* Health Authority or Coroner or CPSBCf or College of Physician* and Surgeon* or Health Canada or VCHg or Worksafe or Worksafebc or Worker* Comp* or BCAAh or Veteran* Affair or RCMPi or Air Canada or Quality

    aWorking lists created in step 7 of the Clinic List Algorithm.

    bFor search terms, the asterisk (*) denotes that any character following the search term was allowed, round brackets signify the inclusion of any number of terms inside those brackets, square brackets indicate that any of the letters inside the brackets were allowable in the word, and curly brackets identify a search term specific to a clinic that is not a generic term and is not included in this list. Regular expression statements used in the algorithm code are found in Multimedia Appendix 2.

    cALC: alternate level of care.

    dSTI: sexually transmitted infection.

    eSTD: sexually transmitted disease.

    fCPSBC: College of Physicians and Surgeons of British Columbia.

    gVCH: Vancouver Coastal Health.

    hBCAA: British Columbia Automobile Association.

    iRCMP: Royal Canadian Mounted Police.

    Step 3: Process Data Sets (Automated)

    The software filtered the CPSBC Registry list using the Specialties and Certificates column to include only FPs. The CPSBC Registry list contained 13,726 physicians, of which 6942 were identified as FPs. We removed addresses from outside British Columbia (n=82), leaving 6860 FPs (Figure 2). These 6860 physicians were found to have 7206 registered addresses. All remaining address fields in the Registry list were then standardized.

    ‎
    Figure 2. Case study results identifying included, excluded, and undetermined addresses of primary care locations in British Columbia.
    View this figure

    Step 4: Consolidate Data Sets (Automated)

    Additional address data were merged with the Registry list, appending geolocation coordinates and relevant CHSA data fields to each entry using consistent data fields between data sources.

    Step 5: Transform From List of Physicians to Initial List of Clinics (Automated)

    The software identified 2915 unique addresses from the Registry list. All 6860 FPs were then assigned to the unique addresses, creating the initial clinic-centric list.

    Step 6: Add Additional Metadata (Automated)

    Metadata were added as new variables by the software to include the number of FPs identified at each clinic, the rurality of clinic locations, key term identification, and overall summaries of each process undertaken by the software.

    Step 7: Create Working Lists (Automated)

    The inclusion and exclusion criteria developed in step 2 were applied to create the 15 working lists. The results of this step are depicted in Figure 2. The partial lists’ data sources were applied to identify addresses of walk-in clinics, UPCCs, hospitals, corrections facilities, and long-term care facilities and then sorted to their respective working lists. Key search terms in the address fields of each remaining listing were sorted to respective working lists (Table 1). Finally, unique addresses with more than one associated FP and that were not sorted by any previous step were assigned to the multi-practitioner working list. Single addresses listed by only one FP were assigned to the single-practitioner working list.

    Step 8: Verify Working Lists (Manual)

    The verification process was completed manually, using the working lists produced in step 7. The goal of verification was to determine if an address assigned to a particular working list had been correctly included or excluded as a community-based location that provided any primary care.

    The sample size for verification was determined for each separate working list. The proportion that was verified differed between working lists. Considerations in verification were (1) baseline confidence that the sorting method would accurately include and exclude addresses and (2) time and resources available for the verification process. Multimedia Appendix 3 includes the proportion of addresses verified for each group.

    The verification process was applied to each working list and consisted of at least one of four reviews. In the first review, lists prepared by government organizations were assumed to be accurate, and no additional verification was done. The second review was manual and was performed by an expert informant (RKM) who personally knew providers or clinics that were delivering primary care. The third and fourth reviews were done by KF and IRC and began with an internet search for clinic name, address, and FP names. If the internet search was insufficient to ascertain that primary care was being delivered at that location, a final, most resource-intensive level of review was done by phoning the clinic.

    The internet search process and script used for phone call verification is included in Multimedia Appendix 4. A team member (IRC) collated responses from all four types of reviews and compared a subset of completed entries to ensure consistency between the methods of verification.

    The denominator for verification accuracy was the number of addresses in the step multiplied by the proportion to be verified. If a verified address was included—or excluded, depending on the specific working list—as a primary care location, it contributed to the numerator. This gave a relative accuracy for the groups used in the algorithm to identify inclusion or exclusion of potential primary care clinics.

    Confirmation of primary care service provision was not possible for the virtual working list, as the six physical addresses correctly identified with this filter were for administrative offices only. For the remainder of the working lists, verification was completed for almost all potential clinics found, with two notable exceptions. The family working list verification was completed on only 27% (21/77) of the clinics identified because this filter was established late in our development process as a very high-fidelity filter. The single-practitioner working list verification was completed on only 15.98% (211/1320) of the addresses identified; of these 211 addresses, only 118 (55.9%) were currently providing primary care. Initial work to develop patterns to identify clinics from the single-practitioner working list indicated that this working list was nonspecific to primary care clinics (eg, contained many residential addresses).

    Step 9: Consolidate Working Lists (Automated)

    The software merged the working lists into one final clinic list that is presented in Multimedia Appendix 5. From the original 2915 unique addresses identified, the CLA excluded 356 (12.21%) addresses, representing 1624 FPs. The CLA also defined 1320 addresses as single-physician addresses that were not identified through any other filter. The CLA identified 1239 potential primary care clinics representing 4262 FPs (Figure 2). Table 2 shows the geographic and descriptive data about included primary care clinics.

    Table 2. Geographic distribution and descriptive statistics of included primary care clinic addresses from the case study in British Columbia.
    CHSAa urban or rural classificationbUnique addressesc (n=1239), n (%)FPsd,e with addresses in this region (n=4262), n (%)FPs per unique address



    		Median (IQR)Range
    Metropolitan566 (45.68)1897 (44.51)2 (2-4)1-20
    Large urban189 (15.25)647 (15.18)3 (2-4)1-14
    Medium urban195 (15.74)717 (16.82)3 (2-5)1-23
    Small urban99 (7.99)410 (9.62)3 (2-5)1-21
    Rural hub75 (6.05)269 (6.31)3 (2-5)1-15
    Rural102 (8.23)299 (7.02)2 (2-3)1-15
    Remote12 (0.97)23 (0.54)2 (1-2)1-5
    Total1239 (100)4262 (100)2 (2-4)1-23

    aCHSA: Community Health Service Area.

    bUrban and rural classifications are based on the classification of the CHSA by the BC Ministry of Health [30].

    cThe software from the Clinic List Algorithm (CLA) was used to identify the unique addresses that were included, with FPs from the College of Physicians and Surgeons of British Columbia list.

    dFP: family physician.

    eThese are FPs who are registered with the CPSBC and have listed an address identified by the CLA as a primary care location.

    Step 10: Adjust Processing Steps Based on Learnings (Manual)

    Each iteration of the working lists was reviewed by the study authors (IRC, CL, KF, TTH, SF, JK, MAH, and RKM). Three revisions of the software were made to address important learnings (eg, adding the term “family” as an inclusion search term and obtaining the complete list of long-term care addresses). The new rules and processes created as a result of discoveries in the verification process were incorporated into the final code, which is found on GitHub [37].


    Principal Findings

    The CLA identified 1239 addresses where primary care was delivered by 4262 FPs from a list of the 6942 FPs licensed to practice in British Columbia. The algorithm used publicly available data sources and could be repeated as the data sources are updated. The CLA was developed to facilitate the study of regional effects of policies to transform primary care, using the clinic as the unit of analysis. This may be of particular value in regions where such lists do not exist or are not publicly available.

    Previous work exploring geographic distribution of primary care services also used physician registration addresses to find locations of primary care service delivery [25,26]. However, that work did not include a way to remove the physicians who are unlikely to be providing community-based services. Modern FPs have dynamic and varied practice patterns that rarely are in a single location and providing only community-based primary care [20,38]. The CLA allows for observations about how FPs are organizing their work. We identified 1624 FPs who have an address at which primary care services are not available. While these physicians are likely engaged in important health services work that uses their valuable time and skills, they should not be assumed to be a potential source for primary care [18,38,39].

    In our final clinic list, 94.25% (4017/4262) of included FPs shared a registered address with at least one other person. While this may not reflect the complete practice context (eg, whether the practice is organized as a team) and does not include the undetermined single-practitioner working list (n=1320 FPs), it does confirm that most FPs are not working in solo practice settings. The CLA allows for the creation of a unique physician identifier that can be associated with an address. Appropriately constructed research and quality initiatives could use such a variable to study physician practice patterns, identified in administrative data, as mapped to physical locations [8,14,17,40]. In many Canadian regions, this linkage has not previously been possible [5,19,41,42].

    The majority of primary care evaluation and research on access and quality of care has needed to rely on the individual FP as the unit of analysis [19,41,43-45] (eg, patient attachment, third next available appointment, and rates of opioid prescribing by a single FP). This does not appear to represent how the majority of FPs are actually practicing. Measurements that focus on the clinic as the unit of analysis for primary care provision would likely better reflect the changing practice context in primary care and allow for accurate health resource planning [8,14,40,46].

    Limitations and Future Work

    We cannot assume that each practitioner works at each location full time, providing only primary care services, because FPs often work in multiple locations [38]. Further work is required to understand patient access and attachment capacity at each clinic location [47,48]. We assumed that a physician registers all addresses where they provide any care at the time of their license registration. It is possible that this is not the case and that a physician registers an address for convenience or a personal reason. This could result in undercounting of physicians working at a location or failure to identify a primary care location at all.

    We neither called nor visited every address to verify their services, due to limited time and resources. We verified only 15.98% (n=211) of the addresses on the single-practitioner working list of 1320 unique addresses held by one FP. Future projects could include a more inclusive verification process for the single-practitioner working list. However, this work would need to be completed manually, given the lack of patterns we were able to discover in software development with the CLA. Future versions of the CLA should incorporate verification from previous versions, thus limiting the manual verification required for updating the final clinic list.

    Two new primary care clinics in British Columbia are led by nurse practitioners (NPs) without FPs [49] and are, therefore, missing from the present clinic list. Additionally, rural and remote communities have clinics that may be serviced periodically by FPs, NPs, or registered nurses. It is unlikely that these locations were captured by the CPSBC Registry list. Should these types of clinics become more prevalent, the potential remedy for future versions of the final clinic list would be to apply a similar algorithm to registration lists of NPs and primary care registered nurses. Listing a hospital address was an exclusion criterion for the CLA. It is possible that in some settings, particularly rural areas, primary care is being provided at a hospital address. Future projects should verify if primary care is provided at the hospital address or if an FP registered with the CPSBC uses only a hospital address.

    The utility of any registry of addresses relies on the currency and accuracy of the listing [48]. The CLA will require updating; fortunately, the physician registration list is updated continually by the provincial licensing body, and with appropriate resources, the algorithm can be repeated to update the accurate list of clinics.

    Finally, the rapid growth of primary care services offered through virtual platforms introduces an important new element to this work [42,50]. FPs can now provide care to patients in distant locations. In British Columbia, virtual care via the single-payer system requires a physician to be registered with the CPSBC [51]. At this time, it is unclear how virtual services might impact the CLA.

    Conclusions

    The CLA can reliably create a list of primary care clinics based on publicly available information. The algorithm can be applied in other regions that need comprehensive lists of primary care clinics. The CLA offers researchers, decision-makers, and other organizations interested in health services a reliable way to estimate the regional distribution of primary care clinics. Future research could include the application of the CLA to the evaluation of initiatives for primary care transformation.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Detailed description of the application of the Clinic List Algorithm (CLA) method.

    PDF File (Adobe PDF File), 240 KB
    ‎
    Multimedia Appendix 2

    Regular expression statements used in the identification and sorting of addresses from the College of Physicians and Surgeons of British Columbia list to each of the groups.

    PDF File (Adobe PDF File), 140 KB
    ‎
    Multimedia Appendix 3

    Accuracy of algorithm sorting of individual physician addresses from licence registration to identify physical locations of primary care clinics.

    PDF File (Adobe PDF File), 164 KB
    ‎
    Multimedia Appendix 4

    Internet validation process and phone call script.

    PDF File (Adobe PDF File), 108 KB
    ‎
    Multimedia Appendix 5

    Clinic list.

    PDF File (Adobe PDF File), 361 KB
    1. World Health Organization. Declaration of Astana: Global Conference on Primary Health Care. Geneva, Switzerland; 2018.   URL: https://www.who.int/docs/default-source/primary-health/declaration/gcphc-declaration.pdf [accessed 2022-05-26]
    2. Basu S, Berkowitz SA, Phillips RL, Bitton A, Landon BE, Phillips RS. Association of primary care physician supply with population mortality in the United States, 2005-2015. JAMA Intern Med 2019 Apr 01;179(4):506-514 [FREE Full text] [CrossRef] [Medline]
    3. Xu X. Nearly 900,000 British Columbians don’t have a family doctor, leaving walk-in clinics and ERs swamped. The Globe and Mail. 2022 Apr 29.   URL: https:/​/www.​theglobeandmail.com/​canada/​british-columbia/​article-nearly-900000-british-columbians-dont-have-a-family-doctor-leaving/​ [accessed 2022-05-11]
    4. Physicians in Canada. Canadian Institute for Health Information.   URL: https://www.cihi.ca/en/physicians-in-canada? [accessed 2021-03-04]
    5. Lavergne M, Peterson S, McKendry R, Sivananthan S, McGrail K. Full-service family practice in British Columbia: policy interventions and trends in practice, 1991-2010. Healthc Policy 2014 May;9(4):32-47 [FREE Full text] [Medline]
    6. Stewart M, Ryan B. Ecology of health care in Canada. Can Fam Physician 2015 May;61(5):449-453 [FREE Full text] [Medline]
    7. Hutchison B, Levesque J, Strumpf E, Coyle N. Primary health care in Canada: Systems in motion. Milbank Q 2011 Jun;89(2):256-288. [CrossRef] [Medline]
    8. Kiran T, Green ME, DeWit Y, Khan S, Schultz S, Kopp A, et al. Association of physician payment model and team-based care with timely access in primary care: A population-based cross-sectional study. CMAJ Open 2020;8(2):E328-E337 [FREE Full text] [CrossRef] [Medline]
    9. Leslie M, Khayatzadeh-Mahani A, Birdsell J, Forest PG, Henderson R, Gray RP, et al. An implementation history of primary health care transformation: Alberta's primary care networks and the people, time and culture of change. BMC Fam Pract 2020 Dec 05;21(1):258 [FREE Full text] [CrossRef] [Medline]
    10. Implementation of the Integrated System of Primary and Community Care: Team-Based Care Through Primary Care Networks Guidance to Collaborative Services Committees. Vancouver, BC: General Practice Services Committee; 2017 Dec.   URL: https://gpscbc.ca/sites/default/files/PMH%20PCN%20CSC%20Guidance%20201712.pdf [accessed 2022-05-31]
    11. Ministry of Health. Government of British Columbia.   URL: https:/​/www2.​gov.bc.ca/​gov/​content/​governments/​organizational-structure/​ministries-organizations/​ministries/​health [accessed 2022-05-30]
    12. Somé NH, Devlin R, Mehta N, Zaric G, Sarma S. Team-based primary care practice and physician's services: Evidence from family health teams in Ontario, Canada. Soc Sci Med 2020 Nov;264:113310. [CrossRef] [Medline]
    13. Reiss-Brennan B, Brunisholz KD, Dredge C, Briot P, Grazier K, Wilcox A, et al. Association of integrated team-based care with health care quality, utilization, and cost. JAMA 2016;316(8):826-834. [CrossRef] [Medline]
    14. Meyers DJ, Chien AT, Nguyen KH, Li Z, Singer SJ, Rosenthal MB. Association of team-based primary care with health care utilization and costs among chronically ill patients. JAMA Intern Med 2019 Jan 01;179(1):54-61 [FREE Full text] [CrossRef] [Medline]
    15. Schoen C, Osborn R, Doty M, Bishop M, Peugh J, Murukutla N. Toward higher-performance health systems: Adults' health care experiences in seven countries, 2007. Health Aff (Millwood) 2007;26(6):w717-w734. [CrossRef] [Medline]
    16. Kash BA, Cheon O, Halzack NM, Miller TR. Measuring team effectiveness in the health care setting: An inventory of survey tools. Health Serv Insights 2018;11:1-18 [FREE Full text] [CrossRef] [Medline]
    17. Riordan F, McHugh SM, O'Donovan C, Mtshede MN, Kearney PM. The role of physician and practice characteristics in the quality of diabetes management in primary care: Systematic review and meta-analysis. J Gen Intern Med 2020 Jun;35(6):1836-1848 [FREE Full text] [CrossRef] [Medline]
    18. Oandasan IF, Archibald D, Authier L, Lawrence K, McEwen LA, Mackay MP, et al. Future practice of comprehensive care: Practice intentions of exiting family medicine residents in Canada. Can Fam Physician 2018 Jul;64(7):520-528 [FREE Full text] [Medline]
    19. Schultz S, Glazier R. Identification of physicians providing comprehensive primary care in Ontario: A retrospective analysis using linked administrative data. CMAJ Open 2017 Dec 19;5(4):E856-E863 [FREE Full text] [CrossRef] [Medline]
    20. Lavergne MR, Goldsmith LJ, Grudniewicz A, Rudoler D, Marshall EG, Ahuja M, et al. Practice patterns among early-career primary care (ECPC) physicians and workforce planning implications: Protocol for a mixed methods study. BMJ Open 2019 Sep 24;9(9):e030477 [FREE Full text] [CrossRef] [Medline]
    21. Willis TA, West R, Rushforth B, Stokes T, Glidewell L, Carder P, ASPIRE programme team. Variations in achievement of evidence-based, high-impact quality indicators in general practice: An observational study. PLoS One 2017;12(7):e0177949 [FREE Full text] [CrossRef] [Medline]
    22. Goldacre B, Reynolds C, Powell-Smith A, Walker A, Yates T, Croker R, et al. Do doctors in dispensing practices with a financial conflict of interest prescribe more expensive drugs? A cross-sectional analysis of English primary care prescribing data. BMJ Open 2019 Feb 05;9(2):e026886 [FREE Full text] [CrossRef] [Medline]
    23. McLeod L, Buckley G, Sweetman A. Ontario primary care models: A descriptive study. CMAJ Open 2016;4(4):E679-E688 [FREE Full text] [CrossRef] [Medline]
    24. Wranik W, Price S, Haydt S, Edwards J, Hatfield K, Weir J, et al. Implications of interprofessional primary care team characteristics for health services and patient health outcomes: A systematic review with narrative synthesis. Health Policy 2019 Jun;123(6):550-563 [FREE Full text] [CrossRef] [Medline]
    25. Shah TI, Bell S, Wilson K. Spatial accessibility to health care services: Identifying under-serviced neighbourhoods in Canadian urban areas. PLoS One 2016;11(12):e0168208 [FREE Full text] [CrossRef] [Medline]
    26. Gilliland JA, Shah TI, Clark A, Sibbald S, Seabrook JA. A geospatial approach to understanding inequalities in accessibility to primary care among vulnerable populations. PLoS One 2019;14(1):e0210113 [FREE Full text] [CrossRef] [Medline]
    27. Marshall EG, Gibson RJ, Lawson B, Burge F. Protocol for determining primary healthcare practice characteristics, models of practice and patient accessibility using an exploratory census survey with linkage to administrative data in Nova Scotia, Canada. BMJ Open 2017 Mar 16;7(3):e014631 [FREE Full text] [CrossRef] [Medline]
    28. Partner organizations. Medical Council of Canada.   URL: https://mcc.ca/about/partner-organizations/ [accessed 2021-04-05]
    29. Registrant directory. College of Physicians and Surgeons of British Columbia.   URL: https://www.cpsbc.ca/registrant_search [accessed 2022-05-26]
    30. Community Health Service Areas - CHSA. Government of British Columbia Data Catalogue. Victoria, BC: Health Sector Information, Analysis and Reporting, British Columbia Ministry of Health; 2019.   URL: https://catalogue.data.gov.bc.ca/dataset/community-health-service-areas-chsa [accessed 2022-05-26]
    31. BC Address Geocoder. Government of British Columbia.   URL: https://www2.gov.bc.ca/gov/content/data/geographic-data-services/location-services/geocoder [accessed 2022-05-26]
    32. Walk-in Clinics in BC. Government of British Columbia Data Catalogue. Victoria, BC: HealthLinkBC, British Columbia Ministry of Health; 2022.   URL: https://catalogue.data.gov.bc.ca/dataset/walk-in-clinics-in-bc [accessed 2022-05-26]
    33. Howard M, Goertzen J, Kaczorowski J, Hutchison B, Morris K, Thabane L, et al. Emergency Department and Walk-in Clinic Use in Models of Primary Care Practice with Different After-Hours Accessibility in Ontario. Healthc Policy 2008 Aug;4(1):73-88 [FREE Full text] [Medline]
    34. Government of British. Hospitals in BC. Government of British Columbia Data Catalogue. Victoria, BC: HealthLinkBC, British Columbia Ministry of Health; 2022.   URL: https://catalogue.data.gov.bc.ca/dataset/hospitals-in-bc [accessed 2022-05-26]
    35. Government of British Columbia. Urgent and Primary Care Centres. Government of British Columbia Data Catalogue. Victoria, BC: HealthLinkBC, British Columbia Ministry of Health; 2022.   URL: https://catalogue.data.gov.bc.ca/dataset/urgent-and-primary-care-centres [accessed 2022-05-26]
    36. Long Term Care Directory – Information and Reports. Victoria, BC: British Columbia Office of the Seniors Advocate   URL: https://www.seniorsadvocatebc.ca/long-term-care-directory/ [accessed 2022-05-25]
    37. Innovation Support Unit. Clinic list BC. GitHub. 2021.   URL: https://github.com/ISU-UBC/clinic-list-BC [accessed 2022-05-06]
    38. Hedden L, Banihosseini S, Strydom N, McCracken R. Modern work patterns of "classic" versus millennial family doctors and their effect on workforce planning for community-based primary care: A cross-sectional survey. Hum Resour Health 2020 Sep 21;18(1):67 [FREE Full text] [CrossRef] [Medline]
    39. Reeve J, Beaulieu M, Freeman T, Green LA, Lucassen P, Martin C, et al. Revitalizing generalist practice: The Montreal Statement. Ann Fam Med 2018 Jul 09;16(4):371-373 [FREE Full text] [CrossRef]
    40. Kiran T, Victor J, Kopp A, Shah B, Glazier R. The relationship between primary care models and processes of diabetes care in Ontario. Can J Diabetes 2014 Jun;38(3):172-178 [FREE Full text] [CrossRef] [Medline]
    41. McGrail K, Lavergne R, Lewis SJ, Peterson SLM, Barer M, Garrison SR. Classifying physician practice style: A new approach using administrative data in British Columbia. Med Care 2015 Mar;53(3):276-282. [CrossRef] [Medline]
    42. Matthewman S, Spencer S, Lavergne MR, McCracken RK, Hedden L. An environmental scan of virtual "walk-in" clinics in Canada: Comparative study. J Med Internet Res 2021 Jun 11;23(6):e27259 [FREE Full text] [CrossRef] [Medline]
    43. Dahrouge S, Hogg W, Younger J, Muggah E, Russell G, Glazier R. Primary care physician panel size and quality of care: A population-based study in Ontario, Canada. Ann Fam Med 2016;14(1):26-33 [FREE Full text] [CrossRef] [Medline]
    44. Hedden L, Lavergne M, McGrail K, Law M, Bourgeault I, McCracken R, et al. Trends in providing out-of-office, urgent after-hours, and on-call care in British Columbia. Ann Fam Med 2019 Mar;17(2):116-124 [FREE Full text] [CrossRef] [Medline]
    45. Desveaux L, Saragosa M, Kithulegoda N, Ivers NM. Family physician perceptions of their role in managing the opioid crisis. Ann Fam Med 2019 Jul;17(4):345-351 [FREE Full text] [CrossRef] [Medline]
    46. Paré G, Raymond L, Castonguay A, Grenier Ouimet A, Trudel M. Assimilation of medical appointment scheduling systems and their impact on the accessibility of primary care: Mixed methods study. JMIR Med Inform 2021 Nov 16;9(11):e30485 [FREE Full text] [CrossRef] [Medline]
    47. Langton J, Wong S, Johnston S, Abelson J, Ammi M, Burge F, et al. Primary care performance measurement and reporting at a regional level: Could a matrix approach provide actionable information for policy makers and clinicians? Healthc Policy 2016 Nov;12(2):33-51 [FREE Full text] [Medline]
    48. Strumpf E, Levesque J, Coyle N, Hutchison B, Barnes M, Wedel R. Innovative and diverse strategies toward primary health care reform: Lessons learned from the Canadian experience. J Am Board Fam Med 2012 Mar;25 Suppl 1:S27-S33 [FREE Full text] [CrossRef] [Medline]
    49. BC Medical Journal. New nurse-practitioner primary care clinics. BC Med J 2020 Sep;62(7):250-251 [FREE Full text]
    50. Glazier RH, Green ME, Wu FC, Frymire E, Kopp A, Kiran T. Shifts in office and virtual primary care during the early COVID-19 pandemic in Ontario, Canada. CMAJ 2021 Feb 08;193(6):E200-E210. [CrossRef] [Medline]
    51. Practice Standard: Virtual Care. Version 8.3. Vancouver, BC: College of Physicians and Surgeons of British Columbia; 2022 May 06.   URL: https://www.cpsbc.ca/files/pdf/PSG-Telemedicine.pdf [accessed 2022-05-24]

    ‎
    CHSA: Community Health Service Area
    CLA: Clinic List Algorithm
    CPSBC: College of Physicians and Surgeons of British Columbia
    FP: family physician
    NP: nurse practitioner
    UPCC: Urgent and Primary Care Centre

    Edited by A Mavragani; submitted 21.10.21; peer-reviewed by D Madhusudhan, Y Xie; comments to author 18.03.22; revised version received 13.05.22; accepted 19.05.22; published 22.06.22

    Copyright

    ©Ian R Cooper, Cameron Lindsay, Keaton Fraser, Tiffany T Hill, Andrew Siu, Sarah Fletcher, Jan Klimas, Michee-Ana Hamilton, Amanda D Frazer, Elka Humphrys, Kira Koepke, Lindsay Hedden, Morgan Price, Rita K McCracken. Originally published in JMIR Formative Research (https://formative.jmir.org), 22.06.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.