This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (2226) Registered Report (528) mHealth in a Clinical Setting (582) Wearable Devices and Sensors (825) Novel Sensors and Data Acquisition Methods in Cardiology (191) Tools, Programs and Algorithms (245)

Published on in Vol 6, No 11 (2022): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/36340, first published .
Measurement of Vital Signs Using Lifelight Remote Photoplethysmography: Results of the VISION-D and VISION-V Observational Studies

Measurement of Vital Signs Using Lifelight Remote Photoplethysmography: Results of the VISION-D and VISION-V Observational Studies

Measurement of Vital Signs Using Lifelight Remote Photoplethysmography: Results of the VISION-D and VISION-V Observational Studies

Authors of this article:

Emily Heiden1 Author Orcid Image ;   Tom Jones1 Author Orcid Image ;   Annika Brogaard Maczka2 Author Orcid Image ;   Melissa Kapoor2 Author Orcid Image ;   Milan Chauhan1 Author Orcid Image ;   Laura Wiffen1 Author Orcid Image ;   Helen Barham3 Author Orcid Image ;   Jeremy Holland4, 5 Author Orcid Image ;   Manish Saxena6 Author Orcid Image ;   Simon Wegerif4 Author Orcid Image ;   Thomas Brown1 Author Orcid Image ;   Mitch Lomax7 Author Orcid Image ;   Heather Massey7 Author Orcid Image ;   Shahin Rostami8 Author Orcid Image ;   Laurence Pearce4 Author Orcid Image ;   Anoop Chauhan1 Author Orcid Image
Article Authors Cited by (5) Tweetations (2) Metrics

    Original Paper

    1Portsmouth Hospitals University NHS Trust, Portsmouth, United Kingdom

    2Mind Over Matter Medtech Ltd, London, United Kingdom

    3The Text Doctor, Wantage, United Kingdom

    4Xim Ltd, Southampton, United Kingdom

    5Centre for Business Innovation Limited, Cambridge, United Kingdom

    6Barts NIHR Biomedical Research Centre, Queen Mary University of London, London, United Kingdom

    7School of Sport, Health & Exercise Science, University of Portsmouth, Portsmouth, United Kingdom

    8Data Science Lab, Polyra Limited, Bournemouth, United Kingdom

    *these authors contributed equally

    Corresponding Author:

    Melissa Kapoor, BSc, DPhil

    Mind Over Matter Medtech Ltd

    Kemp House

    London, EC1V 2NX

    United Kingdom

    Phone: 44 7881 927063

    Email: melissa@mind-medtech.com


    Background: The detection of early changes in vital signs (VSs) enables timely intervention; however, the measurement of VSs requires hands-on technical expertise and is often time-consuming. The contactless measurement of VSs is beneficial to prevent infection, such as during the COVID-19 pandemic. Lifelight is a novel software being developed to measure VSs by remote photoplethysmography based on video captures of the face via the integral camera on mobile phones and tablets. We report two early studies in the development of Lifelight.

    Objective: The objective of the Vital Sign Comparison Between Lifelight and Standard of Care: Development (VISION-D) study (NCT04763746) was to measure respiratory rate (RR), pulse rate (PR), and blood pressure (BP) simultaneously by using the current standard of care manual methods and the Lifelight software to iteratively refine the software algorithms. The objective of the Vital Sign Comparison Between Lifelight and Standard of Care: Validation (VISION-V) study (NCT03998098) was to validate the use of Lifelight software to accurately measure VSs.

    Methods: BP, PR, and RR were measured simultaneously using Lifelight, a sphygmomanometer (BP and PR), and the manual counting of RR. Accuracy performance targets for each VS were defined from a systematic literature review of the performance of state-of-the-art VSs technologies.

    Results: The VISION-D data set (17,233 measurements from 8585 participants) met the accuracy targets for RR (mean error 0.3, SD 3.6 vs target mean error 2.3, SD 5.0; n=7462), PR (mean error 0.3, SD 4.0 vs mean error 2.2, SD 9.2; n=10,214), and diastolic BP (mean error −0.4, SD 8.5 vs mean error 5.5, SD 8.9; n=8951); for systolic BP, the mean error target was met but not the SD (mean error 3.5, SD 16.8 vs mean error 6.7, SD 15.3; n=9233). Fitzpatrick skin type did not affect accuracy. The VISION-V data set (679 measurements from 127 participants) met all the standards: mean error −0.1, SD 3.4 for RR; mean error 1.4, SD 3.8 for PR; mean error 2.8, SD 14.5 for systolic BP; and mean error −0.3, SD 7.0 for diastolic BP.

    Conclusions: At this early stage in development, Lifelight demonstrates sufficient accuracy in the measurement of VSs to support certification for a Level 1 Conformité Européenne mark. As the use of Lifelight does not require specific training or equipment, the software is potentially useful for the contactless measurement of VSs by nonclinical staff in residential and home care settings. Work is continuing to enhance data collection and processing to achieve the robustness and accuracy required for routine clinical use.

    International Registered Report Identifier (IRRID): RR2-10.2196/14326

    JMIR Form Res 2022;6(11):e36340

    doi:10.2196/36340

    Keywords

    general practice; vital signs/methods; vital signs/standards; photoplethysmography; remote photoplethysmography; remote photoplethysmography; Lifelight; contactless; software; algorithm development; algorithm; blood pressure; health monitoring; health technology; remote monitoring 


    The regular measurement of vital signs (VSs) is an integral component of clinical care, as changes in VS often occur a few hours before an adverse event [1], providing an opportunity for intervention. However, the recording of VSs is often inadequate, such that clinical deterioration often goes unnoticed or is not detected in time to treat effectively [2]. In response to this challenge, the National Early Warning Score (NEWS) has been developed as a systematic approach to identify and respond to patients at risk of deterioration in health care settings based on the scoring of respiratory rate (RR), oxygen saturation, temperature, systolic blood pressure (SBP), pulse rate (PR), and level of consciousness [3]. The Recognise Early Soft Signs, Take Observations, Respond, Escalate (RESTORE2) system for use in care homes incorporates the NEWS alongside observations of soft signs to identify potential deterioration in clinical conditions [4]; however, this requires staff to be trained in the measurement of VSs.

    VS measurement following discharge, for example, after surgery, is also important to identify deterioration. A European study of 193 readmitted patients identified marked deteriorations in PR (23%) and RR (28%) but only small changes (1%-2%) in blood pressure (BP) and oxygen saturation [5]. However, another study of 725 patients reported that, while 53% followed at least 10 of the recommended steps necessary for accurate BP measurement at home, only 1% followed all 15 recommendations [6]. Thus, home measurement of VSs is important—RR and PR in particular—but requires several pieces of equipment (BP monitor, pulse oximeter) and for patients to be educated in best practices.

    Digital health technologies, such as wireless smart patches that measure PR and RR and finger clip BP monitors, have the potential to improve the ease and accuracy of VS measurement (Table 1). Photoplethysmography (PPG; the basis of pulse oximetry) enables the rapid and simultaneous measurement of VSs by detecting changes in the light reflected from the skin surface due to volumetric changes in the blood vessels. PPG has been used to measure PR [7,8], oxygen saturation [9], BP [10,11], and RR [7,12]. The COVID-19 pandemic has increased interest in using remote technology as a way to monitor patients with nonserious symptoms to reduce the burden on health care facilities, making them available for high-risk groups and the seriously affected, and to monitor patients with other medical conditions, thereby avoiding the risk of SARS-CoV-2 infection associated with visits to health care facilities [13]. Contactless technology is also potentially useful in situations where current care cannot be readily used, such as in mental health settings [14].

    Lifelight (Xim Ltd) is a novel software being developed as a medical device for the measurement of VSs by remote PPG (rPPG), based on live video capture of the face using the integral camera on smart devices (eg, laptops or smartphones). The software captures the average color of multiple regions of interest 30 times every second for 60 seconds; subtle changes in coloration are used to determine VSs (Figure 1).

    Table 1. Accuracy performance targets for Lifelight.
    Key innovative technology and vital signTarget accuracy, mean error (SD)BasisaReferences
    Wireless smart patches

    		Pulse rate (beats per minute)2.2 (9.2)Weighted average of performance of 3 devices[15-17]

    		Respiratory rate (respirations per minute)2.3 (5.0)Weighted average of performance of 4 devices[15,16,18,19]
    Finger photoplethysmography monitor

    		Systolic blood pressure (mmHg)6.7 (15.3)Weighted average of performance of 6 devices[20-25]

    		Diastolic blood pressure (mmHg)5.5 (8.9)Weighted average of performance of 6 devices[20-25]

    aRelevance and quality scores: 3.0-3.16 for pulse rate, 2.83-3.16 for respiratory rate, 2.83-3.5 for systolic/diastolic blood pressure.

    ‎
    Figure 1. Use of remote photoplethysmography in the Lifelight software. BP: blood pressure; bpm: beats per minute; RGB: red, green, blue; rpm: respirations per minute; VS: vital sign.
    View this figure

    Here, we report early validation steps of the Lifelight software for the measurement of PR, RR, SBP, and diastolic BP (DBP; in line with the intended purpose of Lifelight) [26]. As Lifelight is a contactless technology, there are no relevant International Organization for Standardization (ISO) standards for validation. The most similar devices are wireless smart patches and finger clip BP monitors. We therefore developed a novel methodology for validation, informed by the standards for pulse oximetry [27] and noninvasive sphygmomanometers [28], and a validation study of the pyroelectric polymer for measuring RR [29]. A rigorous systematic literature review was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines to identify the performance of relevant devices for each VS. Quality and relevance scores were used to weight the findings (average score out of 4 for methodological quality: study design, sample size, method of comparison; scientific validity; and relevance to Lifelight’s intended purpose). These performance targets (Table 1) were calculated in preparation for a Conformité Européenne (CE)–marking audit. As per criterion 1 of the standard for noninvasive sphygmomanometers [28], the mean error and SD of the Lifelight measurements are compared with standard of care (SOC) measurements recorded concurrently. The targets in Table 1 have been approved by the UK Health Research Authority (HRA) for the ongoing Vital Sign Comparison Between Lifelight and Standard of Care (VISION) Acute study (NCT04589923).

    Here, we report two early studies in the development of Lifelight. The objective of the Vital Sign Comparison Between Lifelight and Standard of Care: Development (VISION-D) study (NCT04763746) was to collect RR, PR, and BP measurements simultaneously by using the current SOC manual methods and the Lifelight software to iteratively refine the software algorithms. The objective of the Vital Sign Comparison Between Lifelight and Standard of Care: Validation (VISION-V) study (NCT03998098) was to validate the use of Lifelight software to accurately measure VSs.


    VISION-D

    VISION-D was a prospective observational study conducted over 12 months during 2018 and 2019 [26], involving 8585 inpatients, outpatients, and healthy volunteers aged >3 years. There were no exclusion criteria to ensure local representation in age, sex, health condition, and skin tone and the inclusion of a wide range of VS values within and outside normal healthy ranges. The sample size was expected to exceed 2000 volunteers but was not formally prespecified, as it would depend on the incremental improvement in accuracy of the Lifelight system. The study continued until acceptable accuracy was achieved through machine learning. The sponsor kept the study teams informed on progress.

    The study was conducted at Queen Alexandra Hospital, Portsmouth Hospitals University National Health Service (NHS) Trust in accordance with Good Clinical Practice and was approved by the HRA (Integrated Research Application System number: 242581). All participants gave written informed consent.

    Measurements were taken by trained nursing staff and clinical trial assistants. PR and BP were measured with a standard clinical automatic sphygmomanometer (Welch Allyn Connex Spot Monitor) on one arm, allowing both to be measured simultaneously, rather than also using an electrocardiogram to record PR. RR was determined via the manual counting of observed inspirations over 60 seconds. The Lifelight software was run on a sixth generation Apple iPad, held approximately 1 meter from the participant and angled toward their face. Measurement started and stopped automatically, and the data were sent to a secure database without being displayed (to prevent clinical interpretation or analysis). Two sets of measurements were taken by two staff members during the same 60-second period and then repeated, giving 4 sets in total (Figure 2). Pre- and postmeasurement observations were made of background luminosity, temperature, the use of makeup, and facial features.

    Transmitted data were encrypted and stored in a secure database. No identifiable data were stored. Only data for adults (≥18 years) were reported. The data were used to train the software algorithms: the ensemble machine learning algorithm Extra Trees [30] was used for BP, and the filtering of the Fourier-transformed space followed by shape feature counting was used for PR and RR.

    ‎
    Figure 2. Data collection in VISION-D. SOC: standard of care; VISION-D: Vital Sign Comparison Between Lifelight and Standard of Care: Development.
    View this figure

    VISION-V

    VISION-V (n=127) was conducted at the School of Sport, Health and Exercise Science at the University of Portsmouth, United Kingdom, during 2019. Measurements were performed as in VISION-D but in a normobaric hypoxic chamber (Figure 3). VSs were measured 3 times in each participant by two observers who were blinded to their device readings and to each other’s readings. Data collection was overseen by an independent supervisor. The study was conducted in accordance with Good Clinical Practice and approved by the HRA (Integrated Research Application System number: 258187). All participants gave written informed consent.

    In addition to standard VSs measurement, healthy participants aged 18-39 years exercised on a recumbent cycle ergometer (maximum intensity 200 W) to generate a wide range of PR and RR values, per the laboratory’s standard operating procedure and under the advice of the independent medical officer. The exercise intensity and hypoxic environment were individually titrated to induce ≥80% oxygen desaturation. VSs were measured immediately after each exercise bout.

    ‎
    Figure 3. The environmental chamber used for hypoxic exercise testing and normoxic blood pressure (BP) evaluation: (a) recumbent chair; (b) ergometer; (c) ergometer control panel used for cycle exercise; (d) iPad running Lifelight software; (e) photographic lights to supplement chamber lighting; (f) Welch Allyn Connex Spot Monitors used for measuring BP, pulse rate, and oxygen saturation.
    View this figure

    Ethics Approval

    Ethical approval for VISION-V was granted by the London-Dulwich Research Ethics Committee (reference 19/LO/0427). The Medicines and Healthcare products Regulatory Agency issued a notice of no objection for the medical device to be used in VISION-V (reference CI/2018/0078). VISION-D was approved by the HRA and Health and Care Research Wales (reference 18-NS-0047). All participants provided written informed consent.

    Statistical Analysis

    In VISION-D, the enrolled set comprised all recruited participants; the full analysis set (FAS) comprised those for whom VS measurements are included. Reasons for exclusion were an age of <18 years, incorrect or incomplete data entry, physiologically implausible data (determined by the clinical investigator), and low signal quality (pulse signal quality indicator <0.85; eg, because of excessive movement or insufficient light).

    To ensure the accuracy of sphygmomanometers over a clinically useful range, the ISO standard for SBP requires that ≥5% of measurements are ≤100 mmHg, ≥5% are ≥160 mmHg, and ≥20% are ≥140 mmHg [28]. For DBP, ≥5% of measurements should each be ≤60 mmHg and ≥100 mmHg, and ≥20% should be ≥85 mmHg [28]. We therefore analyzed similar BP subgroups constructed using data randomly selected from the full data set; the distribution was calculated by up-weighting all SBP/DBP bands not meeting the minimum percentages to become ≥5% or ≥25% of the subgroup as appropriate and down-weighting bands exceeding the minimum percentages.

    A subgroup was also created using the Fitzpatrick Skin Type Scale [31], comprising ≥5% each in groups 1 and 4-6 and ≥20% each for groups 2 and 3, with up- and down-weighting as described for the BP subgroup.

    The primary analysis in both studies assessed the performance of Lifelight against the SOC measurements; an accuracy target was deemed to be met if mean error and SD for Lifelight measurements at least equaled the target (Table 1). Heat maps were generated for the VISION-D data, as the large amount of data rendered a scatter plot unclear. Scatter plots were developed for the smaller VISION-V data set (which was insufficient for a heat map).

    Linear regression was used to assess the impact of skin tone on the accuracy of Lifelight for measuring each VS, using the Fitzpatrick skin tones as the exploratory variable.


    VISION-D

    The enrolled set comprised 8585 participants; 60%-67% were included in individual VS analyses, and 17,233 measurements were collected, of which 43%-59% were included in the individual VS analyses (FAS). Demographic details are provided in Table 2. There were no protocol deviations or adverse events.

    The performance targets were met for all measurements except SBP in the FAS and the BP subgroup (Table 3). Heat maps of the reference method (SOC manual measurement) versus the test measurement are shown in Figure 4. Values for RR fell within a narrow range, distorting the appearance of the heat map. Amplifying the proportion of DBP data at extreme values slightly reduced the accuracy whereas amplifying the proportion of SBP data at extreme values had little effect (analysis not shown).

    Table 2. Characteristics of the final analysis set in VISION-Da.
    CharacteristicParticipantsbValue, rangeValue, mean (SD)
    SexN/AcN/A

    		Female, n (%)5649 (65.8)N/AcN/A

    		Male, n (%)2936 (34.2)N/AN/A
    Age (years), n85854-9649.7 (17.1)
    Fitzpatrick skin tone, n (%)dN/AN/A

    		1



    		RRe197 (3.44)



    		PRf170 (3.30)



    		SBPg158 (2.98)



    		DBPh149 (2.89)


    		2



    		RR2967 (51.81)



    		PR2646 (51.41)



    		SBP2733 (51.54)



    		DBP2663 (51.69)


    		3



    		RR2292 (40.02)



    		PR2068 (40.18)



    		SBP2162 (40.77)



    		DBP2101 (40.78)


    		4



    		RR189 (3.30)



    		PR185 (3.59)



    		SBP175 (3.30)



    		DBP169 (3.28)


    		5



    		RR28 (0.49)



    		PR29 (0.56)



    		SBP23 (0.43)



    		DBP22 (0.43)


    		6



    		RR5 (0.09)



    		PR2 (0.04)



    		SBP5 (0.09)



    		DBP5 (0.10)


    		Unassigned



    		RR49 (0.86)



    		PR47 (0.91)



    		SBP50 (0.94)



    		DBP43 (0.83)

    PR (beats per minute)572732-18373.6 (12.2)
    RR (respirations per minute)51478-2316.1 (2.8)
    SBP (mmHg)530371-223130.7 (19.4)
    DBP (mmHg)515246-13679.9 (9.2)

    aVISION-D: Vital Sign Comparison Between Lifelight and Standard of Care: Development.

    bValues for sex and age data are for the enrolled set; data for vital signs are for the full analysis set; only data from adults (>18 years) were analyzed.

    cN/A: not applicable.

    dNot all measurements contributed to each vital sign (eg, not everyone with a Fitzpatrick skin tone of 1 had respiratory rate, pulse rate, systolic blood pressure, and diastolic blood pressure analyzed because of exclusions, such as poor signal quality).

    eRR: respiratory rate.

    fPR: pulse rate.

    gSBP: systolic blood pressure.

    hDBP: diastolic blood pressure.

    Table 3. Performance of Lifelight in VISION-Da.

    		Measurements (n=17,233), n (%)Accuracy, mean error (SD)


    		TargetFull analysis setBPb subgroup
    Pulse rate (beats per minute)10,214 (59)2.2 (9.2)0.3 (4.0)N/Ac
    Respiratory rate (respirations per minute)7462 (43)2.3 (5.0)0.3 (3.6)N/A
    Systolic BP (mmHg)9233 (54)6.7 (15.3)3.5 (16.8)4.1 (17.0)
    Diastolic BP (mmHg)8951 (52)5.5 (8.9)−0.4 (8.5)−1.0 (10.0)

    aVISION-D: Vital Sign Comparison Between Lifelight and Standard of Care: Development.

    bBP: blood pressure.

    cN/A: not applicable.

    ‎
    Figure 4. Heat maps for correlation between Lifelight (test methods) and standard of care (reference) measurements in VISION-D. The density of white points illustrates the extent of overlap. Correlation coefficients (R2) were 0.89 for pulse rate, 0.11 for respiratory rate, 0.30 for systolic blood pressure, and 0.15 for diastolic blood pressure. The line of identity (y=x) illustrates when the Lifelight (test) measurement provided was the same as the reference. bpm: beats per minute; VISION-D: Vital Sign Comparison Between Lifelight and Standard of Care: Development.
    View this figure

    For the Fitzpatrick subgroup, the performance targets were met for PR, RR, and DBP; for SBP, the standard was met for mean error but not SD (Table 4). The regression analysis for skin tone showed only small changes in error between one Fitzpatrick group and the next, with similar changes in error for the FAS and Fitzpatrick subgroup (Table 5).

    As data accumulated, signal processing was used to improve the accuracy of PR and RR measurement and machine learning for BP. The SBP SD decreased from 22 to 14 mmHg over the 12-month study. The proportion of measurements ≤5 mmHg of the reference doubled from 15% to 30%, and the percentage of measurements ≤10 mmHg increased from 30% to 50%.

    Table 4. Performance of Lifelight in VISION-Da in the Fitzpatrick subgroup.b

    		Eligible measurements, nTarget, mean error (SD)Accuracy, mean error (SD)
    Pulse rate (beats per minute)67002.2 (9.2)0.3 (4.0)
    Respiratory rate (respirations per minute)45202.3 (5.0)0.4 (3.7)
    Systolic blood pressure (mmHg)51526.7 (15.3)3.6 (16.6)
    Diastolic blood pressure (mmHg)49605.5 (8.9)−0.4 (8.5)

    aVISION-D: Vital Sign Comparison Between Lifelight and Standard of Care: Development.

    bThe subgroup comprised ≥5% each in groups 1 and 4-6 and ≥20% each for groups 2 and 3.

    Table 5. Regression analysis for skin tone.

    		Full analysis setFitzpatrick subgroup

    		Measurements, nChange in erroraMeasurements, nChange in error
    Pulse rate (beats per minute)10,1310.4567000.46
    Respiratory rate (respirations per minute)73910.1145200.13
    Systolic blood pressure (mmHg)91480.551521.1
    Diastolic blood pressure (mmHg)8870−0.84960−0.8

    aValues are the change in error from one Fitzpatrick group to the next in the full analysis set and the Fitpatrick subgroup, comprising ≥5% each in groups 1 and 4-6 and ≥20% each for groups 2 and 3.

    VISION-V

    Characteristics of the FAS (n=125) are presented in Table 6. There were no protocol deviations or adverse events. For the different VSs, 61%-83% of measurements were eligible for the performance analysis (Table 7). The scatter plots showed good correlations between Lifelight and SOC measurements of VSs (Figure 5). The performance targets for the FAS were met for all VSs (Table 8).

    Table 6. Reference data for the full analysis set in VISION-Va (n=125 participants).
    CharacteristicValueValue, mean (SD)
    Sex, n (%)N/Ab

    		Male55 (44)

    		Female70 (56)
    Age (years), range18-6630.2 (11.6)
    Pulse rate (beats per minute), range47-12779.4 (15.2)
    Respiratory rate (respirations per minute), range6-2714.8 (3.9)
    Systolic blood pressure (mmHg), range96-176.5122.9 (15.9)
    Diastolic blood pressure (mmHg), range62-109.577.8 (7.8)

    aVISION-V: Vital Sign Comparison Between Lifelight and Standard of Care: Validation.

    bN/A: not applicable.

    Table 7. Eligible measurements in VISION-Va.

    		Participants included in analyses, nEligible measurementsb, n (%)
    Pulse rate72308 (83)
    Respiratory rate67143 (61)
    Systolic blood pressure115115 (69)
    Diastolic blood pressure113113 (64)

    aVISION-V: Vital Sign Comparison Between Lifelight and Standard of Care: Validation.

    bComplete measurement sets where the photoplethysmography signal quality was adequate to measure vital signs using Lifelight. Lifelight measurements were eligible for the analysis if the photoplethysmography signal quality was ≥0.85 and the measurement set was complete (one set each for pulse rate, systolic blood pressure, and diastolic blood pressure.

    ‎
    Figure 5. Scatter plots with correlation lines for the vital signs measured with Lifelight (test) versus standard of care (reference) method. Correlation coefficients (R2) were 0.94 for pulse rate (PR), 0.30 for respiratory rate (RR), 0.21 for systolic blood pressure (SBP), and 0.17 for diastolic blood pressure (DBP); 95% Bland-Altman limits of agreement were −5.9 and 8.8 bpm for PR, −6.9 and 6.6 for RR, −25.6 and 31.2 for SBP, and −14.1 and 13.4 for DBP. bpm: beats per minute; rpm: respirations per minute.
    View this figure
    Table 8. Accuracy of Lifelight in VISION-Va.

    		Target accuracy, mean error (SD)Accuracy in VISION-V, mean error (SD)
    Pulse rate (beats per minute)2.2 (9.2)1.4 (3.8)
    Respiratory rate (respirations per minute)2.3 (5.0)−0.1 (3.4)
    Systolic blood pressure (mmHg)6.7 (15.3)2.8 (14.5)
    Diastolic blood pressure (mmHg)5.5 (8.9)–0.3 (7.0)

    aVISION-V: Vital Sign Comparison Between Lifelight and Standard of Care: Validation.


    Principal Results

    VISION-D and VISION-V demonstrate the accuracy of the Lifelight software in the simultaneous contactless measurement of VSs, based on more than 17,000 measurements. The predefined performance targets were met for PR, RR, and DBP in VISION-D; for SBP, the mean error was met but not SD (Table 3). All targets were met in VISION-V (Table 8). On the basis of these data, Lifelight achieved Level 1 CE mark certification as a medical device [14].

    The use of mobile devices for measurement of VSs presents some challenges compared with controlled laboratory scenarios, for example [32]. To mitigate some of these challenges, we have compared VSs that were measured simultaneously by using SOC methods and Lifelight. We believe VISION-D to be the largest study to date to measure VSs using rPPG. As there are currently no standards for contactless measurement of VSs, we developed performance targets in discussion with the HRA and a CE-marking auditor (Table 1). The HRA has accepted these targets for the ongoing VISION-Acute study (NCT04589923), and the targets can therefore be considered applicable to the VISION-V and VISION-D studies. The software algorithms were refined continuously by using data collected during VISION-D, and the final algorithms were used in VISION-V. The accuracy targets (set before data analysis) were met in VISION-V. Although participants in VISION-V had a wide range of VS values, the ISO distribution criteria for BP were not met, likely because the participants were from a healthy population (few had hypotension or hypertension). However, amplifying the proportion of participants with high/low BP in VISION-D did not affect the accuracy of SBP measurement, but the SD for the DBP performance target was no longer met.

    Although the accuracy targets were met for RR, values recorded by Lifelight were 10 to 20 respirations per minute (rpm), whereas the reference values were 5 to 22 rpm, indicating that there may be some loss of accuracy at the slower rates. An RR above 22 rpm is clinically important but was not captured in the VISION-V and VISION-D studies, likely because the participants were mostly healthy. This is being addressed in both the VISION-Acute and the VISION: Multisite Development (VISION-MD) studies (NCT04589923 and NCT04763746, respectively), which are enrolling a broader range of patients with VS values outside the normal range, including some who are critically ill, to improve the accuracy of Lifelight for clinical use.

    Our substantial database from VISION-D includes medical history, temperature, light (lux meter), Fitzpatrick skin tone, facial tattoos, birthmarks, facial hair, etc, which can be used to explore potential interference factors (in contrast to the Medical Information Mart for Intensive Care PPG database of patients who are critically ill [33]).

    Limitations and Future Work

    Studies in 2018 and 2019 demonstrated the potential of PPG to detect changes in cardiovascular activity and the measurement of BP [34-36]; a recent study claims to meet the ISO standards for BP measurement (ISO 81060-2), based on 225 measurements in 85 volunteers [37]. The accuracy in VISION-V was also within the ISO 81060-2 standard (5 ± 8 mmHg) for DBP, and it was within the mean error but not within the SD for SBP, although this ISO relates to the cuff-based measurement of BP. In addition, based on the mean error in VISION-D, the performance of Lifelight was comparable to that reported in the literature for most of the devices on which the standards were based. BP is inherently more complex to measure than PR and RR, in terms of the data form and machine learning and because reference measurements are less accurate.

    As with any recording device, signal quality may be compromised if the participant moves excessively or light levels are insufficient. The proportion of eligible measurements ranged from 61% for RR to 83% for PR. Ineligible measurements were largely due to the inadequate quality (blurring) of the video recordings. Higher-resolution video recording is being used in the current VISION studies (described in more detail below), which is expected to provide a cleaner and more robust signal. However, Lifelight is easy to use, and measurements can be repeated within a minute in the event of a poor signal.

    Skin type is a potential source of error with PPG devices, as melanin absorbs green light, potentially increasing errors in measurements in dark-skinned individuals compared with light-skinned individuals [38]. However, skin type does not affect the accuracy of Lifelight: the performance targets were met for RR, PR, and DBP in the Fitzpatrick subgroup, and mean error was met for SBP but not SD. Moreover, amplifying the proportion of participants with light and dark tones did not affect accuracy. Bent and colleagues [38] also reported that Fitzpatrick skin type had no significant effect on the accuracy of PR measurements by wearable optical heart rate sensors; however, this was a small study (n=53). Although the Fitzpatrick Skin Type Scale is the current gold standard [31], its use has been criticized because of racial bias, weak correlation with skin color, and broad within-group variations in skin tone. Spectrocolorimetry, which uses multiple variables to categorize skin tone objectively, has been proposed as an alternative [31], which may be incorporated into later studies to confirm our findings.

    The accuracy of the Lifelight algorithms will further improve with continuing data collection. The ongoing VISION-MD study is collecting data from a wide range of participants, including patients who are critically ill, which will be used for algorithm development and then testing. Higher-resolution video data are being collected in this study, and the algorithms are focusing on smaller but higher-quality regions of interest.

    Comparison With Prior Work

    The use of rPPG offers several advantages in addition to the rapid and contactless measurement of RR, PR, and BP simultaneously. There is no need for calibration, servicing, cleaning several pieces of equipment, or specialist training. Such advantages are particularly useful in residential care. Indeed, Lifelight has been piloted with the Hampshire Hospitals NHS Foundation Trust as part of a telemedicine service during the COVID-19 pandemic [39]. Care teams found the software easy to use and care was improved, as residents did not need to travel and VSs could be recorded easily by a known carer; clinicians’ travelling time was also reduced. Another study of remote VS monitoring in residential care reported that 87% of emergency department attendances were avoided [40]. Less tangible but valuable benefits include reduced anxiety among staff and residents, particularly the fear of hospitalization [40].

    Notably, RR is often missed from VS monitoring or measured inaccurately [41], but changes in RR can be a harbinger of physiological conditions such as hypoxia, hypercapnia, and acidosis [42]. During the COVID-19 pandemic, patients at risk in England were provided with pulse oximeters, with instructions to seek medical help if oxygen saturation fell below 92% [43]. However, changes to RR indicate increased ventilation and precede reductions in oxygen saturation [41], thus giving an earlier indication of clinical deterioration. A PPG device to record RR would therefore be invaluable in this situation. The COVID-19 pandemic also highlighted the importance of contactless VS measurement [13].

    Conclusion

    This preliminary evaluation of Lifelight demonstrates sufficient accuracy in the measurement of VSs to support Level 1 CE mark certification, with further work ongoing to develop Lifelight into a robust method for measurement of VSs in daily clinical use. As the use of Lifelight does not require specific training or equipment, the software is potentially useful for the contactless measurement of VSs by nonclinical staff in residential and home care settings.

    Acknowledgments

    Xim Ltd won a Small Business Research Initiative (SBRI) Phase II contract to conduct Vital Sign Comparison Between Lifelight and Standard of Care: Development (VISION-D) and an Innovate UK SMART grant to fund Vital Sign Comparison Between Lifelight and Standard of Care: Validation. VISION-D was supported by SBRI Healthcare, a National Health Service England and National Health Service Improvement initiative supported by the Academic Health Science Networks.

    The authors would like to thank all the volunteers who took part in the two studies. The Lifelight Trials Group includes Sharon Allard, Dr Mark Lyons-Amos, Bethany Armstead, Rosalynn Austin, Rebecca Baker, Dr Michelle Baker Moffat, Armida Balawon, Debbi Barnes, Sonia Baryschpolec, Sean Beech, Selina Begum, Lauren Bell, Helen Blackman, Marie Broadway, Kate Burrows, Philippa Copnall, Zoe Daly, Joanne Dash, Mini David, Teresa Day, Jacqueline Denham, Rodrigo Dias, Alison Dimmer, Gemma Dixon, Tracey Dobson, Catherine Edwards, Carole Fogg, Dr Jim Forrer, Francis Galera, Zoe Garner, Andrew Gribbin, Elizabeth Hawes, Serena Howe, Karen Hudson, Amanda Hungate, Victoria Hunter, Jo Kerr, Adam Kiddle, Arjun Kumar, Shanqin Liu, Beverley Longhurst, Sharon McCready, Shoid Miah, Maria Moon, Kirsty Parker, Gina Pelletier, Connie Petronzio, David Petronzio, Michelle Pople, Benildo Jr Quiros, Deidre Rodgers, Dr Mike Sadler, Kerrie Scott, Josh Sephton, Samantha Smith, Bruce Stanley, Nina Szarazova, Nick Thorne, Monika Thwaites, Sarah Tronk, Catherine Tuffrey, Marcus Tuke, Charlotte Turner, James Turner, Lewis Valaitis, Dr Lieke van Putten, Lyn Vinall, Marie White, Melanie Willcox, Jonathon Winter, Carole Wragg, and Kim Wren.

    Authors' Contributions

    The Vital Sign Comparison Between Lifelight and Standard of Care: Validation (VISION-V) protocol was designed by The Clinical Trials Company. The Vital Sign Comparison Between Lifelight and Standard of Care: Development (VISION-D) protocol was designed by MK, TJ, EH, and AC. Both protocols were approved by LP. Data collection was led by the University of Portsmouth for VISION-V (ML and HM) and by Portsmouth Hospitals National Health Service Trust for VISION-D (TJ, EH, MC, LW, TB, and AC). Data analysis and interpretation for both studies were performed by Mind Over Matter Medtech Ltd (ABM and MK), with support from Xim Ltd (JH, SW, and LP), and with support from MS and SR for VISION-D. The paper was developed and revised by HB, and it has been extensively reviewed and approved by all authors.

    Conflicts of Interest

    LP is a shareholder of XIM Ltd.

    1. Buist MD, Jarmolowski E, Burton PR, Bernard SA, Waxman BP, Anderson J. Recognising clinical instability in hospital patients before cardiac arrest or unplanned admission to intensive care. A pilot study in a tertiary-care hospital. Med J Aust 1999 Jul 05;171(1):22-25. [CrossRef] [Medline]
    2. Brekke IJ, Puntervoll LH, Pedersen PB, Kellett J, Brabrand M. The value of vital sign trends in predicting and monitoring clinical deterioration: a systematic review. PLoS One 2019;14(1):e0210875 [FREE Full text] [CrossRef] [Medline]
    3. NEWS frequently asked questions. NHS England. 2021.   URL: https:/​/www.​england.nhs.uk/​ourwork/​clinical-policy/​sepsis/​nationalearlywarningscore/​news-frequently-asked-questions [accessed 2022-09-04]
    4. West Hampshire CCG and Wessex Patient Safety Collaborative. RESTORE2. Yorkshire and Humber AHSN. 2021.   URL: https:/​/www.​yhahsn.org.uk/​wp-content/​uploads/​2020/​05/​RESTORE2-Training-Slides-4_3-WPSC-200401.​03-1586963980-1.​pdf [accessed 2022-09-04]
    5. Panday RSN, Subbe CP, van Galen LS, Kellett J, Brabrand M, Nickel CH, et al. Changes in vital signs post discharge as a potential target for intervention to avoid readmission. Acute Med 2018;17(2):77-82. [Medline]
    6. Flacco ME, Manzoli L, Bucci M, Capasso L, Comparcini D, Simonetti V, et al. Uneven accuracy of home blood pressure measurement: a multicentric survey. J Clin Hypertens (Greenwich) 2015 Aug;17(8):638-643. [CrossRef] [Medline]
    7. Johansson A, Oberg PA, Sedin G. Monitoring of heart and respiratory rates in newborn infants using a new photoplethysmographic technique. J Clin Monit Comput 1999 Dec;15(7-8):461-467. [CrossRef] [Medline]
    8. Poh M, Poh YC. Validation of a standalone smartphone application for measuring heart rate using imaging photoplethysmography. Telemed J E Health 2017 Aug;23(8):678-683. [CrossRef] [Medline]
    9. Aoyagi T, Miyasaka K. Pulse oximetry: its invention, contribution to medicine, and future tasks. Anesth Analg 2002 Jan;94(1 Suppl):S1-S3. [Medline]
    10. Elgendi M, Fletcher R, Liang Y, Howard N, Lovell NH, Abbott D, et al. The use of photoplethysmography for assessing hypertension. NPJ Digit Med 2019;2:60. [CrossRef] [Medline]
    11. Radha M, de Groot K, Rajani N, Wong CCP, Kobold N, Vos V, et al. Estimating blood pressure trends and the nocturnal dip from photoplethysmography. Physiol Meas 2019 Feb 26;40(2):025006. [CrossRef] [Medline]
    12. Nilsson L, Johansson A, Kalman S. Monitoring of respiratory rate in postoperative care using a new photoplethysmographic technique. J Clin Monit Comput 2000;16(4):309-315. [CrossRef] [Medline]
    13. Kumar SS, Dashtipour K, Abbasi QH, Imran MA, Ahmad W. A review on wearable and contactless sensing for COVID-19 with policy challenges. Front Comm Net 2021 May 19;2:636293. [CrossRef]
    14. Lifelight First for monitoring vital signs. National Institute for Health and Care Excellence. 2020 Apr 08.   URL: https://www.nice.org.uk/advice/mib213/chapter/The-technology [accessed 2022-09-14]
    15. Breteler MJM, KleinJan EJ, Dohmen DAJ, Leenen LPH, van Hillegersberg R, Ruurda JP, et al. Vital signs monitoring with wearable sensors in high-risk surgical patients: a clinical validation study. Anesthesiology 2020 Mar;132(3):424-439 [FREE Full text] [CrossRef] [Medline]
    16. Breteler MJM, Huizinga E, van Loon K, Leenen LPH, Dohmen DAJ, Kalkman CJ, et al. Reliability of wireless monitoring using a wearable patch sensor in high-risk surgical patients at a step-down unit in the Netherlands: a clinical validation study. BMJ Open 2018 Feb 27;8(2):e020162 [FREE Full text] [CrossRef] [Medline]
    17. Murali S, Rincon F, Cassina T, Cook S, Goy JJ. Heart rate and oxygen saturation monitoring with a new wearable wireless device in the intensive care unit: pilot comparison trial. JMIR Biomed Eng 2020 Apr 22;5(1):e18158. [CrossRef]
    18. Lee PJ. Clinical evaluation of a novel respiratory rate monitor. J Clin Monit Comput 2016 Apr;30(2):175-183. [CrossRef] [Medline]
    19. Li T, Divatia S, McKittrick J, Moss J, Hijnen NM, Becker LB. A pilot study of respiratory rate derived from a wearable biosensor compared with capnography in emergency department patients. Open Access Emerg Med 2019;11:103-108. [CrossRef] [Medline]
    20. Alfano G, Fontana F, Cappelli G. Noninvasive blood pressure measurement in maintenance hemodialysis patients: comparison of agreement between oscillometric and finger-cuff methods. Nephron 2017;136(4):309-317. [CrossRef] [Medline]
    21. Allan PD, O'Donnell T, Tzeng Y. Agreement between finger plethysmography- and brachial oscillometry-derived blood pressure measurements. Clin Physiol Funct Imaging 2018 May;38(3):439-446. [CrossRef] [Medline]
    22. Becker S, Spiesshoefer J, Brix T, Tuleta I, Mohr M, Emdin M, et al. Validity of transit time-based blood pressure measurements in patients with and without heart failure or pulmonary arterial hypertension across different breathing maneuvers. Sleep Breath 2020 Mar;24(1):221-230. [CrossRef] [Medline]
    23. Gratz I, Deal E, Spitz F, Baruch M, Allen IE, Seaman JE, et al. Continuous non-invasive finger cuff CareTaker® comparable to invasive intra-arterial pressure in patients undergoing major intra-abdominal surgery. BMC Anesthesiol 2017 Mar 21;17(1):48 [FREE Full text] [CrossRef] [Medline]
    24. Tanioku T, Yoshida A, Aratani Y, Fujii K, Kawamata T. Validation of noninvasive continuous arterial pressure measurement by ClearSight System™ during induction of anesthesia for cardiovascular surgery. BMC Anesthesiol 2020 Jul 20;20(1):176 [FREE Full text] [CrossRef] [Medline]
    25. Wang Z, Chen G, Lu K, Zhu Y, Chen Y. Investigation of the accuracy of a noninvasive continuous blood pressure device in different age groups and its ability in detecting hypertension and hypotension: an observational study. BMC Anesthesiol 2019 Dec 05;19(1):223 [FREE Full text] [CrossRef] [Medline]
    26. Jones TL, Heiden E, Mitchell F, Fogg C, McCready S, Pearce L, et al. Developing the accuracy of vital sign measurements using the Lifelight software application in comparison to standard of care methods: observational study protocol. JMIR Res Protoc 2021 Jan 28;10(1):e14326 [FREE Full text] [CrossRef] [Medline]
    27. BS EN ISO 80601-2-61 - Medical electrical equipment. Particular requirements for basic safety and essential performance of pulse oximeter equipment. The British Standards Institution. 2019.   URL: https://landingpage.bsigroup.com/LandingPage/Undated?UPI=000000000030316719 [accessed 2022-09-15]
    28. ISO 81060-2:2018 - Non-invasive sphygmomanometers — Part 2: Clinical investigation of intermittent automated measurement type. International Organization for Standardization. 2019.   URL: https://www.iso.org/standard/73339.html [accessed 2022-09-09]
    29. Brookes CN, Whittaker JD, Moulton C, Dodds D. The PEP respiratory monitor: a validation study. Emerg Med J 2003 Jul;20(4):326-328 [FREE Full text] [CrossRef] [Medline]
    30. Geurts P, Ernst D, Wehenkel L. Extremely randomized trees. Mach Learn 2006 Mar 2;63(1):3-42. [CrossRef]
    31. Colvonen PJ. Response to: investigating sources of inaccuracy in wearable optical heart rate sensors. NPJ Digit Med 2021 Feb 26;4(1):38. [CrossRef] [Medline]
    32. Casalino G, Castellano G, Zaza G. Evaluating the robustness of a contact-less mHealth solution for personal and remote monitoring of blood oxygen saturation. J Ambient Intell Humaniz Comput 2022 Jan 14:1-10 [FREE Full text] [CrossRef] [Medline]
    33. Johnson AEW, Pollard TJ, Shen L, Lehman LH, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data 2016 May 24;3:160035. [CrossRef] [Medline]
    34. Barszczyk A, Lee K. Measuring blood pressure: from cuff to smartphone. Curr Hypertens Rep 2019 Oct 10;21(11):84. [CrossRef] [Medline]
    35. Liu J, Luo H, Zheng PP, Wu SJ, Lee K. Transdermal optical imaging revealed different spatiotemporal patterns of facial cardiovascular activities. Sci Rep 2018 Jul 12;8(1):10588. [CrossRef] [Medline]
    36. Wei J, Luo H, Wu SJ, Zheng PP, Fu G, Lee K. Transdermal optical imaging reveal basal stress via heart rate variability analysis: a novel methodology comparable to electrocardiography. Front Psychol 2018;9:98. [CrossRef] [Medline]
    37. Yang D, Xiao G, Wei J, Luo H. Preliminary assessment of video-based blood pressure measurement according to ANSI/AAMI/ISO81060-2: 2013 guideline accuracy criteria: Anura smartphone app with transdermal optimal imaging technology. Blood Press Monit 2020 Oct;25(5):295-298. [CrossRef] [Medline]
    38. Bent B, Goldstein BA, Kibbe WA, Dunn JP. Investigating sources of inaccuracy in wearable optical heart rate sensors. NPJ Digit Med 2020;3:18. [CrossRef] [Medline]
    39. Remote monitoring of vital signs. NHS Transformation Directorate. 2020 Oct 08.   URL: https://www.nhsx.nhs.uk/ai-lab/explore-all-resources/understand-ai/remote-monitoring-vital-signs/ [accessed 2022-09-04]
    40. Implementing remote monitoring in care homes: 3 lessons learned. Current Health. 2021.   URL: https://www.currenthealth.com/resources/blog/implementing-remote-monitoring-in-care-homes/ [accessed 2022-09-04]
    41. Kelly C. Respiratory rate 1: why measurement and recording are crucial. Nurs Times 2018;114:23-24 [FREE Full text]
    42. Rolfe S. The importance of respiratory rate monitoring. Br J Nurs 2019 Apr 25;28(8):504-508. [CrossRef] [Medline]
    43. COVID-19 guidance note: COVID oximetry @home. NHS England. 2020.   URL: https:/​/www.​england.nhs.uk/​coronavirus/​publication/​novel-coronavirus-covid-19-standard-operating-procedure-covid-oximetry-home/​ [accessed 2022-09-04]

    ‎
    BP: blood pressure
    CE: Conformité Européenne
    DBP: diastolic blood pressure
    FAS: full analysis set
    HRA: Health Research Authority
    ISO: International Organization for Standardization
    NEWS: National Early Warning Score
    NHS: National Health Service
    PPG: photoplethysmography
    PR: pulse rate
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
    RESTORE2: Recognise Early Soft Signs, Take Observations, Respond, Escalate
    rpm: respirations per minute
    rPPG: remote photoplethysmography
    RR: respiratory rate
    SBP: systolic blood pressure
    SOC: standard of care
    VISION: Vital Sign Comparison Between Lifelight and Standard of Care
    VISION-D: Vital Sign Comparison Between Lifelight and Standard of Care: Development
    VISION-MD: Vital Sign Comparison Between Lifelight and Standard of Care: Multisite Development
    VISION-V: Vital Sign Comparison Between Lifelight and Standard of Care: Validation
    VS: vital sign

    Edited by A Mavragani; submitted 24.01.22; peer-reviewed by J Kellett, N Georgi; comments to author 11.05.22; revised version received 29.06.22; accepted 29.06.22; published 14.11.22

    Copyright

    ©Emily Heiden, Tom Jones, Annika Brogaard Maczka, Melissa Kapoor, Milan Chauhan, Laura Wiffen, Helen Barham, Jeremy Holland, Manish Saxena, Simon Wegerif, Thomas Brown, Mitch Lomax, Heather Massey, Shahin Rostami, Laurence Pearce, Anoop Chauhan. Originally published in JMIR Formative Research (https://formative.jmir.org), 14.11.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.