Original Paper
Abstract
Background: At the start of the COVID-19 pandemic, unprecedented pressure was placed on health care services globally. An opportunity to alleviate this pressure was to introduce a digital health platform that provided COVID-19–related advice and helped individuals understand and manage their COVID-19 symptoms. Therefore, in July 2020, the Your COVID Recovery website was launched by the National Health Service of England with the aim of creating a practical tool that provides advice and support to individuals recovering from COVID-19. The website includes information on many of the key COVID-19 symptoms. To date, public use of the Your COVID Recovery website and user behavior remain unknown. However, this information is likely to afford insight into the impact of the website and most commonly experienced COVID-19 symptoms.
Objective: This study aimed to evaluate public use of the Your COVID Recovery website, a digital health platform that provides support to individuals recovering from COVID-19, and determine user behavior during its first year of operation.
Methods: Google Analytics software that was integrated into the Your COVID Recovery website was used to assess website use and user behavior between July 31, 2020, and July 31, 2021. Variables that were tracked included the number of users, user country of residence, traffic source, number of page views, number of session views, and mean session duration. User data were compared to COVID-19 case data downloaded from the UK government’s website.
Results: During the study period, 2,062,394 users accessed the Your COVID Recovery website. The majority of users were located in the United Kingdom (1,265,061/2,062,394, 61.30%) and accessed the website via a search engine (1,443,057/2,062,394, 69.97%). The number of daily website users (n=15,298) peaked on January 18, 2021, during the second wave of COVID-19 in the United Kingdom. The most frequently visited pages after the home page were for the following COVID-19 symptoms: Cough (n=550,190, 12.17%), Fatigue (n=432,421, 9.56%), Musculoskeletal pain (n=406,859, 9.00%), Taste and smell (n=270,599, 5.98%), and Breathlessness (n=203,136, 4.49%). The average session duration was 1 minute 13 seconds.
Conclusions: A large cohort of individuals actively sought help with their COVID-19 recovery from the website, championing the potential of this tool to target an unmet health care need. User behavior demonstrated that individuals were primarily seeking advice on how to relieve and manage COVID-19 symptoms, especially symptoms of cough, fatigue, and musculoskeletal pain. COVID-19 rehabilitation programs should use the results of this study to ensure that the program content meets the needs of the post–COVID-19 population.
doi:10.2196/37811
Keywords
Introduction
The COVID-19 pandemic, caused by SARS-CoV-2, created a public health emergency of international concern [
]. At the time of this writing, there have been over 22 million confirmed cases, 945,000 hospital admissions, and 175,000 deaths related to COVID-19 in the United Kingdom [ ]. Globally, these figures are compounded, with more than 6.4 million deaths worldwide [ ].Symptoms of COVID-19 have been reported in the acute phase of the infection, short-term follow-up, and in the succeeding months [
- ]. The symptoms experienced at these time points have been catalogued among both individuals who were hospitalized due to COVID-19 and those who managed their infection in the community [ - ]. Individuals experiencing COVID-19 symptoms for more than 12 weeks post infection are considered to have post–COVID-19 syndrome or post–COVID-19 condition [ , ].Commonly reported symptoms of COVID-19, irrespective of how the initial infection was managed, include fatigue, dyspnea, fever, headaches, loss of taste and smell, and musculoskeletal pain [
- ]. Together with the cognitive and psychological symptoms of COVID-19, these physical symptoms impact quality of life, health, and activities of daily living [ - , ]. The World Health Organization, which proposed the definition of post–COVID-19 condition, acknowledge that these symptoms can fluctuate in terms of number and severity [ ].Recovery and ongoing symptom burden from COVID-19 has been reported in a number of large cohorts [
- ]. These studies describe blunted recovery for a large proportion of individuals. Indeed, symptoms persist for months in up to 92% and 36% of hospitalized and nonhospitalized individuals, respectively [ - ]. The Post-Hospitalisation COVID-19 (PHOSP-COVID) study, a large multicenter follow-up study in the United Kingdom, reported that ~6 months post hospital discharge for COVID-19, only 29% of individuals felt fully recovered [ ]. Several characteristics are associated with an increased likelihood of post–COVID-19 condition, including increasing age and BMI and female sex [ ]. Thus, there is a pressing need to provide reliable and accurate information to support recovery from COVID-19 at scale.Digital health platforms, including websites and smartphone apps, represent an opportunity to provide rapid access to education and self-management tools to millions of people, overcoming the constraints of health care professional time and social distancing rules. Due to these characteristics, the pandemic has witnessed a rapid increase in the application of digital technologies that aim to mitigate the impact of COVID-19 on individuals and health systems [
]. During the early stages of the pandemic, digital technologies were implemented to prevent and detect COVID-19 infections; for example, Singapore and Taiwan introduced a mobile contact tracing app to reduce the transmission of SARS-CoV-2 [ , ]. Digital tools were also used to host digital consultations and monitor the vital signs and symptoms of patients managing their COVID-19 infection in the community [ , ]. However, no digital tool was available in the United Kingdom, which provided general information on all elements of recovering from COVID-19, including the physical, emotional, and psychological well-being.Therefore, in reaction to the urgent need to support individuals throughout their COVID-19 recovery, the Your COVID Recovery website was launched on July 31, 2020 [
]. Created by a research team at University Hospitals of Leicester in collaboration with health care professionals, professional bodies, patients with COVID-19, and the National Health Service (NHS) of England, this website is freely accessible to everyone with internet access. The website contains information on the effects of COVID-19 on the mind and body, including guidance on how to relieve and manage >15 COVID-19 symptoms. Information on how to manage daily activities, cope with grief and bereavement, return to work, and access additional support is also available on the website.The use of this digital health platform is yet to be assessed but may inform whether it effectively targets an unmet health care need. Understanding the health issues in individuals recovering from COVID-19 is paramount to developing and implementing effective treatment strategies. Characterizing the knowledge seeking behaviors of individuals recovering from COVID-19 is likely to provide insight into the symptoms individuals are experiencing and the health care support required. Currently, information seeking behaviors in relation to COVID-19 remain largely unknown [
]. Therefore, the aim of this study was to assess usage patterns of the Your COVID Recovery website to understand public use and user behavior during its first year of operation.Methods
Aggregate data sourced from Google Analytics were used to assess website use and user behavior. Google collects and links actions via a JavaScript code installed on the website. All extracted data were anonymous. The “Privacy and Cookies” page on the Your COVID Recovery website outlines how information on user activity is collected and how visitors can opt out of data collection.
The following data were collected to assess website use and user engagement: number of users, user country of residence, traffic source, number of page views, number of sessions per user, and mean session duration. A page view occurs when a single page is loaded or reloaded in a browser, whereas a session refers to a group of interactions with the website, which take place within a set time frame (sessions end after 30 minutes of inactivity). User data were compared to COVID-19 case data downloaded from the UK government’s website [
].Results
Website Users
In one year (between July 31, 2020, and July 31, 2021), the Your COVID Recovery website had 2,062,394 users from 187 countries. More than half of these users (1,265,061/2,062,394, 61.30%) were from the United Kingdom, with 14.27% (294,321/2,062,394) of all users located in London (
).Users were primarily acquired from an organic search (1,443,057/2,062,394, 69.97%; traffic from search engines), a direct search (290,591/2,062,394, 14.09%; entering the website address in a browser search bar), through referrals (269,142/2,062,394, 13.05%; traffic from other websites providing a website link), and social media (58,160/2,062,394, 2.82%). There were no paid advertisements for the website and 1444 of 2,062,394 (0.07%) users accessed the website via email. The top 3 referral websites were owned by the NHS, British Broadcasting Corporation, and British Heart Foundation. Almost all users used a mobile phone (1,559,072/2,062,394, 75.59%) or desktop computer (437,190/2,062,394, 21.20%) to access the website.
The mean number of daily users who accessed the website each month is shown in
; the number of users (n=15,298) peaked on January 18, 2021, during the second wave of COVID-19 in the United Kingdom ( ).Country | Users, n (%) |
United Kingdom | 1,265,061 (61.30) |
United States | 334,162 (16.20) |
India | 203,588 (9.87) |
South Africa | 30,987 (1.50) |
Canada | 23,431 (1.14) |
Ireland | 11,789 (0.57) |
Philippines | 11,303 (0.55) |
Pakistan | 11,283 (0.55) |
United Arab Emirates | 10,954 (0.53) |
Other countriesa | 156,309 (7.58) |
aCountries that account for less than 0.5% of total users. Data were not available for 0.17% of users.
User Behavior
The Your COVID Recovery home page had the highest number of page views (1,300,622/4,522,182, 28.76%). This page contains information on the purpose of the website and links to all other pages. After the home page, the following pages received the most views: Cough (550,190/4,522,182, 12.17%), Fatigue (432,421/4,522,182, 9.56%), Musculoskeletal pain (406,859/4,522,182, 9.00%), Taste and smell (270,599/4,522,182, 5.98%), and Breathlessness (203,136/4,522,182, 4.49%). All these pages provide advice on how to relieve and manage a specific COVID-19 symptom and when to seek further help. Shifts in user behavior occurred throughout the study period;
shows monthly page views for the 10 most viewed pages.User Engagement
During the first year of operation, there were 2,642,377 sessions. Most users (2,068,638/2,642,377, 78.29%) visited the website once (
). On average, users viewed 1.71 pages per session with an average session duration of 1 minute 13 seconds ( ).Session frequency | Sessions, n (%) |
1 | 2,068,638 (78.29) |
2 | 331,462 (12.54) |
3 | 98,563 (3.73) |
4 | 43,872 (1.66) |
5 | 24,128 (0.91) |
6 | 15,185 (0.57) |
7 | 10,402 (0.39) |
8 | 7441 (0.28) |
9-14 | 20,862 (0.79) |
15-25 | 10,955 (0.41) |
26-50 | 6002 (0.23) |
51-100 | 2644 (0.10) |
101-200 | 1367 (0.05) |
≥201 | 856 (0.03) |
Session duration (minutes) | Sessions, n (%) |
≤1 | 2,204,368 (83.42) |
>1 to ≤3 | 175,896 (6.66) |
>3 to ≤10 | 167,892 (6.35) |
>10 | 94,221 (3.57) |
Discussion
Principal Findings
This study was the first to investigate public use of the Your COVID Recovery website and user behavior during its first year of operation. The website contains a myriad of resources, including information on how to manage daily activities, get moving again, care for friends and family, cope with grief and bereavement, and relieve and manage >15 COVID-19 symptoms. Our data show that more than 2 million individuals accessed the website in a 12-month period, primarily to view information on COVID-19 symptoms. Taken together, these findings highlight the potential of this novel tool to help millions of people with their COVID-19 recovery without placing additional strain on health care services.
Number of Website Users
As previously stated, over 2 million users from 187 countries accessed the Your COVID Recovery website in the study period. Our results show that a large cohort of individuals were actively seeking support with their COVID-19 recovery and were willing to receive this support via a digital health platform. In line with this behavior, other studies have reported an increase in the use of digital social platforms to look up information during the pandemic, potentially due to the isolation imposed by the pandemic [
, ]. The authors of this paper are unaware of any similar health care platforms, negating comparisons between user numbers. However, the large number of website users in this study aligns with the public’s high level of willingness to use other digital tools generated during the pandemic, such as contact tracing apps [ ]. We also report that the majority of users accessed the website via organic search (ie, through a search engine)—an observation that is consistent with the information seeking behaviors of university students in Germany during the early stages of the COVID-19 pandemic [ ].Generally, changes in the number of daily website visitors mirrored those in the number of UK COVID-19 cases (
). However, several spikes in the number of daily website visitors occurred between August 2020 and November 2020 ( ). Throughout the study period, the website was shared by collaborators, charities, media outlets, and members of the public on an ad hoc basis via news reports, email, and social media platforms; there was no marketing plan in place. The acquisition report on Google Analytics shows that the majority of the aforementioned spikes in website visitors were consequent to an increase in referrals from media outlets. A spike in website users also occurred during April 2021, approximately 10 weeks after the peak of the second wave of COVID-19 in the United Kingdom. At this time, the number of new daily COVID-19 cases was less than 1000 ( ). This suggests that the UK public accessed the website in response to acute COVID-19 infections and persistent COVID-19 symptoms.User Behavior
Users were primarily seeking information on how to relieve and manage COVID-19 symptoms. The top 5 pages viewed suggest that individuals would like more information on the following symptoms: Cough, Fatigue, Musculoskeletal pain, Loss of taste and smell, and Breathlessness. Consistent with these page views, 5 months after a COVID-19–related hospitalization, 92.8% (632/855) of patients had a persistent symptom, and the most common symptoms were muscle pain, fatigue, and physical slowing down [
]. Likewise, in a cohort of hospitalized and nonhospitalized patients, 4 months after a COVID-19 infection, the most common symptoms were fatigue, breathlessness, and muscle ache [ ]. Thus, page views on the Your COVID Recovery website align with the most frequently reported COVID-19 symptoms.The number of views received by the top 10 pages each month tended to follow the same trend, except for cough (
). The factors underpinning the increase in cough page views between March and May 2021 are unclear. The increase in cough page views does not coincide with an increase in page referrals from a single source, suggesting that it is not the result of an external organization promoting the web page. Furthermore, the authors are unaware of any events, announcements, or government initiatives within this period, which may have propagated page views. Thus, it is tempting to speculate that the observation may reflect an increase in individuals experiencing a COVID-19–related cough between March and May 2021. However, further work is needed to investigate this notion and resolve the cause.Rehabilitation services should ensure that information on the most viewed symptoms is included in their programs to meet the demands of the post–COVID-19 population. Health care professionals involved in acute COVID-19 care and the post–COVID-19 condition care pathway should also discuss the most commonly sought symptoms with patients and signpost patients to the website for symptom support.
Limitations
The limitations of this study relate to the use of Google Analytics. A new client ID is created each time a user deletes the browser cookies, uses a different browser, or switches devices. Subsequently, the same user can be counted as a new user [
]. Nevertheless, this parameter provides a strong indication of website use.User demographics can only be collected from users who are logged into their Google account when visiting the website. In this study, demographics were collected for 366,281/2,062,394 (17.76%) of users and were, therefore, not reported. This information is crucial to understand the true use of the website and develop initiatives that target poorly engaged populations. Previously, several factors have been linked to information seeking about COVID-19, including living in an urban area, perceived disease susceptibility, perceived disease severity, higher self-efficacy, and higher health literacy [
].Pages on chest pain and headaches post–COVID-19 infection were added to the website on June 1, 2021, and included in the analysis. The popularity of these pages remains unclear due to the content only being available for 4 weeks of the study period. Finally, the website may have obviated the need for phone-based or physical appointments between health care professionals and individuals recovering from COVID-19, bridging the gap between demand and limited health care resources. However, to confirm this, further investigation is necessary.
Conclusions
This study describes the usage patterns of the Your COVID Recovery website during its first year of operation. Over 2 million users accessed the website, demonstrating that individuals are keen to receive digital health care support with their COVID-19 recovery. Users primarily visited the website to attain information on how to relieve and manage COVID-19 symptoms, particularly cough, fatigue, and musculoskeletal pain.
Acknowledgments
We thank everyone who contributed toward the creation of the Your COVID Recovery website. This includes Chloe Adams, Rebecca Barclay, Annette Bishop, Laura Breach, Camilla Dawson, Helen Harte, Kim Hicklin, Sally Hinton, Steve Holmes, David Murphy, Diane Playford, Ruth Ten Hove, Lauren Walker, Tammy Walker, and Emily Walters, who are part of the Your COVID Recovery Core Group. We are also very grateful to the other health care professionals, professional bodies, patients, and the National Health Service (NHS) of England, who helped create and review website content. Finally, we would like to thank NHS England for project funding and GlaxoSmithKline for the unrestricted educational grant that supported the development of the website. SJS is a National Institute for Health Research (NIHR) Senior Investigator.
Disclaimer
The views expressed in this paper are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.
Conflicts of Interest
None declared.
References
- Jasarevic T, Lindmeier C, Chaib F. Statement on the second meeting of the International Health Regulations (2005) Emergency Committee regarding the outbreak of novel coronavirus (2019-nCoV). World Health Organization. 2020. URL: https://tinyurl.com/yckuww9y [accessed 2022-08-16]
- Coronavirus (COVID-19) in the UK. Government of the United Kingdom. URL: https://coronavirus.data.gov.uk [accessed 2022-08-16]
- COVID-19 Dashboard. Johns Hopkins University & Medicine. Coronavirus Resource Center. URL: https://coronavirus.jhu.edu/map.html [accessed 2022-08-16]
- Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, et al. Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China. JAMA 2020 Mar 17;323(11):1061-1069 [FREE Full text] [CrossRef] [Medline]
- Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020 Feb 15;395(10223):497-506 [FREE Full text] [CrossRef] [Medline]
- Evans RA, McAuley H, Harrison EM, Shikotra A, Singapuri A, Sereno M, PHOSP-COVID Collaborative Group. Physical, cognitive, and mental health impacts of COVID-19 after hospitalisation (PHOSP-COVID): a UK multicentre, prospective cohort study. Lancet Respir Med 2021 Nov;9(11):1275-1287 [FREE Full text] [CrossRef] [Medline]
- D'Cruz RF, Waller MD, Perrin F, Periselneris J, Norton S, Smith L, et al. Chest radiography is a poor predictor of respiratory symptoms and functional impairment in survivors of severe COVID-19 pneumonia. ERJ Open Res 2021 Jan;7(1) [FREE Full text] [CrossRef] [Medline]
- Carfì A, Bernabei R, Landi F, Gemelli Against COVID-19 Post-Acute Care Study Group. Persistent Symptoms in Patients After Acute COVID-19. JAMA 2020 Aug 11;324(6):603-605 [FREE Full text] [CrossRef] [Medline]
- Bliddal S, Banasik K, Pedersen OB, Nissen J, Cantwell L, Schwinn M, et al. Acute and persistent symptoms in non-hospitalized PCR-confirmed COVID-19 patients. Sci Rep 2021 Jun 23;11(1):13153 [FREE Full text] [CrossRef] [Medline]
- COVID-19 rapid guideline: managing the long-term effects of COVID-19. National Institute for Health and Care Excellence. URL: https://www.nice.org.uk/guidance/ng188 [accessed 2022-08-16]
- Soriano JB, Murthy S, Marshall JC, Relan P, Diaz JV, WHO Clinical Case Definition Working Group on Post-COVID-19 Condition. A clinical case definition of post-COVID-19 condition by a Delphi consensus. Lancet Infect Dis 2022 Apr;22(4):e102-e107 [FREE Full text] [CrossRef] [Medline]
- Jacobs LG, Gourna Paleoudis E, Lesky-Di Bari D, Nyirenda T, Friedman T, Gupta A, et al. Persistence of symptoms and quality of life at 35 days after hospitalization for COVID-19 infection. PLoS One 2020;15(12):e0243882 [FREE Full text] [CrossRef] [Medline]
- Sudre CH, Murray B, Varsavsky T, Graham MS, Penfold RS, Bowyer RC, et al. Attributes and predictors of long COVID. Nat Med 2021 Apr;27(4):626-631 [FREE Full text] [CrossRef] [Medline]
- Golinelli D, Boetto E, Carullo G, Nuzzolese AG, Landini MP, Fantini MP. Adoption of digital technologies in health care during the COVID-19 pandemic: systematic review of early scientific literature. J Med Internet Res 2020 Nov 06;22(11):e22280 [FREE Full text] [CrossRef] [Medline]
- Ting DSW, Carin L, Dzau V, Wong TY. Digital technology and COVID-19. Nat Med 2020 Apr 27;26(4):459-461 [FREE Full text] [CrossRef] [Medline]
- Lee B, Ibrahim SA, Zhang T. Mobile apps leveraged in the COVID-19 pandemic in East and South-East Asia: review and content analysis. JMIR Mhealth Uhealth 2021 Nov 11;9(11):e32093 [FREE Full text] [CrossRef] [Medline]
- Greenhalgh T, Koh GCH, Car J. Covid-19: a remote assessment in primary care. BMJ 2020 Mar 25;368:m1182. [CrossRef] [Medline]
- Kim JH, Choi WS, Song JY, Yoon YK, Kim MJ, Sohn JW. The role of smart monitoring digital health care system based on smartphone application and personal health record platform for patients diagnosed with coronavirus disease 2019. BMC Infect Dis 2021 Feb 27;21(1):229 [FREE Full text] [CrossRef] [Medline]
- Your COVID Recovery. NHS England. URL: https://www.yourcovidrecovery.nhs.uk [accessed 2022-08-16]
- Kassie SY, Melese T, Handebo S, Sebastian Y, Ngusie HS. Information seeking about COVID-19 and associated factors among chronic patients in Bahir Dar city public hospitals, Northwest Ethiopia: a cross-sectional study. BMC Infect Dis 2022 Apr 01;22(1):325 [FREE Full text] [CrossRef] [Medline]
- Banerjee D, Meena KS. COVID-19 as an "Infodemic" in public health: critical role of the social media. Front Public Health 2021 Mar 18;9:610623 [FREE Full text] [CrossRef] [Medline]
- Zhao Y, Cheng S, Yu X, Xu H. Chinese public's attention to the COVID-19 epidemic on social media: observational descriptive study. J Med Internet Res 2020 May 04;22(5):e18825 [FREE Full text] [CrossRef] [Medline]
- Altmann S, Milsom L, Zillessen H, Blasone R, Gerdon F, Bach R, et al. Acceptability of app-based contact tracing for COVID-19: cross-country survey study. JMIR Mhealth Uhealth 2020 Aug 28;8(8):e19857 [FREE Full text] [CrossRef] [Medline]
- Dadaczynski K, Okan O, Messer M, Leung AYM, Rosário R, Darlington E, et al. Digital health literacy and web-based information-seeking behaviors of university students in Germany during the COVID-19 pandemic: cross-sectional survey study. J Med Internet Res 2021 Jan 15;23(1):e24097 [FREE Full text] [CrossRef] [Medline]
- Dennis A, Wamil M, Alberts J, Oben J, Cuthbertson DJ, Wootton D, COVERSCAN study investigators. Multiorgan impairment in low-risk individuals with post-COVID-19 syndrome: a prospective, community-based study. BMJ Open 2021 Mar 30;11(3):e048391 [FREE Full text] [CrossRef] [Medline]
- Clark DJ, Nicholas D, Jamali HR. Evaluating information seeking and use in the changing virtual world: the emerging role of Google Analytics. Learn Publ 2014;27(3):163-239 [FREE Full text] [CrossRef]
Abbreviations
NHS: National Health Service |
PHOSP-COVID: Post-Hospitalisation COVID-19 |
Edited by A Mavragani; submitted 08.03.22; peer-reviewed by M Waller, K Arteaga-Livias; comments to author 01.06.22; revised version received 03.08.22; accepted 22.08.22; published 20.01.23
Copyright©Molly M Baldwin, Enya Daynes, Emma Chaplin, Amye Goddard, Phoebe H I Lloyd-Evans, George Mills, Annabel Hong, Nikki Gardiner, Sally J Singh. Originally published in JMIR Formative Research (https://formative.jmir.org), 20.01.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.