This paper is in the following e-collection/theme issue:

Development and Evaluation of Research Methods, Instruments and Tools (481) Web-based and Mobile Health Interventions (3297) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1514) Methods and New Tools in Mental Health Research (454) E-Health / Health Services Research and New Models of Care (517) Health Professionals' Training in eHealth, Digital Medicine, Medical Informatics (104) Diagnostic Tools in Mental Health (242)

Published on in Vol 7 (2023)

This is a member publication of University of Cambridge (Jisc)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/43271, first published .
Opportunities for the Implementation of a Digital Mental Health Assessment Tool in the United Kingdom: Exploratory Survey Study

Opportunities for the Implementation of a Digital Mental Health Assessment Tool in the United Kingdom: Exploratory Survey Study

Opportunities for the Implementation of a Digital Mental Health Assessment Tool in the United Kingdom: Exploratory Survey Study

Authors of this article:

Benedetta Spadaro1 Author Orcid Image ;   Nayra A Martin-Key1 Author Orcid Image ;   Erin Funnell1, 2 Author Orcid Image ;   Jiří Benáček1 Author Orcid Image ;   Sabine Bahn1, 2 Author Orcid Image
Article Authors Cited by (2) Tweetations (2) Metrics

    Original Paper

    1Cambridge Centre for Neuropsychiatric Research, Department of Chemical Engineering, University of Cambridge, Cambridge, United Kingdom

    2Psyomics Ltd, Cambridge, United Kingdom

    *these authors contributed equally

    Corresponding Author:

    Sabine Bahn, MD, PhD

    Cambridge Centre for Neuropsychiatric Research

    Department of Chemical Engineering

    University of Cambridge

    Philippa Fawcett Drive

    Cambridge, CB3 0AS

    United Kingdom

    Phone: 44 1223 334151

    Email: sb209@cam.ac.uk


    Background: Every year, one-fourth of the people in the United Kingdom experience diagnosable mental health concerns, yet only a proportion receive a timely diagnosis and treatment. With novel developments in digital technologies, the potential to increase access to mental health assessments and triage is promising.

    Objective: This study aimed to investigate the current state of mental health provision in the United Kingdom and understand the utility of, and interest in, digital mental health technologies.

    Methods: A web-based survey was generated using Qualtrics XM. Participants were recruited via social media. Data were explored using descriptive statistics.

    Results: The majority of the respondents (555/618, 89.8%) had discussed their mental health with a general practitioner. More than three-fourths (503/618, 81.4%) of the respondents had been diagnosed with a mental health disorder, with the most common diagnoses being depression and generalized anxiety disorder. Diagnostic waiting times from first contact with a health care professional varied by diagnosis. Neurodevelopmental disorders (30/56, 54%), bipolar disorder (25/52, 48%), and personality disorders (48/101, 47.5%) had the longest waiting times, with almost half (103/209, 49.3%) of these diagnoses taking >6 months. Participants stated that waiting times resulted in symptoms worsening (262/353, 74.2%), lower quality of life (166/353, 47%), and the necessity to seek emergency care (109/353, 30.9%). Of the 618 participants, 386 (62.5%) stated that they felt that their mental health symptoms were not always taken seriously by their health care provider and 297 (48.1%) were not given any psychoeducational information. The majority of the respondents (416/595, 77.5%) did not have the chance to discuss mental health support and treatment options. Critically, 16.1% (96/595) did not find any treatment or support provided at all helpful, with 63% (48/76) having discontinued treatment with no effective alternatives. Furthermore, 88.3% (545/617) of the respondents) had sought help on the web regarding mental health symptoms, and 44.4% (272/612) had used a web application or smartphone app for their mental health. Psychoeducation (364/596, 61.1%), referral to a health care professional (332/596, 55.7%), and symptom monitoring (314/596, 52.7%) were the most desired app features. Only 6.8% (40/590) of the participants said that they would not be interested in using a mental health assessment app. Respondents were the most interested to receive an overall severity score of their mental health symptoms (441/546, 80.8%) and an indication of whether they should seek mental health support (454/546, 83.2%).

    Conclusions: Key gaps in current UK mental health care provision are highlighted. Assessment and treatment waiting times together with a lack of information regarding symptoms and treatment options translated into poor care experiences. The participants’ responses provide proof-of-concept support for the development of a digital mental health assessment app and valuable recommendations regarding desirable app features.

    JMIR Form Res 2023;7:e43271

    doi:10.2196/43271

    Keywords

    assessment; digital mental health; development; implementation; mental health; provision; support; mobile phone 


    Background

    Mental health concerns in the United Kingdom are prevalent and growing [1]. More recently, the COVID-19 pandemic has led to further increases in the incidence of adverse mental health symptoms, substance use, and suicidal ideation in the United Kingdom and worldwide [2,3]. Treatment options exist, and they are often effective for most mental health conditions; however, underdiagnosis and misdiagnosis are common, resulting in inappropriate and ineffective treatment. In the United Kingdom, only 1 in 8 adults receives mental health treatment [4], and it is estimated that at least 75% of the people with poor mental health do not get access to the right treatment [5]. Readily available opportunities for mental health assessments or screening may be useful to identify concerns earlier, allowing for patient stratification and, in turn, personalized treatment plans and strategies. Data show that early identification and home treatment for mental health problems can decrease hospital admissions, reducing high-cost intensive interventions [6].

    To this end, web applications and smartphone apps may offer an innovative and cost-effective way to improve mental health care detection and diagnosis. Indeed, mental health assessment apps have the potential to support individuals by screening for mental health symptoms and supporting self-management [7] while aiding primary care professionals and less experienced mental health workers in clinical decision-making. In fact, digital technologies can help alleviate the load on the health care system by providing individuals with subthreshold or mild mental health symptoms with self-help tips and psychoeducation, thereby reserving the limited and specialized services for patients with more severe and complex symptoms.

    Interestingly, it has been shown that patients are more inclined to report severe mental health symptoms on technology platforms than to a health care professional (HCP) [8], and patients value the empowerment and autonomy that can be obtained via the use of a digital platform [9]. These technologies also have the potential to aid in engaging typically hard-to-reach patient populations by reducing stigma and facilitating help-seeking behaviors [10]. Importantly, the acceptability and efficacy of digital platforms for improving the reach, quality, and impact of mental health care have been previously demonstrated [11], with research on digital screening and monitoring technologies showing feasibility across a range of mental health conditions [12]. Despite this, evidence also suggests low user engagement [13] and a high dropout rate for mental health apps [14,15], particularly in real-world settings [16]. In this regard, further insights into the promise of digital technologies for mental health screening and assessment are required, particularly in regard to investigating existing unmet mental health care needs and establishing potential users’ views on using a mental health app.

    Objectives

    To this end, we set to investigate the potential value proposition of a mental health assessment app. To do this, we conducted a study that was divided into two parts: (1) a web-based anonymous survey and (2) a series of web-based semistructured interviews. This paper presents the results from part 1 of the study. The aim of this study was to understand the current state of mental health care provision in the United Kingdom and to explore experiences with digital technologies for mental health. To this end, the first objective was to explore experiences with mental health care provision offered via health care services and the workplace over the last 5 years. The second and third objectives were to explore the use of, and interest in, digital technologies for mental health, including web applications or smartphone apps, and to investigate attitudes toward using a mental health assessment app to screen, aid in the diagnosis, and triage mental health concerns, respectively. The findings from this survey have important implications regarding the mental health care experiences of those who sought help and their preferences for future mental health app design.


    Participants

    Participants were recruited between November 15, 2021, and February 7, 2022, via email, paid Facebook and Instagram advertisements, unpaid posts on the Cambridge Centre for Neuropsychiatric Research Facebook and Twitter pages, and Reddit. Recruitment messages were also disseminated by word of mouth and through relevant foundations and support groups. The inclusion criteria for the study were as follows: (1) aged ≥18 years, (2) UK residence, and (3) had visited an HCP in the previous 5 years (between 2016 and 2021) to discuss mental health symptoms. These criteria were chosen to yield an adult population sample that would represent potential users of a mental health app. The 5-year time frame was chosen to gather feedback and experiences regarding recent mental health provision provided via health care services and workplaces in the United Kingdom. There were no other inclusion criteria. Participants were invited to enter their email address for the chance to win 1 of 3 high street vouchers worth £50 (US $60) each.

    Ethics Approval

    The study was approved by the Cambridge Human Biology Research Ethics Committee (PRE.2021.053).

    Informed Consent

    All participants provided informed consent electronically before participating in the study.

    Materials and Procedure

    An anonymous web-based survey was created using Qualtrics XM to explore the current state of mental health care provision in the United Kingdom and attitudes toward using a mental health assessment app to screen, diagnose, and triage mental health symptoms. The survey could be completed in 20 to 25 minutes and comprised four sections: (1) sociodemographic information, (2) mental health symptoms and experience of health care service provision, (3) the impact of mental health symptoms in the workplace as well as the experience of mental health provision in the workplace, and (4) experiences and interest in using digital technology for mental health. The survey was adaptive in nature such that only relevant questions were asked based on previous responses. Questions regarding waiting times for diagnoses, therapy, or counseling refer to the time involved in waiting from the first contact with an HCP or initial referral or self-referral to receiving therapy or counseling services.

    Patient and Public Involvement Review

    Throughout the planning stage of this study, we engaged in various patient and public involvement (PPI) activities to thoroughly review the study’s methods and materials. More specifically, the web-based survey, the information sheet, consent form, and study debrief were first designed with input from an experienced psychiatrist (SB) and then reviewed in consultation with the members of the Cambridge University Hospitals (CUH) PPI panel. The PPI review strategy was designed collaboratively with the PPI engagement and communications lead and the PPI engagement coordinator of the CUH PPI panel. First, the survey and study materials were reviewed by the 3 PPI panel members with lived experience of mental health concerns in one-on-one Zoom (Zoom Video Communications, Inc) sessions with 2 authors (BS and NAM-K), with each session lasting approximately 1 hour. Second, the reviewed versions of the survey and study materials were further reviewed independently in both their Word (Microsoft Corp) and web-based formats by other members of the CUH PPI panel. All feedback was collated in a comprehensive report, and changes were made to the survey and study materials accordingly. Overall, the clarity of the survey and study materials was improved through careful adjustments to the wording. The survey was shortened, and questions were optimized to ease completion.

    Data Analytic Strategy

    Quantitative data (ie, frequencies and percentages) were analyzed and processed in Excel (version 2206; Microsoft Corp). Figure S1 in Multimedia Appendix 1 was created in R (version 4.1.2; R Foundation for Statistical Computing), using the packages rgdal (version 1.6-2), gpclib (version 1.5-6), and maptools (version 1.1-5) for spatial data manipulation and ggplot2 (version 3.4.0) for plotting. Data included sociodemographic information, mental health characteristics, mental health provision, and the effects of mental health on work life, as well as experience in the use of digital technologies for mental health and interest in using a mental health assessment app. Given that the survey was adaptive in nature, such that only relevant questions were asked based on previous responses, sample numbers varied per question, with percentages calculated using the total n per question rather than the overall sample size. Where the n differed from the overall sample size, this has been highlighted in the tables.


    Sociodemographic Characteristics

    A total of 1072 participants commenced the survey, of whom 618 (57.65%) confirmed that they had discussed their mental health with an HCP in the previous 5 years and answered at least the first 2 sections of the survey. The responses from these 618 participants were analyzed.

    A summary of the respondents’ sociodemographic information can be found in Table 1. The average age of the respondents was 49.24 (SD 14.89) years, and the majority were women (437/618, 70.7%), White (595/618, 96.3%), and native English speakers (596/618, 96.4%). Of the 618 participants, 232 (37.5%) had at least an undergraduate degree, 193 (31.2%) were single, and 191 (30.9%) were married or in a civil partnership. Regarding accommodation characteristics, living alone or with a partner was the most common arrangement, with 35.6% (220/618) living alone, 26.7% (165/618) living with a partner, and 16.7% (103/618) living with a partner and children. Of the 618 participants, 266 (43%) were currently employed (ie, full time, part time, or self-employment) and 392 (63.4%) had an annual household income of <£35,001 (US $42,001) before tax. The survey was completed from across the United Kingdom. The distribution and frequency of post code areas can be seen in Figure S1 in Multimedia Appendix 1. Participants came from 111 of the main 125 UK postcode areas.

    Table 1. Sociodemographic characteristics (n=618).
    Sociodemographic characteristicsValues
    Age (years), mean (SD)49.24 (14.89)
    Gender, n (%)

    		Woman437 (70.7)

    		Man158 (25.6)

    		Nonbinary14 (2.3)

    		Prefer not to answer9 (1.5)
    Ethnicity, n (%)

    		Asian or Asian British6 (1)

    		Black, African, Caribbean, or Black British4 (0.7)

    		White595 (96.3)

    		Mixed or multiple ethnic groups8 (1.3)

    		Other5 (0.8)
    Language or native tongue, n (%)

    		English596 (96.4)

    		Other22 (3.6)
    Education, n (%)

    		Below GCSEa or equivalent83 (13.4)

    		GCSE or equivalent126 (20.4)

    		A level or IBb or advanced higher141 (22.8)

    		Undergraduate degree133 (21.5)

    		Postgraduate degree99 (16)

    		Prefer not to answer36 (5.8)
    Relationship status, n (%)

    		Single193 (31.2)

    		Married or civil partnership191 (30.9)

    		Cohabiting75 (12.1)

    		Separated25 (4.1)

    		Divorced80 (12.9)

    		Widowed28 (4.5)

    		Other16 (2.6)

    		Prefer not to answer10 (1.62)
    Living arrangement, n (%)

    		Living alone220 (35.6)

    		Living in shared accommodation with previously unknown individual or individuals24 (3.9)

    		Living with friends21 (3.4)

    		Living with relatives, including single parent85 (13.8)

    		Living with a partner165 (26.7)

    		Living with a partner and children103 (16.7)
    Employment statusc, n (%)

    		Full-time employment154 (24.9)

    		Part-time employment78 (12.6)

    		Self-employment34 (5.5)

    		Parental leave or care for a family member10 (1.6)

    		Student31 (5)

    		Voluntary work32 (5.2)

    		Retired117 (18.9)

    		Unemployed146 (23.6)

    		Other68 (11)

    		Prefer not to answer13 (2.1)
    Household income (£; £1=US $1.2), n (%)

    		<15,000205 (33.2)

    		15,001-25,000119 (19.3)

    		25,001-35,00068 (11)

    		35,001-45,00040 (6.5)

    		45,001-55,00032 (5.2)

    		55,001-65,00021 (3.4)

    		65,001-75,0006 (1)

    		75,001-85,00011 (1.8)

    		>85,00123 (3.7)

    		Prefer not to answer93 (15.1)

    aGCSE: General Certificate of Secondary Education.

    bIB: International Baccalaureate.

    cPercentages add up to >100% because respondents could select multiple options.

    Mental Health Symptoms and Diagnosis Provision

    A summary of the respondents’ mental health symptoms and diagnosis provision can be found in Table S1 in Multimedia Appendix 1 and Table 2. The majority of the respondents (555/618, 89.8%) had discussed their mental health with a general practitioner (GP) in the last 5 years, with 58.4% (361/618) having also seen a therapist or counselor and 34.6% (214/618) having also seen a psychiatrist. Mental health care visits were typically provided free of charge via the National Health Service (NHS; 571/618, 92.4%). Of the 618 respondents, 231 (37.4%) had been diagnosed with a mental health disorder since 2016. Participants were most commonly diagnosed with depression (165/231, 71.4%) and generalized anxiety disorder (126/231, 54.5%).

    Diagnostic waiting times from first contact with an HCP varied across diagnoses, with diagnoses of neurodevelopmental disorders and bipolar disorder having the highest proportions of waiting times over 6 months (Table 2). More specifically, 54% (30/56) of the neurodevelopmental disorder diagnoses, 48% (25/52) of the bipolar disorder diagnoses, and 47.5% (48/101) of the personality disorder diagnoses were received after waiting for >6 months from first contact with an HCP. Of the participants (353/503, 70.2%) who waited >1 month to receive a diagnosis, 74.2% (262/353) stated that this resulted in their symptoms worsening, and 47% (166/353) also stated that their day-to-day life was made harder by the wait. Another common consequence of the waiting period was seeking emergency mental health care (109/353, 30.9%).

    Table 2. Distribution of waiting times per diagnosis (n=581)a.
    DiagnosisDiagnoses, n (%)

    		>1 monthBetween 1 and 3 monthsBetween 3 and 6 months<6 monthsNot sure
    Depression (n=411)155 (37.7)74 (18)66 (16.1)55 (13.4)61 (14.8)
    Bipolar disorder (n=52)5 (9.6)9 (17.3)1 (1.9)25 (48.1)12 (23.1)
    GADb (n=263)84 (31.9)56 (21.3)42 (16)41 (15.6)40 (15.2)
    Social anxiety or phobia (n=137)27 (19.7)27 (19.7)28 (20.4)35 (25.6)20 (14.6)
    Panic disorder or panic attacks (n=132)36 (27.3)24 (18.2)25 (18.9)24 (18.2)23 (17.4)
    OCDc (n=53)6 (11.3)9 (17)15 (28.3)13 (24.5)10 (18.9)
    Insomnia or another sleep disorder (n=62)13 (21)9 (14.5)17 (27.4)10 (16.1)13 (21)
    Schizophrenia or psychosis (n=34)12 (35.3)2 (5.9)9 (26.5)7 (20.6)4 (11.8)
    Personality disorders (n=101)10 (9.9)11 (10.9)13 (12.9)48 (47.5)19 (18.8)
    Eating disorders (n=38)7 (18.4)4 (10.5)5 (13.2)15 (39.5)7 (18.4)
    PTSDd or a trauma-related mental health disorder (n=152)25 (16.4)21 (13.8)32 (21.1)58 (38.2)16 (10.5)
    A neurodevelopmental disorder (eg, ASDe, ADHDf, and learning disability; n=56)5 (8.9)7 (12.5)8 (14.3)30 (53.6)66 (10.7)
    Other disorder or disorders (n=46)9 (19.6)2 (4.4)4 (8.7)19 (41.3)12 (26.1)

    aThe overall n and n per diagnosis add up to different numbers than if you were to add diagnoses per condition before 2016 and after 2016, as some participants reselected the same diagnosis along with different ones for before 2016 and after 2016.

    bGAD: generalized anxiety disorder.

    cOCD: obsessive compulsive disorder.

    dPTSD: posttraumatic stress disorder.

    eASD: autism spectrum disorder.

    fADHD: attention-deficit/hyperactivity disorder.

    Mental Health Support and Treatment Provision

    A summary of the respondents’ mental health support and treatment provision can be found in Table S1 in Multimedia Appendix 1. Of the 618 respondents, 386 (62.5%) stated that they felt that their mental health symptoms were not always taken seriously by their HCP, with 297 (48.1%) reporting receiving no information about mental health disorders (eg, what the symptoms are, how common they are, why they may arise, and treatment options). Similarly, 77.5% (461/595) felt that they were not always given the opportunity to discuss mental health support and treatment options related to the management of their mental health symptoms. The most common treatment options were medication (517/618, 83.7%) and counseling or psychotherapy (481/618, 77.8%), with 50.6% (301/595) finding treatment moderately or extremely helpful.

    Of those who received counseling or psychotherapy, 41.8% (201/481) reported having to wait >3 months from referral or self-referral, with the majority of respondents (212/334, 63.5%) who waited >1 month stating that this had resulted in their symptoms getting worse. Of the 481 respondents, 213 (44.3%) were referred for counseling or therapy by an HCP, whereas 209 (43.5%) had self-referred. Of the 209 respondents who had self-referred, 159 (76.1%) stated that the self-referral process had been easy. Of the 50 respondents who found it at least slightly difficult, long waiting times (n=37, 74%) and not knowing how to choose a counseling service or a therapist (n=22, 44%) were the main barriers to self-referral.

    Critically, of the 96 respondents who did not find any treatment or support (eg, medication, counseling, or psychotherapy) at all helpful, 76 (79%) stated that the treatment made them feel worse, with 63% (n=48) having discontinued treatment and not having found an effective treatment or support for their mental health symptoms at the time of completing the survey.

    Mental Health in the Workplace

    A summary of the respondents’ mental health in the workplace can be found in Table S1 in Multimedia Appendix 1. Of the 290 respondents who were employed (full time or part time) or self-employed, on parental leave, or doing voluntary work, 256 (88.3%) reported that their mental health symptoms had affected their experience in the workplace. Of these 256 respondents, 226 (88.3%) stated that their mental health symptoms had increased their stress levels at work. This was followed by decreased productivity (145/256, 56.6%) and having an impact on work relationships (145/256, 56.6%). The most common sources of mental health support provided by employers were wellness programs (89/263, 33.8%) and training courses or support related to workplace mental health (86/263, 32.7%). When respondents who were employed full time or part time, on parental leave, or doing voluntary work were asked what kind of mental health services they would like to receive from their workplace, most of them (125/262, 47.5%) stated that they would be interested in training courses or support, followed by an interest in mental health app provision (110/262, 41.8%) and wellness programs (108/262, 41.1%).

    Experiences and Interest in Using Digital Technology for Mental Health

    A summary of the respondents’ experiences and interest in using digital technology for mental health can be found in Table S2 in Multimedia Appendix 1.

    The majority of the respondents (545/617, 88.3%) sought help and information on the web regarding their mental health symptoms, with the information most commonly searched for being symptom characteristics (446/543, 82.1%) and treatment or therapy options (390/543, 71.8%). Of the 612 respondents, 272 (44.4%) had used a web application or smartphone app for their mental health, with 206 (75.5%) stating that they did not have to pay to use these apps. Of the 582 respondents, 176 (30.2%) stated that they were using wearable devices (eg, a smartwatch), with the most common uses being tracking physical activity (149/176, 84.7%) and heart rate (111/176, 63.1%), along with monitoring sleep (106/176, 60.2%).

    When the respondents were asked to select features for their ideal mental health app, the feature most desired was psychoeducation (ie, gaining a better understanding of one’s mental health state; 364/596, 61.1%). This was followed by receiving help to be referred to an HCP (332/596, 55.7%) and monitoring of symptoms over time (314/596, 52.7%). Of the 594 respondents, 318 (53.5%) stated that being able to search for, and use, the app independently of HCPs would encourage them to use it, whereas 250 (42.1%) stated that referral to the app by an HCP would be a prompt to use the app. Of the 593 respondents, 389 (65.6%) reported that they would prefer to use a web application (ie, available either using a computer or a mobile phone), whereas 204 (34.4%) preferred a smartphone-only app. Of the 591 respondents, 299 (50.6%) were Android mobile phone users, closely followed by 246 (41.6%) iPhone users. The most common browsers used by respondents to search the web were Google Chrome (343/590, 58.1%) and Safari (133/590, 22.5%).

    When the respondents were asked about their hypothetical interest in using an app to complete a mental health assessment before an appointment with an HCP, only 6.8% (40/590) said that they would not be interested in using the app. Of the 550 respondents who were interested, 289 (52.5%) expressed a preference for the results of the mental health assessment to be sent directly to their health care provider, whereas 186 (33.8%) preferred taking their mental health assessment results independently to an HCP. Regarding a hypothetical results report, respondents were most interested to receive an overall severity score of their mental health symptoms (441/546, 80.8%) and an indication of whether they should get mental health support (454/546, 83.2%). Of the 545 respondents, 417 (76.5%) stated that they would seek professional help if the results from the mental health assessment suggested that they may be experiencing a mental health disorder, with the majority being most likely to see their GP (323/523, 61.8%). Of the 545 respondents, 106 (19.5%) stated that they would want their mental health assessment results to be reviewed by a psychiatrist, even if it came at a cost, whereas 256 (47%) were not interested at all in the review, and 183 (33.6%) were not sure. Most of the respondents (301/542, 69.6%) stated that they would feel at least slightly comfortable if the mental health assessment app used artificial intelligence (AI) to assess mental health symptoms. Of the 575 respondents, 415 (72.2%) stated that they would not be willing to pay for the mental health assessment app.


    Principal Findings and Comparison With Prior Work

    The aim of this study was to investigate the current state of mental health provision in the United Kingdom as well as understand the utility of, and interest in, digital mental health technologies. To do this, we implemented an anonymous web-based survey comprising four sections: (1) sociodemographic information, (2) mental health symptoms and experience of health care service provision, (3) impact of mental health symptoms in the workplace and experience of mental health provision in the workplace, and (4) experiences and interest in using digital technology for mental health. Overall, the findings from this survey study support the view that there are critical gaps in current mental health care provision in the United Kingdom.

    The survey results support the central role of GPs in the delivery of mental health care. Indeed, out of the various HCPs involved in the delivery of mental health care in the United Kingdom, GPs were consulted by 89.8% (555/618) of the respondents. Previous evidence cites mental health problems as the second most common reason for primary care consultations in the United Kingdom, and GPs reportedly spend approximately 30% of their time on mental health concerns [16]. Critically, the United Kingdom is experiencing a GP retention crisis: GPs are overwhelmed with an increasing workload and administrative burden, often leading to time-pressured consultations that can affect the quality of care [17]. In addition, in some instances, GPs have reported that their practices were underprepared to provide timely and effective mental health support [18]. This should be considered when considering the gaps and possible improvement strategies regarding the delivery of mental health support.

    In addition to the key role of GPs, our findings identify prolonged waiting times for diagnosis and treatment of mental health disorders as a significant area for improvement. A total of 70.2% (353/503) of our respondents waited >4 weeks to receive a diagnosis, and 41.8% (201/481) had to wait >12 weeks to begin counseling or psychotherapy. We observed variation in the waiting times of different diagnoses. In our sample, diagnoses of neurodevelopmental disorders (eg, autism spectrum disorder and attention-deficit/hyperactivity disorder), bipolar disorder, and personality disorders took the longest to diagnose. These findings are in line with well-documented evidence; for instance, the diagnosis of bipolar disorder is frequently delayed owing to a variety of factors, including time constraints during consultations in primary care settings coupled with the underreporting of manic or hypomanic symptoms and symptom overlap with other conditions, especially major depressive disorder [19]. Numerous studies and systematic reviews report that >40% of patients with bipolar disorder were initially misdiagnosed with unipolar depression [20-23]. Less well documented but still acknowledged is the fact that the diagnosis of personality disorders remains challenging, with case reports discussing delays and frequent misdiagnoses. Similarly, research has shown there are significant rates of misdiagnosis for neurodevelopmental disorders such as attention-deficit/hyperactivity disorder and autism spectrum disorder, especially in the adult female population [24,25].

    Interestingly, our results show that some conditions, including unipolar depression (ie, major depressive disorder; 229/411, 55.7%) and generalized anxiety disorder (140/263, 53.2%), were mostly diagnosed within <3 months. Although we did not specifically ask which HCP provided the diagnosis, the relatively short time frame suggests that these patients were diagnosed in a primary care setting because waiting times for specialist secondary care assessments are considerably longer in the United Kingdom [26]. The possibility of accessing timely mental health support at the primary care level is very important. However, evidence suggests a high rate of misdiagnoses in primary care not only for more complex psychiatric disorders such as bipolar disorder but also for other mental disorders. A large meta-analysis of >100 studies involving 50,371 patients showed that GPs correctly identified unipolar depression in 47% of the cases, with misidentification outnumbering missed cases [27]. Similarly, it is estimated that 47% of anxiety disorders are not recognized in primary care, and two-thirds are misdiagnosed with other mental health conditions and hence do not receive the most appropriate treatment [28]. This can also be due to the fact that patients with mental health concerns frequently present with psychosomatic symptoms [29].

    This evidence should not be interpreted as a criticism of primary care support but rather as a call for supporting nonspecialists in making more accurate triage decisions and diagnoses [27]. Time pressure, comorbidities, and a tendency to prioritize physical health over mental health are all aspects that contribute to the misdiagnosing of patients with mental health conditions in primary care [27]. Importantly, delays and misdiagnoses have well-known negative impacts on health at both the individual and population levels. Especially in the case of bipolar disorder, a misdiagnosis can have particularly detrimental consequences, with patients being placed at a significantly higher risk of suicide, treatment resistance, and manic episodes if they are treated with antidepressants instead of mood stabilizers. This highlights the importance of undertaking timely, comprehensive, and differential diagnostic mental health assessments.

    In our study, participants reported that waiting times had detrimental effects on their mental health symptoms and quality of life. This mirrors recent findings from the Royal College of Psychiatrists reporting that 39% of patients saw a deterioration in their mental health while waiting for mental health support, leading to lower quality of life (89%); relationship problems (33%); financial troubles (30%); and problems at work, including job losses (18%) [26]. Critically, this study shows that prolonged mental health assessment timelines led 30.9% (109/353) of the respondents to seek emergency care. Once again, this is not an isolated finding because the Royal College of Psychiatrists reported that 40% of the patients waiting for mental health treatment contact emergency or crisis services, with 1 in 9 ending up in the emergency room [26].

    Thus, the evidence gathered in this study, viewed in the broader context of related research, supports the introduction of a mental health assessment tool that could act as a triage tool for nonspecialists and specialist mental health care providers. If delivered digitally before the physician’s appointment, the tool could gather and summarize symptom and personal information, thus providing HCPs with diagnostically relevant information before an in-person assessment. This may relieve time pressure and improve accuracy.

    Importantly, a substantial proportion of the respondents stated that they felt that their mental health symptoms were not always taken seriously by their health care provider (386/618, 62.5%) and that they were not given any information about mental health disorders (eg, what the symptoms are, how common they are, and why they may arise) or about treatment and psychotherapy options (297/618, 48.1%). This constitutes a concerning finding because the National Institute for Health and Care Excellence (NICE) guidelines recommend that symptoms and treatment options should be explained and discussed with the patient; for instance, in the case of depression, the guidance’s principle of care section specifically states that the clinician should discuss the nature of the condition, the symptoms, the treatment options, and the steps to possible recovery, as well as “taking steps to create an optimistic and welcoming atmosphere to reduce stigma” [30]. Unfortunately, the understaffed and time-pressured environment in which HCPs operate often makes adherence to the NICE guidelines close to impossible.

    In addition to not being given sufficient information, 16.1% (96/595) of the respondents were not offered treatment or support (eg, medication, counseling, or psychotherapy) that they found helpful, with the majority (76/90, 79%) stating that the treatment made them feel worse; consequently, 63% (48/76) of the respondents had discontinued treatment and not found an effective alternative. However, it was reassuring to find that the majority of those who had self-referred to psychotherapy or counseling found the self-referral process easy (159/209, 76.1%). For those who found it difficult (50/209, 23.9%), once again it was the long waiting times that were perceived as a barrier (37/50, 74%), followed by not knowing how to choose a counseling service or a psychotherapist (22/50, 44%); hence, more effective signposting and guidance are needed. Interestingly, the perceived lack of mental health information and referral signposting were mirrored in the most desired features for a mental health app chosen by our survey participants (ie, psychoeducation and referral to an HCP), which are discussed in greater detail in the following paragraphs.

    Finally, the impact of mental health symptoms on work activities cannot be overstated. Of the 290 respondents in employment, 256 (88.3%) disclosed that their mental health symptoms had a negative impact on their work experience. Indeed, although mental health concerns are acknowledged in the United Kingdom, the stigma and social exclusion of those with mental health symptoms often translate into poor mental health awareness and support in the workplace [31]. Critically, mental health disorders, representing approximately one-fifth of the burden of adult disease in the United Kingdom, play a significant role in sickness absence from work [32,33]. In turn, absence owing to mental health symptoms can lead to decreased workplace well-being and deteriorating work relationships, in addition to productivity loss, with negative economic outcomes for both employers and wider society.

    Thus, there have been research efforts in designing various types of eHealth interventions (eg, mindfulness apps, web-based cognitive behavioral therapy, and stress management apps) to reduce mental health burden in the workplace. However, these interventions are often not tailored to any specific disorder, the evidence from systematic reviews and meta-analyses is inconclusive, and efficacy as well as employee acceptability are highly variable [34,35]. In addition, eHealth interventions are often designed to equip employees with generic coping strategies rather than identifying and treating diagnostically relevant symptoms. Considering that individuals who are later diagnosed with a mental health disorder tend to visit GPs more frequently and, before their diagnosis, take more sick leave [36], greater efforts should be focused on providing the means to identify mental health concerns in the workplace early.

    This call to action echoes the occupational mental health guidance newly released by the Royal College of Psychiatrists, which calls for better support for people with mental health problems to find, return to, and remain in work [37]. A study found that the introduction of a workplace intervention in the form of a screening and care management for those living with (or at risk of) depression was estimated to cost £31 (US $37.2) per employee for assessment and £240 (US $288) for therapy and could yield a 300% return on investment over a 2-year period [6]. In this study, respondents seemed open to receiving support from their workplace, with mental health apps being one of the desired means of support. According to previous evidence, the introduction of digital health technologies in the workplace has often been welcomed, with caution and concerns around health data sharing, privacy, and autonomy [38,39].

    In the context of digital mental health assessments, any symptom data disclosed by an individual are to be considered health data under the General Data Protection Regulation (GDPR) and thus must be handled accordingly as per the regulation, that is, the individual should be able to access all personal data and outcomes of sensor and intervention technologies without the interference of others, and their employer should not have access to any of these data or outcomes or be able to derive these outcomes from group data [39]. These crucial data protection points must be addressed during the development phase of any digital health tool as well as in its implementation and presentation to future users. Overall, we report a general interest in digital mental health tools offered by employers; however, further research is required to better characterize the acceptability of a mental health assessment app in workplace settings.

    Regarding the use of digital technologies for mental health, our findings should be interpreted keeping the following population characteristics in mind: (1) of the 617 respondents, 545 (88.3%) had looked up information on the web regarding their mental health symptoms and treatment or therapy options; (2) two-fifths (272/612, 44.4%) of the respondents had used a web application or smartphone app for their mental health; and (3) of the 582 respondents, 176 (30.2%) had also used wearable devices such as smartwatches to track their physical well-being and sleep. Various studies have found that access to, and the use of, digital technologies, including smartphones, web-based programs, and social media, among individuals living with mental illness is increasing, with well-documented evidence arising from various clinical and community settings [40-43]. Thus, although potentially inflated by recruitment bias, these findings, which are in line with previous evidence, depict the prevalence and use of digital technology for mental health.

    The responses in our study offered valuable insights into users’ preferred mental health app features, with psychoeducation (ie, gaining a better understanding of one’s mental health status), symptom monitoring, and referrals to HCPs being the most popular. These findings may be the result of the perceived lack of provision of mental health information discussed previously and the lack of guidance on where and how to choose counseling and support options reported by those who went through a self-referral process. In addition, the focus on psychoeducation and symptom monitoring stresses the importance and potential perceived benefit of empowering patients with evidence-based knowledge and a sense of control over their condition. Crucially, providing psychoeducation can increase help-seeking behaviors, reduce stigma, and improve patient engagement and adherence to the HCPs’ recommendations [44-46].

    Furthermore, psychoeducation can increase mental health literacy [47], and, if supplemented with self-help tips, it can improve coping self-efficacy (ie, ability to cope with distress and adversity) [48]. Along similar lines, self-monitoring is thought to improve mental health and well-being by increasing emotional self-awareness (ie, the individual’s ability to identify their symptoms in case of a relapse). Thus, a combination of the desired features as selected by the respondents could offer multiple benefits in managing mental health conditions while addressing some of the perceived gaps in mental health care provision. Implementing the desired features discussed here may also offer benefits beyond the individual patient. Evidence in GP practices has demonstrated that providing self-care advice on GP websites and active signposting to relevant nonmedical staff (ie, social prescribers) reduces the number of inappropriate GP appointments, with GPs reporting being able to spend more time with patients. In addition, with patients receiving self-care information from GPs, they became better informed of their choices and their support options beyond the GP [49].

    When asked about a hypothetical mental health assessment app, 93.2% (550/590) of the respondents reported that they would like to try it out and offered insights into how they would like to receive results and follow-up contact from an HCP. A severity score and actionable help seeking or triage recommendations were the most requested features for the mental health assessment results report. Regarding the preferences of sharing the results report with an HCP, one-third (186/550, 33.8%) of the respondents reported preferring to independently decide whether to share their results. Critically, 19.6% (107/545) of the respondents said that they were unsure about seeking help if the results report told them that they may be experiencing a mental health disorder. This result has important development implications. It suggests that there may be differences in users’ behaviors upon receipt of their mental health assessment results, with some users wanting to seek help and others preferring not to do so. The latter behavior may be due to stigmatizing beliefs, perceived difficulties in expressing mental health concerns, a preference for self-reliance, or perhaps previous negative health care experiences, which are barriers identified in previous research [50]. Considering this evidence, the importance of providing clear psychoeducation, self-help tips, and guidance on how to seek help cannot be overstated. In addition, our results call for future research on the barriers and facilitators to help seeking in the context of delivering a digital mental health assessment.

    Despite the interest in the digital mental health assessment app, willingness to pay was low with 72.2% (415/575) of the respondents stating that they would not be willing to pay for it. This may be due to a variety of reasons; for instance, 75.7% (206/272) of our app-using respondents were users of free apps. Critically, willingness to pay for a health app is often dependent on the perceived benefits derived from using the app [51]. On the basis of our respondents’ preferences, receiving a diagnosis was not among the most desirable features in a mental health app; hence, the perceived value of a mental health assessment app may not have been as high as that of an ideal app that offers psychoeducation, symptom monitoring, and HCP referral information and pathways, alongside an assessment of symptoms.

    Moreover, the British population benefits from a national health care system, the NHS, that provides most mental health (and physical) care services for free; thus, most of the respondents may expect the digital mental health assessment to be provided through the NHS at no out-of-pocket cost. Similarly, only a small proportion of the respondents (106/545, 19.4%) were interested in a potentially costly psychiatrist review of their mental health assessment results report. Interestingly, most of the respondents (377/542, 69.6%) stated that they would feel at least slightly comfortable if the mental health assessment app used AI to assess mental health symptoms. This is in line with previous evidence that showed moderate acceptability (60%-80%) of AI-led chatbots in general care as well as mental health care [52,53]. Hesitancy toward AI is known to be exacerbated by a variety of factors, including poorer perceived digital skills and a dislike for digital interactions, but this can be mitigated by perceived utility and trustworthiness [53]. Hence, further research is required to more deeply investigate the impact that AI could have on app uptake and any strategies that could improve hesitant users’ perspectives. Overall, all discussed findings relating to app features, potential implementation pathways, and app technology aspects have important implications in the design and funding of a viable and accessible mental health assessment app.

    Limitations

    The survey was comprehensive and carefully designed with inputs from an experienced psychiatrist as well as from individuals with lived experience of mental health concerns. However, most of the individuals who participated in this study were women (437/618, 70.7%), more highly educated than average (232/618, 37.5%) had at least an undergraduate degree), and spoke English as their first language (596/618, 96.4%). Thus, the findings from this study may not be fully generalizable to the broader British population. Notably, 34.6% (214/618) of the respondents had also seen a psychiatrist, which suggests that the survey had reached a significant proportion of individuals who likely experienced severe mental health symptoms that required psychiatric support or assessment. In addition, this survey may have been subject to recruitment bias because individuals with negative experiences of mental health care provision may have been more receptive to the recruitment and more likely to enroll in the study. Less than half (272/612, 44.4%) of the respondents had used a mental health app before; hence, the interest in trying out a mental health assessment app cannot be explained only by habit or recruitment bias.

    Conclusions

    The findings from this study highlight the need to improve the early diagnosis of mental health disorders, especially bipolar disorder and neurodevelopmental disorders. This could have several benefits, including higher patient satisfaction and well-being as well as decreased mental health care costs. However, the implementation of a mental health assessment app has the potential to create a bottleneck effect in which assessment and diagnostic waiting times are shortened, but access to support remains limited owing to a lack of resources. Thus, it is fundamental to provide in-app features (eg, psychoeducation, symptom monitoring, and triaging and sources of support) to assist patients through the waiting times and their care journeys. These features also have the potential to increase mental health literacy, coping strategies, and symptom awareness, which is likely to improve mental health outcomes. Finally, funding strategies and choice of technology (to use AI or not to use AI?) are important aspects to consider in the future development of the digital mental health assessment tool; critically, they may have an impact on the accessibility dictated by purchasing power and digital literacy with the risk of excluding various groups of individuals who may benefit from the app.

    Acknowledgments

    The authors are most grateful to all survey respondents for their participation. The authors also fondly thank the volunteers from the Cambridge University Hospitals patient and public involvement panel for their input in reviewing the study materials, as well as Ms Bethany Vincent and Dr Amanda Stranks for their guidance in devising a patient and public involvement strategy for this study. This study was funded by the Stanley Medical Research Institute (07R-1888).

    Data Availability

    The data that support the findings of this study are available from the corresponding author (SB) upon reasonable request.

    Authors' Contributions

    NAM-K, BS, EF, and SB conceived the study focus and materials. EF coordinated and conducted participant recruitment. BS performed the data analysis. BS and NAM-K prepared the manuscript, with revisions by EF, JB, and SB. All authors contributed to the paper and approved the submitted version.

    Conflicts of Interest

    SB is the director and shareholder of Psynova Neurotech Ltd and Psyomics Ltd. EF is a consultant for and has financial interests in Psyomics Ltd. All other authors declare no other conflicts of interest.

    Multimedia Appendix 1

    Postcode area map of survey participants, their mental health symptoms and their experiences of health care service provision, and their experiences and interest in using digital technology for mental health.

    DOCX File , 46 KB
    1. O’Shea N, Bell A. A spending review for wellbeing. Centre for Mental Health. Jul 2020. URL: https:/​/www.​centreformentalhealth.org.uk/​sites/​default/​files/​publication/​download/​CentreforMentalHealth_SpendingReviewForWellbeing.​pdf [accessed 2022-09-20]
    2. Jia R, Ayling K, Chalder T, Massey A, Broadbent E, Coupland C, et al. Mental health in the UK during the COVID-19 pandemic: cross-sectional analyses from a community cohort study. BMJ Open. Sep 15, 2020;10(9):e040620. [FREE Full text] [CrossRef] [Medline]
    3. O'Connor RC, Wetherall K, Cleare S, McClelland H, Melson AJ, Niedzwiedz CL, et al. Mental health and well-being during the COVID-19 pandemic: longitudinal analyses of adults in the UK COVID-19 Mental Health and Wellbeing study. Br J Psychiatry. Jun 2021;218(6):326-333. [FREE Full text] [CrossRef] [Medline]
    4. Adult psychiatric morbidity survey: survey of mental health and wellbeing, England, 2014. National Health Service Digital. Sep 29, 2016. URL: https:/​/digital.​nhs.uk/​data-and-information/​publications/​statistical/​adult-psychiatric-morbidity-survey/​adult-psychiatric-morbidity-survey-survey-of-mental-health-and-wellbeing-england-2014 [accessed 2023-02-15]
    5. Chief Medical Officer annual report 2013: public mental health. Department of Health and Social Care United Kingdom Government. Sep 9, 2014. URL: https:/​/www.​gov.uk/​government/​publications/​chief-medical-officer-cmo-annual-report-public-mental-health [accessed 2023-02-15]
    6. Fundamental facts about mental health 2016. Mental Health Foundation. URL: https:/​/www.​mentalhealth.org.uk/​explore-mental-health/​publications/​fundamental-facts-about-mental-health-2016 [accessed 2022-09-20]
    7. Bucci S, Schwannauer M, Berry N. The digital revolution and its impact on mental health care. Psychol Psychother. Jun 28, 2019;92(2):277-297. [CrossRef] [Medline]
    8. Torous J, Staples P, Shanahan M, Lin C, Peck P, Keshavan M, et al. Utilizing a personal smartphone custom app to assess the Patient Health Questionnaire-9 (PHQ-9) depressive symptoms in patients with major depressive disorder. JMIR Ment Health. Mar 24, 2015;2(1):e8. [FREE Full text] [CrossRef] [Medline]
    9. Knowles SE, Toms G, Sanders C, Bee P, Lovell K, Rennick-Egglestone S, et al. Qualitative meta-synthesis of user experience of computerised therapy for depression and anxiety. PLoS One. Jan 17, 2014;9(1):e84323. [FREE Full text] [CrossRef] [Medline]
    10. Schueller SM, Hunter JF, Figueroa C, Aguilera A. Use of digital mental health for marginalized and underserved populations. Curr Treat Options Psych. Jul 5, 2019;6(3):243-255. [CrossRef]
    11. Naslund JA, Marsch LA, McHugo GJ, Bartels SJ. Emerging mHealth and eHealth interventions for serious mental illness: a review of the literature. J Ment Health. 2015;24(5):321-332. [FREE Full text] [CrossRef] [Medline]
    12. BinDhim NF, Shaman AM, Trevena L, Basyouni MH, Pont LG, Alhawassi TM. Depression screening via a smartphone app: cross-country user characteristics and feasibility. J Am Med Inform Assoc. Jan 17, 2015;22(1):29-34. [FREE Full text] [CrossRef] [Medline]
    13. Torous J, Nicholas J, Larsen ME, Firth J, Christensen H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid Based Ment Health. Aug 05, 2018;21(3):116-119. [CrossRef] [Medline]
    14. Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, Merry S. Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res. Jun 06, 2018;20(6):e199. [FREE Full text] [CrossRef] [Medline]
    15. Meyerowitz-Katz G, Ravi S, Arnolda L, Feng X, Maberly G, Astell-Burt T. Rates of attrition and dropout in app-based interventions for chronic disease: systematic review and meta-analysis. J Med Internet Res. Sep 29, 2020;22(9):e20283. [FREE Full text] [CrossRef] [Medline]
    16. Gask L, Kendrick T, Peveler R, Chew-Graham CA. What is primary care mental health? In: Gask L, Kendrick T, Peveler R, Chew-Graham CA, editors. Primary Care Mental Health. Cambridge, MA. Cambridge University Press; 2018;1-11.
    17. Owen K, Hopkins T, Shortland T, Dale J. GP retention in the UK: a worsening crisis. Findings from a cross-sectional survey. BMJ Open. Feb 27, 2019;9(2):e026048. [FREE Full text] [CrossRef] [Medline]
    18. Fisher R, Turton C, Gershlick B, Alderwick H, Thorlby R. Feeling the strain: what the Commonwealth Fund’s 2019 international survey of general practitioners means for the UK. The Health Foundation. Mar 2020. URL: https://www.health.org.uk/publications/reports/feeling-the-strain [accessed 2022-09-20]
    19. Keramatian K, Pinto JV, Schaffer A, Sharma V, Beaulieu S, Parikh SV, et al. Clinical and demographic factors associated with delayed diagnosis of bipolar disorder: data from Health Outcomes and Patient Evaluations in Bipolar Disorder (HOPE-BD) study. J Affect Disord. Jan 01, 2022;296:506-513. [CrossRef] [Medline]
    20. Ghaemi SN, Boiman EE, Goodwin FK. Diagnosing bipolar disorder and the effect of antidepressants: a naturalistic study. J Clin Psychiatry. Oct 2000;61(10):804-8; quiz 809. [CrossRef] [Medline]
    21. Hirschfeld RM, Lewis L, Vornik LA. Perceptions and impact of bipolar disorder: how far have we really come? Results of the national depressive and manic-depressive association 2000 survey of individuals with bipolar disorder. J Clin Psychiatry. Feb 2003;64(2):161-174. [Medline]
    22. Hirschfeld RM. Differential diagnosis of bipolar disorder and major depressive disorder. J Affect Disord. Dec 2014;169:S12-S16. [CrossRef]
    23. Lish JD, Dime-Meenan S, Whybrow PC, Price RA, Hirschfeld RM. The National Depressive and Manic-depressive Association (DMDA) survey of bipolar members. J Affect Disord. Aug 1994;31(4):281-294. [CrossRef] [Medline]
    24. Johnson J, Morris S, George S. Attention deficit hyperactivity disorder in adults: what the non-specialist needs to know. Br J Hosp Med (Lond). Mar 02, 2020;81(3):1-11. [FREE Full text] [CrossRef] [Medline]
    25. Gesi C, Migliarese G, Torriero S, Capellazzi M, Omboni AC, Cerveri G, et al. Gender differences in misdiagnosis and delayed diagnosis among adults with autism spectrum disorder with no language or intellectual disability. Brain Sci. Jul 09, 2021;11(7):912. [FREE Full text] [CrossRef] [Medline]
    26. Two-fifths of patients waiting for mental health treatment forced to resort to emergency or crisis services. Royal College of Psychiatrists. Oct 6, 2020. URL: https:/​/www.​rcpsych.ac.uk/​news-and-features/​latest-news/​detail/​2020/​10/​06/​two-fifths-of-patients-waiting-for-mental-health-treatment-forced-to-resort-to-emergency-or-crisis-services [accessed 2022-09-20]
    27. Mitchell AJ, Vaze A, Rao S. Clinical diagnosis of depression in primary care: a meta-analysis. Lancet. Aug 22, 2009;374(9690):609-619. [CrossRef] [Medline]
    28. Wittchen HU, Kessler RC, Beesdo K, Krause P, Höfler M, Hoyer J. Generalized anxiety and depression in primary care: prevalence, recognition, and management. J Clin Psychiatry. 2002;63 Suppl 8:24-34. [Medline]
    29. Sartorius N, Ustün TB, Lecrubier Y, Wittchen HU. Depression comorbid with anxiety: results from the WHO study on psychological disorders in primary health care. Br J Psychiatry Suppl. Jun 1996(30):38-43. [Medline]
    30. Depression in adults: treatment and management. National Institute for Health and Care Excellence. Jun 29, 2022. URL: https://www.nice.org.uk/guidance/ng222 [accessed 2022-09-20]
    31. Gray NS, Davies H, Snowden RJ. Reducing stigma and increasing workplace productivity due to mental health difficulties in a large government organization in the UK: a protocol for a randomised control treatment trial (RCT) of a low intensity psychological intervention and stigma reduction programme for common mental disorder (Prevail). BMC Public Health. Jun 09, 2020;20(1):896. [FREE Full text] [CrossRef] [Medline]
    32. Singleton N, Bumpstead R, O'Brien M, Lee A, Meltzer H. Psychiatric morbidity among adults living in private households, 2000. Int Rev Psychiatry. Jul 11, 2003;15(1-2):65-73. [CrossRef] [Medline]
    33. Stansfeld SA, Fuhrer R, Head J. Impact of common mental disorders on sickness absence in an occupational cohort study. Occup Environ Med. Jun 12, 2011;68(6):408-413. [FREE Full text] [CrossRef] [Medline]
    34. Stratton E, Lampit A, Choi I, Calvo RA, Harvey SB, Glozier N. Effectiveness of eHealth interventions for reducing mental health conditions in employees: a systematic review and meta-analysis. PLoS One. Dec 21, 2017;12(12):e0189904. [FREE Full text] [CrossRef] [Medline]
    35. Scheutzow J, Attoe C, Harwood J. Acceptability of web-based mental health interventions in the workplace: systematic review. JMIR Ment Health. May 11, 2022;9(5):e34655. [FREE Full text] [CrossRef] [Medline]
    36. Hansson L, Borgquist L, Nettelbladt P, Nordström G. The course of psychiatric illness in primary care patients. Soc Psychiatry Psychiatr Epidemiol. Jan 1994;29(1):1-7. [CrossRef]
    37. More support needed for people with mental health difficulties at work. Royal College of Psychiatrists. Jul 14, 2022. URL: https://tinyurl.com/mvyktwdd [accessed 2022-09-20]
    38. Collins P, Marassi S. Is that lawful? Data privacy and fitness trackers in the workplace. Int J Comp Labour Law Ind Relat. Feb 01, 2021;37(Issue 1):65-94. [CrossRef]
    39. Roossien CC, de Jong M, Bonvanie AM, Maeckelberghe EL. Ethics in design and implementation of technologies for workplace health promotion: a call for discussion. Front Digit Health. Aug 20, 2021;3:644539. [FREE Full text] [CrossRef] [Medline]
    40. Aschbrenner KA, Naslund JA, Grinley T, Bienvenida JC, Bartels SJ, Brunette M. A survey of online and mobile technology use at peer support agencies. Psychiatr Q. Sep 4, 2018;89(3):539-548. [FREE Full text] [CrossRef] [Medline]
    41. Brunette MF, Achtyes E, Pratt S, Stilwell K, Opperman M, Guarino S, et al. Use of smartphones, computers and social media among people with SMI: opportunity for intervention. Community Ment Health J. Aug 8, 2019;55(6):973-978. [FREE Full text] [CrossRef] [Medline]
    42. Firth J, Cotter J, Torous J, Bucci S, Firth JA, Yung AR. Mobile phone ownership and endorsement of "mHealth" among people with psychosis: a meta-analysis of cross-sectional studies. Schizophr Bull. Mar 2016;42(2):448-455. [FREE Full text] [CrossRef] [Medline]
    43. Naslund JA, Aschbrenner KA, Bartels SJ. How people with serious mental illness use smartphones, mobile apps, and social media. Psychiatr Rehabil J. Dec 2016;39(4):364-367. [FREE Full text] [CrossRef] [Medline]
    44. Taylor-Rodgers E, Batterham PJ. Evaluation of an online psychoeducation intervention to promote mental health help seeking attitudes and intentions among young adults: randomised controlled trial. J Affect Disord. Oct 2014;168:65-71. [CrossRef] [Medline]
    45. Kravitz RL, Franks P, Feldman MD, Tancredi DJ, Slee CA, Epstein RM, et al. Patient engagement programs for recognition and initial treatment of depression in primary care: a randomized trial. JAMA. Nov 06, 2013;310(17):1818-1828. [FREE Full text] [CrossRef] [Medline]
    46. Simmons L, Jones T, Bradley E. Reducing mental health stigma: the relationship between knowledge and attitude change. Eur J Ment Health. Jun 12, 2017;12(1):25-40. [CrossRef]
    47. Donker T, Griffiths KM, Cuijpers P, Christensen H. Psychoeducation for depression, anxiety and psychological distress: a meta-analysis. BMC Med. Dec 16, 2009;7:79. [FREE Full text] [CrossRef] [Medline]
    48. Bakker D, Kazantzis N, Rickwood D, Rickard N. Mental health smartphone apps: review and evidence-based recommendations for future developments. JMIR Ment Health. Mar 01, 2016;3(1):e7. [FREE Full text] [CrossRef] [Medline]
    49. 600 GP hours released a year after reducing inappropriate appointments – Chiswick Health Practice, London. National Health Service England. URL: https:/​/www.​england.nhs.uk/​gp/​case-studies/​600-gp-hours-released-a-year-after-reducing-inappropriate-appointments-chiswick-health-practice-london/​ [accessed 2022-10-03]
    50. Salaheddin K, Mason B. Identifying barriers to mental health help-seeking among young adults in the UK: a cross-sectional survey. Br J Gen Pract. Sep 29, 2016;66(651):e686-e692. [FREE Full text] [CrossRef]
    51. Tobias G, Sgan-Cohen H, Spanier AB, Mann J. Perceptions and attitudes toward the use of a mobile health app for remote monitoring of gingivitis and willingness to pay for mobile health apps (part 3): mixed methods study. JMIR Form Res. Oct 05, 2021;5(10):e26125. [FREE Full text] [CrossRef] [Medline]
    52. Nadarzynski T, Miles O, Cowie A, Ridge D. Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: a mixed-methods study. Digit Health. 2019;5:2055207619871808. [FREE Full text] [CrossRef] [Medline]
    53. Morris RR, Kouddous K, Kshirsagar R, Schueller SM. Towards an artificially empathic conversational agent for mental health applications: system design and user perceptions. J Med Internet Res. Jun 26, 2018;20(6):e10148. [FREE Full text] [CrossRef] [Medline]

    ‎
    AI: artificial intelligence
    CUH: Cambridge University Hospitals
    GDPR: General Data Protection Regulation
    GP: general practitioner
    HCP: health care professional
    NHS: National Health Service
    NICE: National Institute for Health and Care Excellence
    PPI: patient and public involvement

    Edited by T Leung; submitted 07.10.22; peer-reviewed by S Rennick-Egglestone, M Galani; comments to author 27.01.23; revised version received 02.03.23; accepted 10.07.23; published 07.08.23.

    Copyright

    ©Benedetta Spadaro, Nayra A Martin-Key, Erin Funnell, Jiří Benáček, Sabine Bahn. Originally published in JMIR Formative Research (https://formative.jmir.org), 07.08.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.