This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (2491) Depression and Mood Disorders; Suicide Prevention (1392) Mental Health Issues in Adolescence (457)

Published on in Vol 2, No 1 (2018): Jan-Jun

Investigating Associations Between Changes in Mobile Phone Use and Emotions Using the Experience Sampling Method: Pilot Study

Investigating Associations Between Changes in Mobile Phone Use and Emotions Using the Experience Sampling Method: Pilot Study

Investigating Associations Between Changes in Mobile Phone Use and Emotions Using the Experience Sampling Method: Pilot Study

Authors of this article:

Suzanne Roggeveen1 Author Orcid Image ;   Jim van Os2, 3 Author Orcid Image ;   Kelly Bemelmans1 Author Orcid Image ;   Mikal van Poll1 Author Orcid Image ;   Richel Lousberg1 Author Orcid Image
Article Authors Cited by (3) Tweetations (1) Metrics

    Original Paper

    1Department of Psychiatry and Psychology, Maastricht University, Maastricht, Netherlands

    2Brain Center Rudolf Magnus, Department of Psychiatry, University Medical Center Utrecht, Utrecht, Netherlands

    3Institute of Psychiatry, Department of Psychosis Studies, King's College London, King's Health Partners, London, United Kingdom

    Corresponding Author:

    Suzanne Roggeveen, MD, PhD

    Department of Psychiatry and Psychology

    Maastricht University

    Vijverdalseweg 1

    Maastricht,

    Netherlands

    Phone: 31 43 3884111

    Fax:31 43 3875457

    Email: s.roggeveen@maastrichtuniversity.nl


    Background: The use of mobile phones has become, especially for young people, an integrated part of everyday life. Using the experience sampling method (ESM) may provide further insight on the association between mobile phone use and mental health.

    Objective: The objective of this study was to examine associations between mobile phone use and subtle changes in mental state.

    Methods: The ESM-based PsyMate app was installed on the mobile phones of 2 healthy 20-year-old participants. Over a period of 3 months, participants rated their mental states at 10 semirandom moments in the flow of daily life. Each assessment included present state emotions, environmental circumstances, and phone use.

    Results: Multilevel regression analyses indicated that an increase in mobile phone use was associated with a small increase in negative affect (particularly feeling bored and feeling lonely; P<.001) and small decreases in positive affect (P=.002) and concentration (P=.001). Treating the data as 2 separate N=1 studies revealed that the association with negative affect was present in both participants, whereas the associations with positive affect and concentration were evident in only 1 of the 2 participants.

    Conclusions: This pilot study suggests that mobile phone use may be associated with person-specific and group-level changes in emotional state. A larger study is required to study these associations, possible causality, and factors driving underlying heterogeneity in the pattern of associations.

    Trial registration: ClinicalTrials.gov NCT03221985; https://clinicaltrials.gov/ct2/show/NCT03221985 (archived by WebCite at http://www.webcitation.org/6zJnp61Wj)

    JMIR Formativ Res 2018;2(1):e12

    doi:10.2196/formative.8499

    Keywords

    mobile phone; experience sampling method; emotions; affect; concentration 


    Given widespread use of mobile phones, research has been conducted to investigate possible side effects. For example, mobile phone use is associated with cyberbullying [1] and slower response while driving [2]. Furthermore, mobile phone use may be excessive or even compulsive, which was coined as “problematic mobile phone use” [3]. At least 11 different questionnaires have been used to test the construct of mobile phone use addiction [3-14], mostly based on criteria for dependence as described in the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) and now the DSM-5, which has comparable dependence criteria [15]. The psychological mechanism driving mobile phone addiction, dubbed nomophobia (the fear of being out of mobile phone contact), was proposed in 2014 [16]. The related fear of missing out (FoMO) was defined as “a pervasive apprehension that others might be having rewarding experiences from which one is absent” [17,18]. In addition to a possible addictive component, associations have been reported between mobile phone use and depression, anxiety, stress, and sleep problems [7,11,19-24]. Estimates of problematic mobile phone use across these different outcomes differ widely, ranging from 0% to 38% [25].

    Problematic mobile phone use may be more prevalent in people who have certain personality traits [26]. Lower levels of self esteem were consistently associated with problematic mobile phone use across different studies [3,20,27,28]; higher levels of extraversion were associated with more frequent mobile phone use [3,29].

    Although the above studies are examples of a growing body of work examining associations between mobile phone use and psychological constructs, the relation remains uncertain and research focusing on existing categories of psychopathology is inconclusive [30]. Therefore, in this pilot study, we addressed the more basic question of whether mobile phone use would impact daily life variation in core emotions, moving away from psychological constructs like personality traits or diagnostic categories. Given the highly dynamic process of mobile phone use, varying from moment to moment in daily life, the methodology used should be capable of capturing this dynamic process.

    Studies in this area usually use traditional retrospective questionnaires that are associated with several well-known forms of bias and cannot capture dynamic variation of mental states associated with daily life phone use [31]. A data acquisition method which is relatively free of these kinds of bias is the experience sampling method (ESM) [32]. ESM is a valid and reliable method which can contribute to the understanding of the relationship between environmental phenomena and mental experience [33]. Another advantage of this method is the ability to detect possible subtle (unconscious) changes in affect in the context of daily life in relation to mobile phone use. There are also other mobile phone apps using ESM [34,35]. A recent Australian study examined the use of such an app for monitoring well-being in context and in real time, including personalized feedback [34].

    In order to pilot the use of ESM in the context of mobile phone use, an ESM pilot study (N=2) was conducted in order to examine associations between mobile phone use and subtle changes in mental states. In ESM studies, participants are beeped at semirandom moments to record their in-the-moment emotional and behavioral states several times during the day (usually 6 to 10 times) [33]. In addition, the actual circumstances (where and with whom a participant is) are also rated. This dynamic repeated measure design allows for prospective modeling of behavioral and affective dynamic patterns during the day as well as for examining associations with context [33].

    Guided by previous literature, the following hypotheses were postulated: (1) a general increase of phone use will be associated with higher scores on negative affect, lower levels of positive affect, and lower levels of concentration [21,36] and (2) whenever a person cannot engage in mobile phone use, increased levels of negative affect will ensue.


    Participants

    Recruitment took place in September 2016 using posters distributed at Maastricht University Medical Centre in Maastricht, The Netherlands. Inclusion criteria were aged 20 to 25 years, healthy, good understanding of the Dutch language, and mobile phone use. Exclusion criteria were a psychiatric diagnosis and pregnancy. Two healthy, female volunteers, both aged 20 years and students at Maastricht University, were enrolled. Participants were frequent mobile phone users who were used to carrying a mobile phone with them at all times and did not experience their phone use as problematic. Participants were compensated €150 (US $177).

    Procedures

    Briefing

    During the briefing, participants were helped to download the ESM PsyMate app on their mobile phone (from the App Store or Google Play). They were instructed on how to use the app. It was stressed that participants should not change their daily life routines; they were asked to carry their mobile phone with them at all times in order to miss as few beeps as possible. In addition to the ESM scheme, participants completed separate morning and evening questionnaires. On the morning questionnaire, before the first beep of the day, participants were asked to answer some questions about the quality of sleep and the location of the mobile phone in the past night (Multimedia Appendix 1). In the evening, after the last beep, some additional questions were asked about the use of the PsyMate app and its possible impact on the participant (Multimedia Appendix 1). Morning and evening questionnaires were presented to the participants every day of the study. At all times during the study, a researcher (SR) was available for questions. After the briefing session, the study period of 3 months started.

    Data Collection

    In order to collect ESM data, the PsyMate app [37] was installed on the personal mobile phone of participants. Data collection took place over a period of 3 months. The PsyMate app emitted 10 beeps per day at semirandom intervals in each of ten 90-minute time blocks between 7:30 am and 10:00 pm. The app worked independently of internet connectivity. After each beep, participants were asked to answer the ESM items as soon as possible (thus capturing information about the in-the-moment state). Items should be answered within 15 minutes in order to safeguard real-time assessment [38]. There were 4 positive affect ESM items (cheerful, mentally fit, relaxed, and globally feeling well), and 6 items indexed negative affect (irritated, bored, lonely, gloomy, stressed, and worried). Next, current context and activities (physical activity, daily life activities, persons present) as well as physical items (tired, level of concentration, and pain) were rated. Finally, mobile phone use since the last beep (frequency, frustration when not able to use the mobile phone) was measured. An overview of ESM items is presented in Multimedia Appendix 1. The affect items were rated on a 7-point Likert scale, ranging from not at all to very much. Mobile phone use was rated as follows: at each beep, the participant was asked to give an estimate of the frequency of mobile phone use between the last beep and the present beep. Zero represents no use, 1 represents once, 2 represents 2 to 5 times, 3 represents 5 to 10 times, and 4 represents more than 10 times. Over the total period, participant 1 had a mean between-beep mobile phone use of 1.72 (SD 1.06) and participant 2 a mean of 0.81 (SD 0.98).

    After the 3-month ESM period, a debriefing session was held with both participants. Participants were asked to what degree the past 3 months were representative of their daily life and to what extent PsyMate had interfered with their normal routines.

    Data Reduction

    App data were directly transferred to an internet cloud when internet connectivity was available. When there was no connection to the internet, data were temporarily stored on the mobile phone. The data of both participants were directly extracted from the cloud and imported in an SPSS Statistics (IBM Corp) datafile.

    PsyMate studies have shown that positive and negative affect (PA and NA, respectively) items can be reliably (Cronbach alpha>0.7) and consistently [33] scaled into 2 factors: a PA and an NA factor.

    Analyses

    Data on momentary mental state at beep moment t and level of phone use between the last beep (t–1) and the present (t) were retrieved in order to model affect parameters as the dependent and phone use as the independent variable in the analyses.

    Statistical analyses were conducted with SPSS 24.0 (IBM Corp) [39]. The data were hierarchically structured, since multiple assessments were performed and clustered within days that in turn were clustered within participants. Multilevel random regression analyses were used to test the relationship between mobile phone use and affect, taking the hierarchical structure into account. In order to model time effects, beep number and beep time interval were incorporated as covariates in all analyses. In order to correct for interdependence of the data over successive beeps, an autoregressive (AR1) covariance structure was selected.Since there were 2 participants, allowing for investigation of person-specific patterns, data were also analyzed as 2 N=1 studies. To this end, linear regression analyses, using affect as dependent parameter and mobile phone use as predictor, were performed separately for participant 1 and 2. In these regression analyses, beep number and beep time interval were also incorporated as covariates. A 2-sided P<.05 was considered statistically significant.

    Ethics Statement

    Approval was obtained from the medical ethics committee of the Academic Hospital Maastricht on May 19, 2016. All participants provided written informed consent.


    Participant 1 used the PsyMate app during 96 days and responded to 399/960 beeps (41.6%). Thus, on average 4.2 out of 10 beeps each day were completed. Participant 2 completed 506/930 beeps (54.4%) or 5.4 beeps out of 10 each day. Guided by previous work with this ESM scheme, a response of 30% to the ESM beeps was considered the minimum for inclusion in the analysis [38].

    In order to model change in affect from beep to beep in relation to mobile phone use, an a priori limit was set on days with at least 4 completed beeps. In participant 1, 62 of 96 days met this requirement (65% of all the days), with an average of 5 completed beeps per day. In participant 2, 78 out of 93 days (84% of all days) met the requirement, with an average of 6 beeps per day. Setting the a priori limit caused an ESM data reduction of 19% in participant 1 and 8% in participant 2.

    Table 1 shows that responding to PsyMate beeps generally was not rated as impacting mood or normal phone use. One change was that normally participants would not carry their phones with them at all times, but because of the study they now did so. Furthermore, participants noted that it was tempting to take a look at their phone after a PsyMate beep some of the time. A difference in response between the 2 participants can be noted in FoMO: participant 1 experienced this feeling more often than participant 2.

    In Table 2, an overview of the results of multilevel (results of the 2 participants together) and linear (results per participant) regression analyses is provided. The frequency of mobile phone use between the previous and the current beep was modeled as predictor of current affect variables. In the combined dataset, higher levels of mobile phone use were associated with more NA and less PA. Decomposing NA and PA into their separate constituents revealed that bored and lonely stood out in strength of association among the NA items, whereas cheerful, relaxed, and globally feeling well stood out among the PA items. Item concentration was also negatively associated with higher levels of phone use. Analyzing participant data separately revealed that the association between frequency of phone use and NA was consistent across participants. The association with PA was consistent across the 2 participants, although only significant in participant 1. Cohen d was 0.14 for negative affect and 0.11 for positive affect.

    The second hypothesis, that when a participant was not allowed to or capable of using a mobile phone, she would report more negative affect parameters, could not be tested due to a lack of data. For example, participant 1 only reported no phone use in 56 beeps, of which only 8 could be attributed to being permitted to use a mobile phone.

    Table 1. Results from evening questionnaires of participant 1 (n=52) and participant 2 (n=84).
    QuestionParticipant 1, mean (SD)Participant 2, mean (SD)
    Responding to PsyMate beeps has influenced my mood.1.54 (1.24)1.82 (0.88)
    Without PsyMate, I would have done other things today.1.12 (0.83)1.02 (0.153)
    After responding to PsyMate beeps, I used my mobile phone.2.98 (1.85)4.11 (1.73)
    PsyMate has influenced my normal phone use today.2.17 (1.32)1.44 (0.91)
    Today, I experienced fear of missing out.3.62 (1.57)1.39 (0.70)
    Table 2. Estimates of mobile phone use and affect.
    CharacteristicParticipant 1 and 2Participant 1Participant 2

    		Beta coefficient of mobile phone uset valueBeta coefficient of mobile phone uset valueBeta coefficient of mobile phone uset value
    Negative affect0.474.070.672.540.332.62

    		Irritated0.071.710.060.720.081.94

    		Bored0.225.370.313.870.143.30

    		Lonely0.124.600.223.890.051.76

    		Sadness0.051.440.050.620.030.66

    		Stressed0.041.190.010.090.010.15

    		Worried0.030.880.030.430.040.76
    Positive affect–0.29–3.09–0.41–1.90–0.08–0.69

    		Mentally fit0.000.140.040.670.020.74

    		Cheerful–0.10–2.72–0.16–2.16–0.04–0.85

    		Relaxed–0.09–2.39–0.19–2.58–0.01–0.27

    		Globally well–0.11–3.37–0.09–1.38–0.06–1.67
    Other






    		Tired0.051.18–0.06–0.690.060.89

    		Concentrating–0.13–3.26–0.26–3.54–0.05–0.97

    Principal Findings

    The main findings of this study: an increase in mobile phone use is associated with a small increase in NA (particularly feeling bored and feeling lonely) and small decreases in PA and concentration.

    In this N=2 pilot study, participants answered questions in the PsyMate app about their mental state and mobile phone use over a 3-month period. The goal was to investigate whether an association between the two could be demonstrated as a prelude to a larger study. Guided by previous work, it was hypothesized that a general increase of phone use would be associated with higher scores on NA, lower levels of PA, and lower levels of concentration [21,36]. The results show that these hypotheses were confirmed. Although all of the NA items showed a positive association, the NA items lonely and bored stood out. Based on the literature, it was also expected that other components of NA such as sadness would be significantly associated with mobile phone use. This item was directionally associated with mobile phone use but below the conventional limit of significance. The significant decrease of PA after an increase of phone use was seen in 3 out of 4 components of PA. While the association with NA was replicated across the 2 participants, the association with PA and concentration appeared to be person-specific. Person-specific moderators may play a role, such as level of self-esteem and extraversion that have been linked to problematic phone use, as well as other personality traits [40]. In the current analysis, participant 1 reported more FoMO. The experience of FoMO may also underlie person-specific results in the association between mental state and mobile phone use.

    It was not possible to investigate the hypothesis that not being permitted to use a mobile phone would result in higher levels of NA due to a lack of data resulting in lack of variability.

    This study indicates that in-the-moment associations between mobile phone use and affect may be subtle and difficult to report using retrospective reports from cross-sectional questionnaires. Participants in this study appeared to differ in their global and in-the-moment reports. If the outcomes of this study can be replicated in a larger study population, combining group-level and person-specific approaches of analysis, it may be easier to develop person-specific and evidence-based approaches for problematic mobile phone use.

    Limitations

    This was a pilot study and results must be considered preliminary. A larger study is required to further study the associations described in this analysis. Second, based on the results from Table 1, it may be hypothesized that the use of a mobile phone ESM app to collect the data may have influenced mobile phone use to some extent, with a potential for bias. To what degree this may impact the results has to be investigated in future studies. Third, in this pilot the level of mobile phone use (in minutes) was estimated at each beep by the participants themselves. It would have been more accurate to also measure phone use digitally in duration and type (distinguishing between email and social media, for example).

    Conclusion

    In future research, the above considerations need to be taken into account. In addition, there are some other recommendations. First, it would be instructive to investigate the effects of mobile phone use on the quality of sleep, as an association was suggested in previous studies [21,36]. In this study, the questionnaire was included but analyses could not be performed due to lack of variability in the data. Second, as observed in the evening questionnaire of this ESM pilot, FoMO can vary greatly between individuals and it would be desirable to add this question to the beeps.

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix 1

    PsyMate questionnaires.

    PDF File (Adobe PDF File), 46KB
    1. Wang J, Iannotti RJ, Nansel TR. School bullying among adolescents in the United States: physical, verbal, relational, and cyber. J Adolesc Health 2009 Oct;45(4):368-375 [FREE Full text] [CrossRef] [Medline]
    2. Hancock PA, Lesch M, Simmons L. The distraction effects of phone use during a crucial driving maneuver. Accid Anal Prev 2003 Jul;35(4):501-514. [Medline]
    3. Bianchi A, Phillips JG. Psychological predictors of problem mobile phone use. Cyberpsychol Behav 2005 Feb;8(1):39-51. [CrossRef] [Medline]
    4. Toda M, Monden K, Kubo K, Morimoto K. Cellular phone dependence tendency of female university students. Nihon eiseigaku zasshi (Japanese J Hygiene) 2004;59:383-386. [CrossRef]
    5. Billieux J, Van der Linden M, Rochat L. The role of impulsivity in actual and problematic use of the mobile phone. Appl Cognitive Psychol 2008;22:1195-1210. [CrossRef]
    6. Igarashi T, Motoyoshi T, Takai J, Yoshida T. No mobile, no life: self-perception and text-message dependency among Japanese high school students. Comput Hum Behav 2008;24:2311-2324. [CrossRef]
    7. Jenaro C, Flores N, Gómez-Vela M, González-Gil F, Caballo C. Problematic internet and cell-phone use: psychological, behavioral, and health correlates. Addict Res Theory 2007;15:309-320. [CrossRef]
    8. Chóliz M. Mobile-phone addiction in adolescence: the test of mobile phone dependence. Prog Health Sci 2012;2:33-44.
    9. Rutland J, Sheets T, Young T. Development of a scale to measure problem use of short message service: the SMS Problem Use Diagnostic Questionnaire. Cyberpsychol Behav 2007 Dec;10(6):841-843. [CrossRef] [Medline]
    10. Walsh S, White KM, Young RM. Needing to connect: the effect of self and others on young people's involvement with their mobile phones. Aus J Psych 2010 Dec;62(4):194-203. [CrossRef]
    11. Yen C, Tang T, Yen J, Lin H, Huang C, Liu S, et al. Symptoms of problematic cellular phone use, functional impairment and its association with depression among adolescents in Southern Taiwan. J Adolesc 2009 Aug;32(4):863-873. [CrossRef] [Medline]
    12. Martinotti G, Villella C, Di Thiene D, Di Nicola M, Bria P. Problematic mobile phone use in adolescence: a cross-sectional study. J Pub Health 2011;19:545-551. [CrossRef]
    13. Kwon M, Kim D, Cho H, Yang S. The smartphone addiction scale: development and validation of a short version for adolescents. PLoS One 2013;8(12):e83558 [FREE Full text] [CrossRef] [Medline]
    14. Billieux J. Problematic use of the mobile phone: a literature review and a pathways model. Curr Psych Rev 2012 Oct 01;8(4):299-307. [CrossRef]
    15. American Psychological Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5). Washington: American Psychiatric Pub; 2013.
    16. Bragazzi N, Del Puente G. A proposal for including nomophobia in the new DSM-V. Psychol Res Behav Manag 2014;7:155-160 [FREE Full text] [CrossRef] [Medline]
    17. Przybylski A, Murayama K, DeHaan C, Gladwell V. Motivational, emotional, and behavioral correlates of fear of missing out. Comput Hum Behav 2013;29:1841-1848. [CrossRef]
    18. Elhai J, Levine J, Dvorak R, Hall B. Fear of missing out, need for touch, anxiety and depression are related to problematic smartphone use. Comput Hum Behav 2016;63:509-516. [CrossRef]
    19. Elhai JD, Dvorak RD, Levine JC, Hall BJ. Problematic smartphone use: a conceptual overview and systematic review of relations with anxiety and depression psychopathology. J Affect Disord 2017 Jan 01;207:251-259. [CrossRef] [Medline]
    20. Ha JH, Chin B, Park D, Ryu S, Yu J. Characteristics of excessive cellular phone use in Korean adolescents. Cyberpsychol Behav 2008 Dec;11(6):783-784. [CrossRef] [Medline]
    21. Thomée S, Härenstam A, Hagberg M. Mobile phone use and stress, sleep disturbances, and symptoms of depression among young adults: a prospective cohort study. BMC Public Health 2011;11:66 [FREE Full text] [CrossRef] [Medline]
    22. Sánchez-Martínez M, Otero A. Factors associated with cell phone use in adolescents in the community of Madrid (Spain). Cyberpsychol Behav 2009 Apr;12(2):131-137. [CrossRef] [Medline]
    23. Al-Khlaiwi T, Meo SA. Association of mobile phone radiation with fatigue, headache, dizziness, tension and sleep disturbance in Saudi population. Saudi Med J 2004 Jun;25(6):732-736. [Medline]
    24. Elhai J, Levine J, Dvorak R, Hall B. Non-social features of smartphone use are most related to depression, anxiety and problematic smartphone use. Comput Hum Behav 2017;69:75-82. [CrossRef]
    25. Pedrero PEJ, Rodríguez MMT, Ruiz SDLJM. [Mobile phone abuse or addiction. A review of the literature]. Adicciones 2012;24(2):139-152 [FREE Full text] [Medline]
    26. Kim Y, Jeong J, Cho H, Jung D, Kwak M, Rho MJ, et al. Personality factors predicting smartphone addiction predisposition: behavioral inhibition and activation systems, impulsivity, and self-control. PLoS One 2016;11(8):e0159788 [FREE Full text] [CrossRef] [Medline]
    27. Walsh SP, White KM, Young RM. Over-connected? A qualitative exploration of the relationship between Australian youth and their mobile phones. J Adolesc 2008 Feb;31(1):77-92. [CrossRef] [Medline]
    28. Ehrenberg A, Juckes S, White KM, Walsh SP. Personality and self-esteem as predictors of young people's technology use. Cyberpsychol Behav 2008 Dec;11(6):739-741. [CrossRef] [Medline]
    29. Butt S, Phillips J. Personality and self reported mobile phone use. Comput Hum Behav 2008 Mar;24(2):346-360. [CrossRef]
    30. Elhai JD, Dvorak RD, Levine JC, Hall BJ. Problematic smartphone use: a conceptual overview and systematic review of relations with anxiety and depression psychopathology. J Affect Disord 2017 Jan 01;207:251-259. [CrossRef] [Medline]
    31. Hassan E. Recall bias can be a threat to retrospective and prospective research designs. Internet J Epidemiol 2006;3:339-412. [CrossRef]
    32. Larson R, Csikszentmihalyi M. The experience sampling method. New Dir Methodol Soc Behav Sci 1983;15:41-56.
    33. van Os J, Verhagen S, Marsman A, Peeters F, Bak M, Marcelis M, ESM-MERGE Investigators, et al. The experience sampling method as an mHealth tool to support self-monitoring, self-insight, and personalized health care in clinical practice. Depress Anxiety 2017 Dec;34(6):481-493. [CrossRef] [Medline]
    34. Rickard N, Arjmand H, Bakker D, Seabrook E. Development of a mobile phone app to support self-monitoring of emotional well-being: a mental health digital innovation. JMIR Ment Health 2016 Nov 23;3(4):e49 [FREE Full text] [CrossRef] [Medline]
    35. Burns MN, Begale M, Duffecy J, Gergle D, Karr CJ, Giangrande E, et al. Harnessing context sensing to develop a mobile intervention for depression. J Med Internet Res 2011;13(3):e55 [FREE Full text] [CrossRef] [Medline]
    36. Oftedal G, Wilén J, Sandström M, Mild KH. Symptoms experienced in connection with mobile phone use. Occup Med (Lond) 2000 May;50(4):237-245. [Medline]
    37. PsyMate.   URL: http://www.psymate.eu/ [accessed 2018-05-10] [WebCite Cache]
    38. Delespaul P. Assessing Schizophrenia in Daily Life: The Experience Sampling Method. Maastricht: Maastricht University Medical Centre; 1995.
    39. IBM SPSS Statistics for Windows. 22.0 ed. Armonk: IBM Corp; 2013.
    40. Billieux J, Maurage P, Lopez-Fernandez O, Kuss D, Griffiths M. Can disordered mobile phone use be considered a behavioral addiction? An update on current evidence and a comprehensive model for future research. Curr Addict Rep 2015;2:156-162. [CrossRef]

    ‎
    ESM: experience sampling method
    FoMO: fear of missing out
    NA: negative affect
    PA: positive affect

    Edited by G Eysenbach; submitted 19.07.17; peer-reviewed by J Elhai, J Andrews; comments to author 23.11.17; revised version received 31.03.18; accepted 31.03.18; published 18.06.18

    Copyright

    ©Suzanne Roggeveen, Jim van Os, Kelly Bemelmans, Mikal van Poll, Richel Lousberg. Originally published in JMIR Formative Research (http://formative.jmir.org), 18.06.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on http://formative.jmir.org, as well as this copyright and license information must be included.