Published on in Vol 8 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48525, first published .
The Effects of a Single-Session Virtual Rumination Intervention to Enhance Cognitive Functioning in Veterans With Subjective Cognitive Symptoms: Multimethod Pilot Study

The Effects of a Single-Session Virtual Rumination Intervention to Enhance Cognitive Functioning in Veterans With Subjective Cognitive Symptoms: Multimethod Pilot Study

The Effects of a Single-Session Virtual Rumination Intervention to Enhance Cognitive Functioning in Veterans With Subjective Cognitive Symptoms: Multimethod Pilot Study

Original Paper

1Research Service, VA San Diego Healthcare System, San Diego, United States

2Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, United States

3The VA Center of Excellence for Research on Returning War Veterans, Waco, TX, United States

4Herbert Wertheim School of Public Health and Human Longevity Science, University of California San Diego, San Diego, CA, United States

5UC San Diego Altman Clinical and Translational Research Center Dissemination and Implementation Science Center, University of California San Diego, San Diego, CA, United States

6Department of Psychiatry, University of California San Diego, San Diego, CA, United States

7Department of Psychology and Neuroscience, Baylor University, Waco, TX, United States

Corresponding Author:

Tara Austin, PhD

Research Service

VA San Diego Healthcare System

3350 La Jolla Village Drive

San Diego, 92161

United States

Phone: 1 8585528585

Email: tara.austin@va.gov


Background: Subjective cognitive concerns (SCCs) entail perceived difficulties in thinking or memory, often reported without substantial objective evidence of cognitive impairment. These concerns are prevalent among individuals with a history of brain injuries, neurological conditions, or chronic illnesses, contributing to both psychological distress and functional limitations. They are increasingly considered to be a risk factor for future objective decline. A considerable number of individuals reporting SCCs also exhibit mental health symptoms, such as a history of trauma, depression, or anxiety. Interventions that address modifiable emotional and cognitive factors related to SCC could improve functioning and quality of life. Therefore, the use of emotion regulation strategies, especially those directed at minimizing rumination, could serve as a promising focus for interventions aimed at mitigating subjective cognitive concerns in veteran populations.

Objective: This pilot study explored the feasibility, acceptability, and preliminary efficacy of a brief, 1-session emotion regulation intervention called “Worry Less, Remember More.” The Worry Less, Remember More intervention was designed to reduce rumination and improve subjective cognitive functioning in veterans with subjective cognitive changes (N=15).

Methods: We randomized 15 veterans to either the active telehealth condition or waitlist control and completed the intervention. Participants were aged between 31 and 67 (mean 49.5, SD 10.1) years, and the sample was primarily male (12/15, 83%) and White (10/15, 67%). The most common diagnoses were posttraumatic stress disorder and depression. Following the intervention, veteran input was sought through semistructured interviews with a subset of 12 participants, examining feasibility, acceptability, and perceived efficacy. Preliminary efficacy was also measured using pre- and postintervention self-report measures.

Results: Veterans reported that this intervention was acceptable, with 92% (11/12) of the sample reporting that they benefited from the intervention and would recommend the intervention to others with similar difficulties. Semistructured interviews revealed difficulties with feasibility, including problems with the remote consenting process, forgetting appointments, and needing additional strategies to remember to consistently use the interventions. The intervention improved self-reported cognitive symptoms on quantitative measures but did not improve self-reported rumination.

Conclusions: This pilot study establishes the preliminary feasibility, acceptability, and efficacy of the Worry Less, Remember More intervention for veterans with subjective cognitive symptoms. Future iterations of the intervention may benefit from simplifying the electronic consent process, providing reminders for appointments, and incorporating compensatory cognitive strategies to assist with using the telehealth system, as well as applying the strategies learned in the intervention. While future research is needed with larger samples, including nonveteran populations, the intervention may also be a useful clinical tool to bridge care between neuropsychology clinics and mental health treatment.

JMIR Form Res 2024;8:e48525

doi:10.2196/48525

Keywords



Subjective cognitive concerns (SCCs) refer to perceived challenges in thinking or memory reported with either no evidence or only minimal objective evidence of cognitive impairment [1]. SCCs are common in people with histories of brain injuries, neurological illnesses, and other chronic illnesses and contribute to psychological distress and functional impairment [2-5]. More than 10% of US veterans aged 45 years or older report subjective cognitive symptoms [6]. Interest in SCCs has increased due to cognitive symptoms, such as “brain fog,” following the COVID-19 infection [7]. Research has found that SCCs are often related to potentially modifiable factors that influence cognition, such as mood, and many individuals with SCCs have mental health symptoms, including a history of trauma, depression, or anxiety [8-11]. A recent study in a neuropsychology clinic found that childhood trauma predicted SCCs and that this relationship was mediated by a ruminative thought style [12]. Emotion dysregulation, including rumination, contributes to and maintains psychopathology as well as cognitive dysfunction, particularly in those with affective illnesses [13] and has been implicated in the maintenance of neuropsychiatric illness [14,15]. Rumination, or the tendency to passively and persistently dwell on negative or problematic aspects of life, and the ruminative thought process, which includes the act of focusing on the potential causes and outcomes of the negative or problematic aspects of life, are forms of emotional dysregulation, which are patterns of emotional experience or expression that interfere with goal-directed activity [14]. Ineffective coping strategies perpetuate emotion dysregulation and, thereby, depression and other psychological disorders [16,17].

Emotion regulation approaches vary in their impact on both emotional health (eg, depression relapse and severity) and cognitive functioning. Less effective regulation strategies, such as rumination (eg, perseverative thought processes focusing on negative content) [18] and suppression (inhibiting the outward signs of inner feelings), are suggested to be cognitively taxing, thus diminishing cognitive resources [19]. Rumination and suppression have been associated with poor health and negative psychological outcomes in the general population as well as in veteran populations [20]. In veterans, rumination has been found to moderate the association between posttraumatic stress disorder (PTSD) or depression and risky behavior [21] and between moral injury and negative mental health symptoms [22]. Rumination is also associated with sleep problems in veterans with PTSD and depression [22]. There is also preliminary evidence that rumination may moderate the relationship between attentional difficulties and PTSD symptoms [23].

As such, emotion regulation strategy use, particularly strategies aimed at reducing rumination, may be a good target for intervention to reduce SCCs in veteran populations. In order to address these difficulties, we created a 1-session treatment called “Worry Less, Remember More,” integrating elements from Watkins’s [24] rumination-focused cognitive-behavioral therapy for depression and Gilbert’s [25] compassion-focused therapy (Multimedia Appendix 1 [24,26,27]). The psychoeducation portion consisted of concepts from evolutionary psychology as described by Gilbert [25], including an evolutionarily adapted attentional bias toward negative information, information about emotional regulation systems and their responses to trauma and stress, and attention as a limited resource that can be redirected. We used Watkins’s [24] 12-session rumination-focused cognitive-behavioral therapy for depression to provide specific examples of rumination, purposes of rumination, and 3 short intervention exercises. The session was designed to be delivered through telehealth, as there is evidence that telehealth and web-based interventions are feasible, acceptable, and efficacious in bridging care and supplementing existing mental health treatment [28,29], including in populations with cognitive difficulties [30].

In addition to establishing the feasibility and efficacy of emotion regulation interventions to improve subjective cognitive functioning, it is also important to establish the acceptability of the intervention to individuals with SCCs to increase treatment engagement, compliance, and completion [31]. For this study, we operationalized feasibility (including demand, implementation, practicality, and integration into existing systems) and acceptability according to Bowen et al [32], Pearson et al [33], and Sekhon et al [34]. The goal of this study was to establish the feasibility, acceptability, and preliminary efficacy of a 1-session, rumination-focused intervention for veterans with SCCs compared to a waitlist control condition.


Ethical Considerations

This study was approved by the Central Texas Veterans Healthcare System Institutional Review Board (IRB number 00697). All participants were informed of the purpose of the study, as well as the possibility of dropping out at any time, and signed written informed consent before participation. All included study data are deidentified, and all quotes are anonymous and have been carefully reviewed to have all potentially identifiable data removed. Participants were paid US $40 per visit (US $120 in total).

Recruitment

Veterans were recruited from the Veterans Administration (VA) neuropsychology specialty clinics, primary care clinics, and mental health clinics. The majority of veterans who participated were referred by mental health providers, though some veterans self-referred through flyers placed on the medical campus.

Inclusion criteria included verbal endorsement of cognitive difficulties and veteran status. Exclusion criteria included (1) a score of <23 on the Montreal Cognitive Assessment (MoCA); (2) current substance abuse; or (3) a diagnosis of serious mental illness, such as schizophrenia or psychotic disorders. We screened 49 veterans for eligibility, of whom 9 were self-referred and 40 were referred by mental health providers. Of the 49 veterans referred, 23 did not return to complete informed consent, 4 declined to participate, 2 had MoCA scores <23, another 2 were ineligible due to substance use, and 1 was ineligible due to a diagnosis of severe mental illness. Thus, a total of 17 veterans were enrolled and randomized to either the intervention or waitlist control condition before baseline testing. Of the veterans randomized, 15 attended the first visit (baseline testing and intervention for the intervention group; baseline testing only for the waitlist control group), and 12 attended both the initial assessment and follow-up testing. The 12 participants who completed the intervention also completed quantitative assessments and qualitative interviews at the 8-week follow-up. All study procedures (including screening, consenting, assessment, and intervention) were delivered remotely using VA video telehealth software.

Sample Characteristics

Participants’ were aged between 31 and 67 (mean 49.5, SD 10.1) years (Table 1), and the sample was primarily male (12/15, 83%) and White (10/15, 67%). The most common diagnoses were PTSD and depression. There were no significant differences between the full sample and the qualitative interview participant subset on age, gender, race or ethnicity, rates of PTSD or sleep difficulties, or the percentage of participants who completed all study visits. The qualitative interview group had a higher percentage of brain injuries and lower rates of depression.

Table 1. Demographic information, computerized patient record system (CPRS) diagnoses, and baseline self-report measures for study participants. The percentages might not add up to 100% due to rounding off.
DemographicIntervention group (n=7)Waitlist control group (n=8)Qualitative sample subset (n=12)
Participants who completed the study, n (%)6 (86)N/Aa10 (83)
Age (years), mean (SD)51.7 (11.5)49.6 (8.7)49.4 (10.1)
Gender (male), n (%)5 (71)7 (88)10 (83)
Self-reported race, n (%)

Asian0 (0)1 (13)0 (0)

White5 (71)6 (75)8 (67)

Black2 (29)1 (13)4 (33)
Self-reported ethnicity, n (%)

Hispanic1 (14)1 (13)1 (8)
CPRS diagnoses of interest, n (%)

PTSDb3 (42)3 (38)6 (50)

Depression4 (57)3 (38)4 (33)

Sleep1 (14)2 (25)3 (25)

ADHDc1 (14)0 (0)1 (8)

Traumatic brain injury2 (28)2 (25)4 (33)
Baseline self-report measures, mean (SD)

BDI-IId31.55 (10.54)34 (8.83)N/A

BAIe20.75 (5.11)17.36 (5.33)N/A

RRS-SFf19.6 (3.67)23.33 (6.15)N/A

BRIEF-Ag96 (26.7)82.75 (30.96)N/A

NSIh44 (12.51)37.38 (9.02)N/A

Rivermeadi42.33 (8.96)29.44 (5.71)N/A

aN/A: not applicable.

bPTSD: posttraumatic stress disorder.

cADHD: Attention deficit hyperactivity disorder.

dBDI-II: Beck Depression Inventory-Second Edition.

eBAI: Beck Anxiety Inventory.

fRRS-SF: Ruminative Response Scale and Perseverative Thinking Questionnaire-Short Form.

gBRIEF-A: Behavior Rating Inventory of Executive Functioning-Adult.

hNSI: Neurobehavioral Symptom Inventory.

iIndicates statistically significant difference between groups (P<.05).

Study Procedure

The pilot study was a 1-visit randomized controlled trial with 2 follow-up visits to gather outcome data. All study visits were conducted remotely, using the VA telehealth system. Before the start of the study, participants were randomized to either an intervention or waitlist control condition. At the first visit, participants in both conditions completed a comprehensive preintervention self-report battery. Immediately following the initial baseline measures, those randomized to the intervention condition then participated in a 30-minute psychoeducation and rumination-focused intervention, whereas those in the waitlist control condition were excused. Then, 8 weeks later, both groups completed follow-up behavioral measures, and the waitlist control group received the intervention. Both groups completed follow-up behavioral measures at the third visit, approximately 8 weeks after the second visit.

Measures

Measures administered included the Beck Depression Inventory-Second Edition (BDI-II) [35], the Beck Anxiety Inventory (BAI) [36], the Ruminative Response Scale and Perseverative Thinking Questionnaire-Short Form (RRS-SF) to assess rumination [37], the Behavior Rating Inventory of Executive Functioning-Adult (BRIEF-A) self-report [38], the Neurobehavioral Symptom Inventory (NSI) [39], and the Rivermead Post-Concussion Symptoms Questionnaire [40]. Raw scores from the BRIEF-A and cognitive items from the Rivermead and NSI were summed into a cognitive index score for each participant.

Statistical Analysis

Quantitative analyses were performed in R (R Core Team) using statistical packages and the original code [41]. The data were checked for normality and outlier values; no corrections were needed. When <10% of data were missing at random, missing values were estimated and imputed using a random forest–based imputation, which has been shown to be appropriate for imputing mixed continuous or categorical data even in the presence of potential interactions and nonlinearity [42]. Differences in pre-post outcome measures (rumination and cognitive composite score) were assessed using repeated measures ANOVA with group as a between subject factor and time point (pre or post) and test as within-subject factors. Significant ANOVAs were followed up with 2-tailed t tests. Post hoc power analysis showed that with our sample size, we were only 15% powered to find an effect similar to previous single-session studies, which found small effects on emotional functioning (d=0.10-0.30). Based on the effect sizes in these studies, 139 participants per group would be needed for an α=.05 and a power of 0.80. As such, the purpose of this study is only to determine preliminary efficacy.

Qualitative Data Collection and Analysis

We created an interview guide based on acceptability and feasibility concepts from Sekhon et al [34] and Bowen et al [32]. One portion of the interview guide consisted of 2 questions asked of all participants (“would you recommend this intervention to others with thinking difficulties?” and “did you feel you benefited from this intervention?”). The second portion of the interview guide contained flexible questions and prompts related to intervention cohesiveness, perceived effectiveness, usability, feasibility, and preferences. Example prompts from the interview guides are included in Table 2.

Interviews were conducted by 2 researchers at least 1 month after the second visit, and each interview was conducted by a researcher not involved in intervention delivery for each participant. Interviews lasted 20-45 minutes and were recorded and transcribed verbatim by the primary researcher (TA). Following each interview, a memo was written describing the conversation, themes observed, and experience of the interviewer. During the interview and transcription, responses were put under the construct addressed. If a response did not appear to address a construct, it was written at the bottom of the interview form. Following transcription, these responses were read and coded according to pre-established codes. Pre-established codes and themes were identified through discussions with participants before initiating the formal qualitative portion of the project. Additionally, themes that appeared in both the data memos before the transcription process and after all interviews were completed were coded. All interviews were read and coded for evidence of emerging codes. A secondary coder met to review and discuss the assigned codes. Discrepancies between coders were resolved by discussion.

Table 2. Quotes about veterans’ experiences of the intervention.
Constructs and examples of interview questionsVeterans’ responses
Participant satisfaction

  • Would you recommend this program to other Veterans?
  • 92% (11/12) said “yes”

  • Do you feel you benefited from this intervention?
  • 92% (11/12) said “yes”
Perceived difficulties: preintervention

  • What lead you to sign up for this intervention? Did you have any specific goals going into the intervention or areas you wanted help with?
  • What were some areas of difficulty before the intervention?
  • “It takes me longer to complete tasks,…. Longer and longer to complete tasks”
  • “I’m having [a] lot of issues with concentration staying on task, forgetfulness, when I was younger I had ADD [attention deficit disorder]. I didn’t know about adult ADD and it is something you don’t grow out of?”
  • “To improve memory- that was the hope, but no expectations”
  • “[I] got out of the military, can’t concentrate. I quit things, can’t wrap my head around them”
  • “Hard time coming up with my own thoughts”
  • “Don’t remember things”
  • “Walk from one room to another room, go in the room and forget why I’m there”
Initial expectations

  • What were your initial expectations of the intervention?
  • How did your referring provider explain the intervention to you?
  • “It was supposed to help with my memory, correct? It sounds like a cliché but I didn’t really have any expectations.”
  • “It was about memory loss, wasn’t it? I guess thinking, maybe some ideas on how to improve my memory.”
  • “Well, they were doing a study for Veterans who were having cognitive issues.”
  • “I didn’t really know what to expect.”
  • “I originally from what I heard and read into, I thought it would be giving me some skills to help combat the cognitive decline I have had over the past of the few years, not mentally a decline, but a slowing of my thought process.”
  • “Not really sure, I didn’t really, didn’t really have much. I guess to help others.”
Perceived effectiveness

  • Have any specific things in your life changed?
  • Do you feel you benefited from the intervention?
  • Has another (family members, coworkers, or medical team) noticed changes in either your mood or cognitive functioning?
  • “The wife has noticed my attitude and like that I have helped and she thought my participation was positive”
  • “My wife has picked up the fact I am a bit more in tune, especially if we are in a public situation.”
  • “My wife has mentioned [me] being in a better mood. Getting up and doing more things. Now being a bit more detail focused”
  • “I do. It’s not like taking a pill and automatically fixed. It takes work on my part. Still can’t get over that hump in real life.”
Barriers to participation or using strategies

  • Were there any barriers to participation?
  • “If they could email appointment reminders, like a hard copy, just as a physical reminder. And y’all may have done that, I don’t know”
  • “I just… I just hardly ever have my ringer on on my phone. I have problems following through with stuff like that”
  • “I have never actually been tested, but I think I have a learning disability, but I think I have dyslexia. Yes, that’s one of the barriers. Had to read the questions a couple different times.”
  • “Technical difficulties with VVC [VA video connect system], took about an hour or so for the questions.”
Target population

  • Who do you think would benefit from a program like this?
  • “Combat veterans for sure”
  • “Would be helpful to do post-deployment”

Quantitative Findings

There were no significant differences between groups on preintervention measures of rumination, perseverative thinking, or mood. There was a significant difference on one measure of neuropsychiatric symptoms, with higher reported cognitive difficulties on the NSI in the treatment group (Table 1). Both groups reported high levels of neuropsychiatric symptoms, rumination, and perseverative thinking, as well as severe symptoms of depression and moderate symptoms of anxiety.

Acceptability

A total of 92% (11/12) of participants reported they benefited from the intervention and would recommend the intervention to other veterans with similar difficulties. The 1 veteran who reported they did not benefit directly from the program reported benefiting somewhat from the intervention, as it was able to provide a referral to more intensive cognitive rehabilitation treatment.

Efficacy

When examining the postintervention outcome measures (rumination and the cognitive composite index), there was a significant interaction between time and group for the cognitive composite index (F1,13=5.97; P=.03), with significant improvement in the intervention group and not the control group (small effect d=0.10). There was not a significant interaction between time and group on measures of self-reported rumination.

Qualitative Findings

Preintervention Expectations and the Motivation to Participate

Veterans reported few, if any, expectations for the intervention, with comments like “I didn’t really know what to expect” or reported general expectations about improving cognition, such as “It was supposed to help with my memory, correct?” (Table 2 contains participant responses). A total of 92% (11/12) veterans reported that their primary motivation to start the intervention was to have tools to help with their daily difficulties with cognition. One veteran reported that his primary motivation to participate was to improve future treatments for other veterans experiencing cognitive problems.

Acceptability

When asked about recommending the intervention to others with similar difficulties, several veterans (n=4 with similar comments) reported that the intervention “would be helpful to do postdeployment” and should be given to all “combat veterans for sure” before the development of cognitive difficulties. The feedback on perceived effectiveness was generally positive, with most veterans reporting improvement in daily functioning. Notably, more veterans reported their spouse or partner had noticed improvement (n=6) compared to those who stated they had noticed improvement themselves (n=4).

Feasibility

A barrier to participation in the study was the required remote consenting procedures. A total of 23 veterans expressed interest but did not return the consent form. Those who participated in the intervention reported that the remote consenting process was more difficult compared to previous in-person consenting for research participation. Another barrier to participation was forgetting appointments, and many participants had to be rescheduled multiple times due to forgetting appointments. Veterans were called the week of their appointment to remind them of their appointment; however, they requested additional reminders and reminders in digital modalities, such as “email appointment reminders, like a hard copy, just as a physical reminder.” Retention rates improved when the telehealth system started to send out SMS text message reminders of the appointment along with the email reminder.

Even though 92% (11/12) of participants said they recommended the intervention, only 2 out of the 12 veterans were able to describe and recall an exercise from the study, and several indicated that they forgot what the exercises were. Of the 10 veterans who did not remember the specifics of the intervention, 2 reported it was helpful to learn more about additional resources for both cognitive skills and treatments for mood, which they were able to pursue after the intervention. A veteran reported it was helpful as “this helped me put things into words and helps me understand. Sometimes you don’t know how to put things into words.” He reported that being able to explain both his cognitive difficulties and mood symptoms had improved communication with his family and members of his health care team. In contrast to the intervention exercises, the psychoeducation portion was noted as helpful in interviews with 10 veterans.


Overview

We found the preliminary efficacy of a 1-session rumination-focused intervention to improve cognitive symptoms; however, there was no change in rumination, which was the proposed treatment target and mechanism. In qualitative interviews, veterans reported this intervention was acceptable and beneficial, as evidenced by over 92% 11/12) stating they benefited from the intervention and would recommend the intervention to others with similar difficulties. In addition to being acceptable to veterans, there was a high level of perceived effectiveness and intervention cohesiveness. Due to the discrepancy between self-reported improvement and the scores on the RRS-SF, further research may benefit from exploring the use of other rumination or perseverative thought measures.

The psychoeducation and brief intervention modules have potential utility in bridging care after neuropsychological or neurological evaluations and subsequent referrals to mental health treatment. Brief, internet-administered interventions have been shown to be effective in bridging care for mental health symptoms [28]. The brief interventions described in the module and handouts can then be used to build awareness while waiting to be seen by mental health clinicians or for existing mental health patients to understand how their treatment may improve their cognitive functioning. In these cases, the intervention can be incorporated into the feedback session and may yield additional “buy-in” from veterans to fully participate in mental health treatment. Due to the large number of veterans reporting SCC, telehealth-based intervention is an efficient and cost-effective way to meet these needs [43].

There are several limitations in this study, including the small sample size, which limited statistical analyses. Our pilot work suggests that veterans with subjective cognitive changes are amenable to psychological treatment and perceive benefit from a short, 1-session intervention. Further work with a larger sample size is needed to fully evaluate efficacy and whether the intervention described here should be implemented more broadly. Additionally, a larger sample size will allow further exploration of how changes in rumination may or may not mediate the relationship between SCCs and cognition. Further studies can then evaluate whether the psychoeducation about rumination is sufficient to fulfill the long-term goals of the intervention, namely, to bridge care following referral to mental health services and increase veteran buy-in for participation in psychological treatments to improve cognition. Further research in this area could also explore the use of a longer intervention as a standalone treatment.

Conclusion

In conclusion, we found preliminary evidence for the feasibility, acceptability, and efficacy of a 1-session rumination-focused intervention for veterans with SCCs, which will benefit from continued evaluation of this intervention as well as comparison to routine clinical practice.

Data Availability

The data sets generated during or analyzed during this study are available from the corresponding author on reasonable request.

Conflicts of Interest

None declared.

Multimedia Appendix 1

"Worry less, remember more" intervention and resources.

DOCX File , 34 KB

  1. Mitchell AJ. Is it time to separate subjective cognitive complaints from the diagnosis of mild cognitive impairment? Age Ageing. 2008;37(5):497-499. [FREE Full text] [CrossRef] [Medline]
  2. Hill NL, McDermott C, Mogle J, Munoz E, DePasquale N, Wion R, et al. Subjective cognitive impairment and quality of life: a systematic review. Int Psychogeriatr. 2017;29(12):1965-1977. [FREE Full text] [CrossRef] [Medline]
  3. Kinsinger SW, Lattie E, Mohr DC. Relationship between depression, fatigue, subjective cognitive impairment, and objective neuropsychological functioning in patients with multiple sclerosis. Neuropsychology. 2010;24(5):573-580. [FREE Full text] [CrossRef] [Medline]
  4. Dujardin K, Duhamel A, Delliaux M, Thomas-Antérion C, Destée A, Defebvre L. Cognitive complaints in Parkinson's disease: its relationship with objective cognitive decline. J Neurol. 2010;257(1):79-84. [FREE Full text] [CrossRef] [Medline]
  5. French LM, Lange RT, Brickell T. Subjective cognitive complaints and neuropsychological test performance following military-related traumatic brain injury. J Rehabil Res Dev. 2014;51(6):933-950. [FREE Full text] [CrossRef] [Medline]
  6. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/ [accessed 2024-03-06]
  7. Austin T, Hodges C, Darowski E, Thomas M, Bergmans R, Parr S, et al. Meta-analysis of cognitive function following nonsevere SARS-CoV-2 infection. Preregistered Prospero. 2024.:CRD42021293124. (forthcoming).
  8. Barker A, Prior J, Jones R. Memory complaint in attenders at a self‐referral memory clinic: The role of cognitive factors, affective symptoms and personality. Int J Geriat Psychiatry. Oct 13, 2004;10(9):777-781. [FREE Full text] [CrossRef]
  9. Larrabee GJ, Levin HS. Memory self-ratings and objective test performance in a normal elderly sample. J Clin Exp Neuropsychol. Jun 1986;8(3):275-284. [CrossRef] [Medline]
  10. Samuelson KW, Abadjian L, Jordan JT, Bartel A, Vasterling J, Seal K. The association between PTSD and functional outcome is mediated by perception of cognitive problems rather than objective neuropsychological test performance. J Trauma Stress. Oct 2017;30(5):521-530. [CrossRef] [Medline]
  11. Vanderploeg RD, Belanger HG, Curtiss G, Bowles AO, Cooper DB. Reconceptualizing rehabilitation of individuals with chronic symptoms following mild traumatic brain injury. Rehabil Psychol. Feb 2019;64(1):1-12. [CrossRef] [Medline]
  12. Szabo YZ, Nelson SM, Lantrip C. Cognitive complaints in neuropsychologically normal adults: A brief report on the roles of childhood abuse and rumination. Traumatology. Mar 2020;26(1):29-34. [FREE Full text] [CrossRef]
  13. Gotlib IH, Joormann J. Cognition and depression: current status and future directions. Annu Rev Clin Psychol. 2010;6:285-312. [FREE Full text] [CrossRef] [Medline]
  14. Ochsner KN, Silvers JA, Buhle JT. Functional imaging studies of emotion regulation: a synthetic review and evolving model of the cognitive control of emotion. Ann N Y Acad Sci. Mar 2012;1251:E1-24. [FREE Full text] [CrossRef] [Medline]
  15. Pugach CP, Campbell AA, Wisco BE. Emotion regulation in posttraumatic stress disorder (PTSD): Rumination accounts for the association between emotion regulation difficulties and PTSD severity. J Clin Psychol. Mar 2020;76(3):508-525. [CrossRef] [Medline]
  16. Joormann J, Vanderlind WM. Emotion regulation in depression. Clin Psychol Sci. Jun 30, 2014;2(4):402-421. [FREE Full text] [CrossRef]
  17. Joormann J, Quinn ME. Cognitive processes and emotion regulation in depression. Depress Anxiety. Apr 2014;31(4):308-315. [CrossRef] [Medline]
  18. Sansone RA, Sansone LA. Rumination: relationships with physical health. Innov Clin Neurosci. Feb 2012;9(2):29-34. [FREE Full text] [Medline]
  19. Gross JJ. Emotion regulation: affective, cognitive, and social consequences. Psychophysiology. May 2002;39(3):281-291. [CrossRef] [Medline]
  20. Richards JM, Gross JJ. Emotion regulation and memory: The cognitive costs of keeping one's cool. Journal of Personality and Social Psychology. Sep 2000;79(3):410-424. [CrossRef] [Medline]
  21. Borders A, McAndrew LM, Quigley KS, Chandler HK. Rumination moderates the associations between PTSD and depressive symptoms and risky behaviors in U. S. veterans. J Trauma Stress. Oct 2012;25(5):583-586. [CrossRef] [Medline]
  22. Bravo AJ, Kelley ML, Mason R, Ehlke S, Vinci C, Redman Ret LJC. Rumination as a mediator of the associations between moral injury and mental health problems in combat-wounded veterans. Traumatology (Tallahass Fla). Mar 2020;26(1):52-60. [FREE Full text] [CrossRef] [Medline]
  23. Cox RC, Olatunji BO. A systematic review of sleep disturbance in anxiety and related disorders. J Anxiety Disord. Jan 2016;37:104-129. [CrossRef] [Medline]
  24. Watkins ER. Rumination-Focused Cognitive-Behavioral Therapy for Depression. New York. Guilford Publications; 2016.
  25. Gilbert P. A brief outline of the evolutionary approach for compassion focused therapy. Psychol Psychiatry. 2017;3(6):218-227. [FREE Full text]
  26. Addis ME, Martell CR. Overcoming Depression One Step at a Time : the New Behavioral Activation Approach to Getting your Life Back. Oakland. New Harbinger Publications, Inc; 2004.
  27. McGowan SK, Behar E. A preliminary investigation of stimulus control training for worry: effects on anxiety and insomnia. Behav Modif. 2013;37(1):90-112. [CrossRef] [Medline]
  28. Taylor ME, Lozy O, Conti K, Wacha-Montes A, Bentley KH, Kleiman EM. The effectiveness of a brief telehealth and smartphone intervention for college students receiving traditional therapy: longitudinal study using ecological momentary assessment data. JMIR Ment Health. Jun 29, 2022;9(6):e33750. [FREE Full text] [CrossRef] [Medline]
  29. Schlicker S, Baumeister H, Buntrock C, Sander L, Paganini S, Lin J, et al. A web- and mobile-based intervention for comorbid, recurrent depression in patients with chronic back pain on sick leave (Get.Back): pilot randomized controlled trial on feasibility, user satisfaction, and effectiveness. JMIR Ment Health. Apr 15, 2020;7(4):e16398. [FREE Full text] [CrossRef] [Medline]
  30. Boucher E, Honomichl R, Ward H, Powell T, Stoeckl SE, Parks A. The effects of a digital well-being intervention on older adults: retrospective analysis of real-world user data. JMIR Aging. Sep 02, 2022;5(3):e39851. [FREE Full text] [CrossRef] [Medline]
  31. Cone JD. Evaluating Outcomes: Empirical Tools for Effective Practice. Washington, DC. American Psychological Association; 2002.
  32. Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al. How we design feasibility studies. Am J Prev Med. May 2009;36(5):452-457. [FREE Full text] [CrossRef] [Medline]
  33. Pearson N, Naylor PJ, Ashe MC, Fernandez M, Yoong SL, Wolfenden L. Guidance for conducting feasibility and pilot studies for implementation trials. Pilot Feasibility Stud. Oct 31, 2020;6(1):167. [FREE Full text] [CrossRef] [Medline]
  34. Sekhon M, Cartwright M, Francis JJ. Acceptability of health care interventions: A theoretical framework and proposed research agenda. Br J Health Psychol. Sep 2018;23(3):519-531. [CrossRef] [Medline]
  35. Beck AT, Steer RA, Brown G. Beck Depression Inventory–II (BDI-II) [Database record]. APA PsycTests. 1996. URL: https://psycnet.apa.org/doiLanding?doi=10.1037%2Ft00742-000 [accessed 2024-03-07]
  36. Beck AT, Steer RA. BAI, Beck Anxiety Inventory: Manual. San Antonio. Psychological Corporation; 1993.
  37. Treynor W, Gonzalez R, Nolen-Hoeksema S. Rumination reconsidered: a psychometric analysis. Cogn Behav Ther. 2003;27:247-259. [FREE Full text] [CrossRef]
  38. Roth R. BRIEF-A: Behavior Rating Inventory of Executive Function - Adult Version. Lutz; Florida. PsychologicalAssessment Resources; 2005.
  39. Cicerone KD, Kalmar K. Persistent postconcussion syndrome. J Head Trauma Rehabil. 1995;10(3):1-17. [FREE Full text] [CrossRef]
  40. King NS, Crawford S, Wenden FJ, Moss NE, Wade DT. The rivermead post concussion symptoms questionnaire: a measure of symptoms commonly experienced after head injury and its reliability. J Neurol. 1995;242(9):587-592. [FREE Full text] [CrossRef] [Medline]
  41. R Core Team. R: A Language And Environment For Statistical Computing. Vienna, Austria. R Foundation for Statistical Computing; 2021.
  42. Hong S, Lynn KS. Accuracy of random-forest-based imputation of missing data in the presence of non-normality, non-linearity, and interaction. BMC Med Res Methodol. 25, 2020;20(1):199. [FREE Full text] [CrossRef] [Medline]
  43. Tate DF, Finkelstein EA, Khavjou O, Gustafson A. Cost effectiveness of internet interventions: review and recommendations. Ann Behav Med. 2009;38(1):40-45. [FREE Full text] [CrossRef] [Medline]


BAI: Beck Anxiety Inventory
BDI-II: Beck Depression Inventory-Second Edition
BRIEF-A: Behavior Rating Inventory of Executive Functioning-Adult
MoCA: Montreal Cognitive Assessment
NSI: Neurobehavioral Symptom Inventory
PTSD: posttraumatic stress disorder
RRS-SF: Ruminative Response Scale and Perseverative Thinking Questionnaire-Short Form
SCC: subjective cognitive concern
VA: Veterans Administration


Edited by A Mavragani; submitted 26.04.23; peer-reviewed by A Ecker, L Yu; comments to author 01.11.23; revised version received 19.12.23; accepted 21.12.23; published 12.04.24.

Copyright

©Tara Austin, Jennifer Smith, Borsika Rabin, Laurie Lindamer, James Pittman, Staley Justice, Elizabeth W Twamley, Crystal Lantrip. Originally published in JMIR Formative Research (https://formative.jmir.org), 12.04.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.