Analysis of Post-Deployment Cognitive Performance and Symptom Recovery in U.S. Marines

Abstract

Background

Computerized neurocognitive testing (NCAT) has been proposed to be useful as a screening tool for post-deployment cognitive deficits in the setting of mild traumatic brain injury (mTBI). We assessed the clinical utility of post-injury/post-deployment Automated Neurocognitive Assessment Metric (ANAM) testing, using a longitudinal design to compare baseline ANAM tests with two post-deployment ANAM tests in a group of Marines who experienced combat during deployment.

Methods and Findings

Post-deployment cognitive performance and symptom recovery were compared in a subsample of 1324 U.S. Marines with high rates of combat exposure during deployment. Of the sample, 169 Marines had available baseline and twice repeated post-deployment ANAM results. A retrospective analysis of the ANAM data, which consisted of a self-report questionnaire about deployment-related blast exposure, recent history of mTBI, current clinical symptoms, and cognitive performance. Self-reported concussion sustained anytime during deployment was associated with a decrease in cognitive performance measured between 2–8 weeks post-deployment. At the second post-deployment test conducted on average eight months later, performance on the second simple reaction time test, in particular, remained impaired and was the most consistent and sensitive indicator of the cognitive decrements. Additionally, post-concussive symptoms were shown to persist in injured Marines with a self-reported history of concussion for an additional five months after most cognitive deficits resolved. Results of this study showed a measurable deployment effect on cognitive performance, although this effect appears to resolve without lasting clinical sequelae in those without history of deployment-related concussion.

Conclusions

These results highlight the need for a detailed clinical examination for service members with history of concussion and persistent clinical symptoms. Reliance solely upon computerized neurocognitive testing as a method for identifying service members requiring clinical follow-up post-concussion is not recommended, as cognitive functioning only slowly returned to baseline levels in the setting of persistent clinical symptoms.

About the Authors:

F. J. Haran

* E-mail: [email protected]

Affiliation: Biomedical Research & Operations Department, Navy Experimental Diving Unit, Panama City Beach, Florida, United States of America

Aimee L. Alphonso

Affiliations Henry M. Jackson Foundation for the Advancement of Military Medicine, Arlington, Virginia, United States of America, Department of Orthopedics and Rehabilitation, Walter Reed National Military Medical Center, Bethesda, Maryland, United States of America

Alia Creason

Affiliations Universal Consulting Services, Inc., Arlington, Virginia, United States of America, Traumatic Brain Injury Programs, Wounded, Ill, and Injured Directorate, U.S. Navy Bureau of Medicine and Surgery (BUMED), Arlington, Virginia, United States of America

Justin S. Campbell

Affiliation: Naval Space and Warfare Systems Center Pacific, San Diego, California, United States of America

Dagny Johnson

Affiliation: Eyak Corporation, Arlington, Virginia, United States of America

Emily Young

Affiliation: Eyak Corporation, Arlington, Virginia, United States of America

Jack W. Tsao

Affiliation: Traumatic Brain Injury Programs, Wounded, Ill, and Injured Directorate, U.S. Navy Bureau of Medicine and Surgery (BUMED), Arlington, Virginia, United States of America

Introduction

Since October 2001, over two million service members (SMs) have deployed in support of Operation Iraqi Freedom (OIF) and Operation Enduring Freedom (OEF) in support of the North Atlantic Treaty Alliance (NATO) International Security Assistance Force (ISAF) in Afghanistan[1]. One of the greatest risks that service members face during deployment is exposure to injury as a result of explosive blasts (e.g., mortar shells, rocket-propelled grenades, landmines, and improvised explosive devices [IEDs]), which have caused approximately 78% of all combat-related injuries in OIF/OEF and 40% of military deaths in OIF[2], [3]. Traumatic Brain Injury (TBI) has become a common combat-related injury secondary to blast exposure. The United States (U.S.) Department of Defense (DoD) defines traumatic brain injury (TBI) as a “traumatically induced structural injury and/or physiological disruption of brain function as a result of an external force”[4].

Mild TBI (mTBI), commonly referred to as concussion, is the most prevalent form of TBI and is recognized as an alteration of consciousness ≤24 hours, loss of consciousness (if any) <30 minutes, posttraumatic amnesia ≤24 hours, and normal structural neuroimaging[4], [5]. The symptoms of mTBI can be somatic (e.g., headache, dizziness, sensitivity to light and sound); cognitive (e.g., difficulty with attention, memory, and language); and/or psychological (e.g., irritability, depression, anxiety)[4]. Recent estimates suggest that 7.4% to 22.8% of SMs return from deployment having sustained TBI of any severity [6], [7]. Given the prevalence of mTBI in the warfighter, the military healthcare system has mandated military Services to have screening protocols in place to assist with determining if follow-up clinical evaluation by a medical specialist. All SMs are required to take a pre-deployment neurocognitive assessment as a baseline; however, the DoD does not have a policy requiring post-deployment testing for all SMs. SMs who answer affirmatively on post-deployment TBI screening questions which are part of the DoD required Post-Deployment Health Assessment (PDHA), used to identify SMs who need further clinical evaluation as a result of sustaining a mTBI/concussion during deployment, may receive post-deployment neurocognitive testing as part of this clinical evaluation.

The designated DoD tool for neurocognitive assessment is the Automated Neuropsychological Assessment Metrics version 4 TBI Military battery (ANAM4 TBI-MIL). The ANAM4 TBI-MIL is a self-administered, computerized test that measures neurocognitive performance in six domains: reaction time, processing speed, learning, working memory, delayed memory, and spatial memory [8], [9]. The ANAM4 TBI-MIL has been shown to be valid and have clinical utility as an individual diagnostic or population screening tool for the detection of neurocognitive dysfunction following a single, uncomplicated concussion within an acute post-injury (i.e., 72 hours) window, particularly if the results are compared against a pre-deployment/pre-injury baseline [10], [11], [12], [13].

Recent research has shown that the ANAM4 TBI-MIL may have clinical utility as an indicator of neurocognitive recovery when given outside of the acute window. Reaction time based performance tests have been reported to be correlated with to return-to-duty time with poorer performance linked with longer time needed to return to duty [14]. Bryan and Hernandez reported that SMs with a history of mTBI had a greater decrease in neurocognitive performance when compared to a pre-injury/pre-deployment baseline than SMs without a history of mTBI [11]. The study population was tested up to two years after injury indicating that some SMs may have persistent long-term cognitive deficits following TBI and that the ANAM4 TBI-MIL is sensitive even years post-injury [11].

The aim of this study is to assess the clinical utility of post-injury/post-deployment ANAM testing, including as a possible measure of neurocognitive change, using a longitudinal design to compare baseline ANAMs with two post-deployment ANAMs taken from a sample of Marines who experienced combat during their deployment.

Materials and Methods

Ethics

This project was part of a Navy Medicine performance improvement effort examining the utility of enhanced post-deployment TBI screening, including post-deployment ANAM testing. This study was approved by the Naval Air Warfare Center Aircraft Division (NAWCAD) Institutional Review Board (IRB), Patuxent River, MD (Protocol #: NAWCAD.2011.0003-CR01-EMC). The study was a retrospective analysis of de-identified data and did not involve any interaction with human subjects, thus, informed consent was waived by the NAWCAD IRB.

Subjects

A convenience sample of de-identified data (N = 1324) were obtained from Marine Corps units with known high rates of concussion and/or combat and blast exposure while on deployment who returned to their home bases between February 2010 and December of 2011.

Inclusion criteria required that all SMs completed three ANAM4 TBI-MIL assessments (i.e., a pre-deployment, an initial or 1st post-deployment, and a 2nd post-deployment) as well as a DoD Abbreviated Concussion Symptom Inventory (ACSI). The ANAM4 TBI-MIL data set was provided by the Army Neurocognitive Assessment Branch, San Antonio, TX. The ACSI data set was provided by the Navy Bureau of Medicine and Surgery (BUMED) Wounded, Ill, and Injured Directorate (M9). After the datasets were cross-referenced 171 SMs met the inclusion criteria.

Exclusion criteria were if ANAM4-TBI-MIL scores were in the top 1% for speed while simultaneously in the bottom 1% for accuracy [6]. These criteria sought to exclude individuals who simply responded as quickly as possible to items without apparent attention to the accuracy of their response, which would lead to artificially faster response times with very poor accuracy, giving the false impression of superior performance [6]. After the exclusion criteria were applied to the datasets, 2 SMs were excluded, leaving the sample size at 169 SMs.

Available demographic for the total sample (Tables 1), prior to group assignment, indicated that 100% of the sample was male with a mean age of 22.5 years (SD ±3.4). The occupations of the Marines were primarily: rifleman (39%), infantry (20%), machine gunner (13%), mortarman (6%) and anti-tank missileman (4%). The remaining occupations were classified as “other” (17%).

[Figure omitted. See PDF.]

Table 1. Sample characteristics (n = 169).

https://doi.org/10.1371/journal.pone.0079595.t001

Pre-deployment (T1) data were from assessments that occurred at least six months preceding deployment. The initial Post-deployment (T2) data were from testing occurring two to eight weeks following return from deployment. The 2nd post-deployment (T3) data were from testing that occurred from three to 18 months following the T2 post-deployment assessment. The T3 ANAM assessments come from those SMs who were preparing for another deployment to OIF or OEF and were done as part of DoD policy requiring pre-deployment neurocognitive testing. The average time (month ± SD) between testing was as follows: T1−T2 = 11±2.5, T1−T3 = 19±3.4 and T2−T3 = 7.6±2.5.

Group assignment (concussion and no concussion) was determined based on the results of a self-report TBI questionnaire administered as part of the ANAM4 TBI-MIL. Data from T2 was used in for group assignment. Individuals included in the concussion group reported an injury event accompanied by an alteration of consciousness. This included endorsement of at least one of the following symptoms immediately following the injury event: feeling dazed or confused, experiencing loss of consciousness, or experiencing loss of memory for the injury [6]. After group assessment, 76 and 93 SMs were assigned to the concussion and no concussion (control) groups, respectively.

Instrument

The ANAM4 TBI-MIL is an automated, computerized neurocognitive assessment that includes a self-report TBI questionnaire, two subjective subtests (Sleepiness Scale and Mood Scale), and six performance subtests administered in order [6]. Detailed descriptions of these subtests can be found elsewhere [15]. For the purposes of this study, we analyzed the TBI questionnaire and the performance subtests: Simple Reaction Time (SRT), Procedural Reaction Time (PRO), Coded Substitution (CDS), Matching to Sample (M2S), Mathematical Processing (MTH), Code Substitution Delayed (CDD), and Simple Reaction Time Repeated (SRT2).

The ACSI is a self-report survey of blast exposure and eleven symptoms thought to be associated with TBI created by BUMED M9. The ACSI was designed as screening tool which would give medical providers mTBI specific symptomology to assist with the implementation of follow-on care.

Dependent Variables

The ANAM4 TBI-MIL records accuracy, speed, and throughput performance on each subtest. Throughput (TP) is a single outcome measure produced from percent correct (accuracy) divided by mean reaction time (speed). Therefore, TP scores represent the correct number of responses per minute of available response time; thus, higher values indicate better performance [13]. TP is considered a measure of effectiveness or cognitive efficiency [16]. For the purposes of this study, only TP scores were used in the analyses.

Statistical Analyses

Group differences in the combined ANAM4-TBI-MIL TBI questionnaire and ACSI symptomology were compared for the control and concussion groups for each testing session using three separate Wilcoxon rank sum tests with Sidak adjustments. Descriptive statistics were calculated on each ANAM4 TBI-MIL performance test. Data for each of the ANAM4 TBI-MIL performance tests were analyzed using a mixed model (2×3) analysis of variance (ANOVA) with repeated measures approach with group as the between-subjects variable and time as the within-subjects variable. A planned comparison for group [2 (group) x 2 (time) ANOVA with repeated measures] was performed between the baseline testing session and each of the post-test sessions (baseline vs. T2 and baseline vs. T3) for each performance test. If these results were significant, the analyses were followed by additional planned comparisons (paired t-tests) to isolate significance. Sidak adjustments were applied to the planned comparisons to maintain a family-wise alpha of .05. Analyses were performed with Matlab 2012b (Natick, MA).

Results

There were significant differences in the total number of post-concussive clinical symptoms reported on the ANAM4-TBI-MIL TBI questionnaire and ACSI between the pre-deployment assessment and both post-deployment assessments across groups (Tables 2 and 3); however, there were no significant differences in number of post-concussive clinical symptoms reported between the two post-deployment assessments. The control group indicated that a total of 1 and 5 symptoms were worse from the baseline for T2 and T3, respectively. These differences may have been due to a deployment effect, (i.e., fatigue; Table 2). In contrast, the concussed group indicated that 20 and 21 symptoms were worse from the baseline for T2 and T3, respectively (Table 3).

[Figure omitted. See PDF.]

Table 2. ANAM4 TBI-MIL Questionnaire and ACSI Symptomology for Non-Concussed Service Members (N = 93).

https://doi.org/10.1371/journal.pone.0079595.t002

[Figure omitted. See PDF.]

Table 3. ANAM4 TBI-MIL Questionnaire and ACSI Symptomology for Concussed Service Members (N = 76).

https://doi.org/10.1371/journal.pone.0079595.t003

The mean pre-deployment and both initial and second post-deployment TP scores for service members with and without self-reported history of concussion are presented in Tables 4 and 5, respectively. ANOVA with repeated measures indicated that there were significant group by time interactions for SRT2 [F(2,334) = 5.95, p = 0.003], M2S [F(2,334) = 5.80, p = 0.003], CDS [F(2,334) = 7.05, p<0.000], and CDD [F(2,334) = 4.03, p = 0.019]. The follow-up ANOVA with repeated measures indicated that there was a significant group by time interaction between baseline testing and the post-deployment test for SRT2 [F(2,334) = 12.1, p = 0.000], M2S [F(2,334) = 6.83, p = 0.010], CDS [F(2,334) = 10.09, p = 0.002], and CDD [F(2,334) = 8.07, p = 0.005].

[Figure omitted. See PDF.]

Table 4. Throughput Means (SE) for Non-Concussed Service Members.

https://doi.org/10.1371/journal.pone.0079595.t004

[Figure omitted. See PDF.]

Table 5. Throughput Means (SE) for Concussed Service Members.

https://doi.org/10.1371/journal.pone.0079595.t005

The planned comparison paired t-tests revealed that there were no significant differences between groups performance at baseline line testing and the second post-deployment test; however, there were significant differences revealed at the first post-deployment test for SRT2 [t(167) = 3.52, p = 0.001; g = 0.54]; M2S[t(167) = 3.44, p = 0.024; g = 0.35], CDS [t(167) = 3.44, p = 0.001; g = 0.53], and CDD [t(167) = 3.17, p = 0.002; g = 0.48].

The planned comparison paired t-tests revealed that there were no significant differences in control group performance (i.e., TP score) between the baseline and each of the post-deployment test sessions (i.e., control group performance was stable across all three testing sessions; Table 4). The paired t-tests revealed significant decrements in the concussion group performance from the baseline to the first post-deployment test SRT2 [t(150) = 5.21, p<0.000; g = 0.84], M2S [t(150) = 3.96, p<0.000; g = 0.63] and CDS [t(150) = 4.0, p<0.000; g = 0.65]. The significant decrement persisted to the second post-deployment assessment for SRT2 [t(150) = 2.86, p = 0.005; g = 0.46] only (Table 5).

Additionally, three out of the four performance tests were not found to be statistically significant. SRT, CDD, and MTH, all had a medium effect (Hedge's g>0.50). There, non-significant decrements in performance extended to the second post-deployment test session for all of the performance tests, albeit with small ES, except for CDS, which increased from the baseline session. It should be noted that these decrements were actually improvements from the first post-deployment test session and the only performance test that was statistically lower from the baseline was SRT2.

Discussion

This is the first study to our knowledge that has examined longitudinal cognitive functioning in SMs with self-reported mTBI. Through the use of the ANAM4 TBI-MIL neurocognitive assessment during the post-concussive phase, we found declines in cognitive performance from the pre-deployment assessment (i.e., baseline) to the first post-deployment assessment (two to eight weeks after return from deployment) which, except for the second simple reaction time test, resolved by the second post-deployment assessment (∼seven months following first post-deployment assessment). This recovery pattern is consistent with the mTBI post-injury literature, as cognitive deficits in concussed individuals rarely last more than three months [13], [17]. However, the SMs reported an increase in post-concussive symptoms from baseline which did persist over time and did not resolve by the second post-deployment assessment.

These results suggest that cognitive declines during the chronic post-injury phase for some SMs with self-reported mTBI persist for periods as long as eight weeks post-deployment. This finding is contrary to previous studies on military samples which have reported that the ANAM4 TBI-MIL is only sensitive to cognitive declines during the acute post-injury phase (i.e., within 72 hours) and that there is no clinical utility outside of a ten-day post-injury window [18], [19]. However, other research has shown that cognitive deficits can persist for periods as long as one to three months, which is supported by our results [17], [19], [20]. Longitudinal studies that repeatedly assess cognitive performance in controlled intervals (i.e., on a monthly basis) will be necessary to better clarify recovery (or lack of recovery) patterns over time.

The only performance test that had persistent declines beyond the first post-deployment assessment was SRT2 in the concussion group. This result supports a growing body of literature that has identified impaired reaction time as the most sensitive marker of cognitive performance changes following an mTBI, and helpful in differentiating injured from non-injured SMs [10], [13], [19], [21], [22]. Impaired reaction time has been shown to have prognostic value (i.e., clinical utility) in predicting recovery especially when compared to a personal baseline rather than a group norm [23]. Reaction time is typically prolonged immediate post-injury and gradually returns back to baseline during recovery [22]. Decreases in reaction time have been suggested to be a result of injury to the anterior corona radiata and the uncinate fasciculus, as well as to the cingulum and the genu of the corpus callosum; however, normal interindividual variation in brain structure would require neuroimaging to isolate any neural correlate [24].

In the ANAM4 TBI-MIL, simple reaction time is currently scored based upon two administrations, one at the beginning (i.e., SRT) and one at the end (i.e., SRT2) of the battery.

Our results indicate that the second simple reaction time subtest (SRT2) is a more sensitive test longitudinally in differentiating injured from non-injured SMs. We propose that the poor performance on the SRT2 on both post-deployment tests separated by a period of several months may be an indicator of persistent cognitive/mental fatigue. Mental fatigue is a poorly understood symptom of mTBI where by fatigued individuals often report having difficulty focusing their attention and are, consequently, easily distracted [25−27]. Mental fatigue has been reported to be exacerbated by prolonged administration of neuropsychological testing [28]. We hypothesize that by the second post-deployment assessment, which is well into the chronic recovery phase, the SMs may have difficulties in cognitive functioning after finishing the entire test battery (i.e., 7 performance tests) due to the mental exertion required to complete it. Mental fatigue is may be exacerbated by post-injury sequelae such as pain, sleep difficulties, depression, and anxiety, all of which are often experienced by SMs post-deployment [25].

The SMs in this study experienced mTBI-related sequelae that persisted for an additional ∼5 months after most cognitive deficits resolved. Concussed SMs reported an increase in concussion-related symptoms from the baseline which persisted over time and had not resolved by the second post-deployment assessment. These results are also consistent with studies which have reported that symptoms are present six months or longer following deployment in SMs with mTBI [29]-[32] and/or emerge over time following deployment [33], [35], [36]. One study has reported that symptoms associated with self-reported mTBI were present one year post-deployment [34]. Persisting symptoms, however, are not specific to mTBI [33−36]. Thus, it is possible that the symptoms reported in the concussion group may actually be indicative of other conditions which could be co-morbid, such as post-traumatic stress disorder, depression, or pain, and that these factors may be the primary contributors to the observed declines in cognitive performance rather than persistent post-concussive syndrome.

A key limitation of the study was the high exclusion rate which is not a reflection of the clinical utility of the ANAM4-TBI-MIL test battery, but rather of DoD policy which mandates that all SMs undergo computerized neurocognitive testing prior to deployment to OEF and OIF. Current DoD policy does not mandate post-deployment testing. The assessments performed at T1 and T3 were performed prior to a deployment, as required by DoD policy. The assessments performed at T2 (i.e., post-deployment) were used to evaluate whether routine post-deployment ANAM testing should be implemented. The SMs who had a third ANAM assessment (T3) reflect a random selection from the initial sample - these were SMs who were transferred to new units that were chosen for deployment which necessitated an additional pre-deployment assessment (which is termed the 2nd post-deployment assessment).

There were several additional limitations pertaining to this study. The SMs involved were members of units who had known high rates of concussion and blast exposure. Thus, the results of this study may not be generalizable to the general military or civilian populations. The data included self-reported symptom information; therefore, the results are subject to recall biases. The number of deployments was not controlled for, thus a deployment effect cannot be excluded as contributing factor. Another limitation of the current study is the ANAM4 TBI-MIL restriction to visually-based stimuli, which ignore other areas of cognition such as language skill and auditory processing. Clinicians who also assess performance in these additional areas could provide a more comprehensive clinical evaluation; however, a lengthier test battery is not practical for the combat zone. The use of neurocognitive testing in the absence of clinical evaluation should be questioned as psychological functioning (i.e., depression) which can be a major confounder of cognitive functioning and, thus, test results [35]. A normal limitation of neurocognitive performance is affected by age, ethnic background, education, and developmental disorders; however, comparing post-injury scores to a baseline results in greater diagnostic accuracy than comparison to a group normative value [11]. An additional limitation was that there were four databases which were cross-referenced to ensure that SMs had data for each ANAM4-TBI-MIL assessment and for the ACSI. Not all service members had data for three assessments which led to a high exclusion rate of 1152 SMs. As cognitive functioning returned to baseline levels while symptoms persisted, these results highlight the need for a detailed clinical examination in the setting of a history of concussion where there are persistent clinical symptoms, rather than relying solely upon computerized cognitive testing as a method for identifying SMs requiring follow-up post-injury. Our results do indicate that there is a measurable deployment effect on neurocognitive performance, which appears to resolve without lasting clinical sequelae in those not injured. In those who sustained a concussion, the most striking late finding is the presence of persistent clinical symptoms and an isolated persistent impairment in simple reaction time but no other detectable impairment of cognitive test measures.

Acknowledgments

Disclaimer: The opinions or assertions contained herein are the private views of the authors and are not to be construed as official or as reflecting the views of the Department of the Navy or the Department of Defense. We would like to thank Mikias Wolde, Lauren Stentz, Sherry Wing, and Kevin Garcia for assistance with data entry.

Author Contributions

Conceived and designed the experiments: FJH AC JSC JWT. Performed the experiments: N/A. Analyzed the data: FJH. Contributed reagents/materials/analysis tools: DJ EY ALA. Wrote the paper: FJH ALA JWT.

Citation: Haran FJ, Alphonso AL, Creason A, Campbell JS, Johnson D, Young E, et al. (2013) Analysis of Post-Deployment Cognitive Performance and Symptom Recovery in U.S. Marines. PLoS ONE 8(11): e79595. https://doi.org/10.1371/journal.pone.0079595

References

1. Bass E, Golding H (2012) The Veteran's Health Administration's Treatment of PTSD and Traumatic Brain Injury among Recent Combat Veterans. The Congressional Budget Office.

2. Owens BD, Kragh JF Jr, Wenke JC, Macaitis J, Wade CE, et al. (2008) Combat wounds in Operation Iraqi Freedom and Operation Enduring Freedom. J Trauma 64: 295–299.

3. Hayward P (2008) Traumatic brain injury: the signature of modern conflicts. Lancet Neurol 7: 200–201.

4. Casscells SW (2007) Traumatic Brain Injury: Definition and Reporting. In: Affairs DoDH, editor.

5. Center DaVBI (2012) DoD TBI Worldwide 200-2012Q1. Available: http://www.dvbic.org/sites/default/files/uploads/dod-tbi-2000-2012.pdf.

6. Roebuck-Spencer TM, Vincent AS, Twillie DA, Logan BW, Lopez M, et al. (2012) Cognitive change associated with self-reported mild traumatic brain injury sustained during the OEF/OIF conflicts. Clin Neuropsychol 26: 473–489.

7. Tanielian T, Jaycox LH (2008) Invisible wounds of war: Psychological and cognitive injuries, their consequences, and services to assist recovery. Santa Monica: RAND.

8. Roebuck-Spencer T, Sun W, Cernich AN, Farmer K, Bleiberg J (2007) Assessing change with the Automated Neuropsychological Assessment Metrics (ANAM): issues and challenges. Arch Clin Neuropsychol 22 Suppl 1S79–87.

9. Bleiberg J, Garmoe W, Cederquist J, Reeves D, Lux W (1993) Effects of dexedrine on performance consistency following brain injury: A double-blind crossover case study. Neuropsychiatry, Neuropsychology, and Behavioral Neurology 6: 245–248.

10. Luethcke CA, Bryan CJ, Morrow CE, Isler WC (2011) Comparison of concussive symptoms, cognitive performance, and psychological symptoms between acute blast-versus nonblast-induced mild traumatic brain injury. J Int Neuropsychol Soc 17: 36–45.

11. Bryan C, Hernandez AM (2012) Magnitudes of decline on Automated Neuropsychological Assessment Metrics subtest scores relative to predeployment baseline performance among service members evaluated for traumatic brain injury in Iraq. J Head Trauma Rehabil 27: 45–54.

12. Kelly MP, Coldren RL, Parish RV, Dretsch MN, Russell ML (2012) Assessment of acute concussion in the combat environment. Arch Clin Neuropsychol 27: 375–388.

13. Vincent AS, Roebuck-Spencer T, Lopez MS, Twillie DA, Logan BW, et al. (2012) Effects of military deployment on cognitive functioning. Mil Med 177: 248–255.

14. Norris JN, Carr W, Herzig T, Labrie DW, Sams R (2013) ANAM4 TBI Reaction Time-Based Tests Have Prognostic Utility for Acute Concussion. Mil Med 178(7): 767–74.

15. Eonta SE, Carr W, McArdle JJ, Kain JM, Tate C, et al. (2011) Automated Neuropsychological Assessment Metrics: repeated assessment with two military samples. Aviat Space Environ Med 82: 34–39.

16. Thorne DR (2006) Throughput: a simple performance index with desirable characteristics. Behav Res Methods 38: 569–573.

17. McCrea M, Guskiewicz KM, Marshall SW, Barr W, Randolph C, et al. (2003) Acute effects and recovery time following concussion in collegiate football players: the NCAA Concussion Study. JAMA 290: 2556–2563.

18. Coldren RL, Russell ML, Parish RV, Dretsch M, Kelly MP (2012) The ANAM lacks utility as a diagnostic or screening tool for concussion more than 10 days following injury. Mil Med 177: 179–183.

19. Kelly JC, Amerson EH, Barth JT (2012) Mild traumatic brain injury: lessons learned from clinical, sports, and combat concussions. Rehabil Res Pract 2012: 371970.

20. Bleiberg J, Cernich AN, Cameron K, Sun W, Peck K, et al. (2004) Duration of cognitive impairment after sports concussion. Neurosurgery 54: 1073–1078.

21. McCrea M, Prichep L, Powell MR, Chabot R, Barr WB (2010) Acute effects and recovery after sport-related concussion: a neurocognitive and quantitative brain electrical activity study. J Head Trauma Rehabil 25: 283–292.

22. Warden DL, Bleiberg J, Cameron KL, Ecklund J, Walter J, et al. (2001) Persistent prolongation of simple reaction time in sports concussion. Neurology 57: 524–526.

23. Lau B, Lovell MR, Collins MW, Pardini J (2009) Neurocognitive and symptom predictors of recovery in high school athletes. Clin J Sport Med 19(3): 216–21.

24. Niogi SN, Mukherjee P, Ghajar J, Johnson C, Kolster RA, et al. (2008) Extent of Microstructural White Matter Injury in Postconcussive Syndrome Correlates with Impaired Cognitive Reaction Time: A 3T Diffusion Tensor Imaging Study of Mild Traumatic Brain Injury. AJNR Am J Neuroradiol 29: 967–973.

25. Riggio S, Wong M (2009) Neurobehavioral sequelae of traumatic brain injury. Mt Sinai J Med 76: 163–172.

26. Faber LG, Maurits NM, Lorist MM (2012) Mental fatigue affects visual selective attention. PLOS ONE 7(10)..

27. Johansson B, Berglund P, Ronnback L (2009) Mental fatigue and impaired information processing after mild and moderate traumatic brain injury Dec(23)13−14.

28. Barwick F, Arnett P, Slobounov S (2012) EEG correlates of fatigue during administration of a neuropsychological test battery. Clin Neurophysiol 123(2): 278–284.

29. Bombardier CH, Fann JR, Temkin N, Esselman PC, Pelzer E, et al. (2006) Posttraumatic stress disorder symptoms during the first six months after traumatic brain injury. J Neuropsychiatry Clin Neurosci 18: 501–508.

30. Milliken CS, Auchterlonie JL, Hoge CW (2007) Longitudinal assessment of mental health problems among active and reserve component soldiers returning from the Iraq war. JAMA 298: 2141–2148.

31. Macera CA, Aralis HJ, Macgregor AJ, Rauh MJ, Galarneau MR (2012) Postdeployment symptom changes and traumatic brain injury and/or posttraumatic stress disorder in men. J Rehabil Res Dev 49: 1197–1208.

32. Brenner LA, Ivins BJ, Schwab K, Warden D, Nelson LA, et al. (2010) Traumatic brain injury, posttraumatic stress disorder, and postconcussive symptom reporting among troops returning from iraq. J Head Trauma Rehabil 25: 307–312.

33. Hoge CW, McGurk D, Thomas JL, Cox AL, Engel CC, et al. (2008) Mild traumatic brain injury in U.S. Soldiers returning from Iraq. N Engl J Med 358: 453–463.

34. Polusny MA, Kehle SM, Nelson NW, Erbes CR, Arbisi PA, et al. (2011) Longitudinal effects of mild traumatic brain injury and posttraumatic stress disorder comorbidity on postdeployment outcomes in national guard soldiers deployed to Iraq. Arch Gen Psychiatry 68: 79–89.

35. Pietrzak RH, Johnson DC, Goldstein MB, Malley JC, Southwick SM (2009) Posttraumatic stress disorder mediates the relationship between mild traumatic brain injury and health and psychosocial functioning in veterans of Operations Enduring Freedom and Iraqi Freedom. J Nerv Ment Dis 197: 748–753.

36. Schneiderman AI, Braver ER, Kang HK (2008) Understanding sequelae of injury mechanisms and mild traumatic brain injury incurred during the conflicts in Iraq and Afghanistan: persistent postconcussive symptoms and posttraumatic stress disorder. Am J Epidemiol 167: 1446–1452.