Altered activity of the medial prefrontal cortex and amygdala during acquisition and extinction of an active avoidance task

Abstract

Altered medial prefrontal cortex (mPFC) and amygdala function is associated with anxiety-related disorders. While the mPFC-amygdala pathway has a clear role in fear conditioning, these structures are also involved in active avoidance. Given that avoidance perseveration represents a core symptom of anxiety disorders, the neural substrate of avoidance, especially its extinction, requires better understanding. The present study was designed to investigate the activity of mPFC and amygdala neurons during acquisition and extinction of lever-press avoidance in rats. In particular, neural activity was examined in the mPFC, intercalated cell clusters (ITCs), lateral (LA), basal (BA) and central (CeA) amygdala, at various time points during acquisition and extinction, using induction of the immediate early gene product, c-Fos. Neural activity was greater in the mPFC, LA, BA, and ITC during the extinction phase as compared to the acquisition phase. In contrast, the CeA was the only region that was more activated during acquisition than during extinction. Our results indicate that elevated activity in the mPFC, BA, LA and ITCs, and reduced CeA activity is associated with extinction of active avoidance. Moreover, inhibitory neurons are activated differently in the mPFC and BA during early and late phase of acquisition and extinction, suggesting their dynamic involvement in the development of avoidance response. Together, these data start to identify the key brain regions important in active avoidance behavior, areas that could be associated with avoidance perseveration in anxiety disorders.

Introduction

Avoidance is a common feature of anxiety disorders (American Psychiatric Association, 2000). As avoidance behavior is a key behavioral component of anxiety disorders, learning to extinguish such behavior is a fundamental concept embedded in cognitive behavioral therapy for anxiety disorders, including post-traumatic stress disorders (PTSD) and phobias (Rau et al., 2005; Rauch et al., 2006). Thus, a better understanding of the neurobiological basis of active avoidance and its extinction will provide important insights into future behavioral and pharmacological treatment for clinical anxiety.

Malfunctions in medial prefrontal cortex (mPFC)—amygdala circuit have been identified in patients suffering PTSD, social anxiety disorder (SAD) and general anxiety disorder (GAD; Schwartz and Rauch, 2004; Cottraux, 2005; Guyer et al., 2008). Imaging studies indicate that one of the most consistent findings in PTSD patients is hypoactive ventral mPFC combined with hyperactive amygdala following provocation (Milad et al., 2006; Phan et al., 2006; Rauch et al., 2006). Avoidance develops slowly over time in anxiety disorders, so avoidance learning in animals may provide an opportunity to study the dynamic and progressive neurobiological changes associated with the development of anxiety disorders.

In animal studies, brain regions associated with avoidance behavior include prefrontal cortex (PFC), and amygdala, as well as hippocampus, striatum, medial septum and periaquaductal gray (Kirkby and Kimble, 1968; Bailey et al., 1986; Quirk and Gehlert, 2003; Mobbs et al., 2007; Straube et al., 2009; Pang et al., 2011; Cominski et al., 2014). Electrolytic lesion of the infralimbic cortex (IL) impaired active avoidance learning but facilitated freezing behavior in rats, while central amygdala (CeA) lesion resulted in the opposite behavioral changes (Moscarello and LeDoux, 2013). Rats that previously failed to learn shuttle avoidance can acquire such task following CeA lesion, suggesting ventral mPFC and CeA are playing opposite roles in avoidance learning (Choi et al., 2010). Using an Immunocytochemistry (ICC) approach, Duncan et al. reported that shuttle-box avoidance elicited c-Fos activity in the mPFC, cingulate cortex (CG), and medial amygdala in rats (1996). We recently showed that elevated c-Fos activation in mPFC is associated with faster extinction in rats (Jiao et al., 2011). Elevated and prolonged neural activity in mPFC was also observed in well-trained SD rats, represented by delta-FosB accumulation using Western blot (Perrotti et al., 2013). In addition, we found that rats that exhibited deficits in avoidance extinction also displayed lower gamma-aminobutyric acid (GABA) neuron counts and neuronal activation in basolateral amygdala, suggesting inhibitory modulation is important to ensure successful extinction (Jiao et al., 2011). The present study was conducted to further define the activity of inhibitory neurons in the mPFC and amygdala during the acquisition and extinction of lever-press avoidance.

Materials and Methods

Animals

Sixty-six male Sprague-Dawley (SD) rats (approximately 60 days of age at the start of the experiment) were obtained from Harlan Laboratories (Indianapolis, IN) and housed in individual cages with free access to food and water. Rats were housed in a room maintained on a 12:12 h light/dark cycle for at least 2 weeks prior to the start of the experiment. Experiments occurred between 0700 and 1700 h in the light portion of the cycle (light onset occurred at 0600 h). All procedures received prior approval by the VA NJ Health Care System Institutional Animal Care and Use Committee in accordance with AAALAC standards.

Lever-Press Avoidance Training

As previously described (Servatius et al., 2008), training was conducted in 16 identical operant chambers (Coulbourn Instruments, Langhorn, PA) enclosed in 16 sound-attenuated boxes. The unconditional stimulus (US) was a scrambled 1.0-mA electric foot-shock delivered through the grid floor (Coulbourn Instruments, Langhorn, PA). The CS was a 1000-Hz 75-dB tone (10 dB above background noise). The inter-trial interval (ITI) was 3 min in duration and signaled by a blinking light above the lever.

The avoidance training procedure was composed of 10 sessions of acquisition (A01–A10) and six sessions of extinction (E01–E06), based on previous studies (Servatius et al., 2008; Beck et al., 2010). Avoidance training consisted of 20 trials per session. A session occurred three times per week (sessions separated by 2–3 days). Each session began with a 60 s stimulus-free period. A trial commenced with the delivery of the auditory CS. During the acquisition phase, a lever-press during the first 60 s shock free (warning) period turned off the CS and prevented the delivery of US; this response was designated an “avoidance” response. If no avoidance response was made, a shock period (shock duration = 0.5 s, inter-shock interval = 3 s, 100 shocks maximum/trial) was initiated 60 s after the start of the trial. The CS was presented during the warning and shock periods. Following a lever press during the shock period or if the maximum shock period elapsed, the CS and shock co-terminated and the ITI was initiated. A lever press during the shock period was designated an “escape” response. Extinction sessions were similar to acquisition sessions except no shocks were delivered during trials. “Avoidance” responses during the extinction sessions were lever presses with latencies less than 60 s. A rat that failed to emit a lever press response by the end of the fourth acquisition session was removed from the study. Six rats were dropped from the study for this reason.

Neural activity was assessed at four times in acquisition and two times in extinction. Rats were randomly assigned to be sacrificed after the 2nd, 4th, 8th or 10th acquisition session (session A02, A04, A08 or A10) or after the 1st or 6th extinction session (session E01 or E06) based on A% data with stratification after session A01, and are referred to as group ACQ02, ACQ04, ACQ08, ACQ10, EXT01 and EXT06, respectively.

Data analysis. One-way ANOVA design with main factor of group was used to study the dependent measures in each session to determine whether differences occurred between groups on avoidance ratio, escape ratio, and shock number during the acquisition phase, and avoidance ratio during the extinction phase. A second ANOVA with repeated measurement of session was conducted for each group to assess the change in behavior across acquisition and extinction sessions. Post hoc testing was conducted using Tukey’s test for pair-wise comparison between groups. All data are expressed as means ± the standard error of the mean. Due to recording errors, data from two rats in group EXT01 and 1 rat in group EXT06 were missing from session A01. Therefore, the missing subjects were not included in the analysis for session A01.

Immunocytochemistry (ICC)

Ninety–120 min after the end of a session (A02, A04, A08, A10, E01 or E06), rats were deeply anesthetized with sodium pentobarbital (150 mg/kg) and transcardially perfused with 200 ml of saline solution, followed by 200 ml of 4% paraformaldehyde solution. Brains were extracted, post-fixed in 4% paraformaldehyde at 4°C overnight, and then stored at 4°C in 0.1 M phosphate buffer (PB) solution containing 30% (w/v) sucrose until the brains sank.

Coronal brain sections (50 microns) were prepared on a freezing microtome, and every 6th sections collected from the mPFC (bregma: +4.20 mm ~ +2.53 mm) and the amygdala (bregma: −2.04 mm ~ −3.24 mm; Paxinos and Watson, 1998) were immunostained. To reveal the neural activity during acquisition and extinction of avoidance learning, we quantified c-Fos immunoreactivity (ir; a product from the expression of the immediate early gene c-fos) as a marker of neural activity (Chaudhuri et al., 2000). Given the important role of inhibitory circuits especially in anxiety (McCabe et al., 2004; Berretta et al., 2005), we were particularly interested in the activation of inhibitory (mostly GABAergic) neurons. We stained for parvalbumin (PV), as previously described, to detect GABAergic neurons (Jiao et al., 2011). PV, a calcium-binding protein, is expressed in more than 55% of GABAergic neurons in the basal amygdala (BA) in various species (Sorvari et al., 1996; Ambalavanar et al., 1999; Kemppainen and Pitkänen, 2000; Gabbott et al., 2006; Dávila et al., 2008), and in about 35% mPFC GABAergic neurons in rat (Gabbott and Bacon, 1996; Gabbott et al., 2006). However, some PV-ir negative neurons could be GABAergic neurons. In the intercalated cell clusters (ITCs), which is composed of groups of small to medium size fast-firing GABAergic neurons located between BA and CeA (Royer et al., 1999; Royer and Paré, 2002; Mańko et al., 2011), anti-glutamic acid decarboxylase isoform 67 (GAD67, the rate-limiting enzyme of GABA synthesis) antibody was used to define GABAergic neurons (Izumi et al., 2011). Double labeling of c-Fos and PV or GAD67-ir was assessed to evaluate selective neuronal activation in each region of interest (ROI).

ICC procedures were conducted as previously described (Pang et al., 2001; Miller et al., 2005; Jiao et al., 2011). Sections were stained for c-Fos, followed by a second staining for PV or GAD67. Briefly, sections were incubated in rabbit anti-c-Fos IgG (sc-52, 1:1000, Santa Cruz, CA), mouse anti-PV (P3088, 1:1000, Sigma-Aldrich, MO), or mouse anti-GAD67 (MAB5406, 1:1000, Chemicon, CA); sections for c-Fos and PV staining were incubated overnight at room temperature while sections for GAD67 staining were incubated for 48 h at 4°C. Following incubation in primary antibodies, sections were incubated in secondary antibodies (biotinylated donkey anti-rabbit IgG, or biotinylated donkey anti-mouse IgG (1:200, Jackson ImmunoResearch, PA) for 2 h at room temperature. Visualization was performed using the avidin-biotin method (Vector Laboratories, Burlington, CA) with nickel-enhanced diaminobenzidine for c-Fos and diaminobenzidine alone for PV, or GAD67.

c-Fos-ir nuclei were counted in all ROIs; double labeled c-fos/PV-ir perikarya were counted in the anterior CG, prelimbic (PL), and IL cortices of the mPFC, and the lateral amygdala (LA)/BA; only c-Fos nuclei were counted in the ITCs (defined by darker GAD-ir area). Estimates of the number of immunostained neurons or nuclei were obtained using standard stereology procedures (West, 1993; West et al., 2009) and were conducted blind to the training conditions of the animal. Volume measures for each of the brain regions were also determined. The optical fractionator method (Stereo Investigator v.7.0, MicroBrightField, Colchester, VT) was used to obtain the estimates of cell number on a microscope with an x-, y-, z-axis motorized stage (ASI MS-2000, Applied Scientific Instrumentation, Eugene, OR). Cells containing c-Fos- and c-fos/ PV-ir double labeling were identified using a 40× objective lens. Double-labeled cells were defined by observing a PV-positive soma (light brown in cytoplasm) with a black nucleus in the center (c-Fos). The counting frame had a height of 10 μm and was 80 μm × 80 μm in size for basal and LA, 150 um × 100 um in size for CeA, 50 um × 100 um in size for ITC, and 50 μm × 50 μm in size for medial prefrontal area. Seven to 8 animals per group were counted for analysis in mPFC regions, 5–7 animals per group were counted in BA, and 5–6 animals per group were counted in the CeA and ITC.

Data analysis. A one-way ANOVA with main factor of group (sacrifice time) was used to assess for differences in neural activity within each ROI. General neural activity was represented by the density of c-Fos-ir cells (number of c-Fos-ir cells/volume) while GABAergic activation was represented by the ratio of the density of c-Fos—PV-ir double labeled neurons to the density of single labeled PV-ir neurons. Neural activation was also compared between phases (acquisition or extinction). Post hoc testing was conducted using Tukey’s test for pair-wise comparison between groups. Additional t-tests were performed to compare c-Fos-ir cells and activation in PV-ir neurons between ACQ10 and EXT01 or EXT6. All data are expressed as means ± the standard error of the mean.

Results

Acquisition and Extinction of Lever-Press Avoidance

As judged by avoidance ratio, all groups acquired the task similarly at sacrifice time (main factor = group, ps > 0.05). Groups EXT01 and EXT06 extinguished similarly in the first extinction session, p > 0.05 (Figure 1A). No group differences were found for any of the other measures (i.e., escape ratio and shock number per session, Figures 1B,C; ps > 0.05). As expected, rats avoided more in later acquisition sessions compared to early sessions in all groups (ACQ04, F(3,27) = 33.48; ACQ08, F(7,63) = 20.23; ACQ10, F(9,81) = 5.43; EXT01, F(8,72) = 5.66; EXT06, F(8,72) = 6.15; ps < 0.0001) except for group ACQ02. Moreover, the number of shocks reduced with training (ACQ04, F(3,27) = 30.69; ACQ08, F(7,63) = 16.08; ACQ10, F(9,81) = 6.1; EXT01, F(8,72) = 3.04; EXT06, F(8,72) = 3.18; ps < 0.01). During extinction, rats avoided less in later extinction sessions compared to early extinction sessions (EXT06, F(5,45) = 3.89, p < 0.01). These data suggest that rats in each of the groups acquired and extinguished avoidance responses similarly and that observed difference in immediate early gene product is likely resulting from training phases (i.e., acquisition vs. extinction) and training stages (i.e., session).

FIGURE 1

Figure 1. Avoidance response, escape response and shock number received in acquisition (10 sessions) and extinction (6 sessions) were expressed as avoidance (A, arrows indicate time points of c-Fos-ir evaluation) and escape (B) ratios and the average numbers of received shocks in each session during acquisition (C). Each data point represents group mean ± S.E.M. (n = 8–10/group; data of 2 subjects from group EXT01 and 1 subject from group EXT06 were lost from session A01 due to a power failure during training).

Neural Activity of the mPFC

Acquisition

Rats from ACQ10 exhibited the highest number of c-Fos-ir cells compared to other acquisition groups (Figure 2A), suggesting that mPFC neurons are still active during asymptotic avoidance performance, (CG: F(3,25) = 5.78; IL: 4.69; PL: 7.29; ps < 0.01), post hoc ps < 0.05. Importantly, a greater activation of PV-ir neurons of the CG, PL and IL was observed also in ACQ10 compared to earlier acquisition sessions (CG: F(3,25) = 3.87, p < 0.05; PL: F(3,25) = 5.46, p < 0.005; IL: F(3,25) = 7.75, p < 0.001), post hoc ps < 0.05, suggesting enhanced inhibitory tone in the mPFC as active avoidance response is fully developed (Figure 2B). (for detailed analysis results, see Table 1).

FIGURE 2

Figure 2. Densities of c-Fos-ir cells and the percent of activated PV-ir cells in the medial prefrontal cortex (mPFC) (cingulate cortex, Cg; prelimbic cortex, PL; and infralimbic cortex, IL), were depicted. (A) Densities of c-Fos-ir cells in mPFC sub-regions. (B) Activation of PV-ir cells in the mPFC. Each data point represents group mean ± S.E.M. (*ps < 0.05; n = 7–8/group).

TABLE 1

Table 1. Statistical report of densities of c-Fos-ir and percent of activated PV-ir cells in ROIs during acquisition or extinction phase in rats.

Extinction

Compared to the acquisition phase, all three sub-regions of the mPFC had greater neural activity during the extinction phase than acquisition phase (CG: F(1,42) = 10.79; IL: 10.3; PL: 8.31; ps < 0.01; Figure 2A). However, c-Fos-ir did not differ between ACQ10 and EXT01 nor between EXT01 and EXT06, suggesting enhanced mPFC activity might be the continuation of mPFC activity in late acquisition while c-Fos-ir cell counts sustained during extinction when response dropped. In addition, a greater proportion of PV-ir neurons was activated in all three sub-regions of mPFC during extinction compared to acquisition phase (CG: F(1,42) = 18.25; IL: 8.68; PL: 10.61; ps < 0.01; Figure 2B). Interestingly, there is a trend showing PV-ir neurons are more activated in EXT01 compared to, ACQ10 in CG (t(13) = 1.77, p = 0.10), and EXT06 in CG and IL (t(13) = 1.68 and 1.76, ps = 0.11 and 0.10), suggesting greater inhibitory activity is associated with the transition to extinction.

Neural Activity in Sub-Nuclei of the Amygdala

BA and LA

Acquisition

In the LA and BA nuclei, the numbers of c-Fos-ir cells remained the same during acquisition sessions (ps > 0.05; for detailed analysis results, see Table 1). However, activity of inhibitory PV-ir neurons in the BA increased as acquisition proceeded (F(3,25) = 4.24, p = 0.0172), while activity of inhibitory PV-ir neurons in the LA did not change across acquisition sessions, p > 0.05. The increased activity of inhibitory neurons in the BA as avoidance is acquired may be due to increased glutamatergic inputs from mPFC. Post hoc analysis showed greater BA PV-ir activation in ACQ10 compared to ACQ02 group, p < 0.05 (Figure 3B).

FIGURE 3

Figure 3. Densities of c-Fos-ir cells and the percent of activated PV-ir cells in the LA and BA were depicted. (A) Densities of c-Fos-ir cells in the lateral amygdala (LA) and basal amygdala (BA). (B) Activation of PV-ir cells in the LA and BA. Each data point represents group mean ± S.E.M. (*p < 0.05, n = 5–7/group).

Extinction

Compared to the acquisition phase, BA and LA were activated to a greater extent during the extinction phase (F(1,34) = 11.87 (BA) and 7.33 (LA), ps < 0.005 and 0.05 respectively), suggesting enhanced BA activity during extinction learning (Figure 3A). Particularly in the BA, there were more c-Fos-ir cells from EXT01 compared to ACQ10, t(11,2.76), p < 0.05, suggesting increased BA activity is associated with transition to extinction. Greater activity of inhibitory PV-ir neurons was observed in both the BA and LA during extinction compared to the acquisition phase, F(1,34) = 11.64 (BA) and 11.65 (LA), ps < 0.005 (Figure 3B). However, neither c-Fos-ir nor activated PV-ir neurons, altered between early and late extinction sessions.

ITCs

Acquisition

ITC area was defined by GAD67 staining as depicted in Figure 4B. The number of c-Fos-ir neurons increased while acquisition proceeded in both medial and lateral ITC (lITC: F(1,33) = 11.81; mITC: F(1,32) = 8.82; ps < 0.05; Table 1). Particularly in the mITC, the number of c-Fos-ir cells was higher on later sessions compared to early sessions, post hoc analysis ps < 0.05 (Figure 4A; for detailed statistical analysis results, see Table 1). Since ITCs are composed mainly of GABAergic neurons, elevated ITCs activity during acquisition strongly suggests that the inhibitory tone develops as rats are acquiring the avoidance task.

FIGURE 4

Figure 4. Densities of c-Fos-ir cells in the lateral and medial intercalated cell cluster (ITC) were depicted. (A) Densities of c-Fos-ir cells in the lITC and mITC. Each data point represents group mean + S.E.M. (*ps < 0.05; n = 5–6/group). (B) mITC and lITC were defined by GAD67 staining that was visualized by DAB (×1.25 objective lens). C-Fos-ir cells in the mITC and lITC were visualized by DAB-NiCl2.(×40 objective lens).

Extinction

ITCs activity was greater during the extinction phase than acquisition phase. Although c-Fos-ir cell counts did not differ between ACQ10 and EXT01, a significant increase in c-Fos-ir cell counts was observed in EXT06 in both lITC and mITC, t(10,2.53) and t(10,2.44), ps < 0.05, suggesting transition to extinction did not significantly increase such activity simultaneously, instead, in a delayed mode.

CeA

Acquisition

During the acquisition phase, the number of c-Fos-ir neurons increased with training and peaked in session A08, then reduced to the early acquisition level in session A10. This pattern indicates that CeA may be actively involved in learning active avoidance, but is less involved as learning proceeds to asymptotic performance.

Extinction

In contrast to activity in other ROIs, CeA was activated to a lower degree during the extinction phase compared to acquisition phase, p < 0.005 (Figure 5). Moreover, CeA neural activity remained at such a low level during the entire extinction phase suggesting that CeA activation may be inhibited when avoidance is acquired and when shock is no longer present (Figure 5, for detailed statistical analysis results, see Table 1).

FIGURE 5

Figure 5. Density of c-Fos-ir cells in the central amygdala (CeA). Each data point represents group mean ± S.E.M. (*ps < 0.05; n = 5–6/group).

Discussion

Here we report differential activity of mPFC and amygdalar sub-regions during lever-press avoidance and extinction. In the mPFC and most amygdalar sub-regions, activity increased in late acquisition sessions (A08–A10) when avoidance response was acquired and peaked in extinction phase when shock was no longer present. GABAergic neurons in the mPFC had a similar pattern, more activated in the mPFC in later acquisition, even more in early extinction (E1), but less activated in late extinction (E6). In contrast, activity in the CeA increased during early acquisition sessions, peaked in A08 and reduced in late acquisition and extinction. Therefore, different patterns of activity were observed in mPFC, BA, LA and ITC compared to CeA. These data suggest that general activity, and particularly inhibitory neuronal activation within mPFC-amygdala circuit shifts in a time-dependent manner during acquisition and extinction of lever press avoidance. Together, these data suggest that altered activity observed in similar regions in the present study using avoidance paradigm in rats and in imaging studies in patients with anxiety disorders (Schwartz and Rauch, 2004; Cottraux, 2005; Guyer et al., 2008).

The role of mPFC and amygdala in avoidance task has been previously studied, however mainly using lesion technique in rodents (Choi et al., 2010; Moscarello and LeDoux, 2013; Beck et al., 2014). Pre-training lesion provides a useful tool to evaluate well defined structure-dependence of a task, (Wan et al., 1994). However, compensatory changes in response to lesions may complicate interpretation. We recently reported that mPFC, striatum and amygdala neural activity assessed by c-Fos and delta-FosB was associated with avoidance and extinction in lever-press avoidance (Jiao et al., 2011; Perrotti et al., 2013). However, these studies only evaluated time points at asymptotic avoidance performance and at the end of extinction learning. In order to understand the role of amygdala and mPFC in the acquisition and extinction processes of avoidance, the present study monitored neural activity at various time points during avoidance acquisition and extinction.

The importance of mPFC neural activity in active avoidance and extinction has been recognized and appreciated in recent works using lever-press or shuttle-box avoidance paradigms (Duncan et al., 1996; Jiao et al., 2011; Moscarello and LeDoux, 2013). These studies demonstrated that avoidance learning induced prominent c-Fos expression in the mPFC and CG (Duncan et al., 1996) while IL lesion impaired avoidance learning (Moscarello and LeDoux, 2013). We reported that rats that failed to extinguish lever-press avoidance exhibited lower c-Fos expression in the mPFC compared to rats that successfully extinguished such response (Jiao et al., 2011). Thus mPFC is actively involved in both acquisition and extinction of active avoidance task in rats.

It is known that mPFC is a heterogeneous structure (Gabbott et al., 1997; Vertes, 2004). In fear conditioning and extinction, PL is associated with fear learning while IL is important in extinction learning (Milad and Quirk, 2002; Quirk et al., 2006; Sierra-Mercado et al., 2011). If fear and avoidance share the same pathway, we would expect greater PL activation during acquisition and greater IL activation during extinction. However, we found that the pattern of c-Fos-ir changes was similar in the PL and IL in avoidance. In support of our data, Moscarello and LeDoux (2013) reported that IL is needed to acquire shuttle avoidance, and to reduce warning signal-elicited freezing, yet PL lesion did not affect acquisition. In shuttle avoidance, the cue that is initially paired with the shock induces fear and facilitates freezing behavior, subsequently preventing a shuttle response. Thus fear needs to be overcome while shuttle avoidance is being acquired. Our results support and extend those of Moscarello and LeDoux in that IL activity is increased during lever press avoidance was acquired. In contrast to Moscarello and LeDoux, PL neural activity was also increased during acquisition of lever press avoidance; these differences may due to different avoidance paradigms used in these studies. We also observed an interesting trend on the activation of PV-ir neurons in this area. While there are more activated PV-ir neurons following A10, there is a trend showing increased number of activated PV-ir neurons after E1 (e.g., CG) and decrement after E6 (e.g., IL). Given c-Fos-ir cell counts remained similar following A10, we speculate that there might be increased excitatory activity in the mPFC during late extinction. However, this speculation requires further investigation.

In the ITCs, c-Fos-ir expression progressively increased as learning proceeded from acquisition to extinction of lever-press avoidance. Accumulated evidence demonstrates that ITCs is critical for fear extinction, specifically, for the expression of extinction (Herry et al., 2008; Likhtik et al., 2008; Mańko et al., 2011). This cell cluster receives input from vmPFC and modulates fear extinction through the CeA, a feed-forward inhibition mechanism of extinction (Quirk and Gehlert, 2003; Milad et al., 2004; Hefner et al., 2008; Likhtik et al., 2008; Mańko et al., 2011). Thus the greater ITCs activity here could lead to reduced “fear” component in late acquisition sessions and in extinction via increasing excitatory input from mPFC neurons. Based on the present data, we speculate that when animals reach near asymptotic avoidance performance (i.e., receiving very few shocks), CeA activity is suppressed by increased ITCs input induced by enhanced mPFC activity.

As described above, we observed an inverse relationship in neural activity between CeA and mPFC-ITCs circuits, which is an increase of c-Fos-ir cells counts in the mPFC and non-CeA amygdala in late acquisition accompanied by a decrease of c-Fos-ir cell counts in the CeA following A08. The inverse relationship of c-Fos-ir in the mPFC and CeA is supported by the anatomical connection between these two structures and their physiological roles in aversive learning that we addressed earlier (Morgan and LeDoux, 1999; Rosenkranz et al., 2003; Amano et al., 2010). Lesion/deactivation in the CeA facilitated shuttle avoidance by reducing freezing (Choi et al., 2010; Moscarello and LeDoux, 2013), suggesting that CeA activity inhibits the acquisition of an active avoidance task. Thus rats exposed to shocks would have high CeA activity during early acquisition phase when avoidance response has not yet been fully acquired. However our study showed that the peak CeA activation occurred on session A08 but not A02 when avoidance responding is near asymptote. Similarly, higher c-Fos-ir in the CeA has been reported in rats that are “good” avoiders compared to “poor” avoiders in shuttle-box avoidance, suggesting that elevated CeA activity is associated with active avoidance learning (Martinez et al., 2013). Other than freezing, CeA is associated with arousal, sympathetic and parasympathetic responses to stimuli (LeDoux, 2007). It is possible that elevated CeA activity is due to other factors such as valence (i.e., bad/good behavioral outcome) state (Moul et al., 2012). In addition, it is known that CeA is highly heterogeneous, for instance, a large portion of CeA neurons are interneurons that inhibit CeA output (McDonald and Augustine, 1993; Pitkanen et al., 1997; Sah et al., 2003). Thus it is possible that the high CeA activity on session A08 could due to increased interneuron activation and lead to reduced CeA output. Therefore, the highest CeA activation observed on A08 may be the result of accumulative neural activation, but not necessarily indicate highest levels of fear.

In addition, our findings indicate that both LA and BA regions remained active during extinction of lever-press avoidance. The involvement of BA and LA in acquisition is expected since this region is necessary to acquire and perform an active avoidance task (Silveira et al., 2001; Anglada-Figueroa and Quirk, 2005). However, the extended activity during extinction suggests that the extinction of active avoidance requires both structures. We also found elevated activity in inhibitory PV-ir cells in the LA during extinction. As BA receives robust inputs from LA, increased inhibitory activity in the LA may lead to decreased output to the BA. Moreover, increased PV-ir neuronal activity was observed in BA following A10 and remained the same during extinction while overall BA activity was higher following E1, suggesting different neuronal population may be involved. For instance, BA neurons that fired to fear-associated CS or extinction-associated CS are innervated by projections from heterogeneous origins such as ventral hippocampus or mPFC (Repa et al., 2001; Herry et al., 2008). Thus, it is possible that activities from distinct neuronal populations associated with acquisition or extinction of avoidance learning are overlapping during late acquisition and early extinction, resulting in different activity patterns in the BA through LA.

It is important to note that the neuronal activity of the brain areas investigated here did not change in relation to shock number. Early in training, rats experienced the most amount of shocks in A01 and then reduce number of shocks through out the acquisition phase. In contrast, mPFC and amygdala sub-regions, except CE, had neuronal activity increasing through out the acquisition phase, and some even through extinction when there were no shocks experienced. Even activity in the CE nucleus did not exactly reflect shock number as its activity was highest at A08, but not A01. Previous studies have implicated that fear is greatest early in avoidance training and gradually reduces as avoidance is learned (Coover et al., 1973; Servatius et al., 2008). Thus, the neuronal activity reported in this study does not exactly correlate with the expected dynamics of fear during avoidance learning. Moreover, previous studies show that activity in the amygdala increase during fear conditioning in humans and animals, paralleling the conditioned response (Quirk et al., 1997; Cheng et al., 2007). Another study reported that c-Fos activity in the mPFC was significantly increased in rats acquiring wheel-turn avoidance compared to yoked and house-exposure control rats (Coco and Weiss, 2005). In addition, increased number of mPFC c-Fos-ir neurons was reported following fear extinction compared to unpaired CS/US control groups (Kim et al., 2010). Thus, these data suggest that the changes in neural activity likely results from the development of behavioral avoidance and extinction, as our observation indicates that there is a lack of association between c-Fos-ir cell counts and shock number received from groups (Figures 1C, 2A, 3A, 4A, 5). Taken together, the results of the present study suggest that activity of mPFC-amygdala during avoidance learning is not merely reflecting fear.

Limitations: The evaluation of c-Fos expression only indicates association of these regions in avoidance acquisition and extinction, but not the necessity of these regions in avoidance learning or extinction. Further investigation is needed to make mechanistic conclusions of these brain regions in avoidance and its extinction. Our results further suggest that to move forward, selective lesions of different cell populations within the mPFC and amygdala is necessary. Future studies should also include other regions such as nucleus accumbens (Ramirez et al., 2015) and striatum, as they are important in motivation and stress controllability.

In conclusion, we demonstrated that the dynamic interaction between mPFC and amygdalar sub-regions could partially be the underlying mechanism of avoidance acquisition and extinction. Thus the network activity in avoidance may not be the same in fear conditioning, while there are common structures involved. Our findings on GABAergic neural activity in acquisition and extinction of active avoidance may shed a light on better understanding the mechanism of avoidance and benefit extinction-based therapy for anxiety.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The present work was supported by Merit Review Awards I01BX000132, I01BX000218 and I01CX000771 from the US Department of Veterans Affairs Biomedical Laboratory and Clinical Sciences Research and Development Services, NIH grant RO1-NS44373, and the Stress and Motivated Behavior Institute. The contents do not represent the views of the U.S. Department of Veterans Affairs or the United States Government.

References

Amano, T., Unal, C. T., and Pare, D. (2010). Synaptic correlates of fear extinction in the amygdala. Nat. Neurosci. 13, 489–494. doi: 10.1038/nn.2499

Ambalavanar, R., McCabe, B. J., Potter, K. N., and Horn, G. (1999). Learning-related fos-like immunoreactivity in the chick brain: time-course and co-localization with GABA and parvalbumin. Neuroscience 93, 1515–1524. doi: 10.1016/s0306-4522(99)00217-1

American Psychiatric Association (2000). DSM-IV-TR Diagnostic and Statistical Manual of Psychiatric Disorders. 4th Edn. Washington D.C.: American Psychiatric Association.

Anglada-Figueroa, D., and Quirk, G. J. (2005). Lesions of the basal amygdala block expression of conditioned fear but not extinction. J. Neurosci. 25, 9680–9685. doi: 10.1523/jneurosci.2600-05.2005

Bailey, E. L., Overstreet, D. H., and Crocker, A. D. (1986). Effects of intrahippocampal injections of the cholinergic neurotoxin AF64A on open-field activity and avoidance learning in the rat. Behav. Neural Biol. 45, 263–274. doi: 10.1016/s0163-1047(86)80015-2

Beck, K. D., Jiao, X., Pang, K. C., and Servatius, R. J. (2010). Vulnerability factors in anxiety determined through differences in active-avoidance behavior. Prog. Neuropsychopharmacol. Biol. Psychiatry 34, 852–860. doi: 10.1016/j.pnpbp.2010.03.036

Beck, KD., Jiao, X., Smith, IM., Myers, CE., Pang, KC., and Servatius, R. J. (2014). ITI-Signals and prelimbic cortex facilitate avoidance acquisition and reduce avoidance latencies, respectively, in male WKY rats. Front. Behav. Neurosci. 8:403. doi: 10.3389/fnbeh.2014.00403

Berretta, S., Pantazopoulos, H., Caldera, M., Pantazopoulos, P., and Paré, D. (2005). Infralimbic cortex activation increases c-Fos expression in intercalated neurons of the amygdala. Neuroscience 132, 943–953. doi: 10.1016/j.neuroscience.2005.01.020

Chaudhuri, A., Zangenehpour, S., Rahbar-Dehgan, F., and Ye, F. (2000). Molecular maps of neural activity and quiescence. Acta Neurobiol. Exp. (Wars) 60, 403–410.

Cheng, D. T., Richards, J., and Helmstetter, F. J. (2007). Activity in the human amygdala corresponds to early, rather than late period autonomic responses to a signal for shock. Learn. Mem. 14, 485–490. doi: 10.1101/lm.632007

Choi, J. S., Cain, C. K., and LeDoux, J. E. (2010). The role of amygdala nuclei in the expression of auditory signaled two-way active avoidance in rats. Learn. Mem. 17, 139–147. doi: 10.1101/lm.1676610

Coco, M. L., and Weiss, J. M. (2005). Neural substrates of coping behavior in the rat: possible importance of mesocorticolimbic dopamine system. Behav. Neurosci. 119, 429–445. doi: 10.1037/0735-7044.119.2.429

Cominski, T. P., Jiao, X., Catuzzi, J. E., Stewart, A. L., and Pang, K. C. (2014). The role of the hippocampus in avoidance learning and anxiety vulnerability. Front. Behav. Neurosci. 8:273. doi: 10.3389/fnbeh.2014.00273

Coover, G. D., Ursin, H., and Levine, S. (1973). Plasma-corticosterone levels during active-avoidance learning in rats. J. Comp. Physiol. Psychol. 82, 170–174. doi: 10.1037/h0033790

Cottraux, J. (2005). Recent developments in research and treatment for social phobia (social anxiety disorder). Curr. Opin. Psychiatry 18, 51–54.

Dávila, J. C., Olmos, L., Legaz, I., Medina, L., Guirado, S., and Real, M. A. (2008). Dynamic patterns of colocalization of calbindin, parvalbumin and GABA in subpopulations of mouse basolateral amygdalar cells during development. J. Chem. Neuroanat. 35, 67–76. doi: 10.1016/j.jchemneu.2007.06.003

Duncan, G. E., Knapp, D. J., and Breese, G. R. (1996). Neuroanatomical characterization of Fos induction in rat behavioral models of anxiety. Brain Res. 713, 79–91. doi: 10.1016/0006-8993(95)01486-1

Gabbott, P. L., and Bacon, S. J. (1996). Local circuit neurons in the medial prefrontal cortex (areas 24a,b,c, 25 and 32) in the monkey: II. Quantitative areal and laminar distributions. J. Comp. Neurol. 364, 609–636. doi: 10.1002/(sici)1096-9861(19960122)364:4<609::aid-cne2>3.3.co;2-e

Gabbott, P. L., Dickie, B. G., Vaid, R. R., Headlam, A. J., and Bacon, S. J. (1997). Local-circuit neurones in the medial prefrontal cortex (areas 25, 32 and 24b) in the rat: morphology and quantitative distribution. J. Comp. Neurol. 377, 465–499. doi: 10.1002/(sici)1096-9861(19970127)377:4<465::aid-cne1>3.0.co;2-0

Gabbott, P. L., Warner, T. A., and Busby, S. J. (2006). Amygdala input monosynaptically innervates parvalbumin immunoreactive local circuit neurons in rat medial prefrontal cortex. Neuroscience 139, 1039–1048. doi: 10.1016/j.neuroscience.2006.01.026

Guyer, A. E., Lau, J. Y., McClure-Tone, E. B., Parrish, J., Shiffrin, N. D., Reynolds, R. C., et al. (2008). Amygdala and ventrolateral prefrontal cortex function during anticipated peer evaluation in pediatric social anxiety. Arch. Gen. Psychiatry 65, 1303–1312. doi: 10.1001/archpsyc.65.11.1303

Hefner, K., Whittle, N., Juhasz, J., Norcross, M., Karlsson, R. M., Saksida, L. M., et al. (2008). Impaired fear extinction learning and cortico-amygdala circuit abnormalities in a common genetic mouse strain. J. Neurosci. 28, 8074–8085. doi: 10.1523/JNEUROSCI.4904-07.2008

Herry, C., Ciocchi, S., Senn, V., Demmou, L., Müller, C., and Lüthi, A. (2008). Switching on and off fear by distinct neuronal circuits. Nature 454, 600–606. doi: 10.1038/nature07166

Izumi, T., Boku, S., Shinmin, W., Inoue, T., Konno, K., Yamaguchi, T., et al. (2011). Retrieval of conditioned fear activates the basolateral and intercalated nucleus of amygdala. J. Neurosci. Res 89, 773–790. doi: 10.1002/jnr.22592

Jiao, X., Pang, K. C., Beck, K. D., Minor, T. R., and Servatius, R. J. (2011). Avoidance perseveration during extinction training in Wistar-Kyoto rats: an interaction of innate vulnerability and stressor intensity. Behav. Brain Res. 221, 98–107. doi: 10.1016/j.bbr.2011.02.029

Kemppainen, S., and Pitkänen, A. (2000). Distribution of parvalbumin, calretinin and calbindin-D(28k) immunoreactivity in the rat amygdaloid complex and colocalization with gamma-aminobutyric acid. J. Comp. Neurol. 426, 441–467. doi: 10.1002/1096-9861(20001023)426:3<441::aid-cne8>3.0.co;2-7

Kim, S. C., Jo, Y. S., Kim, I. H., Kim, H., and Choi, J. S. (2010). Lack of medial prefrontal cortex activation underlies the immediate extinction deficit. J. Neurosci. 30, 832–837. doi: 10.1523/jneurosci.4145-09.2010

Kirkby, R. J., and Kimble, D. P. (1968). Avoidance and escape behavior following striatal lesions in the rat. Exp. Neurol. 20, 215–227. doi: 10.1016/0014-4886(68)90095-2

LeDoux, J. (2007). The amygdala. Curr. Biol. 17, R868–R874. doi: 10.1016/j.cub.2007.08.005

Likhtik, E., Popa, D., Apergis-Schoute, J., Fidacaro, G. A., and Pare, D. (2008). Amygdala intercalated neurons are required for expression of fear extinction. Nature 454, 642–645. doi: 10.1038/nature07167

Mańko, M., Geracitano, R., and Capogna, M. (2011). Functional connectivity of the main intercalated nucleus of the mouse amygdala. J. Physiol. 589, 1911–1925. doi: 10.1113/jphysiol.2010.201475

Martinez, R. C., Gupta, N., Lazaro-Munoz, G., Sears, R. M., Kim, S., Moscarello, J. M., et al. (2013). Active vs. reactive threat responding is associated with differential c-Fos expression in specific regions of amygdala and prefrontal cortex. Learn. Mem. 20, 446–452. doi: 10.1101/lm.031047.113

McCabe, C., Shaw, D., Atack, J. R., Street, L. J., Wafford, K. A., Dawson, G. R., et al. (2004). Subtype-selective GABAergic drugs facilitate extinction of mouse operant behaviour. Neuropharmacology 46, 171–178. doi: 10.1016/j.neuropharm.2003.09.004

McDonald, A. J., and Augustine, J. R. (1993) Localization of GABA-like immunoreactivity in the monkey amygdala. Neuroscience 52, 281–294.

Milad, M. R., and Quirk, G. J. (2002). Neurons in medial prefrontal cortex signal memory for fear extinction. Nature 420, 70–74. doi: 10.1038/nature01138

Milad, M. R., Rauch, S. L., Pitman, R. K., and Quirk, G. J. (2006). Fear extinction in rats: implications for human brain imaging and anxiety disorders. Biol. Psychol. 73, 61–71. doi: 10.1016/j.biopsycho.2006.01.008

Milad, M. R., Vidal-Gonzalez, I., and Quirk, G. J. (2004). Electrical stimulation of medial prefrontal cortex reduces conditioned fear in a temporally specific manner. Behav. Neurosci. 118, 389–394. doi: 10.1037/0735-7044.118.2.389

Miller, J. P., McAuley, J. D., and Pang, K. C. (2005). Spontaneous fos expression in the suprachiasmatic nucleus of young and old mice. Neurobiol. Aging 26, 1107–1115. doi: 10.1016/j.neurobiolaging.2004.08.008

Mobbs, D., Petrovic, P., Marchant, J. L., Hassabis, D., Weiskopf, N., Seymour, B., et al. (2007). When fear is near: threat imminence elicits prefrontal-periaqueductal gray shifts in humans. Science 317, 1079–1083. doi: 10.1126/science.1144298

Morgan, M. A., and LeDoux, J. E. (1999). Contribution of ventrolateral prefrontal cortex to the acquisition and extinction of conditioned fear in rats. Neurobiol. Learn. Mem. 72, 244–251. doi: 10.1006/nlme.1999.3907

Moscarello, J. M., and LeDoux, J. E. (2013). Active avoidance learning requires prefrontal suppression of amygdala-mediated defensive reactions. J. Neurosci. 33, 3815–3823. doi: 10.1523/jneurosci.2596-12.2013

Moul, C., Killcross, S., and Dadds, M. R. (2012). A model of differential amygdala activation in psychopathy. Psychol. Rev. 119, 789–806. doi: 10.1037/a0029342

Pang, K. C., Jiao, X., Sinha, S., Beck, K. D., and Servatius, R. J. (2011). Damage of GABAergic neurons in the medial septum impairs spatial working memory and extinction of active avoidance: effects on proactive interference. Hippocampus 21, 835–846. doi: 10.1002/hipo.20799

Pang, K. C., Yoder, R. M., and Olton, D. S. (2001). Neurons in the lateral agranular frontal cortex have divided attention correlates in a simultaneous temporal processing task. Neuroscience 103, 615–628. doi: 10.1016/s0306-4522(01)00018-5

Paxinos, G., and Watson, C. (1998). The Rat Brain in Stereotaxic Coordinates. New York: Academic Press.

Perrotti, L. I., Dennis, T. S., Jiao, X., Servatius, R. J., Pang, K. C., and Beck, K. D. (2013). Activation of extracellular signal-regulated kinase (ERK) and ΔFosB in emotion-associated neural circuitry after asymptotic levels of active avoidance behavior are attained. Brain Res. Bull. 98, 102–110. doi: 10.1016/j.brainresbull.2013.07.004

Phan, K. L., Britton, J. C., Taylor, S. F., Fig, L. M., and Liberzon, I. (2006). Corticolimbic blood flow during nontraumatic emotional processing in posttraumatic stress disorder. Arch. Gen. Psychiatry 63, 184–192. doi: 10.1001/archpsyc.63.2.184

Pitkanen, A., Savander, V., and LeDoux, J. E. (1997). Organization of intra-amygdaloid circuitries in the rat: an emerging framework for understanding functions of the amygdala. Trends Neurosci. 20, 517–523. doi: 10.1016/S0166-2236(97)01125-9

Quirk, G. J., Armony, J. L., and LeDoux, J. E. (1997). Fear conditioning enhances different temporal components of tone-evoked spike trains in auditory cortex and lateral amygdala. Neuron 19, 613–624. doi: 10.1016/s0896-6273(00)80375-x

Quirk, G. J., Garcia, R., and González-Lima, F. (2006). Prefrontal mechanisms in extinction of conditioned fear. Biol. Psychiatry 60, 337–343. doi: 10.1016/j.biopsych.2006.03.010

Quirk, G. J., and Gehlert, D. R. (2003). Inhibition of the amygdala: key to pathological states? Ann. N Y Acad. Sci. 985, 263–272. doi: 10.1111/j.1749-6632.2003.tb07087.x

Ramirez, F., Moscarello, J. M., LeDoux, J. E., and Sears, R. M. (2015). Active avoidance requires a serial basal amygdala to nucleus accumbens shell circuit. J. Neurosci. 35, 3470–3477. doi: 10.1523/jneurosci.1331-14.2015

Rau, V., DeCola, J. P., and Fanselow, M. S. (2005). Stress-induced enhancement of fear learning: an animal model of posttraumatic stress disorder. Neurosci. Biobehav. Rev. 29, 1207–1223. doi: 10.1016/j.neubiorev.2005.04.010

Rauch, S. L., Shin, L. M., and Phelps, E. A. (2006). Neurocircuitry models of posttraumatic stress disorder and extinction: human neuroimaging research—past, present and future. Biol. Psychiatry 60, 376–382. doi: 10.1016/j.biopsych.2006.06.004

Repa, J. C., Muller, J., Apergis, J., Desrochers, T. M., Zhou, Y., and LeDoux, J. E. (2001). Two different lateral amygdala cell populations contribute to the initiation and storage of memory. Nat. Neurosci. 4, 724–731. doi: 10.1038/89512

Rosenkranz, J. A., Moore, H., and Grace, A. A. (2003). The prefrontal cortex regulates lateral amygdala neuronal plasticity and responses to previously conditioned stimuli. J. Neurosci. 23, 11054–11064.

Royer, S., Martina, M., and Paré, D. (1999). An inhibitory interface gates impulse traffic between the input and output stations of the amygdala. J. Neurosci. 19, 10575–10583.

Royer, S., and Paré, D. (2002). Bidirectional synaptic plasticity in intercalated amygdala neurons and the extinction of conditioned fear responses. Neuroscience 115, 455–462. doi: 10.1016/s0306-4522(02)00455-4

Sah, P., Faber, E. S. L., De Armentia, L. M., and Power, J. (2003). The amygdaloid complex: anatomy and physiology. Physiol. Rev. 83, 803–834. doi: 10.1152/physrev.00002.2003

Schwartz, C. E., and Rauch, S. L. (2004). Temperament and its implications for neuroimaging of anxiety disorders. CNS Spectr. 9, 284–291.

Servatius, R. J., Jiao, X., Beck, K. D., Pang, K. C., and Minor, T. R. (2008). Rapid avoidance acquisition in Wistar-Kyoto rats. Behav. Brain Res. 192, 191–197. doi: 10.1016/j.bbr.2008.04.006

Sierra-Mercado, D., Padilla-Coreano, N., and Quirk, G. J. (2011). Dissociable roles of prelimbic and infralimbic cortices, ventral hippocampus and basolateral amygdala in the expression and extinction of conditioned fear. Neuropsychopharmacology 36, 529–538. doi: 10.1038/npp.2010.184

Silveira, M. C., Zangrossi, H., de Barros Viana, M., Silveira, R., and Graeff, F. G. (2001). Differential expression of Fos protein in the rat brain induced by performance of avoidance or escape in the elevated T-maze. Behav. Brain Res. 126, 13–21. doi: 10.1016/s0166-4328(01)00233-9

Sorvari, H., Miettinen, R., Soininen, H., and Pitkänen, A. (1996). Parvalbumin-immunoreactive neurons make inhibitory synapses on pyramidal cells in the human amygdala: a light and electron microscopic study. Neurosci. Lett. 217, 93–96. doi: 10.1016/s0304-3940(96)13067-6

Straube, T., Schmidt, S., Weiss, T., Mentzel, H. J., and Miltner, W. H. (2009). Dynamic activation of the anterior cingulate cortex during anticipatory anxiety. Neuroimage 44, 975–981. doi: 10.1016/j.neuroimage.2008.10.022

Vertes, R. P. (2004). Differential projections of the infralimbic and prelimbic cortex in the rat. Synapse 51, 32–58. doi: 10.1002/syn.10279

Wan, R. Q., Pang, K., and Olton, D. S. (1994). Hippocampal and amygdaloid involvement in nonspatial and spatial working memory in rats: effects of delay and interference. Behav. Neurosci. 108, 866–882. doi: 10.1037/0735-7044.108.5.866

West, M. J. (1993). New stereological methods for counting neurons. Neurobiol. Aging 14, 275–285. doi: 10.1016/0197-4580(93)90112-o

West, M. J., Bach, G., Soderman, A., and Jensen, J. L. (2009). Synaptic contact number and size in stratum radiatum CA1 of APP/PS1DeltaE9 transgenic mice. Neurobiol. Aging 30, 1756–1776. doi: 10.1016/j.neurobiolaging.2008.01.009