The Time Course of the Influence of Valence and Arousal on the Implicit Processing of Affective Pictures

Abstract

In the current study, we investigated the time course of the implicit processing of affective pictures with an orthogonal design of valence (negative vs. positive) by arousal (low vs. high). Previous studies with explicit tasks suggested that valence mainly modulates early event-related potential (ERP) components, whereas arousal mainly modulates late components. However, in this study with an implicit task, we observed significant interactions between valence and arousal at both early and late stages over both parietal and frontal sites, which were reflected by three different ERP components: P2a (100–200 ms), N2 (200–300 ms), and P3 (300–400 ms). Furthermore, there was also a significant main effect of arousal on P2b (200–300 ms) over parieto-occipital sites. Our results suggest that valence and arousal effects on implicit affective processing are more complicated than previous ERP studies with explicit tasks have revealed.

About the Authors:

Chunliang Feng

Affiliation: State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

Lili Wang

Affiliation: State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

Chao Liu

Affiliation: State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

Xiangru Zhu

Affiliation: Department of Psychology, Henan University, Henan, China

Ruina Dai

Affiliation: State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

Xiaoqin Mai

* E-mail: [email protected] (XM); [email protected] (YL)

Affiliation: Center for Human Growth and Development, University of Michigan, Ann Arbor, Michigan, United States of America

Yue-Jia Luo

* E-mail: [email protected] (XM); [email protected] (YL)

Affiliation: State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

Introduction

As one of the fundamental aspects of the human mind, emotion and its brain mechanisms have received increasing interest recently, especially with the development of non-invasive neuroimaging techniques such as functional magnetic resonance imaging (fMRI) and event-related potentials (ERPs) [1]. Compared to fMRI, the ERP technique can provide fine-grain temporal resolution of mental processing and thus has been widely used in studying the time course of affective processing. Studies have revealed that affective modulations can occur as early as around 100 ms after stimulus onset and can be sustained for as long as several seconds [2]. According to the dimensional view of emotion, affective valence (ranging from negative to positive) and arousal (ranging from calm to excited) are two primary dimensions of emotion [3]. A rich body of literature has suggested that these two dimensions modulate ERP components at different temporal stages with valence mainly affecting ERP components at an early stage (e.g., before 200 ms) and arousal mainly affecting ERP components at a later stage (e.g., after 250 ms) [2], [4], [5].

The modulating effect of valence on the early stage of affective processing has been attributed to the biological significance of negative stimuli [2], [6]. At the early stage, several ERP components (e. g., P1, N1, P2) elicited by negative stimuli have been found to be more pronounced than those elicited by positive and neutral stimuli [7], [8], [9], [10]. However, such valence effects are not consistent among previous studies. For instance, comparable early ERP components elicited by negative and positive stimuli have also been reported [5], [11], [12], [13], [14]. Additionally, a considerable number of studies have even reported that early ERP components elicited by positive stimuli can be more pronounced than those elicited by negative stimuli, possibly due to the greater “automatic arousal” of positive stimuli [12], [15], [16], [17].

In contrast, an association between arousal effects and late ERP components is prevalent in previous studies; in particular, arousal effects usually occurred at around 250 ms and were accentuated over the following several seconds [15], [18], [19]. For instance, high arousing (negative and positive) stimuli have been found to elicit more pronounced late ERP components (e. g., N2, P3) than low arousing (neutral) stimuli, even when the affective stimuli were briefly presented [5], [12], [14], [15], [20], [21]. The modulating effects of arousal on late ERP components were suggested to reflect motivation-driven attention to high arousing stimuli, indicating that meaningful stimuli are selectively processed at the late stage [22]. However, such arousal effects have not been consistently observed, and valence effects on late ERP components have also been reported [23], [24], [25]. Current evidence is thus unclear as to whether valence, arousal, or both factors together modulate the late processing of affective stimuli [18].

Although valence and arousal have been suggested to modulate ERP components at relatively separate stages [2], recent behavioral and fMRI studies have found that the effects of arousal and valence are more complicated than the ERP studies have suggested, especially in their interactions [17], [26], [27], [28], [29], [30], [31]. For example, in a behavioral study, Robinson et al. found that participants responded faster to high arousing negative and low arousing positive stimuli than to low arousing negative and high arousing positive stimuli. Subsequent studies further demonstrated that the interaction between valence and arousal can be elicited automatically [32]. Such an interaction has been further confirmed in recent fMRI studies. In a study assessing the neural responses to affective items which are successfully recognized, Steinmetz and his colleagues found that high arousing negative and low arousing positive stimuli enhanced connections between the amygdala and other regions, whereas low arousing negative and high arousing positive stimuli reduced these connections [30]. One way to interpret the valence by arousal interaction is using the model of evaluative space proposed by Cacioppo and his colleagues [33], [34], [35], [36], [37], [38]. According to this model, motivational systems for positive and negative valence processing (appetitive system and aversive system, respectively) are separable and are characterized by different activation functions [39]: whereas the appetitive motivational system tends to respond more than the aversive motivational system when the evaluative input (as indicated by arousal ratings) is low (positive offset), the aversive motivational system responds more than appetitive motivational system when the evaluative input is high [36], [38]. This occurs because the aversive motivational system tends to response more intensely than appetitive motivational to comparable increases in input (negative bias). The positive offset and negative bias could well explain the valence by arousal interaction found in behavioral and fMRI studies [29], [30], [32], [40], as well as the inconsistent valence effects found in previous ERP studies.

Whereas interactions between valence and arousal have been amply demonstrated in behavioral and fMRI studies, there is little evidence for such interactions from ERP studies [2], [17]. A number of ERP studies have been conducted with orthogonal factors of valence by arousal [4], [5], [17], [18], [20], [41], but only one of these revealed a significant interaction between valence and arousal, which was found by analyzing ERP topographies rather than ERP components [4].

Previous ERP studies investigating affective processing often used explicit tasks such as the passive viewing task, oddball paradigm, and affective categorization task [4], [17], [18], [19], [23], [24]. However, numerous studies have shown that affective content can be processed even when it is not explicitly attended [42], [43], [44], [45], [46]. For example, when participants are instructed to categorize affective pictures according to nonaffective features of these stimuli (e.g., identifying how many people in the pictures), affective information has been found to modulate ERP components at both early and late stages [7], [8], [10], [45], [47], [48]. Nevertheless, how such implicit affective processing can be influenced by valence and arousal and what are the corresponding ERP correlates are yet under debate [8], [43], [48]. For instance, previous studies have frequently associated P300 with arousal in implicit affective processing [47], [48], [49], but Carretie and his colleagues [43], [44] demonstrated that the valence-associated N300 (275–325 ms) might be a better index than P300 to reflect implicit processing of affective stimuli.

In sum, the exact contributions of valence and arousal in affective processing are unclear in previous studies, and an orthogonal design of valence by arousal would provide a promising means to systematically investigate their independent and interactive effects on affective processing.

In the present study, we aimed to investigate the electrophysiological correlates of the implicit processing of affective stimuli. Compared to previous implicit tasks in which participants categorized affective stimuli according to nonaffective features of pictures [7], [8], [43], [46], [47], [49], [50], [51], our task was even more “implicit” in that participants did not even need to attend to and process the content of the pictures but merely needed to judge the color of the picture frame [10], [52]. In addition, we employed an orthogonal design of valence by arousal so that both the main effects and interaction could be systematically investigated. According to Cacioppo et al.'s model and prior behavioral findings [29], [32], both faster RTs and higher amplitude ERPs might reflect enhanced responses to the appetitive or aversive motivational system [53], [54]. Accordingly, we hypothesized that when the arousal ratings of stimuli were low, positive stimuli would elicit larger ERPs than negative stimuli, whereas when arousal ratings were high, positive stimuli would elicit smaller ERPs than negative stimuli.

Methods

Participants

Twenty-one individuals (10 females) aged 18–29 years (mean age = 21 years) participated in the present study for payment. All participants had normal or corrected-to-normal vision and did not have any history of psychiatric or neurological illness. This study and the recruitment of participants were approved by the Beijing Normal University Institutional Review Board (IRB). Written informed consents were collected for all participants.

Stimuli

Pictures used in our study were selected from the International Affective Picture System based on normative ratings of valence and arousal [3]. There were four stimuli types: high arousing positive (HP), low arousing positive (LP), high arousing negative (HN), and low arousing negative (LN), with 15 pictures for each type (HP: 2216, 4607, 4658, 4687, 5470, 5621, 5629, 8030, 8034, 8090, 8180, 8190, 8370, 8470, 8490; LP: 1500, 1590, 1670, 2080, 2304, 2340, 2360, 2500, 2515, 5220, 7238, 7285, 7430, 7545, 8320; HN: 3053, 3060, 3071, 3102, 3120, 3130, 3170, 3261, 3350, 3400, 3530, 6313, 6570, 9570, 9921; LN: 2205, 2700, 2722, 2750, 2753, 9001, 9041, 9046, 9265, 9280, 9320, 6010, 9330, 9415, 9830). The valence and arousal ratings of these pictures are listed in Table 1. Positive and negative pictures were significantly different in valence ratings (p<.001), but not in arousal ratings (p = .41); whereas high arousing and low arousing pictures were significantly different in arousal ratings (p<.001), but not in valence ratings (p = .55). All pictures were adjusted to a size of 12°×9° and were surrounded on a random basis by one of four colored frames (red, yellow, blue, or green) having a width of 0.5°. Pictures were presented on a CRT monitor with an 80 Hz refresh rate using the Psychophysics Toolbox extensions for Matlab [55], [56].

[Figure omitted. See PDF.]

Table 1. The mean (with SD) valence and arousal ratings , reaction times (RT, ms) and accuracy (%) in each condition.

https://doi.org/10.1371/journal.pone.0029668.t001

Procedure

The experimental procedure is shown in Figure 1, each trial began with a fixation (750 ms) point, followed by the stimulus for 300 ms. The inter-trial interval was randomized between 1700 and 2300 ms. Participants were instructed to judge the color of the frame as quickly and accurately as possible by pressing one of four corresponding keys. The whole experiment consisted of four blocks of each of the four stimulus types [13], [57], [58], [59]. Each block contained 75 trials. The orders of four blocks were randomized across participants, and the sequence of trials in each block was pseudo-random, with the constraints that identical pictures were not presented successively and picture frames with the same color were not presented successively more than three times. Participants sat in a dimly lit and sound-attenuated chamber facing a CRT monitor 80 cm away from their eyes. Before the formal experiment, each participant was given a training block to get familiar with response keys. Four pictures that were not included in the formal experiment were used in a 20 trial of training block.

[Figure omitted. See PDF.]

Figure 1. Experimental procedure.

A fixation point was first presented for 750 ms. Then an affective picture with a colored frame (either red, yellow, blue, or green) was presented for 300 ms. The participant was instructed to response to the color of the frame as quickly and accurately as possible by pressing one of four separate keys. The inter-trial interval was randomized between 1700 and 2300 ms.

https://doi.org/10.1371/journal.pone.0029668.g001

Electrophysiological recording

The electroencephalogram (EEG) was recorded from 64 scalp sites using electrodes mounted in an elastic cap (Brain Product, GmbH, Germany), with an online reference to the left mastoid. The horizontal electroencephalogram (HEOG) was recorded with two electrodes placing laterally to the right and left eyes. The vertical electroencephalogram (VEOG) was recorded with electrodes placed above and below the right eye. All inter-electrode impedances were maintained below 10 kΩ. The EEG and EOG were amplified using a 0.01–100 Hz band-pass and continuously sampled at 500 Hz in each channel for off-line analysis. All EEG signals were re-referenced off-line to the average of left and right mastoids [60]. The EEG data were low-pass filtered below 30 Hz (24 dB/oct) and were corrected for eye movements or blinks using the Gratton and Coles [61] method as implemented in the Brain Vision analysis software (Brain Product, GmbH, Germany). Trials containing EEG sweeps with amplitudes exceeding ±100 µV were excluded.

Data reduction and analysis

ERPs elicited by each type of stimulus were averaged separately over an epoch of 800 ms with a 200 ms pre-stimulus baseline. Based on inspection of the grand-averaged ERP waveforms (Figure 2) and previous studies of affective picture processing [7], [13], [14], [22], four different ERP components, P2a, P2b, N2, and P3 were analyzed in the current study. Different sets of electrodes in the frontal and parietal regions were chosen for the baseline-to-peak measurements of these components: FC3, FCz, FC4, F3, Fz, and F4 for P2a (100–200 ms) and N2 (200–300 ms) components; PO3 and PO4 for the P2b (200–300 ms) component; P1, P3, P2 and P4 for the P3 (300–400 ms) component. The amplitudes and latencies of these components were then analyzed using repeated measures ANOVAs with the factors of Valence (negative vs. positive) by Arousal (low vs. high) by Hemisphere (left vs. right) by Electrodes (electrodes selected for particular ERP component, as stated above). P values were adjusted according to the Greenhouse-Geisser correction if necessary. Bonferroni correction was used for multiple comparisons.

[Figure omitted. See PDF.]

Figure 2. The grand average ERPs evoked by high arousing positive (HP), low arousing positive (LP), high arousing negative (HN), and low arousing negative (LN) pictures.

Compared to HP and LN, HN and LP stimuli elicited both larger P2a and P3 components at bilateral frontal (F3, F4, FC3, and FC4) and parietal regions (P1, P2, P3 and P4), respectively. Compared to Low arousing pictures, high arousing pictures elicited a larger P2b component at posterior parieto-occipital regions (PO3 and PO4). Furthermore, the arousal effects on the N2 component were restricted to the negative pictures. The voltage topographies for P2a (150–170 ms), P2b/N2 (210–230 ms), and P3 (310–340 ms) components in each condition are shown.

https://doi.org/10.1371/journal.pone.0029668.g002

Results

Behavioral results

The behavioral results are shown in Table 1. Two-way repeated measures ANOVAs of Valence (negative vs. positive) by Arousal (low vs. high) on reaction times (RTs) and accuracy revealed neither significant main effects of Valence (RTs: F(1, 20) = .10, p = .75; accuracy: F(1, 20) = 2.26, p = .15) nor Arousal (RTs: F(1, 20) = .74, p = .40; accuracy: F(1, 20) = .02, p = .90), nor significant interactions of Valence by Arousal, (RTs: F(1, 20) = 2.27, p = .15; accuracy: F(1, 20) = .03, p = .86). Thus, behaviorally participants responded similarly to the frames of affective pictures having different valence and arousal values, indicating that this implicit viewing task required no effortful processing of the affective stimuli [13], [59].

ERP results

P2a (100–200 ms).

Four-way repeated measures ANOVA of Valence (negative vs. positive) by Arousal (low vs. high) by Hemisphere (left vs. medial vs. right) by Electrode (F3, Fz and F4 vs. FC3, FCz, and FC4) on P2a amplitudes yielded a significant main effect of Hemisphere (F(2, 40) = 2.25, p = .049,η²_p = .14) and Electrode (F(1, 20) = 27.04, p<.001,η²_p = .58), as well as a significant interaction of and Hemisphere by Electrode (F(2, 40) = 3.79, p = .031,η²_p = .16) and Valence by Arousal (F(1, 20) = 19.29, p<.001,η²_p = .49), such that P2a amplitudes elicited by high arousing negative pictures were larger than those by high arousing positive pictures; whereas the P2a amplitudes elicited by low arousing negative pictures were smaller than those by lowing arousing positive pictures (Figures 2 and 3, Table 2). Such a Valence by Arousal interaction has rarely been reported in previous ERP studies in which the valence effect was related to this early stage [2], [51]. Further analysis also revealed that the P2a amplitudes were larger at F3, Fz, and F4 (M = 7.82 µV, SD = 4.19) than at FC3, FCz, and FC4 (M = 6.33 µV, SD = 3.69). Four-way repeated measures ANOVA of Valence by Arousal by Hemisphere by Electrode on P2a latencies (Table 3) yielded no significant effects.

[Figure omitted. See PDF.]

Figure 3. The amplitudes of P2a and N2 evoked by high arousing positive (HP), low arousing positive (LP), high arousing negative (HN), and low arousing negative (LN) pictures (error bars show 1 SE).

Interaction between Valence and Arousal was found on P2a and N2. Specifically, valence-arousal-congruent pictures (HN and LP) elicited larger P2a than valence-arousal-incongruent pictures (LN and HP). In addition, the arousal effects for N2were restricted to negative pictures, showing that LN elicited larger N2 than HN. Moreover, the interaction between Valence and Arousal on N2 was restricted to the right hemisphere.

https://doi.org/10.1371/journal.pone.0029668.g003

[Figure omitted. See PDF.]

Table 2. The mean (with SD) peak amplitude (µV) of each component in response to different affective pictures.

https://doi.org/10.1371/journal.pone.0029668.t002

[Figure omitted. See PDF.]

Table 3. The mean (with SD) peak latency (ms) of each component in response to different affective pictures.

https://doi.org/10.1371/journal.pone.0029668.t003

N2(200–300 ms).

Four-way repeated measures ANOVA of Valence (negative vs. positive) by Arousal (low vs. high) by Hemisphere (left vs. medial vs. right) by Electrode (F3, Fz, and F4 vs. FC3, FCz, and FC4) on N2 amplitudes yielded significant main effects of Valence (F(1, 20) = 5.71, p = .027,η²_p = .22) and Hemisphere (F(2, 40) = 12.94, p<.001,η²_p = .39), two-way interactions of Arousal by Hemisphere (F(2, 40) = 4.33, p = .021,η²_p = .18), Arousal by Electrode (F(1, 20) = 8.37, p = .009,η²_p = .30) and Hemisphere by Electrode (F(2, 40) = 6.52, p = .006,η²_p = .25), as well as a three-way interaction of Valence by Arousal by Hemisphere (F(2, 40) = 6.08, p = .006,η²_p = .23). Further analysis revealed that over the right hemisphere, N2 amplitudes were more negative for low arousing negative pictures than for high arousing negative pictures; whereas N2 amplitudes elicited by high and low arousing positive pictures showed no significant difference. In addition, N2 amplitudes were more negative for low arousing negative pictures than for low arousing positive pictures; whereas N2 amplitudes elicited by high arousing negative and positive pictures showed no significant difference (Figure 2 and 3, Table 2). In contrast, over the left and medial sites, no effects were found on the N2 amplitudes. These results indicated that the arousal effects on N2 depended on valence, and such an interaction was restricted to the right hemisphere. Furthermore, N2 amplitudes at medial sites (M = −7.60 µV, SD = 5.94) were more negative than at right (M = −6.26 µV, SD = 5.37) and left (M = −5.66 µV, SD = 4.57) sites, which were consistent with previous findings [10], [62]. Four-way repeated measures ANOVA of Valence by Arousal by Hemisphere by Electrode on N2 latencies (Table 3) only revealed a significant interaction of Hemisphere by Electrode, F(2, 40) = 4.81, p = .014,η²_p = .19. Further analysis revealed that N2 latencies were shorter at FCz (M = 238.55 ms, SD = 17.68) than at Fz (M = 241.02 ms, SD = 19.08).

P2b (200–300 ms).

Three-way repeated measures ANOVA of Valence (negative vs. positive) by Arousal (low vs. high) by Hemisphere (left: PO3 vs. right: PO4) on P2b amplitudes yielded only a significant main effect of Arousal, F (1, 20) = 4.93, p = .038,η²_p = .20, such that high arousing pictures elicited larger P2b than low arousing pictures (Figure 2 and 4, Table 2). Neither the main effect of Valence (F(1, 20) = .13, p = .72) nor the interaction between Valence and Arousal (F(1, 20) = 3.74, p = .067) was significant. These results indicated that the arousal information of affective stimuli could be independently processed within this stage [14], [22]. Three-way repeated measures ANOVA of Valence by Arousal by Hemisphere on P2b latencies (Table 3) revealed a marginally significant main effect of Arousal (F(1, 20) = 4.50, p = .047,η²_p = .18), and a three-way interaction of Valence, Arousal, and Hemisphere (F(1, 20) = 4.45, p = .048,η²_p = .18), such that the latencies for high arousing negative pictures were shorter than those for low arousing negative pictures over the left hemisphere. These results were consistent with previous studies showing that P2b latencies were shorter for low arousing stimuli than for high arousing stimuli [63].

[Figure omitted. See PDF.]

Figure 4. The amplitudes of P2b and P3 evoked by high arousing positive (HP), low arousing positive (LP), high arousing negative (HN), and low arousing negative (LN) pictures (error bars show 1 SE).

The main effect of Arousal was only found on P2b, such that high arousing pictures elicited larger P2b than low arousing pictures. Interaction between Valence and Arousal was found on P3. Specifically, valence-arousal-congruent pictures (HN and LP) elicited larger P3 than valence-arousal-incongruent pictures (LN and HP). In addition, the interaction between Valence and Arousal on P3 was restricted to the right hemisphere.

https://doi.org/10.1371/journal.pone.0029668.g004

P3(300–400 ms).

Four-way repeated measures ANOVA of Valence (negative vs. positive) by Arousal (low vs. high) by Hemisphere (left vs. right) by Electrode (P1 and P2 vs. P3 and P4) on P3 amplitudes yielded a significant main effect of Hemisphere (F(1, 20) = 11.80, p = .003,η²_p = .37), a two-way interaction of Valence by Arousal (F(1, 20) = 8.52, p = .008,η²_p = .30), as well as a three-way interaction of Valence by Arousal by Hemisphere (F(1, 20) = 9.20, p = .007,η²_p = .32). Further analysis revealed that the P3 amplitudes were larger over the left hemisphere than over the right hemisphere. Interestingly, P3 showed a Valence by Arousal interaction similar to P2a over the right hemisphere, such that the P3 amplitudes for high arousing negative pictures were larger than for high arousing positive pictures; whereas P3 amplitudes elicited by low arousing negative pictures were smaller than those by low arousing positive pictures (Figure 2 and 4, Table 2). Such an interaction was not found over the left hemisphere. Such a Valence by Arousal interaction pattern on ERP components has rarely been previously reported, although the interaction of valence and arousal on affective processing at this stage has been suggested [4], [41]. Four-way repeated measures ANOVA of Valence by Arousal by Hemisphere by Electrode on P3 latencies (Table 3) revealed significant main effect of Valence (F(1, 20) = 6.17, p = .022,η²_p = .24) and Electrode (F(1, 20) = 12.36, p = .002,η²_p = .38), such that the latencies of negative pictures were shorter than those of positive pictures; and P3 latencies at P1 and P2 electrodes were shorter than those at P3 and P4 electrodes. Such results of P3 latencies are consistent with previous studies showing that latency reductions at posterior sites were restricted to negative stimuli [64].

Discussion

In the present study, we investigated the influence of valence and arousal on the implicit processing of affective pictures using the ERP technique. We found significant interactions between valence and arousal within both early and late time windows over both parietal and frontal sites, which were reflected in three different ERP components: P2a (100–200 ms), N2 (200–300 ms), and P3 (300–400 ms). In addition, we also found a significant main effect of arousal on the P2b (200–300 ms) component over parieto-occipital sites. These results indicate that valence and arousal play interactive roles in the implicit processing of affective stimuli.

An interaction between valence and arousal effects was found on both the early P2a and late P3 components, such that high arousing negative (HN) and low arousing positive (LP) pictures elicited larger P2a and P3 amplitudes than high arousing positive (HP) and low arousing negative (LN) pictures. These results are consistent with previous behavioral results showing that participants responded faster to HN and LP stimuli than to HP and LN stimuli [29]. Robinson and his colleagues [29] proposed that because high arousing stimuli, no matter whether positive or negative, are negatively coded, the HN and LP stimuli are thus congruent, whereas HP and LN stimuli are incongruent in the valence and arousal dimensions. The observed RT differences could be explained by assuming that valence-arousal-incongruent stimuli (HP and LN) are evaluated more slowly than valence-arousal-congruent stimuli (HN and LP). In another study with an affective Simon task, Eder and Rothermund further demonstrated that the congruency of valence and arousal dimensions can affect processings of stimuli even when participants do not attend to their affective contents. They thus concluded that arousal interacts with valence in stimulus processing, and such interactions occur preattentively [32]. In agreement with these behavioral studies, a recent ERP study found that the interaction between valence and arousal can occur within the interval 302–330 ms [4]. Using the ERP microstate analysis of topography, Gianocci and colleagues found an interesting “common step” between the processing of valence and arousal, such that the last microstate of valence extraction was identical to the first microstate of arousal extraction. This microstate lasted from 302 to 330 ms after the stimulus onset. The authors suggested that such a “common step” reflects the interaction between valence and arousal on affective processing [4].

Our results support and extend previous behavioral findings showing reaction time differences between HN & LP and HP & LN stimuli [29]. Our ERP results indicate that these behavioral differences might be associated with the P2a and P3 components. These results suggest that HN & LP stimuli evoke more affective processing at both early and late stages than HP & LN stimuli.

One possible theoretical explanation for our finding is based on the model of evaluative space proposed by Cacioppo et al. [33], [34]. According to this model, stimuli of low arousal will generate a positive offset that suggests a larger response to positive stimuli (positive offset), whereas stimuli of high arousal will generate an enhanced response to negative stimuli (negativity bias). Both positive offset and negativity bias have been observed in previous behavioral studies [29], [32] (but see [65] for exception), but only negativity bias has been emphasized in ERP studies [9], [66]; such valence effects in ERPs have been considered inconsistent, however [2]. Our results supported and extended previous behavioral findings by showing that positive offset and negativity bias effects can occur at both early (P2a) and later (P3) stages of processing.

In addition, we found a significant interaction between valence and arousal on the N2 component, but with a different pattern than P2a and P3, such that N2 amplitudes were larger for LN than LP, but were identical for HN and HP (Fig.3). Moreover, such an interaction was restricted to the right hemisphere. In previous studies, N2 has been considered as a complex component comprised of several sub-components, some reflecting automatic affective processing and others reflecting executive control processing [10]. The N2 effect found in the current study might be related to both of these. On the one hand, previous studies showed that the arousal effect can automatically modulate ERP components within 200–300 ms, even when the cognitive resource is limited [2], [14], [67]. For instance, compared to high arousing negative and positive pictures, low arousing neutral pictures elicit a negative going component within 200–300 ms at frontal sites [68], [69], even when pictures are briefly presented [14], [22]. Olofsson et al. proposed that the arousal effect between 200–300 ms is related to the amygdala's response to affective stimuli. In our study, we found that low arousing pictures elicited a more negative N2 than high arousing pictures; such arousal effects, however, were only found for negative stimuli [69]. These results suggest that the interaction between valence and arousal on the amygdala might occur within 200–300 ms. On the other hand, the N2 effects found in our study might reflect the valence-related influence on affective processing that has been attributed to the exertion of cognitive control on threat-related stimuli [10], [70], [71]. Consistent with this view, a recent fMRI study found that negative pictures elicit stronger dorsolateral prefrontal activation than positive pictures when participants perform an implicit task [70]. Additionally, the N2 effects we found were prevalent over the right hemisphere, which accords with previous studies showing that negative affective processing is primarily a function of the right hemisphere [67], . In either case, our study demonstrated that valence and arousal also played an interactive role in implicit affective processing at this stage.

In addition to the above-described interactions between valence and arousal, we also found a significant main effect of arousal on the posterior P2b component, such that high arousing pictures elicited larger P2b than low arousing pictures. Such an arousal effect has also been reported in previous studies [50], [75].

In reviewing ERP studies of affective processing in recent decades, Olofsson et al. suggested that valence modulates early ERP components and arousal modulates late ERP components [69]. The present results with implicit affective processing suggest that their proposal might be oversimplified. Two possible reasons might account for why our results were different from previous findings in emotion evaluation tasks. Firstly, participants in previous emotion evaluation tasks were asked to categorize emotional pictures, or simply to look at the emotional pictures. Such manipulations are likely to lead participants to assume that several kinds of affective stimuli (e.g., negative, high arousing stimuli) are more relevant to the task than others [7], [43], [44], [75]. Such a “relevance-for-task effect” has been found to modulate ERP components [44]. Thus, implicit tasks (such as the one used in the present study) might provide a better way to study the valence and arousal effects related to affective processing, because they could avoid the interference of the “relevance-for-task effect”. Secondly, according to the model of evaluation space proposed by Cacioppo [33], [76], when the evaluative activation is low, the intrinsic response of an individual to affective stimuli is that the motivation to explore is stronger than the motivation to avoid (positive offset). However, in previous emotion evaluation tasks (especially in the categorization task), participants were instructed to categorize affective pictures according to their valence, which means they were probably motivated to explore every presented picture. Such a manipulation might cause “task-related motivation”, which would influence the individual's intrinsic response to affective pictures. In contrast, participants in implicit tasks are asked to do tasks that are unrelated to the affective picture. Such a manipulation would avoid interference from “task-related motivation”; therefore the individual's intrinsic response to affective stimuli would be more likely to be observed in implicit tasks. In summary, using implicit tasks could avoid the “relevance-for-task effect” and “task-related motivation” that might interfere with an individual's intrinsic response to affective stimuli; this might explain why the results observed in the present study were different from prior findings with emotion evaluation tasks.

A limitation of the present study is that we did not screen participants in terms of possible anxiety or depressive states. Although previous behavioral and fMRI studies have observed that anxiety and depressive states modulate the processing of affective pictures [77], [78], [79], [80], [81], such influence has been frequently ignored in ERP studies [2], [17], [48], [51]. Several recent studies have indicated that ERPs elicited by affective pictures can be modulated by anxiety states [82], [83], [84], suggesting a promising approach to characterize clinical affective dysfunction [2]. Thus, the modulations of anxiety and depressive states on ERPs evoked by affective pictures deserve systematic investigation in future studies. Another limitation of the current study is that we did not add a blank screen between fixation and picture (see Figure 1) to avoid possible contamination of the ERPs evoked by pictures by a fixation offset effect. Although such an offset effect is generally weak [85], and similar stimulus sequences have been used in previous studies [82], [84], this experimental design flaw should be avoided in future studies.

Acknowledgments

We thank Xiyao Xie and Boqi Du for their assistance with data collection and Jinzhen Li for her comments on this paper.

Author Contributions

Conceived and designed the experiments: CF CL YL. Performed the experiments: CF LW XZ RD. Analyzed the data: CF. Contributed reagents/materials/analysis tools: YL. Wrote the paper: CF XM CL.

Citation: Feng C, Wang L, Liu C, Zhu X, Dai R, Mai X, et al. (2012) The Time Course of the Influence of Valence and Arousal on the Implicit Processing of Affective Pictures. PLoS ONE 7(1): e29668. https://doi.org/10.1371/journal.pone.0029668

References

1. LaBar KS, Cabeza R (2006) Cognitive neuroscience of emotional memory. Nature Reviews Neuroscience 7: 54–64.KS LaBarR. Cabeza2006Cognitive neuroscience of emotional memory.Nature Reviews Neuroscience75464

2. Olofsson JK, Nordin S, Sequeira H, Polich J (2008) Affective picture processing: An integrative review of ERP findings. Biological Psychology 77: 247–265.JK OlofssonS. NordinH. SequeiraJ. Polich2008Affective picture processing: An integrative review of ERP findings.Biological Psychology77247265

3. Lang PJ, Bradley MM, Cuthbert BN (2001) International affective picture system (IAPS): Instruction manual and affective ratings. PJ LangMM BradleyBN Cuthbert2001International affective picture system (IAPS): Instruction manual and affective ratings.Technical Report A-5, The Center for Research in Psychophysiology, University of Florida. Technical Report A-5, The Center for Research in Psychophysiology, University of Florida.

4. Gianotti LRR, Faber PL, Schuler M, Pascual-Marqui RD, Kochi K, et al. (2008) First Valence, Then Arousal: The Temporal Dynamics of Brain Electric Activity Evoked by Emotional Stimuli. Brain Topography 20: 143–156.LRR GianottiPL FaberM. SchulerRD Pascual-MarquiK. Kochi2008First Valence, Then Arousal: The Temporal Dynamics of Brain Electric Activity Evoked by Emotional Stimuli.Brain Topography20143156

5. Rozenkrants B, Olofsson JK, Polich J (2008) Affective visual event-related potentials: Arousal, valence, and repetition effects for normal and distorted pictures. International Journal of Psychophysiology 67: 114–123.B. RozenkrantsJK OlofssonJ. Polich2008Affective visual event-related potentials: Arousal, valence, and repetition effects for normal and distorted pictures.International Journal of Psychophysiology67114123

6. Baumeister RF, Bratslavsky E, Finkenauer C, Vohs KD (2001) Bad is stronger than good. Review of General Psychology 5: 323–370.RF BaumeisterE. BratslavskyC. FinkenauerKD Vohs2001Bad is stronger than good.Review of General Psychology5323370

7. Carretie L, Hinojosa JA, Albert J, Mercado F (2006) Neural response to sustained affective visual stimulation using an indirect task. Experimental Brain Research 174: 630–637.L. CarretieJA HinojosaJ. AlbertF. Mercado2006Neural response to sustained affective visual stimulation using an indirect task.Experimental Brain Research174630637

8. Delplanque S, Lavoie ME, Hot P, Silvert L, Sequeira H (2004) Modulation of cognitive processing by emotional valence studied through event-related potentials in humans. Neuroscience Letters 356: 1–4.S. DelplanqueME LavoieP. HotL. SilvertH. Sequeira2004Modulation of cognitive processing by emotional valence studied through event-related potentials in humans.Neuroscience Letters35614

9. Smith NK, Cacioppo JT, Larsen JT, Chartrand TL (2003) May I have your attention, please: Electrocortical responses to positive and negative stimuli. Neuropsychologia 41: 171–183.NK SmithJT CacioppoJT LarsenTL Chartrand2003May I have your attention, please: Electrocortical responses to positive and negative stimuli.Neuropsychologia41171183

10. Carretie L, Hinojosa JA, Martin-Loeches M, Mercado F, Tapia M (2004) Automatic attention to emotional stimuli: Neural correlates. Human Brain Mapping 22: 290–299.L. CarretieJA HinojosaM. Martin-LoechesF. MercadoM. Tapia2004Automatic attention to emotional stimuli: Neural correlates.Human Brain Mapping22290299

11. Hot P, Saito Y, Mandai O, Kobayashi T, Sequeira H (2006) An ERP investigation of emotional processing in European and Japanese individuals☆. Brain Research 1122: 171–178.P. HotY. SaitoO. MandaiT. KobayashiH. Sequeira2006An ERP investigation of emotional processing in European and Japanese individuals☆.Brain Research1122171178

12. Keil A, Bradley MM, Hauk O, Rockstroh B, Elbert T, et al. (2002) Large-scale neural correlates of affective picture processing. Psychophysiology 39: 641–649.A. KeilMM BradleyO. HaukB. RockstrohT. Elbert2002Large-scale neural correlates of affective picture processing.Psychophysiology39641649

13. Sass SM, Heller W, Stewart JL, Silton RL, Edgar JC, et al. (2010) Time course of attentional bias in anxiety: Emotion and gender specificity. Psychophysiology 47: 247–259.SM SassW. HellerJL StewartRL SiltonJC Edgar2010Time course of attentional bias in anxiety: Emotion and gender specificity.Psychophysiology47247259

14. Schupp HT, Junghofer M, Weike AI, Hamm AO (2003) Emotional facilitation of sensory processing in the visual cortex. Psychological Science 14: 7–13.HT SchuppM. JunghoferAI WeikeAO Hamm2003Emotional facilitation of sensory processing in the visual cortex.Psychological Science14713

15. Bradley MM, Hamby S, Löw A, Lang PJ (2007) Brain potentials in perception: Picture complexity and emotional arousal. Psychophysiology 44: 364–373.MM BradleyS. HambyA. LöwPJ Lang2007Brain potentials in perception: Picture complexity and emotional arousal.Psychophysiology44364373

16. Cuthbert BN, Schupp HT, Bradley MM, Birbaumer N, Lang PJ (2000) Brain potentials in affective picture processing: covariation with autonomic arousal and affective report. Biological Psychology 52: 95–111.BN CuthbertHT SchuppMM BradleyN. BirbaumerPJ Lang2000Brain potentials in affective picture processing: covariation with autonomic arousal and affective report.Biological Psychology5295111

17. Van Strien JW, Langeslag SJE, Strekalova NJ, Gootjes L, Franken IHA (2009) Valence interacts with the early ERP old/new effect and arousal with the sustained ERP old/new effect for affective pictures. Brain Research 1251: 223–235.JW Van StrienSJE LangeslagNJ StrekalovaL. GootjesIHA Franken2009Valence interacts with the early ERP old/new effect and arousal with the sustained ERP old/new effect for affective pictures.Brain Research1251223235

18. Briggs KE, Martin FH (2009) Affective picture processing and motivational relevance: Arousal and valence effects on ERPs in an oddball task. International Journal of Psychophysiology 72: 299–306.KE BriggsFH Martin2009Affective picture processing and motivational relevance: Arousal and valence effects on ERPs in an oddball task.International Journal of Psychophysiology72299306

19. Schupp HT, Cuthbert BN, Bradley MM, Cacioppo JT, Ito T, et al. (2000) Affective picture processing: The late positive potential is modulated by motivational relevance. Psychophysiology 37: 257–261.HT SchuppBN CuthbertMM BradleyJT CacioppoT. Ito2000Affective picture processing: The late positive potential is modulated by motivational relevance.Psychophysiology37257261

20. Rozenkrants B, Polich J (2008) Affective ERP processing in a visual oddball task: Arousal, valence, and gender. Clinical Neurophysiology 119: 2260–2265.B. RozenkrantsJ. Polich2008Affective ERP processing in a visual oddball task: Arousal, valence, and gender.Clinical Neurophysiology11922602265

21. Delplanque S, Silvert L, Hot P, Sequeira H (2005) Event-related P3a and P3b in response to unpredictable emotional stimuli. Biological Psychology 68: 107–120.S. DelplanqueL. SilvertP. HotH. Sequeira2005Event-related P3a and P3b in response to unpredictable emotional stimuli.Biological Psychology68107120

22. Schupp HT, Junghöfer M, Weike AI, Hamm AO (2004) The selective processing of briefly presented affective pictures: An ERP analysis. Psychophysiology 41: 441–449.HT SchuppM. JunghöferAI WeikeAO Hamm2004The selective processing of briefly presented affective pictures: An ERP analysis.Psychophysiology41441449

23. Conroy MA, Polich J (2007) Affective valence and P300 when stimulus arousal level is controlled. Cognition & Emotion 21: 891–901.MA ConroyJ. Polich2007Affective valence and P300 when stimulus arousal level is controlled.Cognition & Emotion21891901

24. Cano M, Class Q, Polich J (2009) Affective valence, stimulus attributes, and P300: Color vs. black/white and normal vs. scrambled images. International Journal of Psychophysiology 71: 17–24.M. CanoQ. ClassJ. Polich2009Affective valence, stimulus attributes, and P300: Color vs. black/white and normal vs. scrambled images.International Journal of Psychophysiology711724

25. Delplanque S, Silvert L, Hot P, Rigoulot S, Sequeira H (2006) Arousal and valence effects on event-related P3a and P3b during emotional categorization. International Journal of Psychophysiology 60: 315–322.S. DelplanqueL. SilvertP. HotS. RigoulotH. Sequeira2006Arousal and valence effects on event-related P3a and P3b during emotional categorization.International Journal of Psychophysiology60315322

26. Adolphs R, Russell JA, Tranel D (1999) A role for the human amygdala in recognizing emotional arousal from unpleasant stimuli. Psychological Science 10: 167–171.R. AdolphsJA RussellD. Tranel1999A role for the human amygdala in recognizing emotional arousal from unpleasant stimuli.Psychological Science10167171

27. Berntson GG, Bechara A, Damasio H, Tranel D, Cacioppo JT (2007) Amygdala contribution to selective dimensions of emotion. Social Cognitive and Affective Neuroscience 2: 123–129.GG BerntsonA. BecharaH. DamasioD. TranelJT Cacioppo2007Amygdala contribution to selective dimensions of emotion.Social Cognitive and Affective Neuroscience2123129

28. Garavan H, Pendergrass JC, Ross TJ, Stein EA, Risinger RC (2001) Amygdala response to both positively and negatively valenced stimuli. Neuroreport 12: 2779–2783.H. GaravanJC PendergrassTJ RossEA SteinRC Risinger2001Amygdala response to both positively and negatively valenced stimuli.Neuroreport1227792783

29. Robinson MD, Storbeck J, Meier BP, Kirkeby BS (2004) Watch out! That could be dangerous: Valence-arousal interactions in evaluative processing. Personality and Social Psychology Bulletin 30: 1472–1484.MD RobinsonJ. StorbeckBP MeierBS Kirkeby2004Watch out! That could be dangerous: Valence-arousal interactions in evaluative processing.Personality and Social Psychology Bulletin3014721484

30. Steinmetz KRM, Addis DR, Kensinger EA (2010) The effect of arousal on the emotional memory network depends on valence. NeuroImage 53: 318–324.KRM SteinmetzDR AddisEA Kensinger2010The effect of arousal on the emotional memory network depends on valence.NeuroImage53318324

31. Lewis PA, Critchley HD, Rotshtein P, Dolan RJ (2007) Neural correlates of processing valence and arousal in affective words. Cerebral Cortex 17: 742–748.PA LewisHD CritchleyP. RotshteinRJ Dolan2007Neural correlates of processing valence and arousal in affective words.Cerebral Cortex17742748

32. Eder A, Rothermund K (2010) Automatic influence of arousal information on evaluative processing: Valence-arousal interactions in an affective Simon task. Cognition & Emotion 24: 1053–1061.A. EderK. Rothermund2010Automatic influence of arousal information on evaluative processing: Valence-arousal interactions in an affective Simon task.Cognition & Emotion2410531061

33. Cacioppo JT, Berntson GG (1994) Relationship between Attitudes and Evaluative Space - a Critical-Review, with Emphasis on the Separability of Positive and Negative Substrates. Psychological Bulletin 115: 401–423.JT CacioppoGG Berntson1994Relationship between Attitudes and Evaluative Space - a Critical-Review, with Emphasis on the Separability of Positive and Negative Substrates.Psychological Bulletin115401423

34. Cacioppo JT, Gardner WL, Berntson GG (1997) Beyond bipolar conceptualizations and measures: The case of attitudes and evaluative space. Personality and Social Psychology Bulletin 1: 3–25.JT CacioppoWL GardnerGG Berntson1997Beyond bipolar conceptualizations and measures: The case of attitudes and evaluative space.Personality and Social Psychology Bulletin1325

35. Cacioppo JT, Gardner WL, Berntson GG (1999) The affect system has parallel and integrative processing components: Form follows function. Journal of Personality and Social Psychology 76: 839–855.JT CacioppoWL GardnerGG Berntson1999The affect system has parallel and integrative processing components: Form follows function.Journal of Personality and Social Psychology76839855

36. Ito T, Cacioppo JT, Lang PJ (1998) Eliciting affect using the international affective picture system: Trajectories through evaluative space. Personality and Social Psychology Bulletin 24: 855–879.T. ItoJT CacioppoPJ Lang1998Eliciting affect using the international affective picture system: Trajectories through evaluative space.Personality and Social Psychology Bulletin24855879

37. Ito T, Cacioppo JT (2001) Affect and attitudes: A social neuroscience approach. In: Forgas JP, editor. The handbook of affect and social cognition. Hilllsdale, NJ: Erlbaum. pp. 50–74.T. ItoJT Cacioppo2001Affect and attitudes: A social neuroscience approach.JP ForgasThe handbook of affect and social cognitionHilllsdale, NJErlbaum5074

38. Ito T, Cacioppo JT (2005) Variations on a human universal: Individual differences in positivity offset and negativity bias. Cognition & Emotion 19: 1–26.T. ItoJT Cacioppo2005Variations on a human universal: Individual differences in positivity offset and negativity bias.Cognition & Emotion19126

39. Rowe G, Hirsh JB, Anderson AK (2007) Positive affect increases the breadth of attentional selection. Proceedings of the National Academy of Sciences of the United States of America 104: 383–388.G. RoweJB HirshAK Anderson2007Positive affect increases the breadth of attentional selection.Proceedings of the National Academy of Sciences of the United States of America104383388

40. Winston JS, Gottfried JA, Kilner JM, Dolan RJ (2005) Integrated neural representations of odor intensity and affective valence in human amygdala. Journal of Neuroscience 25: 8903–8907.JS WinstonJA GottfriedJM KilnerRJ Dolan2005Integrated neural representations of odor intensity and affective valence in human amygdala.Journal of Neuroscience2589038907

41. van Lankveld JJDM, Smulders FTY (2008) The effect of visual sexual content on the event-related potential. Biological Psychology 79: 200–208.JJDM van LankveldFTY Smulders2008The effect of visual sexual content on the event-related potential.Biological Psychology79200208

42. Bernat E, Bunce S, Shevrin H (2001) Event-related brain potentials differentiate positive and negative mood adjectives during both supraliminal and subliminal visual processing. International Journal of Psychophysiology 42: 11–34.E. BernatS. BunceH. Shevrin2001Event-related brain potentials differentiate positive and negative mood adjectives during both supraliminal and subliminal visual processing.International Journal of Psychophysiology421134

43. Carretie L, Iglesias J, Garcia T (1997) A study on the emotional processing of visual stimuli through event-related potentials. Brain and Cognition 34: 207–217.L. CarretieJ. IglesiasT. Garcia1997A study on the emotional processing of visual stimuli through event-related potentials.Brain and Cognition34207217

44. Carretie L, Iglesias J, Garcia T, Ballesteros M (1997) N300, P300 and the emotional processing of visual stimuli. Electroencephalography and Clinical Neurophysiology 103: 298–303.L. CarretieJ. IglesiasT. GarciaM. Ballesteros1997N300, P300 and the emotional processing of visual stimuli.Electroencephalography and Clinical Neurophysiology103298303

45. Carretie L, Hinojosa JA, Mercado F, Tapia M (2005) Cortical response to subjectively unconscious danger. NeuroImage 24: 615–623.L. CarretieJA HinojosaF. MercadoM. Tapia2005Cortical response to subjectively unconscious danger.NeuroImage24615623

46. Diedrich O, Naumann E, Maier S, Becker G, Bartussek D (1997) A frontal positive slow wave in the ERP associated with emotional slides. Journal of Psychophysiology 11: 71–84.O. DiedrichE. NaumannS. MaierG. BeckerD. Bartussek1997A frontal positive slow wave in the ERP associated with emotional slides.Journal of Psychophysiology117184

47. Hajcak G, Moser JS, Simons RF (2006) Attending to affect: Appraisal strategies modulate the electrocortical response to arousing pictures. Emotion 6: 517–522.G. HajcakJS MoserRF Simons2006Attending to affect: Appraisal strategies modulate the electrocortical response to arousing pictures.Emotion6517522

48. Schupp HT, Stockburger J, Codispoti M, Junghofer M, Weike AI, et al. (2007) Selective visual attention to emotion. Journal of Neuroscience 27: 1082–1089.HT SchuppJ. StockburgerM. CodispotiM. JunghoferAI Weike2007Selective visual attention to emotion.Journal of Neuroscience2710821089

49. De Cesarei A, Codispoti M (2006) When does size not matter? Effects of stimulus size on affective modulation. Psychophysiology 43: 207–215.A. De CesareiM. Codispoti2006When does size not matter? Effects of stimulus size on affective modulation.Psychophysiology43207215

50. Carretie L, Mercado F, Tapia M, Hinojosa JA (2001) Emotion, attention, and the ‘negativity bias’, studied through event-related potentials. International Journal of Psychophysiology 41: 75–85.L. CarretieF. MercadoM. TapiaJA Hinojosa2001Emotion, attention, and the ‘negativity bias’, studied through event-related potentials.International Journal of Psychophysiology417585

51. Yuan JJ, Zhang QL, Chen AT, Li H, Wang QH, et al. (2007) Are we sensitive to valence differences in emotionally negative stimuli? Electrophysiological evidence from an ERP study. Neuropsychologia 45: 2764–2771.JJ YuanQL ZhangAT ChenH. LiQH Wang2007Are we sensitive to valence differences in emotionally negative stimuli? Electrophysiological evidence from an ERP study.Neuropsychologia4527642771

52. Kunde W, Mauer N (2008) Sequential modulations of valence processing in the emotional Stroop task. Experimental Psychology 55: 151–156.W. KundeN. Mauer2008Sequential modulations of valence processing in the emotional Stroop task.Experimental Psychology55151156

53. Li XY, Li XB, Luo YJ (2005) Anxiety and attentional bias for threat: an event-related potential study. Neuroreport 16: 1501–1505.XY LiXB LiYJ Luo2005Anxiety and attentional bias for threat: an event-related potential study.Neuroreport1615011505

54. Zhong MT, Zhu XZ, Yi JY, Yao SQ, Atchley RA (2011) Do the early attentional components of ERPs reflect attentional bias in depression? It depends on the stimulus presentation time. Clinical Neurophysiology 122: 1371–1381.MT ZhongXZ ZhuJY YiSQ YaoRA Atchley2011Do the early attentional components of ERPs reflect attentional bias in depression? It depends on the stimulus presentation time.Clinical Neurophysiology12213711381

55. Brainard DH (1997) The Psychophysics Toolbox. Spatial Vision 10: 433–436.DH Brainard1997The Psychophysics Toolbox.Spatial Vision10433436

56. Pelli DG (1997) The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision 10: 437–442.DG Pelli1997The VideoToolbox software for visual psychophysics: Transforming numbers into movies.Spatial Vision10437442

57. Makarchouk NE, Maksimovich KY, Kravchenko VI, Kryzhanovskii SA (2011) Modifications of EEG Activity Related to Perception of Emotionally Colored, Erotic, and Neutral Pictures in Women during Different Phases of the Ovulatory (Menstrual) Cycle. Neurophysiology 42: 362–370.NE MakarchoukKY MaksimovichVI KravchenkoSA Kryzhanovskii2011Modifications of EEG Activity Related to Perception of Emotionally Colored, Erotic, and Neutral Pictures in Women during Different Phases of the Ovulatory (Menstrual) Cycle.Neurophysiology42362370

58. van Hooff JC, Dietz KC, Sharma D, Bowman H (2008) Neural correlates of intrusion of emotion words in a modified Stroop task. International Journal of Psychophysiology 67: 23–34.JC van HooffKC DietzD. SharmaH. Bowman2008Neural correlates of intrusion of emotion words in a modified Stroop task.International Journal of Psychophysiology672334

59. Taake I, Jaspers-Fayer F, Liotti M (2009) Early frontal responses elicited by physical threat words in an emotional Stroop task: Modulation by anxiety sensitivity. Biological Psychology 81: 48–57.I. TaakeF. Jaspers-FayerM. Liotti2009Early frontal responses elicited by physical threat words in an emotional Stroop task: Modulation by anxiety sensitivity.Biological Psychology814857

60. Luck SJ (2005) An introduction to the event-related potential technique. Cambridge, MA: MIT press. SJ Luck2005An introduction to the event-related potential techniqueCambridge, MAMIT press

61. Gratton G, Coles MGH (1989) Generalization and evaluation of eye movement correction procedures. Journal of Psychophysiology 3: 14–16.G. GrattonMGH Coles1989Generalization and evaluation of eye movement correction procedures.Journal of Psychophysiology31416

62. Li H, Yuan JJ, Lin CD (2008) The neural mechanism underlying the female advantage in identifying negative emotions: An event-related potential study. NeuroImage 40: 1921–1929.H. LiJJ YuanCD Lin2008The neural mechanism underlying the female advantage in identifying negative emotions: An event-related potential study.NeuroImage4019211929

63. Huang YX, Luo YJ (2006) Temporal course of emotional negativity bias: An ERP study. Neuroscience Letters 398: 91–96.YX HuangYJ Luo2006Temporal course of emotional negativity bias: An ERP study.Neuroscience Letters3989196

64. Kemp AH, Gray MA, Eide P, Silberstein RB, Nathan PJ (2002) Steady-state visually evoked potential topography during processing of emotional valence in healthy subjects. NeuroImage 17: 1684–1692.AH KempMA GrayP. EideRB SilbersteinPJ Nathan2002Steady-state visually evoked potential topography during processing of emotional valence in healthy subjects.NeuroImage1716841692

65. Corson Y, Verrier N (2007) Emotions and false memories - Valence or arousal? Psychological Science 18: 208–211.Y. CorsonN. Verrier2007Emotions and false memories - Valence or arousal?Psychological Science18208211

66. Ito TA, Larsen JT, Smith NK, Cacioppo JT (1998) Negative information weighs more heavily on the brain: The negativity bias in evaluative categorizations. Journal of Personality and Social Psychology 75: 887–900.TA ItoJT LarsenNK SmithJT Cacioppo1998Negative information weighs more heavily on the brain: The negativity bias in evaluative categorizations.Journal of Personality and Social Psychology75887900

67. Junghofer M, Bradley MM, Elbert TR, Lang PJ (2001) Fleeting images: A new look at early emotion discrimination. Psychophysiology 38: 175–178.M. JunghoferMM BradleyTR ElbertPJ Lang2001Fleeting images: A new look at early emotion discrimination.Psychophysiology38175178

68. Amrhein C, Muhlberger A, Pauli P, Wiedemann G (2004) Modulation of event-related brain potentials during affective picture processing: a complement to startle reflex and skin conductance response? International Journal of Psychophysiology 54: 231–240.C. AmrheinA. MuhlbergerP. PauliG. Wiedemann2004Modulation of event-related brain potentials during affective picture processing: a complement to startle reflex and skin conductance response?International Journal of Psychophysiology54231240

69. Olofsson JK, Polich J (2007) Affective visual event-related potentials: Arousal, repetition, and time-on-task. Biological Psychology 75: 101–108.JK OlofssonJ. Polich2007Affective visual event-related potentials: Arousal, repetition, and time-on-task.Biological Psychology75101108

70. Nielen MMA, Heslenfeld DJ, Heinen K, Van Strien JW, Witter MP, et al. (2009) Distinct brain systems underlie the processing of valence and arousal of affective pictures. Brain and Cognition 71: 387–396.MMA NielenDJ HeslenfeldK. HeinenJW Van StrienMP Witter2009Distinct brain systems underlie the processing of valence and arousal of affective pictures.Brain and Cognition71387396

71. Compton RJ, Banich MT, Mohanty A, Milham MP, Herrington J, et al. (2003) Paying attention to emotion: An fMRI investigation of cognitive and emotional Stroop tasks. Cognitive, Affective, & Behavioral Neuroscience 3: 81–96.RJ ComptonMT BanichA. MohantyMP MilhamJ. Herrington2003Paying attention to emotion: An fMRI investigation of cognitive and emotional Stroop tasks.Cognitive, Affective, & Behavioral Neuroscience38196

72. Dolcos F, LaBar KS, Cabeza R (2004) Dissociable effects of arousal and valence on prefrontal activity indexing emotional evaluation and subsequent memory: an event-related fMRI study. NeuroImage 23: 64–74.F. DolcosKS LaBarR. Cabeza2004Dissociable effects of arousal and valence on prefrontal activity indexing emotional evaluation and subsequent memory: an event-related fMRI study.NeuroImage236474

73. Grimm S, Schmidt CF, Bermpohl F, Heinzel A, Dahlem Y, et al. (2006) Segregated neural representation of distinct emotion dimensions in the prefrontal cortex - an fMRI study. NeuroImage 30: 325–340.S. GrimmCF SchmidtF. BermpohlA. HeinzelY. Dahlem2006Segregated neural representation of distinct emotion dimensions in the prefrontal cortex - an fMRI study.NeuroImage30325340

74. Schupp HT, Stockburger J, Codispoti M, Junghofer M, Weike AI, et al. (2006) Stimulus novelty and emotion perception: the near absence of habituation in the visual cortex. Neuroreport 17: 365–369.HT SchuppJ. StockburgerM. CodispotiM. JunghoferAI Weike2006Stimulus novelty and emotion perception: the near absence of habituation in the visual cortex.Neuroreport17365369

75. Carretie L, Martin-Loeches M, Hinojosa JA, Mercado F (2001) Emotion and attention interaction studied through event-related potentials. Journal of Cognitive Neuroscience 13: 1109–1128.L. CarretieM. Martin-LoechesJA HinojosaF. Mercado2001Emotion and attention interaction studied through event-related potentials.Journal of Cognitive Neuroscience1311091128

76. Cacioppo JT, Gardner WL, Berntson GG (1997) Beyond bipolar conceptualizations and measures: the case of attitudes and evaluative space. Personality and Social Psychology Review 1: 3–25.JT CacioppoWL GardnerGG Berntson1997Beyond bipolar conceptualizations and measures: the case of attitudes and evaluative space.Personality and Social Psychology Review1325

77. Anand A, Li Y, Wang Y, Wu JW, Gao SJ, et al. (2005) Activity and connectivity of brain mood regulating circuit in depression: A functional magnetic resonance study. Biological Psychiatry 57: 1079–1088.A. AnandY. LiY. WangJW WuSJ Gao2005Activity and connectivity of brain mood regulating circuit in depression: A functional magnetic resonance study.Biological Psychiatry5710791088

78. Hamilton JP, Gotlib IH (2008) Neural substrates of increased memory sensitivity for negative stimuli in major depression. Biological Psychiatry 63: 1155–1162.JP HamiltonIH Gotlib2008Neural substrates of increased memory sensitivity for negative stimuli in major depression.Biological Psychiatry6311551162

79. Yiend J, Mathews A (2001) Anxiety and attention to threatening pictures. Quarterly Journal of Experimental Psychology Section a-Human Experimental Psychology 54: 665–681.J. YiendA. Mathews2001Anxiety and attention to threatening pictures.Quarterly Journal of Experimental Psychology Section a-Human Experimental Psychology54665681

80. Smith JC, Bradley MM, Lang PJ (2005) State anxiety and affective physiology: effects of sustained exposure to affective pictures. Biological Psychology 69: 247–260.JC SmithMM BradleyPJ Lang2005State anxiety and affective physiology: effects of sustained exposure to affective pictures.Biological Psychology69247260

81. Koster EHW, Verschuere B, Crombez G, Van Damme S (2005) Time-course of attention for threatening pictures in high and low trait anxiety. Behaviour Research and Therapy 43: 1087–1098.EHW KosterB. VerschuereG. CrombezS. Van Damme2005Time-course of attention for threatening pictures in high and low trait anxiety.Behaviour Research and Therapy4310871098

82. MacNamara A, Hajcak G (2009) Anxiety and spatial attention moderate the electrocortical response to aversive pictures. Neuropsychologia 47: 2975–2980.A. MacNamaraG. Hajcak2009Anxiety and spatial attention moderate the electrocortical response to aversive pictures.Neuropsychologia4729752980

83. MacNamara A, Hajcak G (2009) Spatial Attention and Anxiety Moderate the Late Positive Potential. Psychophysiology 46: S106–S106.A. MacNamaraG. Hajcak2009Spatial Attention and Anxiety Moderate the Late Positive Potential.Psychophysiology46S106S106

84. MacNamara A, Hajcak G (2010) Distinct Electrocortical and Behavioral Evidence for Increased Attention to Threat in Generalized Anxiety Disorder. Depression and Anxiety 27: 234–243.A. MacNamaraG. Hajcak2010Distinct Electrocortical and Behavioral Evidence for Increased Attention to Threat in Generalized Anxiety Disorder.Depression and Anxiety27234243

85. Zhao L (2004) A tutorial of the event-related potential technique. Tianjin: Tianjin Academy of Social Sciences Publishing House. L. Zhao2004A tutorial of the event-related potential techniqueTianjinTianjin Academy of Social Sciences Publishing House