The Temporal Experience of Pleasure Scale (TEPS): Exploration and Confirmation of Factor Structure in a Healthy Chinese Sample

Abstract

Background

The Temporal Experience of Pleasure Scale (TEPS) is a measure specifically designed to capture the anticipatory and consummatory facets of pleasure. However, few studies have examined the structure of the measure in non-Western samples. The current study aimed to evaluate the factor structure and psychometric properties of the TEPS in a Chinese sample.

Methods

We administered the Chinese version of the TEPS to 2275 healthy Chinese college students. They were randomly split into two sub-samples. The first sub-sample was used for exploratory factor analysis (EFA) to examine the structure of the TEPS in a Chinese sample. The second sub-sample was used as a validation sample for the identified structure from the EFA and confirmatory factor analysis (CFA) was adopted.

Results

Results of the EFA suggested a four-factor model (consummatory contextual, consummatory abstract, anticipatory contextual, and anticipatory abstract factors) instead of the original two-factor model (consummatory and anticipatory factors) ascertained from Western samples in the United States. The CFA results confirmed these results in the second sub-sample. Internal consistency and test-retest stability of the TEPS factors were good.

Conclusions

The TEPS has four factors among Chinese participants. Possible reasons for cultural difference and potential applications of the TEPS for cross-cultural comparison are discussed.

About the Authors:

Raymond C. K. Chan

* E-mail: [email protected]

Affiliation: Neuropsychology and Applied Cognitive Neuroscience Laboratory, Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China

Yan-fang Shi

Affiliations Neuropsychology and Applied Cognitive Neuroscience Laboratory, Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China, Graduate School, Chinese Academy of Sciences, Beijing, China

Man-kin Lai

Affiliation: Network for Health and Welfare Studies, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China

Yu-na Wang

Affiliations Neuropsychology and Applied Cognitive Neuroscience Laboratory, Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China, Graduate School, Chinese Academy of Sciences, Beijing, China

Ya Wang

Affiliation: Neuropsychology and Applied Cognitive Neuroscience Laboratory, Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China

Ann M. Kring

Affiliation: Department of Psychology, University of California, Berkeley, California, United States of America

Introduction

Anhedonia is one of the negative symptoms of schizophrenia and is also a key feature of depression associated with social functioning in these patients [1], [2]. Anhedonia refers to the loss or a reduction of the ability to experience pleasure [3]. In addition, similar emotional and personality disturbances have also been demonstrated in individuals at-risk for psychosis (c.f. [4]) and sub-clinical individuals with depressive symptoms (e.g., [5]). Klein [3] argues that anticipatory pleasure involves a feeling of wanting and is associated with motivation and goal-directed behavior, whereas consummatory pleasure involves a feeling of liking and is associated with satiation, or a resolution/fulfilling of a desire. Empirical evidence from social cognitive neuroscience and affective science also supports the distinction between consummatory pleasure and anticipatory pleasure [6]–[12].

However, most of the measures of anhedonia are limited to clinical rating scales and self-report trait questionnaires that adopt a unitary concept, particularly the in-the-moment experience of pleasure or consummatory pleasure (c.f. [4]). Anticipatory pleasure has not been as thoroughly studied. Despite the fact that many studies employ questionnaire based methods to assess trait positive emotion (e.g., [13]–[15]) and in-the-moment experience, very few scales or questionnaires have been designed to capture both anticipatory and consummatory constructs of pleasure.

Gard et al. [16] developed the Temporal Experience of Pleasure Scale (TEPS) to specifically capture these two distinct constructs of anticipatory and consummatory pleasure. It is a short questionnaire with 18 self-reported items (10 items for anticipatory pleasure, 8 for consummatory pleasure) allowing for easy administration. Examination of the scale factor structure in North American samples showed that the TEPS comprised the hypothesized 2-factor model for anticipatory and consummatory pleasure among 4 independent samples of university students [16]. Gard et al. [17] also demonstrated that patients with schizophrenia anticipated less pleasure from future activities than healthy controls during the course of daily life, and thereby, provided further evidence for the deficit of anticipatory pleasure in schizophrenia.

However, all the aforementioned findings were derived from Western samples. Given the potential for cultural differences of emotional experience between Western and Eastern people, the two factors in the TEPS may not fully capture cultural influences. For example, Chinese culture emphasizes the internal and external harmonious conditions between self and external environment as well as body and mind, i.e., the concept of Yi-Yang and Taoism [18]. Individuals are obligated to maintain their own internal harmonious condition through adjusting themselves to “context”. According to this belief, harmony is more or less equivalent to pleasure. Chinese people report lower frequency and intensity of emotional experience as compared to their Western counterparts [19]–[21]. One pilot study using the Chinese version of TEPS [22] showed impressive clinical utility of this scale in differentiating patients with schizophrenia characterized by negative symptoms from those patients without negative symptoms. However, the psychometric properties of the Chinese version of TEPS have not been fully examined.

The current study aimed to examine the factor structure of the TEPS in a large Chinese sample of healthy people. Given the cultural differences between the East and the West, we hypothesized that Chinese people would take less account of the difference in context between present and future time points when they prospect the future, as opposed to their Western counterparts. The secondary aim was to evaluate the internal consistency and test-retest reliability of the translated TEPS at a 4-week interval

Methods

Participants

This study involved three samples. Two thousand two hundred and seventy five undergraduates from four colleges/universities in Guangzhou and Beijing were split randomly into samples A and B. These colleges/universities were Guangdong Jidian Polytechnic, Sun Yat-Sen University at Guangzhou, Beijing Institute of Clothing Technology and Beijing Forestry University. Sample A consisted of 909 men and 247 women (mean age = 19.34 years, SD = 0.98), while sample B consisted of 870 men and 249 women (mean age = 19.36 years, SD = 0.98). There were no significant differences between the samples in gender, age and years of education. Both samples A and B were used to examine the factor structure of the TEPS. Participants in sample C were college students from Sun Yat-Sen University at Zhuhai and comprised 21 men and 35 women (mean age = 19.79 years, SD = 0.87). Individuals in sample C completed the TEPS on two occasions with a 4-week interval in between to assess test-retest reliability. All participants were native Mandarin speakers.

The Chinese version of TEPS

The original English version of TEPS [16] is an 18-item, 6-point-Likert-format measure of anticipatory pleasure and consummatory pleasure. The current study followed the guidelines suggested by Beaton et al. [23] for cross-cultural translation of self-report measures. A panel comprised of 2 doctorate degree experts in psychology assessed these 18 items and found 2 of them (Item 5“I love it when people play with my hair” & item 11“When I'm on my way to an amusement park, I can hardly wait to ride the roller coasters”) to be a poor fit with Chinese culture traditions. The situation described in item 5 could be deemed offensive because most Chinese people consider the head to be an important body part referring to one's dignity and it's thus “to be sacred and inviolable”. For item 11, roller coasters might be popular among young people but not older people. For these considerations, we added two new items into the scale, one anticipatory and one consummatory (items 19, and 20; all items shown in Table 2). The final Chinese version of TEPS comprises 20 items with the same response format as the original English version, i.e., using a 6-point Likert scale (from 1 = very false for me to 6 = very true for me).

Ethical Statement

The current study was approved by the ethics committee of the Institute of Psychology, Chinese Academy of Sciences in Beijing. Written consent was obtained from participants before the administration of the questionnaires.

Data analysis

A 2-stage factor analysis approach was adopted to examine the factor structure of the translated TEPS. Sample A was analyzed using exploratory principal component factor analysis (EFA), whereas Sample B was analyzed using confirmatory factor analysis (CFA) in order to validate the identified factor structure from the EFA. Violation of normality in the variables is a problem with the maximum likelihood estimation method employed by CFA [24]. The Satorra-Bentler [25] and Bollen-Stine bootstrapping [26], [27] methods were adopted to overcome this problem in the current study. The Satorra-Bentler approach rescales chi-square statistics and estimates robust standard errors [25], whereas the Bollen-Stine bootstrapping method re-samples the data to calculate chi-square model fit statistics corrected for bias and estimates standard errors for significant tests [26], [27].

All the data preparation and EFA analyses were performed using SPSS 15.0 and the CFAs using the Satorra-Bentler approach were performed with LISREL 8.70 [28]. The Bollen-Stine bootstrap method was performed using the modified method for missing data in EQS 6.1 under the name Beran-Stine-Bentler bootstrapping procedure [29]. The number of bootstrap samples was selected to maximize accuracy of the evaluation of model fit [30], [31]. A moderate to large bootstrap sample size (N = 200 or above) was suggested [31], and a sample of 250 was found to be effective in producing fewer convergence failures due to non-normality [30].

Cronbach's alphas were computed to determine the internal consistency of the Chinese version of TEPS. Test-retest reliabilities were calculated at a 4-week interval from sample C.

Results

EPA and CFA

Item-total correlation analyses were performed on the 20 items of the Chinese version of TEPS in sample A of 1156 participants. Item 13, “I don't look forward to things like eating out at restaurants. (Anticipatory)”, had no or very low correlations with other items and was discarded in further analyses (Tables 1 and 2). Examination of the scree plot indicated a four-factor solution. Consistent with the two-factor model proposed by Gard et al [16], two of the four factors belonged to the Consummatory factor and the other two belonged to the Anticipatory factor. The two new items (19 and 20) loaded on the consummatory and anticipatory factors respectively as hypothesized.

[Figure omitted. See PDF.]

Table 1. Correlation matrix of the 20 items of the Chinese translated version of TEPS in the 1156 calibration sample of Chinese participants.

https://doi.org/10.1371/journal.pone.0035352.t001

[Figure omitted. See PDF.]

Table 2. Factor loadings of the 4-factor solution for the translated 19-item TEPS in the calibration sample.

https://doi.org/10.1371/journal.pone.0035352.t002

Examination of the meaning in the items of the four factors revealed additional dimensions of the TEPS in Chinese, and the dimensions were named abstract and contextual. Therefore, the four factors of the Chinese version of TEPS were: Abstract Anticipatory (anticipation of something that is more abstract or broad in nature such as “I look forward to a lot of things in my life.”), Contextual Anticipatory (anticipation of something that is more concrete in nature such as “When I think of something tasty, like a chocolate chip cookie, I have to have one.”), Abstract Consummatory (consummation of emotional experience of something that is more abstract or less concrete in nature such as “I enjoy taking a deep breath of fresh air when I walk outside.”) and Contextual Consummatory (consummatory of emotional experience of more concrete in nature such as “When I think about eating my favorite food, I can almost taste how good it is.”). It was noteworthy that items 5 and 19 had low factor loadings on the Contextual Anticipatory factor (factor loading = 0.36) and the Abstract Consummatory factor (factor loading = 0.28), respectively. In addition, item 19 tended to have a cross factor loading on the Contextual Consummatory factors. In order to address this issue in the CFA analyses, we performed the CFA analyses with and without these two items. However, the overall fit for all studied models without these two items was not satisfactory. After consideration of the findings from both the EFA and CFA, we decided to retain these two items in the CFA analyses presented in the next paragraph.

In addition to the original Gard et al. [16] two-factor model and the current EFA four-factor model, a second-order four-factor model was also tested with CFA [32]. That is, the four factors of TEPS could be further factor analyzed into the original Anticipatory and Consummatory factors. All three models were tested using the SB approach with the validation sample of 1119 participants (sample B), and the four-factor model identified by the EFA yielded the best fit (Table 3). The more computationally intensive Bollen-Stine bootstrapping approach was performed only on the four-factor model. Means and 95% confidence intervals (CIs) for the fit indices and factor loadings (Figure 1 loadings plus mean+95% CI) were presented side by side with the estimates obtained by the SB approach. Estimates were within the 95% CIs unless the estimates were dependent on the sample size, which showed better results using the bootstrapping method. The two-stage factor analysis using EFA and CFA on two randomly drawn sub-samples, and the convergence of the CFA results using the SB method and the Bollen-Stine bootstrapping method provided strong empirical support for the four-factor structure of the Chinese version of TEPS.

[Figure omitted. See PDF.]

Figure 1. Four-factor model of the Chinese translated TEPS in the validation sample – Factor loadings and correlations between factors estimated by the Satorra-Bentler (SB) method, and their means (which is the same as the estimates by the SB method at 2 decimal places) and 95% confidence intervals (in brackets) estimated by the Bollen-Stine bootstrapping method.

https://doi.org/10.1371/journal.pone.0035352.g001

[Figure omitted. See PDF.]

Table 3. Evaluative measures of model fit by the three models, and the Bollen-Stine bootstrap estimates for the 4-factor model in the 1119 validation sample of Chinese participants.

https://doi.org/10.1371/journal.pone.0035352.t003

Internal consistency and test-retest reliability

Samples A and B were merged to calculate the internal consistency. Cronbach's α of the four factors were as follows: Abstract Anticipatory = 0.69; Contextual Anticipatory = 0.63; Abstract Consummatory = 0.72; Contextual Consummatory = 0.60. Internal consistency for the total scale was 0.83. Test-retest reliabilities were very good (r = 0.79 to 0.81, p<0.0005) from sample C, suggesting that the measure is assessing stable trait-like experiences.

Discussion

Through testing two alternative models: the original two-factor model by Gard et al. [16] and a four-factor model, we found that the four-factor model, namely the anticipatory contextual, anticipatory abstract, consummatory contextual, and consummatory abstract, was a better fit to the current study's large Chinese sample. The current findings were broadly consistent with Western findings that subjective experience of pleasure can be classified into consummatory and anticipatory components [16], [17]. However, our findings further showed that both the consummatory and anticipatory factors could be further sub-divided into abstract and contextual factors in the Chinese context.

Because selecting information from memory to represent the future is highly relevant to an individual's goals, beliefs and concerns [33], it is possible that frequency of events will facilitate access to reaching them in memory. For the consummatory aspect of the TEPS, those contextual items refer to more physical feelings such as satiation to food, may occur more frequently during daily life than more abstract items. If these experiences are more readily recalled, they may be perceived as subjectively closer to the present by Chinese individuals. The focus on food and eating, an obviously common experience, may also help explain why two anticipatory items from the original TEPS fit on the Contextual Consummatory factor in the Chinese context.

Anecdotally, Chinese respondents took longer to rate the anticipatory abstract items of the TEPS which described very general events. Perhaps it was more difficult for them to envision a non-specific event since they relied on past experience to answer contextual items and were less able to do so for abstract items. However, since the previous studies in other countries did not take the account the response time to rate the anticipatory items, we do not know whether it is really more difficult for Chinese participants to envision a non-specific event than their Western counterparts.

It is important to note that the current findings are not directly comparable to the Western studies of the TEPS because there are differences in statistical approach and other methodological factors (e.g., nature of the study samples). Indeed, given the complexity of cultural differences, and the absence of any non-Chinese comparison group, the current study only provides preliminary evidence for cross-cultural aspects to the temporal experience of pleasure. Without comparable cross-cultural samples between Chinese and Westerner counterparts, we are not confident that the 4 factors generated from the current Chinese sample reflect true cultural differences. The current findings might be either due to cultural or language factors (along with sampling bias and measurement error). Further studies using more rigorous approaches and objective methods such as behavioral experiments [17] and brain imaging paradigms [34] are required to further validate these potential cross-cultural variations of the temporal experience of pleasure. Similarly, it is noteworthy that the labels of “abstract” versus “contextual” appear appropriate for the anticipatory items. However, this dichotomy does not seem to fit as well in distinguishing the two consummatory factors. That is, the items on the “abstract” consummatory factor may also refer to specific contextual pleasures. Indeed, the idea of a consummatory pleasure may be inherently contextual. Moreover, future studies should expand the healthy group size and include community samples in order to cross validate the current factors, particularly to distinguish the two consummatory factors, and to determine whether this Chinese version of TEPS, which includes one more directly social anticipatory item than the original TEPS, will maintain its usefulness in community settings.

In a preliminary study of the TEPS in Chinese patients with schizophrenia [22], we found that patients with minimal negative symptoms experienced significantly more pleasure in contextual anticipatory and contextual consummatory factors than negative symptom patients. Those patients with minimal negative symptoms also exhibited a tendency to experience more abstract anticipatory pleasure than negative symptom ones but there was no significant difference in abstract consummatory pleasure. TEPS scores were also inversely associated with clinical symptom levels [22]. However, since the patients we studied were a relatively chronic sample of patients, we do not know whether a similar deficit would be demonstrated in patients at the early stage of the illness. Therefore, studies are needed that include a wider range of patients at different stages of the illness and different clinical diagnoses (i.e., major depressive and bipolar disorders) with specific anhedonia symptoms in order to determine clinical discrimination across clinical diagnoses.

Taken together, the current study is the first one to examine the factor structure of the TEPS in a Chinese sample. The TEPS is specifically developed to capture two faces of trait hedonic capacity and has been demonstrated with impressive latent structure for researchers to study hedonic trait in healthy Chinese participants.

Author Contributions

Conceived and designed the experiments: RCKC. Performed the experiments: YFS YNW YW. Analyzed the data: YFS MKL YNW YW. Contributed reagents/materials/analysis tools: AMK. Wrote the paper: RCKC YFS AMK.

Citation: Chan RCK, Shi Y-f, Lai M-k, Wang Y-n, Wang Y, Kring AM (2012) The Temporal Experience of Pleasure Scale (TEPS): Exploration and Confirmation of Factor Structure in a Healthy Chinese Sample. PLoS ONE 7(4): e35352. https://doi.org/10.1371/journal.pone.0035352

References

1. Kelley ME, van Kammen DP, Allen DN (1999) Empirical validation of primary negative symptoms: independence from effects of medication and psychosis. Am J Psychiatry 156: 406–411.ME KelleyDP van KammenDN Allen1999Empirical validation of primary negative symptoms: independence from effects of medication and psychosis.Am J Psychiatry156406411

2. Keshavan MS, DeLisi LE, Seidman LJ (2011) Early and broadly defined psychosis risk mental states. Schizophr Res 126: 1–10.MS KeshavanLE DeLisiLJ Seidman2011Early and broadly defined psychosis risk mental states.Schizophr Res126110

3. Klein DF (1984) Depression and anhedonia. In: Clark DC, Fawcett J ed. Anhedonia and affect deficit states. New York: PMA Publishing. pp 1–14: DF Klein1984Depression and anhedonia. In: Clark DC, Fawcett J ed. Anhedonia and affect deficit states. New York: PMA Publishing.pp1–14

4. Horan WP, Blanchard JJ, Clark LA, Green MF (2008) Affective Traits in Schizophrenia and Schizotypy. Schizophr Bull 34: 856–874.WP HoranJJ BlanchardLA ClarkMF Green2008Affective Traits in Schizophrenia and Schizotypy.Schizophr Bull34856874

5. Liu WH, Chan RCK, Wang LZ, Huang J, Cheung EFC, et al. (2011) Deficits in sustaining reward responses in subsyndromal and syndromal major depression. Prog Neuropsychopharmacol Biol Psychiatry 35: 1045–1052.WH LiuRCK ChanLZ WangJ. HuangEFC Cheung2011Deficits in sustaining reward responses in subsyndromal and syndromal major depression.Prog Neuropsychopharmacol Biol Psychiatry3510451052

6. Berridge KC, Kringelbach ML (2008) Affective neuroscience of pleasure: reward in humans and animals. Psychopharmacology 199: 457–480.KC BerridgeML Kringelbach2008Affective neuroscience of pleasure: reward in humans and animals.Psychopharmacology199457480

7. Berridge KC, Robinson TE (1998) What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience? Brian Res Rev 28: 309–369.KC BerridgeTE Robinson1998What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience?Brian Res Rev28309369

8. Dillon DG, Holmes AJ, Jahn AL, Bogdan R, Wald LL, et al. (2007) Dissociation of neural regions associated with anticipatory versus consummatory phases of incentive processing. Psychophysiology 44: 1–14.DG DillonAJ HolmesAL JahnR. BogdanLL Wald2007Dissociation of neural regions associated with anticipatory versus consummatory phases of incentive processing.Psychophysiology44114

9. Drehera JC, Kohna P, Kolachanab B, Weinbergerb DR, Bermana KF (2009) Variation in dopamine genes influences responsivity of the human reward system. Proc Natl Acad Sci USA 106: 617–622.JC DreheraP. KohnaB. KolachanabDR WeinbergerbKF Bermana2009Variation in dopamine genes influences responsivity of the human reward system.Proc Natl Acad Sci USA106617622

10. Germans MK, Kring AM (2000) Hedonic deficit in anhedonia: support for the role of approach motivation. Pers Indiv Differ 28: 659–672.MK GermansAM Kring2000Hedonic deficit in anhedonia: support for the role of approach motivation.Pers Indiv Differ28659672

11. Knutson B, Adams CM, Fong GW, Hommer D (2001) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21RC159: 1–5.B. KnutsonCM AdamsGW FongD. Hommer2001Anticipation of increasing monetary reward selectively recruits nucleus accumbens.J Neurosci21RC15915

12. MacLeod AK, Conway C (2005) Well-being and the anticipation of future positive experiences: The role of income, social networks, and planning ability. Cogn Emot 19: 357–374.AK MacLeodC. Conway2005Well-being and the anticipation of future positive experiences: The role of income, social networks, and planning ability.Cogn Emot19357374

13. Watson D, Clark LA, Tellegen A (1988) : Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol 54: 1063–1070.D. WatsonLA ClarkA. Tellegen1988: Development and validation of brief measures of positive and negative affect: the PANAS scales.J Pers Soc Psychol5410631070

14. Eckblad ML, Chapman LJ, Chapman JP, Mishlove M (1982) The Revised Social Anhedonia Scale. Unpublished test. University of Wisconsin, Madison. ML EckbladLJ ChapmanJP ChapmanM. Mishlove1982The Revised Social Anhedonia Scale.Unpublished test. University of Wisconsin, Madison

15. Chapman LJ, Chapman JP (1978) The Revised Physical Anhedonia Scale. Unpublished test. University of Wisconsin, Madison. LJ ChapmanJP Chapman1978The Revised Physical Anhedonia Scale.Unpublished test. University of Wisconsin, Madison

16. Gard DE, Gard MG, Kring AM, John OP (2006) Anticipatory and consummatory components of the experience of pleasure: A scale development study. J Res Per 40: 1086–1102.DE GardMG GardAM KringOP John2006Anticipatory and consummatory components of the experience of pleasure: A scale development study.J Res Per4010861102

17. Gard DE, Kring AM, Gard MG, Horan WP, Green MF (2007) Anhedonia in schizophrenia: Distinctions between anticipatory and consummatory pleasure. Schizophr Res 93: 253–260.DE GardAM KringMG GardWP HoranMF Green2007Anhedonia in schizophrenia: Distinctions between anticipatory and consummatory pleasure.Schizophr Res93253260

18. Pregadio F (2008) The encyclopedia of Taoism. London; New York: Routledge. F. Pregadio2008The encyclopedia of Taoism.London; New YorkRoutledge

19. Eid M, Diener E (2001) Norms for experiencing emotions in different cultures: inter- and intranational differences. J Pers Soc Psychol 81: 869–885.M. EidE. Diener2001Norms for experiencing emotions in different cultures: inter- and intranational differences.J Pers Soc Psychol81869885

20. Tsai JL, Levenson RW, McCoy K (2006) Cultural and Temperamental Variation in Emotional Response. Emotion 6: 484–497.JL TsaiRW LevensonK. McCoy2006Cultural and Temperamental Variation in Emotional Response.Emotion6484497

21. Tsai JL, Knutson B, Fung HH (2006) Cultural Variation in Affect Valuation. J Pers Soc Psychol 90: 288–307.JL TsaiB. KnutsonHH Fung2006Cultural Variation in Affect Valuation.J Pers Soc Psychol90288307

22. Chan RCK, Wang Y, Huang J, Shi Y, Wang Y, et al. (2010) Anticipatory and consummatory components of the experience of pleasure in schizophrenia: Cross-cultural validation and extension. Psychiatry Res 175: 181–183.RCK ChanY. WangJ. HuangY. ShiY. Wang2010Anticipatory and consummatory components of the experience of pleasure in schizophrenia: Cross-cultural validation and extension.Psychiatry Res175181183

23. Beaton DE, Bombardier C, Guillemin F, Ferraz MB (2000) Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 25: 3186–3191.DE BeatonC. BombardierF. GuilleminMB Ferraz2000Guidelines for the process of cross-cultural adaptation of self-report measures.Spine2531863191

24. West SG, Finch JF, Curran PJ (1995) Structural equations with nonnormal variables: Problems and remedies. In: Hoyle RH ed. Structural equation modeling: Issues and applications. Newbury Park, CA: Sage. pp 56–75: SG WestJF FinchPJ Curran1995Structural equations with nonnormal variables: Problems and remedies. In: Hoyle RH ed. Structural equation modeling: Issues and applications. Newbury Park, CA: Sage.pp56–75

25. Satorra A, Bentler PM (1994) Corrections to test statistics and standard errors in covariance structure analysis. In: Eye AV, Clogg CC ed. Latent variables analysis: Applications for developmental research. Thousand Oaks, CA: Sage. pp 399–419: A. SatorraPM Bentler1994Corrections to test statistics and standard errors in covariance structure analysis. In: Eye AV, Clogg CC ed. Latent variables analysis: Applications for developmental research. Thousand Oaks, CA: Sage.pp399–419

26. Bollen KA, Stine RA (1992) Bootstrapping goodness-of-fit measures in structural equation models. Sociol Method Res 21: 205–229.KA BollenRA Stine1992Bootstrapping goodness-of-fit measures in structural equation models.Sociol Method Res21205229

27. Enders CK (2005) An SAS Macro for implementing the modified Bollen-Stine bootstrap for missing data: Implementing the bootstrap using existing structural equation modeling software. Struct Equ Modeling 12: 620–641.CK Enders2005An SAS Macro for implementing the modified Bollen-Stine bootstrap for missing data: Implementing the bootstrap using existing structural equation modeling software.Struct Equ Modeling12620641

28. Jöreskog KG, Sörbom D (2004) LISREL 8.7: User's reference guide. Chicago: Scientific Software, Inc. KG JöreskogD. Sörbom2004LISREL 8.7: User's reference guide.ChicagoScientific Software, Inc

29. Bentler PM, Wu EJ (2003) EQS 6.1 for windows: User's guide. Encino, CA: Multivariate Software. PM BentlerEJ Wu2003EQS 6.1 for windows: User's guide.Encino, CAMultivariate Software

30. Enders CK (2002) Applying the Bollen-Stine bootstrap for goodness-of-fit measures to structural equation models with missing data. Multivar Behav Res 37: 359–377.CK Enders2002Applying the Bollen-Stine bootstrap for goodness-of-fit measures to structural equation models with missing data.Multivar Behav Res37359377

31. Nevitt J, Hancock GR (2001) Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling. Struct Equ Modeling 8: 353–377.J. NevittGR Hancock2001Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling.Struct Equ Modeling8353377

32. Rindskopf D, Rose T (1988) Some theory and applications of confirmatory second-order factor analysis. Multivar Behav Res 23: 51–67.D. RindskopfT. Rose1988Some theory and applications of confirmatory second-order factor analysis.Multivar Behav Res235167

33. Conway MA (2005) Memory and the self. J Mem Lang 53: 594–628.MA Conway2005Memory and the self.J Mem Lang53594628

34. Knutson B, Greer SM (2008) Anticipatory affect: neural correlates and consequences for choice. Phil Trans R Soc B 363: 3771–3786.B. KnutsonSM Greer2008Anticipatory affect: neural correlates and consequences for choice.Phil Trans R Soc B36337713786