Development of an effective virtual environment in eliciting craving in adolescents and young adults with internet gaming disorder

Abstract

Internet gaming disorder (IGD) is a new disorder that warrants further investigation, as recently noted in the research criteria of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. Offering controlled environments that increase cue-induced craving, virtual reality cue-exposure therapy has been shown to be effective for some addiction disorders. To assess the feasibility of virtual reality for patients with IGD, this study aimed to develop virtual environments that represent risk situations for inducing craving, and assess the effect of virtual reality in cue reactivity. A total of 64 male adolescents and young adults (34 with IGD and 30 without) were recruited for participation. We developed a virtual internet café environment and the participants were exposed to four different tasks. As the primary feasibility outcome, cravings were measured with a visual analogue scale measuring current urge to play a game after exposure to each task. The virtual internet café induced significantly greater cravings in patients with IGD compared to controls. Additionally, patients exhibited a significantly higher acceptance rate of an avatar’s invitation to play a game together than that of controls. In IGD, craving response to the tasks was positively associated with the symptom severity score as measured by Young's Internet Addiction Test. These findings reveal that virtual reality laden with complex game-related cues could evoke game craving in patients with IGD and could be used in the treatment of IGD as a cue-exposure therapy tool for eliciting craving.

About the Authors:

Yu-Bin Shin

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

Affiliations Brain Korea 21 PLUS Project for Medical Science, Yonsei University, Seoul, Republic of Korea, Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea

Jae-Jin Kim

Roles Conceptualization, Funding acquisition, Project administration, Supervision, Writing – review & editing

Affiliations Brain Korea 21 PLUS Project for Medical Science, Yonsei University, Seoul, Republic of Korea, Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea, Department of Psychiatry, Yonsei University Gangnam Severance Hospital, Seoul, Republic of Korea

Min-Kyeong Kim

Roles Investigation, Writing – review & editing

Affiliations Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea, Department of Psychiatry, Yonsei University Gangnam Severance Hospital, Seoul, Republic of Korea

Sunghyon Kyeong

Roles Data curation, Visualization, Writing – review & editing

Affiliation: Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea

Young Hoon Jung

Roles Investigation, Writing – review & editing

Affiliations Brain Korea 21 PLUS Project for Medical Science, Yonsei University, Seoul, Republic of Korea, Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea

Hyojung Eom

Roles Investigation, Visualization, Writing – review & editing

Affiliations Brain Korea 21 PLUS Project for Medical Science, Yonsei University, Seoul, Republic of Korea, Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea

Eunjoo Kim

Roles Conceptualization, Funding acquisition, Project administration, Supervision, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Affiliations Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea, Department of Psychiatry, Yonsei University Gangnam Severance Hospital, Seoul, Republic of Korea

ORCID http://orcid.org/0000-0003-3061-2051

Introduction

Internet gaming disorder (IGD), as recently included in the appendix of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), has become a serious public health problem [1–3]. Because of a rapid rise in internet use, especially among adolescents and young adults, maladaptive use of the internet most commonly occurs in this developmental period [4]. As a transitional developmental stage between childhood and adulthood, adolescence is a critical period for addiction vulnerability [5]. Several studies have reported that adolescents and young adults generally show higher rates of experimentation with and problematic use of substances and gambling than older adults, and adults with a diagnosis of addictive disorders commonly show onset during this period [6,7]. As social, behavioral, and neurobiological development continues throughout adolescence and young adulthood, an addictive disorder during this time could even lead to alteration in brain organization and function [8,9]. Therefore, research and treatment targeting adolescents and young adults with addictive disorders may provide life-long benefits.

There has been some debate as to whether IGD should be included in the category of addictive disorders. According to a recent review, behavioral tendency toward game-related cues and cue-induced neurobiological changes in internet gaming abusers are similar to those seen in people with substance-use disorder (SUD) and pathological gambling (PG), suggesting that IGD may share behavioral and neural mechanisms with SUD and PG [10]. Moreover, internet gaming also stimulates the dopamine-mediated mesolimbic trajectory associated with drug addiction [11,12]. Therefore, studies of IGD-targeted treatment mechanisms are needed to help with the classification of behavioral addiction and the recovery of patients with IGD. In this context, substantial effort has been devoted to developing treatments and identifying predictors of relapse in addiction research [13,14]. It has been reported that one of the strongest predictors of relapse is craving. Craving, defined as a strong desire or urge to use a specific substance or gamble, is a new criterion that was added to DSM-5 for the diagnosis of SUD and PG [1]. Thus, many of the effective treatments for addiction have focused on reducing and managing craving.

Designed to reduce craving, cue-exposure therapy involves controlled and repeated exposure to cues relating to addiction [15]. The cue-reactivity paradigm has mostly focused on proximal cues that are directly linked to actual addictive behaviors (e.g., in the case of a cigarette smoker, burning cigarettes, ashtrays, lighters, or smoking behavior) because such cues are presumably ubiquitous throughout all addictive experience [16,17]. However, craving can be provoked by other cues. Distal cues can be defined as stimuli that have been regularly present during substance use, such as a physical environment, situations, or feelings [18]. Thus, as an alternative to traditional exposure techniques using in vivo, visual, or imaginal modes of cue presentation, recent research has highlighted the usefulness of virtual reality techniques for generating more realistic craving states by providing complex cues [19].

Several investigations have demonstrated the effectiveness of virtual reality (VR) in increasing craving reactivity [20,21]. For example, the efficacy of a virtual environment (VE) reproducing high-risk situations (e.g., being in a virtual pub where diverse forms of smoking paraphernalia and avatars who are offering cigarettes are displayed) has been documented for eliciting subjective craving in patients with SUD [22] and PG [23]. Moreover, studies have demonstrated the efficacy of virtual reality cue-exposure therapy (VRCET) for SUD and PG in reducing craving in response to addiction-related cues and extinction of cue-response association [24,25]. Furthermore, VRCET was found to be as effective as conventional therapy in the treatment of nicotine dependence [26], and CBT coupled with VRCET is effective in the prevention of smoking relapse [27]. Thus, the cue-exposure technique is now being applied to the other clinical targets, such as the IGD [10]. For example, behavioral interventions involving craving induction [28] and virtual reality therapy [29] have been shown to be efficacious, not only in decreasing craving and severity of internet addiction, but also in altering neural activity and functional connectivity. However, few studies have been conducted to specifically investigate use of a VE to elicit cue-induced gaming craving in adolescents and young adults with IGD.

Regarding the location of internet use, most young people use the internet at home, but they also go to internet cafes where they can freely use the internet without parental monitoring [30–34]. Recent studies have demonstrated that access via the internet café is a significant predictor for high internet users [31]. Moreover, as peer influence is one of the factors most commonly linked to risky behavior in adolescents and young adults [35], the internet café environment could enable young people to satisfy a need for acceptance or social support while playing games with peers [33]. Therefore, the urge to game may arise from exposure to a virtual internet cafe that presents gaming-related events commonly experienced by young people. Given that VR could provide patients with opportunities to safely develop and practice coping skills while immersed in an ecologically valid environment [36,37], identifying features of a valid and reliable VE, as a medium for game craving assessment and graded exposure therapy for craving reduction, is essential for future studies.

In addition, there have been relatively few studies of the relationship between cue reactivity and symptom severity [38,39]. A recent study has shown that severity of disorder predicts craving in a VE for cigarette-deprived smokers [40] and gamblers [41]. These studies suggest that investigation of the relationship between IGD severity and cue-reactivity is important to generalize these results in the literature on VRCET.

Therefore, this study explored the feasibility of VR for adolescents and young adults with IGD. For this purpose, we aimed to examine whether adolescents and young adults with IGD react to a virtual internet cafe differently compared with controls. In addition, as preliminary data on the potential of a virtual internet café as a therapeutic tool, brief practice session using a commonly used coping strategy (e.g. refusal skill training in the treatment of addictive disorder) was implemented in our VR program, and we evaluated whether participants’ response could be changed after this practice. A second aim was to assess the extent to which self-reported measures of severity of internet addiction are correlated with VR-induced craving.

Methods

Ethics statement

The study was approved by the Institutional Review Board of Yonsei University Gangnam Severance Hospital, and written informed consent was obtained from all participants after they had received a detailed explanation of the study. In case of adolescents, the written informed consent of their parents was also obtained.

Participants

Male adolescents and young adults (12–25 years of age) were recruited through advertisement at a local hospital and via the internet. As males have a higher prevalence of problematic use of internet games compared with females, only male participants were recruited [42]. All participants were interviewed by a psychiatrist for IGD diagnosis according to DSM-5 section 3 [1]. All enrolled IGD participants were currently addicted to one of Korea’s popular internet games (e.g., League of Legends, Overwatch, or Sudden Attack, etc.) and smartphone games (e.g., Modoo Marble, Clash of Clans, or Seven Knights, etc.). For controls, they were recruited from the local community using online advertisements and psychiatric interviews, and reviews of history were performed to confirm that none had ever been diagnosed with IGD. In addition, controls were screened for family history of psychiatric disorders, and no one had history of any psychiatric illness in first-degree relatives. Exclusion criteria for controls were current use of psychotropic medication and any history of substance use disorder, neurological or neurodevelopmental disorder, major depressive episodes, bipolar I disorder, and psychotic disorder, according to the Mini-International Neuropsychiatric Interview for Children and Adolescents (MINI-KID 6.0) for participants under the age of 18 and the Mini-International Neuropsychiatric Interview (MINI 5.0) for adult participants [43,44]. However, IGD could be highly comorbid with other mental disorders, with the DSM-5, specifically mentioning major depressive disorder and attention deficit hyperactivity disorder. Therefore, in this study, some participants show comorbidity of other mental disorders, as seen in Table 1. Participant characteristics by group are reported in Table 1.

[Figure omitted. See PDF.]

Table 1. Demographic and clinical characteristics, and virtual reality experience assessments of IGD versus HC.

https://doi.org/10.1371/journal.pone.0195677.t001

Measurements

Estimated full intellectual functioning (IQ) was obtained using the short form of the Wechsler Intelligence Scale for Children-Third Edition [45] and the Wechsler Adult Intelligence Scale-Revised [46]. Symptom severity was assessed by the Young’s Internet Addiction Test (IAT), one of the most utilized diagnostic instruments to assess the extent of internet addiction [47]. The IAT scores for 4 controls (13%) were not available because of missing data. Additionally, all participants completed a modified version of the IAT that replaced the term “Internet” in the original version with terms such as “playing internet games.” The IAT has been modified in some recent studies to assess specific subtypes of internet addiction, such as internet role-playing games (e.g., World of Warcraft) [48–50] or internet sex [51]. Cue-induced craving was assessed through a visual analogue scale (VAS) embedded into the VR. When the VAS appeared, participants were instructed to rate their urge to play game at that moment, from 0 (no urge at all) to 100 (intense urge). Participants also completed VR experience measures: the Presence Questionnaire (PQ) [52] and the Simulator Sickness Questionnaire (SSQ) [53]. To be fully immersed in a given virtual environment, it is necessary to have VR with higher sense of realism and minimal simulation sickness. Therefore, PQ and SSQ were included to assess the sense of presence and VR side effects, including some visual fatigue or motion sickness symptoms, when exposed to virtual reality.

Virtual reality

Participants were guided through a presentation of four different sets of VR tasks in a virtual internet café (Fig 1). All participants began by finding themselves standing on the stairs of the building. The participants followed a preset pathway, climbing down the stairs and into the internet café, where the counter clerk greeted them and encouraged them to look around the internet café. In this internet café entrance task, craving was measured twice, before and after entrance. In conversation observation tasks, participants observed peers talking about game updates or world championship finals, and craving was also measured after each task.

[Figure omitted. See PDF.]

Fig 1. Screenshots of virtual environment and experimental procedure of virtual reality tasks.

https://doi.org/10.1371/journal.pone.0195677.g001

In one of the gaming invitation tasks, the participants faced an event in which a peer pressured them to play a game together to relieve exam stress, and they were instructed to accept or reject the invitation. If they accepted the suggestion or rejected all three varying suggestions, the script ended and the VAS appeared. In the other gaming invitation task, the participants faced an event in which a peer pressured them to play a game together to win a battle against opponents who made negative comments about their game. Both tasks were identical in construct although they differed in content.

In the refusal skills practice tasks, participants were instructed to refuse avatars’ invitations to play a game together in a role-playing situation. If they refused all three varying invitations, the script ended and the VAS appeared. Both refusal skills practice tasks were identical in structure, and their content was developed based on the gaming invitation tasks. The critical difference between the gaming invitation tasks and the refusal skills practice tasks was that only in the latter were participants instructed to employ their refusal skills as a strategy for coping with the gaming invitation. This very simple intervention was delivered as a single act.

The internet café scenario was developed based on feedback from patients with IGD and clinical professionals. Especially, the virtual internet cafe generally contained game-related sounds and several avatars engaged in playing games, talking about games and surfing the internet, while the video clips shown on avatar’s monitors and TV, and the script used in conversations for the VR tasks were specifically selected from the League of Legends, the most frequently played game in Korea.

The VR system consisted of a desktop computer running the Microsoft Windows 10 operating system, containing an NVIDIA GeForce GTX 970 graphics card and 16 GB RAM of graphics memory, and an Oculus Rift head-mounted display with tracker (Oculus VR, LLC, USA). Mounted on the headset, the Leap Motion Controller (Leap Motion Inc., USA), a new device suitable for hand gesture controlled user interfaces, was used for the interactions with executable objects and avatars during the virtual experience.

Procedure

After each participant was informed of the purpose of the study and consented to participate, the assessment of demographic and clinical characteristics and IQ was administered and participants began the VR session. As shown in Fig 1, the order in which the three sets of tasks, with the exception of the internet café entrance task, were presented was counterbalanced among participants to control order effects. Unlike the other tasks, each of the game invitation tasks was paired with one of the refusal skills practice tasks. After each VR task, self-report of craving was collected with a VAS built into the VR. After being in the VE, participants completed measures of the VR experience.

Analysis

Differences between groups on demographic, clinical, and VR-related variables were tested using independent t-tests. To investigate the feasibility of VR for adolescents and young adults with IGD, as the primary purpose of this study, a 2 (Group: with and without IGD) × 3 (VR Task: internet café entrance, conversation observation and gaming invitation) analysis of variance (ANOVA) with repeated measures was conducted to compare the differences in self-rating of craving on the VAS as the dependent variable. Independent t-tests were used to compare differences between acceptance rates for IGD group versus controls. Effects on VR-induced cravings of strategies for coping with gaming invitations were tested using a 2 (Group: with and without IGD) × 2 (Refusal Skills: use and non-use) repeated measures ANOVA. The Refusal Skills factor reflected a comparison of craving on two different task types: gaming invitation (non-use) and refusal skills practice (use). To follow up significant main effects and interactions, post hoc analyses were conducted. Pearson correlation coefficients were used to investigate associations between dependent measures of VR-induced craving with clinical variables that differed between groups. In all cases, p<.05 (two-tailed) was considered statistically significant. For post hoc analyses, the Bonferroni correction was applied. All analyses were conducted using SPSS 23.0 (SPSS Inc., Chicago, IL).

Results

Cue effects on VAS craving in a virtual internet café.

A mixed-design ANOVA of VAS craving scores revealed a main effect of Group (F[1,62]=36.096, p<.001), with the IGD group having higher craving scores than controls; there was also a main effect of VR Task (F[2,124]=4.984, p=.008) and a significant Group by VR Task interaction (F[2,124]=3.263, p=.042). Post hoc analyses showed that, regardless of the group factor, entering the internet cafe (mean difference=5.031, SE=1.96, p=.035) and being invited to game (mean difference=5.678, SE=1.969, p=.014) produced significantly higher cravings than observing a conversation about internet games. In addition, among the IGD group, significantly higher cravings were reported when being invited to game compared to when observing a conversation about internet games (T[33]=-3.136, p=.004), but the VR Task differences among the control group were not significant (all p>.008; Table 2).

[Figure omitted. See PDF.]

Table 2. Effects of virtual reality tasks on visual analogue scale (VAS) craving and acceptance rate.

https://doi.org/10.1371/journal.pone.0195677.t002

Group differences in gaming invitation acceptance rates.

With respect to acceptance of avatars’ invitation to play game, the IGD group showed a higher acceptance rate than controls (T[62] = -4.383, p<.001).

Effects of the refusal skills practice on VAS craving.

A mixed-design ANOVA of VAS craving scores revealed a main effect of Group (F[1,62] = 22.013, p<.001) and of Refusal Skills (F[1,62]=17.456, p<.001), and a significant Group by Refusal Skills interaction (F[1,62]=22.201, p<.001). Post hoc analyses showed that craving responses to the refusal skills practice task were significantly lower than those to the gaming invitation task across both groups (mean difference=9.393, SE=2.248, p<.001) and within the IGD group (p<.025). In controls, no significant difference in VAS craving was found (p=.527).

Relationships with clinical variable.

As shown in Fig 2, within the IGD group, VAS cravings after entering the internet café were significantly positively correlated with symptom severity measured by the modified IAT (r = .446, p = .008), but the association of VAS cravings after gaming invitation with the modified IAT scores only reached a trend (r = .307, p = .077). In addition, craving to the conversation observation task was not associated with the modified IAT (r = .272, p = .120). However, VAS craving after this task was only positively associated with scores on the original version of the IAT (r = .347, p = .048) (Fig 2B). There was no relationship between VAS craving after entering the internet café or after being invited to play a game and IAT scores (all ps>.05). In controls, there were no significant correlations (all ps>.05).

[Figure omitted. See PDF.]

Fig 2. Correlations of symptom severity with visual analogue scale (VAS) craving in virtual reality.

https://doi.org/10.1371/journal.pone.0195677.g002

Presence and simulator sickness in the VE.

Participants’ average score on the PQ was 135.06 (SD = 21.56) in the IGD group and 135.96 (SD = 16.67) in controls, both with a mean score above the mid‐point of the scale. These results suggest that participants experience presence in a given virtual environment. The average score on the SSQ was 13.36 (SD = 9.70) in the IGD group and 5.53 (SD = 6.45) in controls. Scores did not differ between groups on the PQ (T[61] = .18, p = 85) but this was not the case on the SSQ (T[61] = -3.73, p<.001). Although a group difference was found on the SSQ, participants across groups reported lower levels of simulator sickness relative to established norms on the SSQ [52].

Discussion

The primary aim of the study was to determine whether a virtual internet café was capable of eliciting cue-induced craving, and to compare these responses in individuals with IGD and healthy controls. The authors developed a VE in which game-related events that commonly experienced by adolescents and young adults were presented. The results indicated that the virtual internet café induced significantly greater craving in the IGD group than in controls. Moreover, VR-induced craving was positively associated with severity of IGD. These results suggest that an internet café scenario is useful for the evaluation of craving and document the potential of VR as a clinical tool for managing game craving.

In this study, participants were exposed to an internet café setting, and patients with IGD reported higher cravings and exhibited higher acceptance rates to gaming invitations than controls. In line with the previous studies attempting to identify the high-risk situations specific to a target disorder, these data suggest that a virtual internet café could be regarded as a high-risk situation for pathological gamers. Given the significant differences between the two groups and acceptable levels of presence and simulator sickness, the virtual internet café appears to be feasible for adolescents and young adults with IGD. Exposure to various tasks while immersed in a specific environment is important for patients to increase the treatment efficacy [25]. In this view, our results demonstrate that presentation of several addiction-related tasks relevant to the VE is also capable of inducing craving in patients with IGD.

Regardless of group, the internet café entrance task and gaming invitation task induced greater craving than the conversation observation task, which instructs participants to watch avatars talking about internet games. In the internet café entrance task, the participant follows a preset pathway, climbing down the stairs and into the internet café, which makes the virtual experience more realistic. And these VR techniques allow users to perceive that they are moving through the environment [54]. This sense of spatial presence contributes to the feeling that they are physically present in the VE and ultimately leads to a more immersive experience which makes the virtual experience more realistic. In the gaming invitation task, the participants have the opportunity to respond to the avatars’ suggestions, and this response has an immediate impact on the subsequent script (i.e., the script either ends or continues with further suggestions). These findings are consistent with the previous reports that more immersive and interactive environments contribute to large increases in the ecological validity of the VE and ultimately lead to greater craving induction [21,55]. Therefore, implementing real-time social interactions in an immersive VE may facilitate greater cue-reactivity compared to allowing the participant to perform a limited role as an observer.

Regarding the results in the IGD group, they exhibited a significant increase in craving response to the gaming invitation task compared to the conversation observation task. It has been reported that the characteristics such as substance availability, peers’ substance use, and peer group pressure, function as risk factors for addiction [6–7,35]. Given that proximal cues have strongest effects in craving induction, passive viewing of avatars who are talking about game updates and watching a gaming competition on-screen seems to be distal to IGD-related behavior. Supporting this interpretation, craving response in this task was positively associated with severity of internet addiction, not with internet gaming addiction specifically. Observing a conversation about internet games seems to reflect simulation of generic internet-related behavior. Therefore, prior to the investigation of effectiveness of VRCET using complex cues for treatment, it is important to validate the VE to make cues more salient and increase target reactivity.

In this study, patients with more severe IGD reported greater craving in the internet café entrance task, while craving in the gaming invitation task was not associated with the severity of IGD. These results may be due to an order effect, since the internet café entrance task always preceded the other tasks. Generally, initial stimuli would produce confounding effects such as familiarization, learning, or desensitization, and result in contamination of the responses of subsequent stimuli [56]. Alternatively, failure to demonstrate a relationship between the craving in the task and the symptom severity may be attributed to modified craving due to consecutive cue-exposure. This interpretation draws from the previous finding that the urge to smoke could be reduced during each of a series of virtual cue-exposure sessions [24]. Moreover, this result could be also explained by individual differences in gaming motives. Specifically, player motives are varied and some participants could be more motivated by factors other than social ones, such as rewards resulting from violent games or escapism [57]. Therefore, the order of cue presentation and the hierarchy of cues should be considered to enhance the efficacy of VRCET. With this in mind, the craving reactivity to VR gaming cues could serve as a predictive and objective measure to characterize the severity of the disorder.

Craving was significantly reduced after the refusal skills practice task; additionally, the IGD group reported greater craving across the tasks compared to controls. Moreover, although controls did not show a significant reduction in craving because of a floor effect, use of strategies for coping with invitations to game decreased craving in IGD. Examining the effects of coping strategies on VAS craving might offer additional insight into the functioning of our VR environments in IGD. It is important for people with IGD to learn refusal skills that enable them to resist peer pressure to engage in risky behaviors. Many prevention strategies focus on teaching refusal skills training in which individuals role-play turning down offers [58]. A study of smoking cessation treatment has shown VRCET with coping skills training has the potential to reduce smoking rates and craving for nicotine. Consistent with these results, our findings suggest that a virtual internet cafe could be an effective medium for the coping skills training combined with cue-exposure.

Regarding simulator sickness, SSQ evaluated several factors relating to the physical after-effects of VE exposure. It has been reported that although the SSQ measures the physical discomfort, the distressed state derived from increased craving could also be reflected in the SSQ [23,59]. In line with these studies, the higher scores reported by the IGD group could reflect some discomfort caused by elicited cravings to game.

There are some potential limitations of the current study that warrant future research. First, the differences between cue and neutral environment were not investigated. Thus, the lack of a control condition makes it difficult to generalize the present results into the literature of treatment for IGD. Second, whereas participants in this study were addicted to various kinds of internet games, the game-related stimuli implemented in the VE consisted of video clips from the League of Legends game. We did find a significant difference between the groups, regardless of specific game stimuli used for the VE. However, given that the participant’s own brand of cigarette is commonly used to make smoking cues more salient in a cue reactivity paradigm, VR using personalized game stimuli may make the VE more ecologically valid and induce more craving. Third, although it has been reported that access to the internet via internet cafés is associated with problematic internet use including internet gaming among Chinese [30], Greek [31], Taiwanese [33], and Korean [34] adolescents, the negative associations of pathological gaming with internet cafés seems to be more prevalent in Asian adolescents. Lastly, since we did not assess the inter-rater reliability during diagnosis of IGD, these results should be interpreted with caution. In order to enhance validity of IGD diagnosis, it would be helpful for multiple clinicians to diagnose IGD in future studies.

Conclusions

In the present study, our results have demonstrated the effectiveness of a VE in eliciting cue-induced craving to game. These findings may have implications for VRCET to systematically desensitize patients with IGD. Given the feasibility demonstrated in this study of VE for IGD, future research should focus on developing VR treatments and comparing them with conventional treatment protocols.

Supporting information

[Figure omitted. See PDF.]

S1 Dataset. The file summarizes data obtained during virtual reality cue-exposure session.

https://doi.org/10.1371/journal.pone.0195677.s001

(XLSX)

Citation: Shin Y-B, Kim J-J, Kim M-K, Kyeong S, Jung YH, Eom H, et al. (2018) Development of an effective virtual environment in eliciting craving in adolescents and young adults with internet gaming disorder. PLoS ONE 13(4): e0195677. https://doi.org/10.1371/journal.pone.0195677

References

1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-500AE): American Psychiatric Pub; 2013.

2. Ferguson CJ, Coulson M, Barnett J. A meta-analysis of pathological gaming prevalence and comorbidity with mental health, academic and social problems. Journal of psychiatric research. 2011;45: 1573–1578. pmid:21925683

3. Ng BD, Wiemer-Hastings P. Addiction to the internet and online gaming. Cyberpsychology & behavior. 2005;8: 110–113.

4. Petry NM , O'brien GF. Internet gaming disorder and the DSM‐5. Addiction. 2013;108: 1186–1187. pmid:23668389

5. Chambers RA, Taylor JR, Potenza MN. Developmental neurocircuitry of motivation in adolescence: a critical period of addiction vulnerability. American Journal of Psychiatry. 2003;160: 1041–1052. pmid:12777258

6. Musher-Eizenman DR, Holub SC, Arnett M. Attitude and peer influences on adolescent substance use: the moderating effect of age, sex, and substance. Journal of drug education. 2003;33: 1–23. pmid:12773022

7. Winters KC, Stinchfield R, Fulkerson J. Patterns and characteristics of adolescent gambling. Journal of Gambling Studies. 1993;9: 371–386.

8. Chambers RA, Potenza MN. Neurodevelopment, impulsivity, and adolescent gambling. Journal of Gambling Studies. 2003;19: 53–84. pmid:12635540

9. Crews F, He J, Hodge C. Adolescent cortical development: a critical period of vulnerability for addiction. Pharmacology Biochemistry and Behavior. 2007;86: 189–199.

10. Zhang Y, Ndasauka Y, Hou J, Chen J, zhuang Yang L, Wang Y, et al. Cue-induced behavioral and neural changes among excessive internet gamers and possible application of cue exposure therapy to internet gaming disorder. Frontiers in psychology. 2016;7.

11. Kim SH, Baik S-H, Park CS, Kim SJ, Choi SW, Kim SE. Reduced striatal dopamine D2 receptors in people with Internet addiction. Neuroreport. 2011;22: 407–411. pmid:21499141

12. Han DH, Lee YS, Yang KC, Kim EY, Lyoo IK, Renshaw PF. Dopamine genes and reward dependence in adolescents with excessive internet video game play. Journal of addiction medicine. 2007;1: 133–138. pmid:21768948

13. Marlatt GA, Donovan DM. Relapse prevention: Maintenance strategies in the treatment of addictive behaviors: Guilford Press; 2005.

14. Smith DP, Battersby MW, Pols RG, Harvey PW, Oakes JE, Baigent MF. Predictors of relapse in problem gambling: A prospective cohort study. Journal of gambling studies. 2015;31: 299–313. pmid:24065314

15. Carter BL, Tiffany ST. Meta‐analysis of cue‐reactivity in addiction research. Addiction. 1999;94: 327–340. pmid:10605857

16. Ashrafioun L, McCarthy A, Rosenberg H. Assessing the impact of cue exposure on craving to gamble in university students. Journal of gambling studies. 2012;28: 363–375. pmid:21853232

17. Conklin CA, Robin N, Perkins KA, Salkeld RP, McClernon FJ. Proximal versus distal cues to smoke: the effects of environments on smokers' cue-reactivity. Experimental and clinical psychopharmacology. 2008;16: 207. pmid:18540780

18. Van Gucht D, Van den Bergh O, Beckers T, Vansteenwegen D. Smoking behavior in context: Where and when do people smoke? Journal of behavior therapy and experimental psychiatry. 2010;41: 172–177. pmid:20060515

19. Kuntze MF, Stoermer R, Mager R, Roessler A, Mueller-Spahn F, Bullinger AH. Immersive virtual environments in cue exposure. Cyberpsychology & behavior. 2001;4: 497–501.

20. Loranger C, Bouchard S, Boulanger J, Robillard G. Validation of two virtual environments for the prevention and treatment of pathological gambling. Journal of CyberTherapy and Rehabilitation. 2011;4: 233–236.

21. Hone-Blanchet A, Wensing T, Fecteau S. The use of virtual reality in craving assessment and cue-exposure therapy in substance use disorders. Frontiers in human neuroscience. 2014;8: 844. pmid:25368571

22. Lee JS, Namkoong K, Ku J, Cho S, Park JY, Choi YK, et al. Social pressure-induced craving in patients with alcohol dependence: application of virtual reality to coping skill training. Psychiatry investigation. 2008;5: 239–243. pmid:20046344

23. Giroux I, Faucher-Gravel A, St-Hilaire A, Boudreault C, Jacques C, Bouchard S. Gambling exposure in virtual reality and modification of urge to gamble. Cyberpsychology, Behavior, and Social Networking. 2013;16: 224–231.

24. Pericot-Valverde I, Secades-Villa R, Gutiérrez-Maldonado J, García-Rodríguez O. Effects of systematic cue exposure through virtual reality on cigarette craving. nicotine & tobacco research. 2014;16: 1470–1477.

25. Park C-B, Park SM, Gwak AR, Sohn BK, Lee J-Y, Jung HY, et al. The effect of repeated exposure to virtual gambling cues on the urge to gamble. Addictive behaviors. 2015;41: 61–64. pmid:25306387

26. Park C-B, Choi J-S, Park SM, Lee J-Y, Jung HY, Seol J-M, et al. Comparison of the effectiveness of virtual cue exposure therapy and cognitive behavioral therapy for nicotine dependence. Cyberpsychology, Behavior, and Social Networking. 2014;17: 262–267.

27. Giovancarli C, Malbos E, Baumstarck K, Parola N, Pélissier M-F, Lançon C, et al. Virtual reality cue exposure for the relapse prevention of tobacco consumption: a study protocol for a randomized controlled trial. Trials. 2016;17: 96. pmid:26892001

28. Zhang J-T, Yao Y-W, Potenza MN, Xia C-C, Lan J, Liu L, et al. Altered resting-state neural activity and changes following a craving behavioral intervention for Internet gaming disorder. Scientific Reports. 2016;6.

29. Park SY, Kim SM, Roh S, Soh M-A, Lee SH, Kim H, et al. The effects of a virtual reality treatment program for online gaming addiction. Computer methods and programs in biomedicine. 2016;129: 99–108. pmid:26860055

30. Wang H, Zhou X, Lu C, Wu J, Deng X, Hong L. Problematic Internet use in high school students in Guangdong Province, China. PloS one. 2011;6: e19660. pmid:21573073

31. Tsitsika A, Critselis E, Kormas G, Filippopoulou A, Tounissidou D, Freskou A, et al. Internet use and misuse: a multivariate regression analysis of the predictive factors of internet use among Greek adolescents. European journal of pediatrics. 2009;168: 655–665. pmid:18762980

32. Tahiroglu AY, Celik GG, Uzel M, Ozcan N, Avci A. Internet use among Turkish adolescents. CyberPsychology & Behavior. 2008;11: 537–543.

33. Wu C-S, Cheng F-F. Internet café addiction of Taiwanese adolescents. CyberPsychology & Behavior. 2006;10: 220–225.

34. Lim K, Meier EB. Different but similar: computer use patterns between young Korean males and females. Educational Technology Research and Development. 2011;59: 575.

35. Gardner M, Steinberg L. Peer influence on risk taking, risk preference, and risky decision making in adolescence and adulthood: an experimental study. Developmental psychology. 2005;41: 625. pmid:16060809

36. Bordnick PS, Traylor AC, Carter BL, Graap KM. A feasibility study of virtual reality-based coping skills training for nicotine dependence. Research on social work practice. 2012;22: 293–300. pmid:25484549

37. Glanz K, Rizzo AS, Graap K. Virtual reality for psychotherapy: Current reality and future possibilities. Psychotherapy: Theory, Research, Practice, Training. 2003;40: 55.

38. Modesto-Lowe V, Burleson JA, Hersh D, Bauer LO, Kranzler HR. Effects of naltrexone on cue-elicited craving for alcohol and cocaine. Drug and alcohol dependence. 1997;49: 9–16. pmid:9476694

39. Liu L, Yip SW, Zhang JT, Wang LJ, Shen ZJ, Liu B, et al. Activation of the ventral and dorsal striatum during cue reactivity in internet gaming disorder. Addiction biology. 2016.

40. Thompson-Lake DG, Cooper KN, Mahoney JJ, Bordnick PS, Salas R, Kosten TR, et al. Withdrawal symptoms and nicotine dependence severity predict virtual reality craving in cigarette-deprived smokers. Nicotine & Tobacco Research. 2014: ntu245.

41. Bouchard S, Robillard G, Giroux I, Jacques C, Loranger C, St-Pierre M, et al. Using Virtual reality in the Treatment of gambling Disorder: The Development of a new Tool for cognitive Behavior Therapy. Frontiers in Psychiatry. 2017;8.

42. Ko C-H, Yen J-Y, Chen C-C, Chen S-H, Yen C-F. Gender differences and related factors affecting online gaming addiction among Taiwanese adolescents. The Journal of nervous and mental disease. 2005;193: 273–277. pmid:15805824

43. Sheehan D, Janavs J, Baker R, Harnett-Sheehan K, Knapp E, Sheehan M, et al. MINI-Mini International neuropsychiatric interview-english version 5.0. 0-DSM-IV. Journal of Clinical psychiatry. 1998;59: 34–57

44. Sheehan DV, Sheehan KH, Shytle RD, Janavs J, Bannon Y, Rogers JE, et al. Reliability and validity of the mini international neuropsychiatric interview for children and adolescents (MINI-KID). The Journal of clinical psychiatry. 2010;71: 313–326. pmid:20331933

45. Donders J. A short form of the WISC—III for clinical use. Psychological Assessment. 1997;9: 15.

46. Silverstein A. Two-and four-subtest short forms of the Wechsler Adult Intelligence Scale-Revised. Journal of Consulting and Clinical Psychology. 1982;50: 415.

47. Young K. Internet addiction test. Center for On-Line Addictions. Bradford, USA. http://www/netaddiction.com/resources/internet_addiction_test.htm (accessed 30 Nov 2008). 2009.

48. Chan PA, Rabinowitz T. A cross-sectional analysis of video games and attention deficit hyperactivity disorder symptoms in adolescents. Annals of General Psychiatry. 2006;5: 16. pmid:17059614

49. Kim EJ, Namkoong K, Ku T, Kim SJ. The relationship between online game addiction and aggression, self-control and narcissistic personality traits. European psychiatry. 2008;23: 212–218. pmid:18166402

50. Pawlikowski M, Brand M. Excessive Internet gaming and decision making: do excessive World of Warcraft players have problems in decision making under risky conditions? Psychiatry research. 2011;188: 428–433. pmid:21641048

51. Brand M, Laier C, Pawlikowski M, Schächtle U, Schöler T, Altstötter-Gleich C. Watching pornographic pictures on the Internet: Role of sexual arousal ratings and psychological–psychiatric symptoms for using Internet sex sites excessively. Cyberpsychology, Behavior, and Social Networking. 2011;14: 371–377.

52. Witmer BG, Singer MJ. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and virtual environments. 1998;7: 225–240.

53. Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology. 1993;3: 203–220.

54. Lombard M, Snyder-Duch J. Interactive advertising and presence: A framework. Journal of Interactive Advertising. 2001;1: 56–65.

55. Fow J, Reality V. A survival guide for the social scientist. Stanford University, Stanford; 2009.

56. Nelson CA, Dolgin KG. The generalized discrimination of facial expression by seven-month-old infants. Child development. 1985: 58–61. pmid:3987408

57. Hilgard J, Engelhardt CR, Bartholow BD. Individual differences in motives, preferences, and pathology in video games: the gaming attitudes, motives, and experiences scales (GAMES). Frontiers in psychology. 2013;4: 608. pmid:24058355

58. Washton AM. A Psychotherapeutic and Skills-Training Approach to the Treatment of Drug Addiction. COPYRIGHT STATUS. 2000: 139.

59. Gamito P, Oliveira J, Baptista A, Morais D, Lopes P, Rosa P, et al. Eliciting nicotine craving with virtual smoking cues. Cyberpsychology, Behavior, and Social Networking. 2014;17: 556–561.