1. Introduction
Technologies in education transform the processes by which education can take place and allow some topics to be taught more effectively [1,2,3,4,5], in a more fun way [6,7] or more interactively [8,9]. One of the technologies being discussed concerning new ways of working with education and new educational practices is immersive virtual environments (IVEs) [1,10,11]. Technology can serve as a tool to emphasize the constructivist elements of teaching [12,13], including collaboration, the ability to form one’s views and opinions on a particular issue [10,14,15], and the development of active learning. Working in virtual environments aims to support constructivist approaches that could otherwise be applied to a limited range of topics or would be difficult to employ.
Technology itself is not a universal solution to teaching [16]. It is necessary to look for ways to create a suitable educational environment and activities that enable students to develop their knowledge. It could be said that concerning immersive virtual environments, we are now challenged to find a way to properly carry out this educational transformation and to utilize the available research outputs to design necessary methodological recommendations and procedures. At present, sufficient empirical experience is still lacking [11,17].
Although the literature shows the gradually expanding possibilities of using immersive virtual environments in education [10,18] at various levels of schools [19,20], that does not mean that immersive virtual environments are being unconditionally accepted or easily applied to the school environment [21]. However, this technology undoubtedly enables the expansion of educational opportunities [22]. Research of virtual environments in education also specifically focuses on geography and understanding its complex natural phenomena [23,24,25]. The potential benefits of immersive technologies can be found, for example, in the study of Philips et al. [26], who examined the usage of immersive 3D geovisualization. The findings showed a range of benefits (improved understanding of the study area, higher interactivity with the data and enhanced motivation) and suggested that an immersive 3D visualization can increase learning effectiveness in higher education.
Within the constructivist paradigm in which we operate, the approach to any means of guidance during education in an IVE varies. Some authors, e.g., Meyer et al. [21], insist that pre-training in the form of introducing the topic of the following virtual reality (VR) lesson is essential for maximizing the educational effect. Chen et al. [27] defined a guided approach as one with additional navigating tools in the IVE (e.g., maps or arrows). In our study, we chose to distinguish between what we called guided lessons, in which the participants were introduced to the virtual environment and their task was explained to them (e.g., marking points on the map that fulfil certain criteria with flags) and unguided lessons, in which the participants were only taught to control the VR, but not given explanations about anything else concerning the environment, stimuli, or tools available). In this sense, the study tended to be closer to evaluating the features of minimally invasive education as perceived by Mitra [28].
This study’s novel approach is thus focused on the effect of having the application and task explained beforehand (guided lesson) on the understanding of a given topic within the context of the application design. Based on our previous teaching and research experience mentioned below (e.g., [29]), hypsography-related tasks were selected for the experimental lessons in the IVE.
Three objectives of this study are as follows:
To discuss, with domain experts—geography teachers—the advantages and drawbacks of using a collaborative immersive virtual environment in their school practice based on the experience with the platform eDIVE;
To analyze in more detail the domain experts’ views on the suitability of the (un)guided lessons for students and the possible effect it may have on students’ learning;
To gain feedback for the improvement and development of CIVEs such as on the eDIVE platform and instructional modules.
2. Materials and Methods
2.1. Research Methods and Techniques
We decided to take a qualitative approach due to the limited number of participants available and the need to understand the topic thoroughly. In addition, one of the advantages of such an approach is the emergence of unanticipated topics. The Research through Design (RtD) approach that we used allows conducting scholarly research that employs the methods, practices, and processes of design practice with the intention of generating new knowledge [30] (p. 166). The intention of RtD is to generate new knowledge by “making things and placing them into the world” [30] (p. 177). The central role in the knowledge-generating process is held by a CIVE prototype and its development and active use that enables interactions that were not possible before. Prototypes can give direction to research by creating new situations to investigate and revealing design patterns, inducing discussion with different stakeholders, or uncovering new phenomena and challenges in the design. Enabling interaction between persons and VR software in this experiment can generate new and valuable findings. When we focus on user experience (UX) findings, of the CIVE, the research moves from the level of application design to the level of lesson/course design, where VR is merely implemented to enhance teaching.
Several data collection techniques were used during the experiment. We used the reflection technique where participants were supposed to cooperate, formulate their ideas and thoughts, and present them in a structured way as answers to questions we asked. Participants—the domain experts—were then interviewed in a focus group. The focus group minimized the researchers’ influence, who only moderated the discussions or brought up the topics omitted by participants through subtle hints. The targets of the focus group were to obtain experts’ evaluation of the educational potential of a CIVE and to detect practical challenges and issues regarding teaching in a virtual environment. Each step of the data collection process (reflection, focus group, experience in the CIVE) was audio-recorded. Transcription of the audio recordings of the reflection and focus group was used as a base for qualitative analysis. Additionally, the experience in the CIVE was both audio- and video-recorded to create a complete picture and to confirm or confront the testimony of teachers during the follow-up reflection and focus group. Simultaneously, at least three researchers were present with each group to observe the participants’ behavior and interactions. These data provide the researchers with objective complementary information and captures participants’ unconscious and nonverbal reactions and behavior.
2.2. Apparatus and Research Environment
The currently presented experiment followed up on the original study and drew from the original experimental CIVE application for geography education [29]. However, a brand new software solution was used in this study—the above-mentioned eDIVE platform [31]—which allows for efficient real-time collaboration. The application is built as a shared virtual room for multiple users, who can be physically split into more than one physical room. The head-mounted displays (HMDs) enable them to communicate and collaborate in a virtual environment. Users can freely move around the room and explore the content from different angles and sides or use teleporting when the physical space is limited. Multiple users are displayed as simple avatars without legs and with HMDs and controllers that they are holding. The main element of the virtual space is a table with a map in the center of the room (Figure 1). The default visualization is a 2D map of terrain that can be altered to two other different terrains by clicking the buttons next to the map.
The study took place at the Department of Geography at Masaryk University in Brno, the Czech Republic, mostly in two separate rooms, one for each group. In total, ten users out of the domain experts pool volunteered for the study. Three researchers and five participants were present in each room during the various steps of the experiment (see Section 2.4 Procedure). During step 4, Collaboration in CIVE, participants were placed into more rooms so that there was a maximum of two participants in each room to provide enough space for movement in the virtual environments and to prevent echoes in the virtual environment. Each participant was equipped with an Oculus Quest 2 HMD (Qualcomm® Snapdragon™ XR2 Platform, Adreno 650 graphic unit, 6 GB RAM) and two controllers. In each room, there was also a computer (Predator) to record the collaboration task in the CIVE, a device provided for presenting the reflection results, and a JABRA speakerphone to audio-record the focus group.
2.3. Task Description
For the purposes of this study, one task was performed—the so-called Mirror Signals [29]. Participants were placed into a virtual environment in front of a table with a map and two fixed flags marking start point (A) and endpoint (B). Five more flags were prepared next to the map (numbered 1, 2, 3, 4, 5) that could be picked up and transferred to it. The aim was to connect start point A with endpoint B using the extra flags while maintaining direct visibility from the start point to the endpoint—in such a way that mirror signals can be transmitted. The intention of the task was to use as few additional flags as possible. Figure 2 illustrates examples of right and wrong startpoint-endpoint connections.
We used two different methods of task instruction, and therefore, the participants were split into two groups we named “Alpha” and “Bravo.” The Alpha group was given more thorough, structured, and unambiguous guided instructions. On the contrary, the Bravo group was deliberately given a general task only, which would allow for a potentially more exploratory and creative way of problem-solving (Table 1).
2.4. Procedure
Participants—the domain experts—volunteered to attend the collaborative, interactive part of a VR workshop during the Geography Summer School at Masaryk University in Brno in August 2021. Afterward, they underwent a six-step procedure: 1. A general VR introduction; 2. VR manipulation training; 3. Task description (different for each group based on its method); 4. Collaboration in CIVE; 5. Reflection instruction and presentation; 6. A semi-structured focus-group. The procedure for both groups took, on average, two hours.
The first step consisted of a general introduction to the IVE and its particular use in education and training and splitting participants into two groups of five people each. Next, we explained the comfort of wearing a VR HMD and the basic manipulation of the controllers to navigate themselves around the Oculus menu. Participants were then trained via the app Oculus Quest 2: The First Steps, to become familiar with the controllers and interact with the objects in a virtual environment. Then, they were asked to take off their HMD and one of the researchers gave short instructions on the experiment app on a computer screen and delivered the task description. They were then split and moved to separate rooms to conduct the collaboration task in the VR. They were able to communicate together in a virtual environment via built-in speakers and microphones. After the VR simulation, participants moved back to the main research room. They were assigned two questions to answer. The questions were: 1. What can students learn from the app? 2. How could students work with the app? Then, they presented their reflection in a short PPT presentation. The final step of the procedure was the focus group. The focus group was semistructured and we asked the participants questions from the following areas set by priority interest: 1. The educational potential of the current teaching design (exploration using CIVE) from the teachers’ point of view; 2. Functions of the geographical task from experts’ point of view; 3. Adaptation of the scenario for real teaching—practical issues, challenges; 4. UX of an IVE app. Audio recordings of reflection presentations and the focus-group were captured by JABRA speakerphone and recorded by OBS Studio software. Finally, participants were rewarded with small gifts (headphones, flash discs, SD cards). A scheme of the experiment’s procedure is illustrated in Figure 3.
2.5. Participants
A total number of 10 participants aged 27 to 55 volunteered for the study. Seven participants were men and three participants were women. They collaborated on geospatial tasks on the platform eDIVE in two research groups based on the type of instructions that they received. The research groups were established randomly with emphasis on a gender balance in each group. None of them had significantly experienced an IVE (apart from for gaming or entertainment purposes). The participants were all either elementary or high school Geography teachers (K12 Geography teachers), which makes them so-called domain experts [32]. They were asked in advance via an online questionnaire about their visual impairments and other possible medical limitations which could have made the VR experience significantly more uncomfortable. Participants were encouraged to report any cybersickness issues and were briefed on options to end participation at any moment if required. The training session in the VR app is illustrated on Figure 4.
3. Results
Practically no differences between opinions on the need for guidance for students in the CIVE in the guided and the unguided groups were found. The participants were able to differentiate between their own first-hand experience in the CIVE and the potential needs of the students, as they literally and repeatedly did; “I think that because we have the knowledge of the contour lines, it wasn’t entirely new for us and we were able to quickly orient ourselves. If we didn’t know anything about the contour lines, we would probably be guessing what these lines mean and what to do with them for a long time. And that would end in disappointment in the students.”
Several topics were discussed from the general use of an IVE in education, guided and unguided approaches to teaching in it, cooperative learning possibilities through the implementation process, software upgrade tips, and new scenarios for the current version of the instructional module used. It was also repeatedly stated that the approach to education would differ according to the age level of the students. The suggestions stated here are meant for high school students and primary school students. Lastly, the current situation in education and the means of employment of the IVE in the classes were discussed.
3.1. CIVE, Its Advantages and Limitations in the Context of Education
The main topics that emerged from the focus groups were the attractiveness of the technology and its effect on the students, the prospect of gamification, easy visualization, place and phenomenon availability, and the effect of anonymity.
3.1.1. Attractiveness of the Technology as an Enhancer and a Distractor
Both groups expected that the novelty of the CIVE would lead to higher motivation in students. The guided group was more focused on the virtual environment in general—“… the remarkability and strangeness of the environment will motivate the students, it makes it interesting...”, “Happiness from the other reality, the uncanny feeling of teleportation and orientation …”, “… it was unbelievable, as if I was holding someone’s hand in reality (during playing in the introductory app to the VR) …”. The participants expected that the first few uses of the HMDs would not lead to much learning; the new environment will consume the students’ attention and they would not be able to concentrate on anything else, as was previously the case with nature walks and the Kahoot! application (a free application for teachers for making short quizzes; [33]).
This makes the attractiveness of the IVE slightly counterproductive as the main goal. However, they also expected that the novelty effect would eventually wear off. The same had happened with the previously mentioned educational alternatives, which were, at the beginning, much fun for the students, but now just common practice during the lessons.
3.1.2. Gamification
The virtual environment resembles the classical video games environment and this association may increase the positive attitudes in the CIVE. One of the possibilities for using games in education was the use of quiz competitions among students with an announced winner at the end. Some participants suggested that letting the students play games in the IVE after school work would work to motivate them, but some were against it, saying that the VE should be motivation itself.
3.1.3. Immediate Visualization for Everyone
The biggest opportunity that the IVE was seen to offer among all participants was the potential to improve the internal visualization of complex topics. With proper visualization, students are able to see deeper connections, which further supports their understanding of a given topic.
A few of the hardest topics for 3D imagination in geography, according to the participants, are the weather fronts and planetary orbits. If the students were able to move the planets themselves to see what is happening, it would help them to understand how it works. In general, if the students could “touch” it, the participants regarded it as a more effective approach. Animations of those phenomena would also ease the teachers’ work, who would not have to draw by hand, which is, according to the participants, quite difficult.
With the 3D models, students could also easily learn how the relief restricts view and how the shape of reliefs differs from each angle.
Another perk of the IVE is the immediate visualized feedback. The participants suggested working in 2D mode, and once the task is finished, the teacher would switch to 3D and the students would better understand their mistakes in relation to the real world.
3.1.4. Places and Phenomenon Proximity
One of the undeniable advantages of the IVE is the possibility to go practically anywhere, a real or unreal place, in no time at all. The participants also reiterated this aspect. They liked the availability of not only distant locations, but also locations inaccessible due to the extreme weather—volcanoes, tectonic, or flooded karstic caves were mentioned. Another plus is that these places can be viewed with their actual proportions as well. In addition, a sort of time travel is available—students can see the formation of riverbeds, karsts, or mountains and compare them according to their age.
Another suggestion was to develop an app with places that students know near to their school. This way they could first theoretically work with it in the IVE and then apply their knowledge in the real world.
3.1.5. Highs and Lows of Anonymity
The option of anonymity in the CIVE was repeatedly mentioned as an advantage, even though it is possible to avoid the anonymity if desired. For the students that are normally too shy to engage with others, it might be easier to participate in anonymous environments. In addition, the traditional hierarchy of the class could be disturbed in the anonymous CIVE, so the students could switch roles with more ease. The effects of this could spill over into the “real world” classes, making the collective more connected.
The participants also feared that the names given in the CIVE could bring mockery to the class. This could be because their nicknames were truly random and somewhat funny, but the teachers would prepare the nicknames beforehand, and as the participants agreed, they saw no problem whatsoever with neutral names.
3.1.6. Cooperation in IVE
The importance of cooperative tasks for the students was discussed. These tasks allow them to create something and find out information themselves instead of just watching passively without participating. In a cooperative task, students would have to decide which role each of them will have, in order to smoothly and quickly solve the problem. Some participants suggested that the students should plan their cooperation in advance instead of during the task.
The teachers could theoretically imagine using the CIVE with the entire class (20–30 students), and at the beginning, they worked with this approach, but the problems of how to manage that soon emerged (see Section 3.3 Implementation).
One problem that may occur is with the easily manipulatable controllers and microphones in other avatars. Even if it was not anyone’s intention to mute their schoolmates, it may create chaos among students and even aversion toward the CIVE. Therefore, it would be best to let the students cooperate once they know how the controllers work and how to easily undo anything that they did not mean to do.
According to the participants, some form of misbehavior is to be expected. It is not only that students may not try to participate, but they might also try to disrupt the work of others. For example, deleting the whiteboard without consent, which happened during distance learning during the pandemic. However, the participants also stated that once the students got a cooperative task, they began to work straight away. Thus, the need for guidance can be applied here as well. It is good for the students to see the progress of their work immediately, for example, through written records of their work or procedures in the IVE.
The presentation of the final outcome of the students’ work is expected as well, during which the teachers can demonstrate other features available in the IVE that the students have not seen before—graphs or pictures.
The participants also suggested one form of explorative competitive collaboration in the IVE, meaning that students, divided into groups, would try their best to find out what to do and how. Once they made a mistake, another group would go in. However, as the groups would be aware of the mistakes of the previous groups, it would be highly unfair and demotivating for the first groups, which were designed to lose.
3.2. Guided versus Unguided Lessons
Interestingly, both groups perceived their activity in the CIVE as unguided and their potential lectures were planned accordingly. The general idea of a guided lesson was with a teacher in the IVE also participating in the lesson. The participants thought that without guidance, the students could get lost, especially when they have no previous knowledge of the given topic and do not understand the maps’ settings. The participants feared that this would destroy the positive effect of the CIVE for the students. Both groups of participants (guided and unguided) agreed that some sort of leadership from teachers is needed in the CIVE. The participants also agreed on the importance of students learning by themselves to facilitate retention. Usually, the order of guidance and exploration differed, and some participants also suggested including short theoretical lectures during the lessons (either in an IVE or in the real environment). One suggestion was to first let the students explore in the CIVE; then, the lecture would follow and the lesson would end again in the CIVE, but this time, the students would already understand the topic. Another approach would be to let the students into the CIVE after the lecture, and they would have to collectively solve some problems related to the topic to comprehend it more. The opposite approach was also suggested—first, the students would try to understand the topic themselves in the CIVE and, at the end of the lesson, the teacher would sum it up for them.
Many ways of guiding the students in the CIVE were named—apart from the teachers navigating them through it—and they could also receive instructions written in virtual notebooks.
The exploration need not be limited to in-app exploration; some participants suggested freedom in topic-related exploration. “When states or cities are discussed, they (students) can have a look at information that interests them and not at the things I’ll show them.”
It was proposed that the explorative options should be limited—the interval of the contour lines should be fixed, for example. This would mean less distraction during the exploration and students would concentrate solely on the main subject matter.
Concerns were raised about the suitability of unguided lessons for students (not only) with special needs. Some thought it could benefit these learners, as they have seen during the pandemic—once they were able to go at their own pace, their results drastically improved, but other students suddenly struggled.
3.3. Implementation
The main problem mentioned by participants regarding the use of the CIVE in schools was their support and maintenance. The IT departments are already supposed to take care of many things—tens of computers, the internet connection, school websites, etc. It seemed unlikely to them that the technicians would be willing to take care of a dozen HDMs (head-mounted displays) as well. They thought that schools would probably have to hire someone for a part time job to take on that task. The schools seem to have enough resources for that (according to our participants), but the paperwork and hiring process remains a complication.
How to get some truly educational apps was also a topic. Currently, there are not that many available, and for the teachers, it would also be crucial to know the sources of the information provided in the app, which is not something that every developer would be willing to share.
Another problem was seen in the desirability, willingness, and general motivation in teachers to use the CIVE in their classes. As an example, they named the interactive whiteboards that are currently in every classroom, but scarcely used to their full potential. It is certainly a more demanding task to prepare lessons with the use of new technology, especially for the older generations, who tend to stick to the same education plan and techniques for years. However, our participants were not comprised of the youngest teacher generation only and yet they all were excited about the prospects of the CIVE. It is important for the teachers to see the purpose of the CIVE: “… there are complications and it’s up to the teachers’ activity, whether they want to use it or not. The purpose and knowledge, that I will gain the children’s interest, that it will be great and they’ll go home excited must prevail and then I’ll do it”.
Another problem that emerged was with insufficient space during classes—there are too many students for any practical use of the HMDs—in these cases, the participants suggested students take turns in different activities during lessons and one station would be the CIVE activity. However, they also said that it would probably be too short and technical problems could shorten this time even more. This could also take more than a single lesson to realize, which may further complicate the schedule. One of the suggestions of how to compensate for this problem was to allow students to take the HMDs home. However, bureaucratically, it would be extremely difficult to establish everything according to the law and, moreover, the timetable would be tricky to form, due to the commuting students. The nicest solution was to use the HMDs in specialized courses only. Typically, there are fewer students enlisted in these courses and they are scheduled after the main classes, which means more room available (apart from empty classrooms, the gym was also suggested) and enough HMDs for each student to have one. This may limit the understanding of a topic among students in one class, but not everything is equally important for everyone; thus, some students may “give up” understanding contour lines in favor of understanding topology, etc. This may also help to solve the problem with the teachers’ lack of motivation to work with the VR. As the students choose these courses according to their interests, it is expected that their level of motivation is higher than those students in regular classes. To work with highly motivated students under good conditions makes the time and complications involved in planning worth it.
The last problem that was addressed was the possibility of (motion) sickness in the IVE. Even in applications where motion is mostly unnecessary, the students might get sick and thus be unable to finish the lesson. To determine which students are able to go through it is again time-demanding even for a small group of students. One solution to this could be projecting the VE during classes. The teachers would be the ones using the HMDs and students would only watch them on a screen. This would eliminate the problems with IVE-induced sickness and also with the need to divide students. This would be a very VR-accessible way for all.
3.4. New Instructional Scenarios and Functionality Upgrade Suggestions
Following their experience in this particular CIVE, the participants came up with many software improvements for smoother class work and new scenarios applicable in the current version of the application.
3.4.1. Software Functionality Upgrade
The participants would appreciate labels in Czech on controllers and the available manuals (either written or map-dependent). In addition, they were missing a function that would export the students’ collective notes to cloud storage, where they would be downloadable. Both groups were missing measuring scales on the maps as well.
One suggestion for preventing students from misbehaving was to block them from the environment once they are inactive for some time, are far away from their classmates, or do not participate at all in the collaborative tasks. This solution will not be able to differentiate between intention and inability to properly orient in the IVE. This seems to create more problems than solutions, as there may be tasks where one of the premises is necessary for completion or some students get blocked without reason and then the teacher would have to deal with it and the time costs would be too high and the environment too rigid.
3.4.2. Instructional Task Suggestions
“We thought that it would be very cool if the students had the opportunity to plan a trip from place A to place B with minimal hill climbing or plan the easiest trail between two points.” Hike planning was suggested in both groups and, according to one participant, they do this in real summer excursions and often end up with horrible journeys, because it is completely up to their students to lead the way. “Where would be the ideal place to build a house?” or “Where is the best place to build a hydroelectric power station?” were also suggested tasks for the students to deal with.
4. Discussion
The research participants—domain experts in geography education—tested a CIVE module, designed for hypsography lessons. Within the qualitative study, they reflected on their personal experience in the role of students attending the educational scenario (with an either guided or unguided approach), but they mainly reflected on the possibilities and limitations of the eDIVE platform and of the educational module from their own expert perspective.
The use of a CIVE in education was altogether regarded as a good idea. The novelty and uniqueness of it were seen as a good means to motivate the students, even though it may be too distracting at the beginning. The option of anonymity holds a potential benefit for shy students that are not able to fully participate in the class in the real environment.
Having fun while learning or being immersed in the activity while studying also corresponds to data from other research [16,34,35]. Research among teachers has shown that they believe that IVEs will lead to greater student motivation, supported by previous studies [17,21]. Anonymity in the CIVE has become a separate topic. Maloney et al. [36] pointed out that anonymity and the ability to decide with whom anonymity-breaking information is shared can be crucial to the resulting educational process and should be considered in the design of the overall environment. Teachers who know the risks and benefits of an anonymous or partially anonymous environment also work with this ambivalence. However, this is a widely debated topic with unclear results [37,38,39].
The main educational potential of the IVE was stated as the ability to easily visualize complex phenomena and to bring the students anywhere in the world. The participants are aware that many of their students do not understand complex topics and only blindly repeat learned phrases. The IVE could help everyone better understand and reduce the gap between the most and least gifted students.
Specific possibilities are offered by using an IVE as a mediator of phenomena or new forms of experience. Some studies [10,14,16] highlighted the importance of IVEs for novices or less experienced individuals, which could be precisely related to compensating for a lack of imagination. The IVE offers the possibility of understanding the world in spatial contexts [17,35,40,41]. Other studies highlighted that IVEs can foster imagination, which can manifest itself in the creative process [42,43] or in the process of further thinking, for example, in science [35].
It was also agreed that there is a need for guidance in the CIVE. The suggested forms differed, but usually, the CIVE activity was interspersed in places with a theoretical lecture from the teacher. This shows the difference between the researchers’ expectation and teachers’ expectation of guidance level. The form of guidance given in the guided group was not sufficient for the participants to call guidance. Their idea of guidance was more similar to Chen et al.’s [27] but with more room for the students to explore, which is known to improve information retention [44]. The prospects of cooperative tasks during learning in the CIVE were mentioned and some concrete forms of it were suggested, as well as the use of gamification to motivate the students more. The cooperation was deemed important as it is important for the students to actively participate and see the outcome of their work to learn more efficiently.
Meyer et al. [21] pointed out the importance of pre-training, especially concerning the quality of the learning process and student distraction. Pre-training and/or guidance made learners focus on what is essential. Similar views can be seen in other studies [27,45,46,47]. Here, the research discourse coincides with teachers’ beliefs that a more fixed assignment is educationally advantageous. Gamification is seen in the literature as a critical element of IVE’s use in education [48,49]. Similarly, we can observe a positive acceptance of the connection between gamification and the determination process [5,50].
The biggest obstruction was seen in the implementation of the VR in schools, as it is not only logistically demanding to maintain the HMDs and schedule enough classrooms to use them in, but it is also hard to ensure the willingness of the teachers to use it. The common practice among teachers according to our participants is to practically ignore any new equipment. A solution to this may not be so easy to find, as this problem does not seem to be entirely age-related, but more motivation-related. There are too many problems that may occur during the lesson and, thus, teachers find this method not worth it. Were sufficient explanation about the full potential of the IVE in education and how to properly work with it given, the teachers would be more likely to incorporate it into their lessons. The participants proposed specific function-related adjustments so the eDIVE platform better meets the user requirements (e.g., ability to write notes). Furthermore, they created new scenarios for the existing module, which elevate the educational potential of the application without any need for changes to the functionality.
Reflections and suggestions of domain-experts gained in the Research through Design process are used in the development of the platform eDIVE and specific instructional modules.
Limitations
Given the type of this study, the sample size was still small. The results are likely to be culture-dependent, as not every country has a positive approach toward children with electronics or enough money to supply schools with the HMDs. Participants in this study graduated from Czech universities and had been educated in the Czech education system; thus, it is possible that their perception and opinions on the IVE is different compared to other teachers from different cultural and educational backgrounds. In addition, the self-selection of participants may imply that these participants have a positive attitude to new teaching techniques and an overall more proactive approach toward their teaching improvement.
5. Conclusions and Future Outlook
The teachers reported great educational potential in using the CIVE during lessons. However, since both groups perceived their experience as unguided, the guided approach should have more structure in practice. Consideration to the needs of the class should be given when deciding on the amount of guidance to provide. The teachers stated many possible problems with the implementation of the technology. However, they also found a solution for every problem, so if interested, schools could find a way to make it work. Based on the findings from this qualitative study, we are preparing quantitative research on real students to shed more light on the suitability of IVEs for education.
Only the substantial activities are listed for each author. Conceptualization, Kateřina Jochecová, Natálie Káčová, Čeněk Šašinka, Zdeněk Stachoň, Michal Černý and Hana Švedová; methodology, Kateřina Jochecová, Čeněk Šašinka, Michal Černý, Natálie Káčová and Zdeněk Stachoň; software, Jiří Chmelík, Vojtěch Brůža and Pavel Ugwitz; validation, Kateřina Jochecová, Hana Švedová, Čeněk Šašinka and Zdeněk Stachoň; formal analysis, Kateřina Jochecová, Čeněk Šašinka and Hana Švedová; investigation, Kateřina Jochecová, Hana Švedová, Čeněk Šašinka, Zdeněk Stachoň and Ondřej Kvarda; resources, Michal Černý and Čeněk Šašinka; data curation, Kateřina Jochecová, Čeněk Šašinka and Hana Švedová; writing—original draft preparation, Kateřina Jochecová, Michal Černý, Hana Švedová, Čeněk Šašinka and Zdeněk Stachoň; writing—review and editing, Nicola Catherine Fořtová and Alžběta Šašinková; visualization, Hana Švedová; supervision, Čeněk Šašinka and Zdeněk Stachoň; project administration, Čeněk Šašinka, Zdeněk Stachoň and Jiří Chmelík; funding acquisition, Čeněk Šašinka and Zdeněk Stachoň. All authors have read and agreed to the published version of the manuscript.
This research was funded by Technology Agency of the Czech Republic, grant number TL03000346 “Education in Collaborative Immersive Virtual Environments”.
Not applicable.
Informed consent was obtained from all subjects involved in the study.
Not applicable.
The authors would like to thank all volunteers and colleagues who participated in this study. This work was supported by the research infrastructure of the HUME Lab Experimental Humanities Laboratory, Faculty of Arts, Masaryk University.
The authors declare no conflict of interest.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Enlarge this image.Figure 1. Example of a map in CIVE. (a)—2D blank map with contour lines; (b)—3D model with contour lines; (c)—3D model with changed contour lines interval by the Equidistance slider; (d)—cross-section of the highest parts of the terrain. On the table—There are purple buttons 1, 2, 3 for different terrains on the left, a blue “Evaluate” button to evaluate visibility between flags A and B, a green “Blank/Ortho” button to switch blank map with orthophoto map, a green “2D/3D” switch button, an “Equidistance” slider for the dynamic setting of contour equidistance, and a “Cross-section” slider to cut upper parts of the terrain.
Enlarge this image.Figure 2. Evaluation of direct visibility. (a) Incorrect (b) and correct connecting startpoint (A) and endpoint (B). Direct visibility is not ensured between points A and B in the left figure, unlike in the right figure, where the flag is placed on the top of the ridge.
Guided and unguided task instructions.
| Guided | We developed a virtual reality application for learning geography with an emphasis on possible student collaboration. We also designed a tutorial for this application. The aim is for students to explore the application’s content freely and independently and actively discover its possibilities. |
| Unguided | We developed a virtual reality application for learning geography with an emphasis on possible student collaboration. We also designed a tutorial for this application. The aim is for students to explore the application’s content freely and independently and actively discover its possibilities. |
References
1. Merchant, Z.; Goetz, E.T.; Cifuentes, L.; Keeney-Kennicutt, W.; Davis, T.J. Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Comput. Educ.; 2014; 70, pp. 29-40. [DOI: https://dx.doi.org/10.1016/j.compedu.2013.07.033]
2. Kadiyala, M.; Crynes, B.L. A Review of Literature on Effectiveness of Use of Information Technology in Education. J. Eng. Educ.; 2000; 89, pp. 177-189. [DOI: https://dx.doi.org/10.1002/j.2168-9830.2000.tb00512.x]
3. Verbruggen, S.; Depaepe, F.; Torbeyns, J. Effectiveness of educational technology in early mathematics education: A systematic literature review. Int. J. Child Comput. Interact.; 2021; 27, 100220. [DOI: https://dx.doi.org/10.1016/j.ijcci.2020.100220]
4. Syakur, A.; Fanani, Z.; Ahmadi, R. The Effectiveness of Reading English Learning Process Based on Blended Learning through “Absyak” Website Media in Higher Education. Bp. Int. Res. Crit. Linguist. Educ. (BirLE) J.; 2020; 3, pp. 763-772. [DOI: https://dx.doi.org/10.33258/birle.v3i2.927]
5. Loureiro, S.M.C.; Bilro, R.G.; Angelino, F.J.D.A. Virtual reality and gamification in marketing higher education: A review and research agenda. Span. J. Mark.-ESIC; 2021; 25, pp. 179-216. [DOI: https://dx.doi.org/10.1108/SJME-01-2020-0013]
6. Mon, C.S.; Yap, K.M.; Ahmad, A. A Preliminary Study on Requirements of Olfactory, Haptic and Audio Enabled Application for Visually Impaired in Edutainment. Proceedings of the 2019 IEEE 9th Symposium on Computer Applications & Industrial Electronics (ISCAIE); Kota Kinabalu, Malaysia, 27–28 April 2019; pp. 249-253.
7. Leff, S.S.; Waasdorp, T.E.; Paskewich, B.S.; Bevans, K.B.; Winston, F.K. The Free2B Multi-Media Bullying Prevention Experience: An Exemplar of Scientific Edutainment. Front. Psychiatry; 2020; 11, 679. [DOI: https://dx.doi.org/10.3389/fpsyt.2020.00679]
8. Zhang, L.; Bowman, D.A.; Jones, C.N. Exploring Effects of Interactivity on Learning with Interactive Storytelling in Immersive Virtual Reality. Proceedings of the 2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games); Vienna, Austria, 4–6 September 2019; pp. 1-8.
9. O’Connor, E.; Worman, T. Designing for Interactivity, While Scaffolding Student Entry, Within Immersive Virtual Reality Environments. J. Educ. Technol. Syst.; 2018; 47, pp. 292-317. [DOI: https://dx.doi.org/10.1177/0047239518817545]
10. Potkonjak, V.; Gardner, M.; Callaghan, V.; Mattila, P.; Gütl, C.; Petrovj, V.M.; Jovanovj, K. Virtual laboratories for education in science, technology, and engineering: A review. Comput. Educ.; 2016; 95, pp. 309-327. [DOI: https://dx.doi.org/10.1016/j.compedu.2016.02.002]
11. Radianti, J.; Majchrzak, T.A.; Fromm, J.; Wohlgenannt, I. A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Comput. Educ.; 2020; 147, 103778. [DOI: https://dx.doi.org/10.1016/j.compedu.2019.103778]
12. Huang, H.-M.; Liaw, S.-S. An Analysis of Learners’ Intentions Toward Virtual Reality Learning Based on Constructivist and Technology Acceptance Approaches. Int. Rev. Res. Open Distrib. Learn.; 2018; 19, pp. 91-115. [DOI: https://dx.doi.org/10.19173/irrodl.v19i1.2503]
13. Johnston, E.; Olivas, G.; Steele, P.; Smith, C.; Bailey, L. Exploring Pedagogical Foundations of Existing Virtual Reality Educational Applications: A Content Analysis Study. J. Educ. Technol. Syst.; 2018; 46, pp. 414-439. [DOI: https://dx.doi.org/10.1177/0047239517745560]
14. Dyer, E.; Swartzlander, B.J.; Gugliucci, M.R. Using virtual reality in medical education to teach empathy. J. Med. Libr. Assoc.; 2018; 106, pp. 498-500. [DOI: https://dx.doi.org/10.5195/jmla.2018.518] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/30271295]
15. Pulijala, Y.; Ma, M.; Pears, M.; Peebles, D.; Ayoub, A. Effectiveness of Immersive Virtual Reality in Surgical Training-A Randomized Control Trial. J. Oral Maxillofac. Surg.; 2018; 76, pp. 1065-1072. [DOI: https://dx.doi.org/10.1016/j.joms.2017.10.002] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/29104028]
16. Johnson, W.L.; Lester, J.C. Face-to-Face Interaction with Pedagogical Agents, Twenty Years Later. Int. J. Artif. Intell. Educ.; 2016; 26, pp. 25-36. [DOI: https://dx.doi.org/10.1007/s40593-015-0065-9]
17. Makransky, G.; Lilleholt, L. A structural equation modeling investigation of the emotional value of immersive virtual reality in education. Educ. Technol. Res. Dev.; 2018; 66, pp. 1141-1164. [DOI: https://dx.doi.org/10.1007/s11423-018-9581-2]
18. Górski, F.; Buń, P.; Wichniarek, R.; Zawadzki, P.; Hamrol, A. Effective Design of Educational Virtual Reality Applications for Medicine using Knowledge-Engineering Techniques. EURASIA J. Math. Sci. Technol. Educ.; 2017; 13, pp. 395-416. [DOI: https://dx.doi.org/10.12973/eurasia.2017.00623a]
19. Hew, K.F.; Cheung, W.S. Use of three-dimensional (3-D) immersive virtual worlds in K-12 and higher education settings: A review of the research. Br. J. Educ. Technol.; 2010; 41, pp. 33-55. [DOI: https://dx.doi.org/10.1111/j.1467-8535.2008.00900.x]
20. Civelek, T.; Ucar, E.; Ustunel, H.; Aydın, M. Effects of a Haptic Augmented Simulation on K-12 Students’ Achievement and their Attitudes towards Physics. Eurasia J. Math. Sci. Technol. Educ.; 2014; 10, pp. 565-574. [DOI: https://dx.doi.org/10.12973/eurasia.2014.1122a]
21. Meyer, O.A.; Omdahl, M.K.; Makransky, G. Investigating the effect of pre-training when learning through immersive virtual reality and video: A media and methods experiment. Comput. Educ.; 2019; 140, 103603. [DOI: https://dx.doi.org/10.1016/j.compedu.2019.103603]
22. Jensen, L.; Konradsen, F. A review of the use of virtual reality head-mounted displays in education and training. Educ. Inf. Technol.; 2018; 23, pp. 1515-1529. [DOI: https://dx.doi.org/10.1007/s10639-017-9676-0]
23. Young, G.; Stehle, S.; Yazgı, B.; Tiri, E. Exploring Virtual Reality in the Higher Education Classroom: Using VR to Build Knowledge and Understanding. J. Univers. Comput. Sci.; 2020; 26, pp. 904-928. [DOI: https://dx.doi.org/10.3897/jucs.2020.049]
24. Batty, M. Virtual Reality in Geographic Information Systems. The Handbook of Geographic Information Science; Wilson, J.P.; Fotheringham, A.S. Blackwell Publishing: Oxford, UK, 2008; pp. 317-334.
25. Fisher, P.; Unwin, D. Virtual Reality in Geography; Taylor and Francis Ltd.: London, UK, 2001.
26. Philips, A.; Walz, A.; Bergner, A.; Graeff, T.; Heistermann, M.; Kienzler, S.; Korup, O.; Lipp, T.; Schwanghart, W.; Zeilinger, G. Immersive 3D geovisualization in higher education. J. Geogr. High. Educ.; 2015; 39, pp. 437-449. [DOI: https://dx.doi.org/10.1080/03098265.2015.1066314]
27. Chen, C.J.; Toh, S.C.; Ismail, W.M.F.W. Are Learning Styles Relevant To Virtual Reality?. J. Res. Technol. Educ.; 2005; 38, pp. 123-141. [DOI: https://dx.doi.org/10.1080/15391523.2005.10782453]
28. Mitra, S. Minimally invasive education: A progress report on the “hole-in-the-wall” experiments. Br. J. Educ. Technol.; 2003; 34, pp. 367-371. [DOI: https://dx.doi.org/10.1111/1467-8535.00333]
29. Šašinka, Č.; Stachoň, Z.; Sedlák, M.; Chmelík, J.; Herman, L.; Kubíček, P.; Šašinková, A.; Doležal, M.; Tejkl, H.; Urbánek, T. et al. Collaborative Immersive Virtual Environments for Education in Geography. ISPRS Int. J. Geo-Inf.; 2019; 8, 3. [DOI: https://dx.doi.org/10.3390/ijgi8010003]
30. Zimmerman, J.; Forlizzi, J. Research Through Design in HCI. Ways of Knowing in HCI; Olson, J.; Kellogg, W. Springer: New York, NY, USA, 2014; pp. 167-189.
31. Šašinka, Č.; Chmelík, J.; Šašinková, A.; Stachoň, Z. The platform eDIVE: A Solution for the Geography Education in Collaborative Immersive Virtual Environment. Proceedings of the ICC 2021—30th International Cartographic Conference; Florence, Italy, 14–18 December 2021.
32. Følstad, A. Work-Domain Experts as Evaluators: Usability Inspection of Domain-Specific Work-Support Systems. Int. J. Hum. Comput. Interact.; 2007; 22, pp. 217-245. [DOI: https://dx.doi.org/10.1080/10447310709336963]
33. Byrne, R. Kahoot!—Create quizzes and surveys your students can answer on any device. Free Technol. Teach.; 2013; Available online: https://www.freetech4teachers.com/2013/11/kahoot-create-quizzes-and-surveys-your.html# (accessed on 29 November 2021).
34. Moro, C.; Stromberga, Z.; Raikos, A.; Stirling, A. The effectiveness of virtual and augmented reality in health sciences and medical anatomy. Anat. Sci. Educ.; 2017; 10, pp. 549-559. [DOI: https://dx.doi.org/10.1002/ase.1696]
35. Lindgren, R.; Tscholl, M.; Wang, S.; Johnson, E. Enhancing learning and engagement through embodied interaction within a mixed reality simulation. Comput. Educ.; 2016; 95, pp. 174-187. [DOI: https://dx.doi.org/10.1016/j.compedu.2016.01.001]
36. Maloney, D.; Zamanifard, S.; Freeman, G. Anonymity vs. Familiarity: Self-Disclosure and Privacy in Social Virtual Reality. Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology; Ottawa, ON, Canada, 1–4 November 2020; 25.
37. Lloyd, A.; Rogerson, S.; Stead, G. Imagining the Potential for Using Virtual Reality Technologies in Language Learning. Digital Language Learning and Teaching: Research, Theory and Practice; Carrier, M.; Damerow, R.M.; Bailey, K.M. Routledge: New York, NY, USA, 2017; pp. 222-234.
38. Coyne, L.; Merritt, T.A.; Parmentier, B.L.; Sharpton, R.A.; Takemoto, J.K. The Past, Present, and Future of Virtual Reality in Pharmacy Education. Am. J. Pharm. Educ.; 2019; 83, 7456. [DOI: https://dx.doi.org/10.5688/ajpe7456]
39. Simpson, R.L. The virtual reality revolution: Technology changes nursing education. Nurs. Manag.; 2002; 33, pp. 14-15. [DOI: https://dx.doi.org/10.1097/00006247-200209000-00007]
40. Huang, K.T.; Ball, C.; Francis, J.; Ratan, R.; Boumis, J.; Fordham, J. Augmented Versus Virtual Reality in Education: An Exploratory Study Examining Science Knowledge Retention When Using Augmented Reality/Virtual Reality Mobile Applications. Cyberpsychol. Behav. Soc. Netw.; 2019; 22, pp. 105-110. [DOI: https://dx.doi.org/10.1089/cyber.2018.0150] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/30657334]
41. Johnson-Glenberg, M.C.; Megowan-Romanowicz, C.; Birchfield, D.A.; Savio-Ramos, C. Effects of Embodied Learning and Digital Platform on the Retention of Physics Content: Centripetal Force. Front. Psychol.; 2016; 7, 1819. [DOI: https://dx.doi.org/10.3389/fpsyg.2016.01819] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27933009]
42. Patera, M.; Draper, S.; Naef, M. Exploring Magic Cottage: A virtual reality environment for stimulating children’s imaginative writing. Interact. Learn. Environ.; 2008; 16, pp. 245-263. [DOI: https://dx.doi.org/10.1080/10494820802114093]
43. Iachini, T.; Maffei, L.; Masullo, M.; Senese, V.P.; Rapuano, M.; Pascale, A.; Sorrentino, F.; Ruggiero, G. The experience of virtual reality: Are individual differences in mental imagery associated with sense of presence?. Cogn. Process.; 2019; 20, pp. 291-298. [DOI: https://dx.doi.org/10.1007/s10339-018-0897-y] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/30569268]
44. Baydas, O.; Karakus, T.; Topu, F.B.; Yilmaz, R.; Ozturk, M.E.; Goktas, Y. Retention and flow under guided and unguided learning experience in 3D virtual worlds. Comput. Hum. Behav.; 2015; 44, pp. 96-102. [DOI: https://dx.doi.org/10.1016/j.chb.2014.11.041]
45. Chen, C.-H.; Yang, J.-C.; Shen, S.; Jeng, M.-C. A Desktop Virtual Reality Earth Motion System in Astronomy Education. J. Educ. Technol. Soc.; 2007; 10, pp. 289-304.
46. Mayer, R.E.; Moreno, R. ‘Nine Ways to Reduce Cognitive Load in Multimedia Learning. Educ. Psychol.; 2003; 38, pp. 43-52. [DOI: https://dx.doi.org/10.1207/S15326985EP3801_6]
47. Harrower, M. The Cognitive Limits of Animated maps. Cartographica; 2007; 42, pp. 349-357. [DOI: https://dx.doi.org/10.3138/carto.42.4.349]
48. Wang, P.; Wu, P.; Wang, J.; Chi, H.L.; Wang, X. A Critical Review of the Use of Virtual Reality in Construction Engineering Education and Training. Int. J. Environ. Res. Public Health; 2018; 15, 1204. [DOI: https://dx.doi.org/10.3390/ijerph15061204]
49. Hu-Au, E.; Lee, J.J. Virtual reality in education: A tool for learning in the experience age. Int. J. Innov. Educ.; 2017; 4, 215. [DOI: https://dx.doi.org/10.1504/IJIIE.2017.10012691]
50. Grivokostopoulou, F.; Perikos, I.; Hatzilygeroudis, I. An Innovative Educational Environment Based on Virtual Reality and Gamification for Learning Search Algorithms. Proceedings of the 2016 IEEE Eighth International Conference on Technology for Education (T4E); Mumbai, India, 2–4 December 2016; pp. 110-115.
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Details
; Stachoň, Zdeněk 3
; Švedová, Hana 4 ; Káčová, Natálie 2 ; Chmelík, Jiří 5
; Brůža, Vojtěch 5 ; Kvarda, Ondřej 3 ; Ugwitz, Pavel 3
; Šašinková, Alžběta 6 ; Fořtová, Nicola Catherine 7 ; Šašinka, Čeněk 2
1 Department of Information and Library Studies, Faculty of Arts, Masaryk University, 60200 Brno, Czech Republic;
2 Department of Information and Library Studies, Faculty of Arts, Masaryk University, 60200 Brno, Czech Republic;
3 Department of Information and Library Studies, Faculty of Arts, Masaryk University, 60200 Brno, Czech Republic;
4 Department of Geography, Faculty of Science, Masaryk University, 61137 Brno, Czech Republic; Department of Educational Sciences, Faculty of Arts, Masaryk University, 60200 Brno, Czech Republic
5 Department of Visual Computing, Faculty of Informatics, Masaryk University, 60200 Brno, Czech Republic;
6 Department of Information and Library Studies, Faculty of Arts, Masaryk University, 60200 Brno, Czech Republic;
7 Department of English and American Studies, Faculty of Arts, Masaryk University, 60200 Brno, Czech Republic;