1. Introduction
To achieve sustainable development goals, the world requires young people who are skillful and keen on science, and who view science as their future career field [1,2,3]. Learning science is therefore essential for today’s learners. At a learner’s level, this helps them to participate as informed and active members of society, and the scientific ways of thinking and skills help them in making decisions based on evidence [4] and also in improving their problem-solving abilities [5]. More specifically, applying science to our daily life needs both theory and a hands-on practicum. While the former lends itself to classroom learning, the latter can only be learned and practiced in a physical [6] or digital laboratory. Indeed, the value of laboratory experiments for science learning is generally recognized [7], as they are an important element in the educational process [8,9] and science cannot be taught meaningfully to learners without practical laboratory experience. Science laboratories can help learners to acquire a positive attitude toward science if they enable learners to be involved in active and successful laboratory activities [10]. Policy makers worldwide recommend including scientific investigations in courses for learners of all ages. Indeed, investigations afford opportunities for learners to interact directly with the material world by using the tools, models, and theories of science [11]. Likewise, activities in a science laboratory provide learners with opportunities to construct their knowledge by experimenting [12], permitting them to combine their perception of theory with laboratory practice [13], and enabling them to develop their skills [14].
For a decade now, Morocco, like other nations, has been experiencing a growing demand for access to higher education. Morocco has 12 public universities (Cadi Ayyad University (UCA), Abdelmalek Essaadi University (UAE), Mohammed V University (UM5), Hassan 1st University (UH1), Hassan II University (UH2), Mohammed 1er University (UMP), Chouaib Doukkali University (UCD), Moulay Ismail University (UMI), Sultan Moulay Sliman University (USMS), Ibn Zohr University (UIZ), Ibn Tofail University (UIT), Sidi Mohammed Ben Abdellah University (USMBA)) spread over the national territory. These universities are becoming unable to keep pace with the growing number of learners and the increasing demand for access to higher education. In addition, despite significant efforts to improve and increase the absorption capacity of universities, for example, by expanding the faculties infrastructure, these efforts are still unable to keep up with the continuous high increase in the number of learners.
Multiple educational initiatives [15,16,17,18,19,20,21,22] based on the integration and use of new technological advances that support the educational processes are taking place in the current teaching and learning approaches, to meeting this growing demand for access to higher education and to encourage greater learner participation and promote innovative and open teaching practices in Moroccan universities. This aim is well highlighted in goal 4 of the United Nations objectives for sustainable development, but these initiatives aim particularly at improving the quality and accessibility of theoretical courses.
Science education is based on the learner’s experimentation in scientific laboratories, where theoretical principles are verified, and the teaching is given a practical orientation [23]. In science faculties, several thousand learners participate in practical laboratory activities in the science disciplines (physics, chemistry, biology, geology, and mathematics). Basically, physics is a science that is produced through observations, investigations, and experiments conducted by experts who develop laws, principles, concepts, and rules in the form of mathematical equations or statements [24]. Physics is commonly taught for all these majors in the first year of university. With the rapid increase of new learners enrolled each year since 2012 in the science faculties, in addition to (1) an increase in the number of laboratory groups; (2) the low number of laboratories at the faculties; (3) inadequate and insufficient scientific material; (4) deteriorated scientific equipment; (5) an insufficient number of supervisors in laboratories; (6) insufficient numbers of preparers and technicians; and (7) learner demotivation, it has become impossible for the educational and administrative staff in the physics departments at the 12 Moroccan universities to schedule and to continue providing physical laboratory practical activities for all learners enrolling in the physics courses of the first year.
Unfortunately, due to all those listed constraints, the Ministry of National Education, Professional Training, Higher Education, and Scientific Research has decided to eliminate the real practical laboratory activities for physics from the first year program for all science faculties. At the same time, it has been necessary to think about appropriate alternatives to provide training in the laboratory and to adopt digital contents and formats within didactic curricula for surmounting this situation. A solution to this issue can be found in the adoption of virtual laboratories, which would allow the creation of virtual practical activities that can simulate the processes and actions that take place in physical laboratories. This was our main goal in looking for sustainable solutions at Moroccan universities to the problems of massification and the inaccessibility of practical work after the decision of the ministry to remove it from the curricula for the first year.
While the influence of information technologies and the Internet on education has radically changed the laboratory science education landscape [25], a new form of the laboratory has emerged. Web-based experimentation or online experimentation promotes learner immersion in virtual environments, recreating the real experience. It is a broad concept that includes many online experimentation tools, such as virtual and remote laboratories, virtual reality, augmented reality, interactive videos, and serious games [26]. Furthermore, it is commonly accepted that digital tools such as interactive simulations or online laboratories can positively affect learner knowledge, skills, and attitudes [27,28].
In our research work, we have an interest in the integration and use of virtual laboratories in scientific and technical education disciplines for many reasons; virtual laboratories help overcome the limitations of physical face-to-face laboratories, such as equipment accessibility, location, and other economic issues. In particular, virtual laboratories are an appropriate tool that can withstand massive access. Indeed, virtual laboratories are computer simulations that offer views and ways of working that are similar to traditional hands-on, face-to-face laboratories [29], and they are environments where learners can perform learning activities [30]. Also, virtual laboratories help learners to engage in their proactive learning process and improve their academic performance [31]. Nowadays, virtual laboratories have developed into interactive graphical online user interfaces in which simulated experiments can be carried out and where learners can manipulate the experiment’s parameters and explore its evolution [32]. The experiments are completely web-based and provide online access. These interesting advantages over traditional hands-on, face-to-face laboratories and many other attractive gains were discussed in detail in a previous research publication [33].
In Moroccan science faculties, a major initiative that aims to introduce online simulation-based virtual laboratories into scientific teaching was conducted by the EXPERES project from 2016 to 2018. EXPERES (Information and Communication Technologies for Education applied to scientific experiments) is an Erasmus + CBHE project. A joint effort among 12 public universities and European partners from Spain and Finland has been the key solution to overcome the problem of practical work at Moroccan universities. Its main objective was the development and implementation of a virtual laboratory as an alternative solution to support the practical work of physics for the benefit of scientific learners in the first year of their bachelor’s degree program. The EXPERES project was approved and supported by the Moroccan Ministry of National Education, Professional Training, Higher Education and Scientific Research and the Moroccan public universities, which were involved and engaged in the development of the digital content for the virtual practical learning environment [33,34].
The purpose of this article is to present the EXPERES virtual laboratory developed using the JavaScript programming language and deployed by the Moodle platform. It also presents the tool used to create and develop scientific computer simulations. The rest of this paper is organized as follows: The Section 2 presents the usefulness of online scientific experimentations and laboratories for science education. The Section 3 describes the adoption of the ADDIE (Analysis, Design, Development, Implementation, and Evaluation) methodology for developing the virtual laboratory. The Section 4 presents a case study. The Section 5 outlines the results and feedback from teachers and learners. Finally, the Section 6 is dedicated to the conclusion.
2. Online Scientific Experimentations and Laboratories
2.1. The Potential of Online Experimentation to Ensure Sustainability for Science Education
Education presents a major point of the 2030 agenda for sustainable development, being both directly connected to the 17 goals of the agenda and at the core of sustainable development goal 4, which aims to ensure inclusive and equitable quality education and promote lifelong learning opportunities for all [35]. In addition, the education system is the key instrument to achieve the United Nations 2030 agenda for sustainable development [36,37]. There is an accord that higher education institutions play an essential role in accomplishing sustainable development goals [2,38], while an inefficient educational system not only influences learners’ learning but also impacts the entire society [39]. Educational technology and online learning have become the pillars of the education of the 21st century and very particularly for ensuring the education for sustainability [2,40]. The development and use of open educational resources (OERs) have an important potential to expand access to learning, enhance the learning experience, and improve the quality of education [41,42]. The adoption of OER and open educational practices (OEPs) builds a sustainable education infrastructure that enhances education quality and offers good learning opportunities.
On the other hand, online laboratories provide great potential for conducting scientific investigations. In addition, online experimentations represented one of the latest pedagogical trends in the educational context during the last few years. They unite the educational benefits from learning-by-doing approaches with the advantages offered by the information and communication technologies (ICTs) for the educational domain [43]. Moreover, they have been adapted to science education as an effective tool for improving the learning quality and the teaching methodologies, enhancing the learning experiences, and increasing the learners’ participation and motivation, in addition to expanding educational opportunities for more learners [44,45]. Also, online laboratories are a very useful tool to ensure educational continuity for laboratory activities in times of crisis when learners can no longer access the physical laboratory [46].
2.2. Related Work
Online experimentation is a large concept that covers many approaches and tools such as remote laboratories [47,48], virtual laboratories [49], virtual and augmented reality [50,51,52,53,54], gamification [55], and other technological tools.
To meet our need for an alternative solution to the elimination of traditional hands-on laboratory activities, we chose to develop a virtual laboratory, the reasons cited below justify this choice:
Implementing a virtual laboratory is a low-cost solution, no equipment is needed for performing the experimentations, all the development work and the implementation are done by the computer;
Deploying the virtual laboratory resources is guaranteed through using a Moodle platform;
Performing practical activities through a virtual laboratory is a cheap and sustainable solution;
Increasing the learners’ motivation and their ability to self-study;
Accessing the virtual laboratory by learners is allowed at all times and places; also, it supports the learners’ simultaneous connections, which means that multiple learners can do the same experiment at the same time.
In this project, virtual laboratories are considered as OERs [18,56], and they are one of the most interesting OERs that might be offered for science education. Meanwhile, creating, developing, and sharing virtual laboratories are OEPs. These two important characteristics of virtual laboratories allow them to be considered as very powerful tools to address challenges related to ensuring sustainable science education. Another aspect of the sustainable goal of this project was its use during the COVID-19 pandemic, where engineering schools, faculties of sciences and technologies, normal high schools, and poly-disciplinary faculties were adapting such online virtual practical work on their platform.
A virtual laboratory is an interactive practical environment where learners can conduct scientific simulated experiments [57]; in addition, they have the potential to enhance learners’ skills, attitudes, and understanding of physics concepts. Many different empirical studies in different areas of science education have shown that the use of virtual laboratories enables learning results comparable to traditional hands-on laboratories [30,58,59,60,61,62,63,64,65]. Moreover, according to Salmerón-Manzano and Manzano-Agugliaro’s study [57], they concluded that researches concerning virtual laboratories are being implemented as a model of teaching and learning with a great future within the university worldwide.
Likewise, learning topics related to theoretical concepts in physics require simulations to support learners’ understanding; for this reason, virtual laboratories are widely used in learning physics [1,24]. Multiple pilot research projects have been carried out to develop examples of virtual laboratories that can be used for practical teaching of physics in higher education. De La Torre et al.’s study [32] revealed the positive impact of using the virtual laboratory and its Moodle deployment on the learners’ learning. Billah and Widiyatmoko’s study [66] confirmed that the contents of the virtual laboratory that provides theoretical material with pictures, animation, and videos let learners learn independently. This is because learners now tend to prefer things related to computers [67]. In Zhao et al.’s study [68], a virtual laboratory was designed to support and enrich the undergraduate learners’ laboratory experience in addition to the existing physical laboratory; the learners considered that the virtual laboratory was very informative and useful. Studies [69,70] revealed that the use of virtual laboratory media could improve the learners’ conceptual understanding, as well as their problem-solving ability [71], and it enhances their creativity [72]. Jiménez et al.’s study [73] mentioned that virtual laboratories open new learning perspectives that cannot fully be explored in a traditional laboratory.
In addition, the immense boon of virtual laboratories was appreciated when the educational activities were affected due to lockdown related to the COVID-19 pandemic [46]. While the theory classes were conducted online, the educational institutions found it difficult to complete the syllabus concerning the laboratory experiments due to the closure of universities as well as conventional laboratories. Kapilan et al. [74] presented the exploitation of virtual laboratories based on simulation during the COVID-19 pandemic for providing learners of mechanical engineering education the opportunity to complete the planned laboratory experiments; the learners’ feedback in this study indicated that the virtual laboratories helped them to understand the theoretical concepts, and they felt that it was necessary to introduce virtual laboratories into the engineering curriculum. García-Vela et al.’s study [75] recommended maintaining the use of the virtual spaces developed during the pandemic as a resource to reinforce the teaching and learning process.
Virtual laboratories are online education tools that bring a new dimension to learning science by using visualization techniques such as animation, simulation, and filmed videos [31,76]. They are a particular approach to hands-on laboratory experience employing computer-based simulations that focus on presenting views and ways of working that are similar to their physical counterparts [77]. They are used to attract learners’ attention and sustain their motivation [78]. Furthermore, they present additional benefits such as supporting distance learning [79]. They are becoming essential components for e-learning environments, especially for scientific and technical education disciplines.
The use of interactive computer simulations in science education has been subjected to several studies [60,64,80]. In science education, the use of computer simulations plays a significant role in enriching teaching, making lectures more attractive to learners and helping them achieve a deeper comprehension of the scientific subjects [81,82] by providing the learner a high level of interaction, active engagement and participation, immediate feedback, and repeated practice challenges [83]. Higher gains for learners using computer simulations than for those using only hands-on activities were also shown in a study on learning physics concepts [80]. The use of carefully designed computer simulations has the potential to result in more favorable attitudes toward science among learners [61]. Simulation is an educational approach to designing teaching and e-learning activities [83]. Computer simulations are programs that model aspects of real-world situations, they include mathematical models and they calculate the effects of certain inputs and select results accordingly [84]. They provide quantitative and hands-on experience for each experiment that supplements real laboratory practices and skills [31]. Simulation software has been increasingly used as an educational tool in recent decades [85]. The ongoing development of technology and programming languages has made simulation an advanced tool that reflects real situations with a high degree of precision [86].
3. Materials and Methods
Laboratory activities are an important pedagogical strategy for acquiring competencies in science education, making learners understand through a practical approach the theoretical topics taught in the classroom. However, due to various shortcomings of traditional laboratories, virtual laboratories have emerged as an alternative to the weakness of physical, face-to-face laboratories, and they are considered as one of the most attractive e-learning applications for higher education [57]. Furthermore, they have been proven to be a powerful tool to achieve sustainability in education.
Building a virtual laboratory for teaching and learning is a highly complicated process. Because experiments performed in traditional hands-on, face-to-face teaching laboratories are not easy to transfer to the online environment, several technicalities are needed to express the behavior of the phenomenon in computer form. Furthermore, these experiments often use scientific instruments and other specialized equipment. Their conception requires skills in diverse areas such as interaction design, visualization, and pedagogy, involving the design and production of texts, images, environments, and interactivity; their production requires programming and animation [30].
Developing an online virtual laboratory is an educational engineering project that requires defining a coherent and adapted strategy. To do that, we chose the ADDIE model (Figure 1) as the main design method. The ADDIE model is the most recognized model of educational engineering; more specifically, it is an instructional system design framework. ADDIE is a colloquial term used to describe a systematic approach to instructional development, virtually synonymous with instructional systems development [87]. The ADDIE model focuses on the process by listing the elements that must be taken into account when developing the educational content.
ADDIE represents the five steps of analysis, design, development, implementation, and evaluation. The methodology adopted for developing such a virtual laboratory was based on the ADDIE model, as follows: (1) analysis: defining the subject, level, list of practical activities to elaborate; (2) design: elaborating the conceptualization and scripting sheets for all determined practical activities; (3) development: developing JavaScript programs for creating simulations, also producing supplementary resources for the laboratory environment; (4) implementation: putting a Moodle platform online and integrating the virtual simulations created and the resources produced; and (5) evaluation: evaluating the laboratory environment content and design for future improvement. The following paragraphs detail the development process, present the tools used, and justify their choices.
3.1. Analysis
In the introduction, the reasons for choosing to implement a virtual laboratory for the physics subject were justified. Mechanics, thermodynamics, electricity, and optics are the physics program modules that are taught in the first year of university, so it was decided to reproduce the same three practical activities performed in a physical laboratory for each module as virtual activities, for a total of 12 activities (Figure 2). Work teams were created at the level of each university, each team was committed to the development of a virtual practical activity, following the actions and pre-planning established by the project steering committee in the work package.
3.2. Design
For the development of each virtual practical activity, the preparation of conceptualization and scripting sheets was essential.
The conceptualization sheet (Figure 3a) described the learning activity in detail by defining the learning activities, the set of tasks proposed to learners, the objectives of the practical activity, and the educational resources to be used for performing the activity. Its creation required a very thorough knowledge of the practical activity in order to make a clear and detailed description of the pedagogical scenario, according to the definition of (1) context and pedagogical choice of the practical activity; (2) target level; (3) pedagogical objectives; (4) prerequisites; (5) content; (6) pedagogical resources and materials; (7) skills to be acquired by learners; and (8) assessment methods and tools.
The scripting sheet (Figure 3b) was prepared based on the conceptualization sheet. It consisted of writing a script that envisaged the realization of the learning sequences and the manipulation of graphic objects within a work environment according to a certain predefined order. Indeed, the objective of scripting is to identify learning sequences by cutting the content into sequences according to specific learning objectives. It also involves organizing resources and planning activities to prepare the order of different sequences or sub-activities for carrying out the proposed activity according to the experimental protocol. In general, the scripting of practical activities consists of the implementation of a coherent strategy integrating a certain number of pedagogical techniques and methods aimed at the exact formulation of the desired concept. The scripting sheet is fundamental to facilitating the programming stage and the development of simulations.
3.3. Development
Developing virtual laboratories from scratch requires an immense effort [32]. The use of Easy JavaScript Simulations (EJSS) [81,88] to create and develop virtual laboratories for science education helped to overcome those difficulties and obstacles. But extra effort was still needed to create a sophisticated, interactive graphical user interface and to develop innovative techno-pedagogical aspects allowing learners a new paradigm of learning practical work.
EJSS is an open-source software tool that was developed in Java and specially designed for the creation of scientific discrete computer simulations in JavaScript programming language for web-accessible online laboratories. EJSS helps to create and produce the simulations and allows users to concentrate most of their time on writing, refining, and improving the algorithms of the underlying scientific model (which is the real expertise), and on writing an additional JavaScript program to develop sophisticated and advanced simulations as required and according to the real needs for the hands-on experimentation, or to add other parameters to the primary simulation. By doing so, programmers can still obtain an independent, high performance, Internet-aware final product. The program provides simplified input forms that correspond to the common structure found in most simulations, so teachers need to provide the JavaScript code relevant to the model and design the user interface for the simulation, using high-level components. EJSS then generates all the code needed for the complete simulation, compiles it, and creates the extra material needed, such as a Hypertext Markup Language (HTML) page, to publish the simulation on the Internet.
Advanced simulations were created in two steps: the building of the model using the built-in simulation mechanism of EJSS, and the construction of the view to show the model state and its reactions to the changes made by learners. EJSS provided a simplified program structure, custom model tools (such as an advanced differential equation editor), and drag-and-drop view elements that let teachers work at a high level of abstraction, thus speeding up the creation process. Teachers input the qualified information on the simulation such as math equations, the initial model state, the design of the learners’ graphic interface, etc., and the program takes care of all the computer-related aspects of creating a finished, independent JavaScript applet.
Another important advantage of EJSS is that it offers hundreds of EJS simulations that can be freely downloaded, modified, and readjusted to create new simulations.
The decision to use JavaScript as a development language was justified by the fact that embedded JavaScript applets are supported and compatible with many web browsers, and that it is supported on several e-learning platforms. For example, JavaScript makes it possible to create JavaScript applications that can be added very easily to the Moodle platform. This means that EJSS, and the simulations created using it, can be used as independent programs under different operating systems, or be distributed via the Internet and run within HTML pages by the most popular web browsers.
Figure 4 below shows the EJSS development interface with an example of JavaScript code for creating the prism simulations that will be presented in the case study in the next section.
The development of an effective virtual laboratory required the deployment of a series of simulations and other appropriate resources. In this step, in addition to the development of the virtual simulations for the 12 activities, other complementary resources were produced in order to provide a complete laboratory environment similar to the physical one: teasers and laboratory videos were filmed, assessment activities, multiple-choice questions (MCQs), simulation files, and theoretical resources were prepared.
-
The teaser presented the background, objectives, and the different parts of the practical activity;
-
Laboratory video showed the hands-on activity performed in the physical laboratory with real materials and equipment;
-
Theoretical resources offered a summary of the theoretical course and focused on the parts concerning the practical activity;
-
MCQs provided learners the possibility to do a self-assessment of laws and equations presented in the theoretical course, which will be used in the practical activity;
-
Simulation files included the experimental protocol, and the operating mode, for providing a laboratory working environment like to the real one;
-
Assessment activity or the simulation report presented the tasks and exercises that the learner should answer during and after performing the practical activity.
3.4. Implementation
The decision to use the Moodle platform [89] as a learning environment to deploy the virtual laboratory was explained by the fact that Moodle is a learning management system (LMS) that supports the management, administration, documentation, tracking, and reporting of training programs, classrooms, and online events. Virtual laboratories take advantage of the Moodle platform capacity to support virtual interaction among learners and tutors through both synchronous and asynchronous collaboration tools. The deployment of the virtual laboratories inside the Moodle platform makes it possible for virtual simulations to be handled by multiple learners simultaneously and provides social contexts where learners interact with each other by the possible collaborative asynchronous and synchronous features such as chat and forums.
Furthermore, the Moodle platform helped to distribute all the convenient resources for a complete online experiment; it included a description of the phenomena under study and the task protocol that learners must follow to achieve the goals of the virtual practical activities. It provided possibilities for performing statistics and supervising the time spent working by learners in each activity.
Figure 5 below provides an overview of the Moodle activities and resources that can be used to display the virtual laboratory digital resources on the platform.
For the integration of all the produced resources and contents of the virtual laboratory into the Moodle platform a course space was created. The activities and resources presented in the Table 1 below were used, adapted, and configured for displaying the digital resources of the virtual laboratory.
Also, the virtual laboratory can be integrated into many LMSs. We chose the Moodle platform because it is more popular; also, learners as well teachers were very familiar with using it as an online learning environment.
The developed virtual laboratory architecture shown in Figure 6 was composed of two layers: (1) the server and (2) the user interface. The server placed in the university computer node was used to host the created Moodle platform and its resources. It allowed the interactions with these resources and handled the incoming requests from end-users. The user interface allowed learners and users in general to communicate and interact with the virtual laboratory deployed on the Moodle platform, to operate online through the Internet the laboratory simulation and the other resources, and also to perform laboratory virtual activities.
Accessing the virtual laboratory did not require any particular application or plug-in installed in the learners’ computers, except a web browser, an Internet connection, and the authentication login and password to access the Moodle platform.
3.5. Evaluation
To validate the created virtual learning environment, teachers and learners experimented with and tested the functioning of the developed simulation and activities. The remarks, feedback, and proposed suggestions were integrated into the final version. Then, the final updated version of the platform resources was communicated to the work team of each university.
4. Case Study: The Virtual Practical Activity of the Prism
Physics is a scientific practical discipline. It is a subject where actual doing is the key for permitting learners to apply their knowledge and develop their skills. Furthermore, geometrical optics is a model of optics that describes light propagation in terms of rays. This case study presents the virtual practical activity of the prism developed by the Cadi Ayyad University team.
4.1. Optical Prism
An optical prism is solid, transparent glass, an optical system formed by two non-parallel flat surfaces, creating an angle between them, and it is characterized by its refractive index n. The prism is used to refract and reflect light, or to decompose and split white light into its different colors, or to measure a refractive index. The traditional geometrical shape of an optical prism is a triangular prism with a triangular base and rectangular sides (Figure 7).
4.2. The Virtual Practical Activity of the Prism
In geometrical optics, the light propagates in a straight line in a transparent, homogeneous, and isotropic medium. When a light ray passes from one medium to another it undergoes refractions and/or reflections. The virtual practical activity of the prism aims to study the propagation of a light ray: the refraction, reflection, deviation, and dispersion of white light by the prism. The skills targeted through these simulated activities enable learners to understand and analyze the propagation of light by a prism. To do this, three investigations were created:
Investigation 1: study of the path of a light ray by a prism and the determination of prism equations.
Investigation 2: study of the deviation by a prism and the determination of the minimum angle of deviation (Dm).
Investigation 3: study of the dispersion of light by a prism.
In the developed graphical interfaces of the simulations, the learner can use a light ray (laser) and a prism and can modify the position and color of the laser as required by questions of the experimental protocol. The learner can also display and use the protractor to measure the values of angles, and use the other simulation tools provided as explained and according to his or her needs.
The first investigation aimed to highlight the propagation of a light ray by a prism (Figure 8). The learner is required to verify by an experimental method the laws of refraction and reflection for a prism, and to study the case of total reflection, as well as to verify the conditions of emergence of the light ray from the prism, and then determine the prism equations shown below and detailed in Figure 7c.
(1)
(2)
(3)
(4)
The second investigation aimed to study the deviation variations depending on the angle of incidence and to determine the angle of the minimum deviation (Figure 9), and then to calculate the index of the prism used in the experiment.
The third investigation aimed to present the phenomenon of the dispersion of white light (Figure 10); it allows the learner to observe and describe the spectrum of light obtained.
4.3. The Sequence of Carrying Out a Virtual Practical Activity
After authentication to the platform, the learner chooses the practical activity to be carried out from the 12 proposed practical activities. Once the activity is accessed, a list of different resources is offered (Table 2); the learner should view these resources and run them in chronological order.
First, the learner consults the theoretical course reminder, then contributes to a MCQ formative assessment. Next, the learner watches the teaser and the laboratory video of each activity, then displays the simulation report and the operating mode. After that, the learner manipulates the simulation according to the experimental protocol and answers the questions of the simulation report. Finally, the learner does the assessment activity and submits it to the tutor.
The platform offers the learner flexibility to work. For example, if he/she is unable to complete the activity which he/she has started, when he/she next connects to the same activity, the platform offers him/her the possibility to finish the activity from the stage where he/she has stopped or to restart the activity.
The learner can also consult or ask questions in the discussion forum. In cases of difficulties related to using the platform, the learner can consult the guide that explains the use of the platform in detail.
4.4. The Learner Activities Tracking
The Moodle platform offered many ways and reports for monitoring the learner’s activities (Figure 11). For the developed platform, the learner activities tracking was ensured through the simulation report and the assignment activity. The learner manipulates the simulations according to the experimental protocol, the obtained measurements are noted in the simulation report. At the end of the activity, the learner copies his/her answers from the simulation report to the assignment activity and sends them on the platform. For some short answers, the learner receives feedback immediately and for other answers, he/she waits until the teacher or tutor correction.
5. Results and Discussion
5.1. The Developed Virtual Laboratory
It is difficult to obtain an understanding of scientific theories without scientific laboratory activities. In order to provide an alternative to actual physics laboratory activities for learners in the first year of their bachelor’s degree, an interactive virtual laboratory integrated into an appropriate online learning environment was implemented in the Moroccan science faculties. The virtual laboratory offered the opportunity to carry out the practical laboratory work virtually by providing computer simulations that give designs and ways of work that are similar to actual experiments.
Twelve virtual practical activities that are mapped to the physics curriculum of the first year of the bachelor’s degree were created, developed, implemented, and are accessible via the dedicated educational platform (
Traditional laboratories provide physical infrastructure but may have location limitations and scheduling and financial issues [90]. Virtual laboratories are becoming mainstream in higher education for science and engineering in many countries around the world [8]. Furthermore, they are very effective learning environments, with great potential for performance at a low cost [91]. Also, technological advancements in education have made it possible for everyone to participate in the virtual world [92] and enjoy the major benefits of the easy transfer of information and connectivity. These characteristics are making it possible for learners to choose when, how, and where to learn [93]. Also, the use of ICT has the potential to enhance the quality of teaching and learning [94].
In addition, the virtual learning environment not only provides rich teaching models and learning content, but also helps improve the ability of learners to analyze problems and explore new concepts [95]. Presently, there are numerous examples of virtual laboratories applied to different scientific subjects, such as physics. Redel-Macías et al.’s [91] study results showed that learners prefer conducting experiments in virtual laboratories instead of physical ones since the former are easier to understand and perform than the latter, with the help of appropriate software applications.
Furthermore, the virtual practical learning environment substitutes for physical laboratory practices by providing similar experiments. Consequently, learners are able to undertake laboratory experiments without having to be in a physical laboratory [14].
The use of the virtual laboratory based on computer simulation and the Moodle platform as a collaborative environment for doing practical activities has many advantages for learners, such as preventing feelings of isolation, increasing flexibility, and effectively augmenting their motivation and productivity by providing feedback on their results and allowing discussion of questions through synchronous and asynchronous discussion forums. Further, the virtual laboratory enhances and improves the quality of learning because learners have unlimited access and can easily repeat the experiments as many times as necessary, at any time and from any place using their computers and an Internet connection [79,96]. Likewise, there is vast evidence that learning outcomes from using a virtual laboratory are at least equal to outcomes from traditional laboratories [59,62,65,97,98]. In addition, virtual laboratories have several advantages over traditional laboratories: they are cheaper as no materials or equipment are required, they have less environmental impact (no waste), and there is no need for preparation beforehand and cleaning [99]. As well, virtual laboratories need less maintenance than traditional ones, which makes them more sustainable, and therefore the virtual laboratories are certainly a means to support the sustainability of universities [57].
5.2. Learner Satisfaction
After the implementation of the virtual laboratory of physics at the Cadi Ayyad University in Marrakech, we used a survey instrument for gathering information regarding the practical content delivery in the newly developed learning environment. The survey was conducted anonymously with the use of Google Forms. The survey contained questions intended to collect the learners’ opinions and level of satisfaction concerning the platform and the virtual laboratory activities produced. The percentage of responses was about 40%. The following table (Table 7) illustrates the opinions obtained from 120 learners from the science faculty, engineering schools, science and technology faculty, and poly-disciplinary faculty of the Cadi Ayyad University.
In general, the table shows that the new proposed learning environment for virtual practical activities was evaluated positively by learners. For all questions, an average of over 59% responded “Yes! Perfectly,” and over 27% responded “Medium.” Also, about 6% answered by “No! not at all”; this can be justified by the reason that just three virtual practical activities for each physics module were not enough and did not cover all the content of the course. As well, about 6% mentioned “I don’t know” because they thought that they did not need practical activities in the first year, since the virtual activities were not officially approved in the curriculum by the Ministry of Higher Education.
Figure 12 displays the learners’ global level of satisfaction regarding the platform; 53.33% said that the platform set-up was very satisfactory, and 35.83% said satisfactory.
The learners’ feedback indicated that they liked the new practical working environment and felt encouraged to learn more effectively in this way [100], in addition, they demanded to add other virtual activities to the platform, for covering all chapters of the physics course. Also, it was proven that the use of virtual laboratories can positively impact learners’ knowledge, skills, and attitudes.
5.3. Teachers’ Opinions
Before starting the development of the virtual practical environment, teachers of physics from all Moroccan science faculties were asked through a survey to give their opinions about the efficiency of setting up a virtual laboratory as an alternative solution to the eliminated practical work of the physical hands-on laboratory of physics. Figure 13, Figure 14, Figure 15 and Figure 16 present the statements obtained from the teachers from nine universities.
For all the survey questions, a good percentage (over 80%) of teachers supported the creation of a virtual environment as a solution to maintain the laboratory activities and their contributions to the improvement of learning.
However, resistance to virtual laboratories is still prevalent [65] because some science teachers discouraged replacing traditional hands-on, face-to-face laboratories with virtual laboratories [59]. They argued that traditional face-to-face laboratories are often seen as an opportunity for learners to practice inquiry skills and scientific process skills, which may be another reason for choosing a hands-on format. Besides, not all laboratory practices can be simulated and reproduced on a computer, nor can all the practical skills be acquired through virtual experimentation [57]. Nevertheless, virtual laboratories are being used to respond to the need of improving learning and expanding educational opportunities for more scientific learners.
After the implementation of the developed virtual learning environment, we recently conducted a new survey for the second year of the implementation of the project, in order to collect the opinions and verify the satisfaction of teachers from the science faculty at Cadi Ayyad University. Teachers who participated in the elaboration of the virtual practical activities, in addition to teachers who experienced these activities, were asked through this survey to give their opinion and express their satisfaction about the platform. A total of 93% of the investigated teachers declared that they utilized the platform for the practical teaching, for the four physics modules (mechanics, thermodynamics, electricity, and optics). Also, teachers were invited to express their opinions about the platform and the virtual laboratory activities produced. Table 8 illustrates the obtained results from 30 teachers who responded to the survey.
The online virtual learning environment was also evaluated very positively by teachers; for all questions, over 99% of teachers gave good and positive opinions about the effectiveness and usefulness of the online simulations and the platform resources. For all questions, an average of over 66% responded “Yes! Perfectly” and over 32% responded “Medium”.
Figure 17 displays the teachers’ global level of satisfaction regarding the platform; 65% said that the platform set-up was very satisfactory, and 35% said that was satisfactory.
In another question, teachers were invited to give their recommendations for the promotion of the practical online learning environment. The main directions given were:
Developing and adding other virtual activities to cover the entire physics course;
Adapting and adjusting the simulations for the smartphone’s screen;
Updating the platform to the new version of Moodle;
Improving the platform ergonomics;
Diversifying disciplines;
Generalizing and formalizing the experience in an institutional way.
Indeed, future efforts will continue the improvement of the virtual laboratory according to the given recommendations.
Another interesting point is that the virtual laboratory could be used as supplemental or pre-laboratory exercises by higher education institutions in Morocco with limited access, for training learners who perform hands-on activities in physical laboratories. In this case, learners achieve some of the reasoning skills and knowledge that they may further combine with practical experimental designs and performance in the physical laboratory sessions. However, virtual laboratories and simulations, when used as pre-laboratory exercises, can positively impact learning and performance [88,92]. Studies from [101,102,103] have shown that combinations of virtual and hands-on laboratory environments result in better content knowledge compared to using one type of environment alone.
6. Conclusions
Laboratory learning is a requirement for science education, especially as it offers learners the possibility to get practical experience. This paper presented an interactive proposed solution to surmount the lack of practical physics activities in the science faculties in Morocco. A virtual laboratory that can be operated via the web and uses computer simulation to illustrate actual physics experiments was developed to support the teaching of physics in science learners’ first year.
The ADDIE (Analysis, Design, Development, Implementation, and Evaluation) model for the online teaching content design was adopted as the main methodology for the development process. This paper also presented the tools employed for the development of the virtual laboratory environment: EJSS software was used to create the simulations that support the JavaScript codes, and the Moodle platform was used to host and deploy the virtual simulations, with additional appropriate resources created for offering learners a collaborative learning environment.
Twelve virtual experiments were developed as part of the EXPERES project, with the participation of the 12 universities. They cover the four disciplinary fields of physics (mechanics, thermodynamics, electricity, and optics) that are taught in the first year. The virtual activities were tested by learners taking physics courses in science faculties. Learners could conduct experiments in the faculties’ computer centers or at home, and the virtual laboratory increased flexibility and learner motivation and provided similar learning achievements to a physical laboratory.
In summary, the effectiveness and usefulness of the virtual laboratory was evaluated positively by teachers and learners; also, learners appreciated the virtual laboratory experience because it increased their motivation to learn physics. In addition, the feedback collected from the learners and teachers indicated that the developed virtual laboratory supported the learners’ understanding of the scientific concept of physics.
There is no doubt that not all the practices of a real laboratory can be reproduced by simulation in the virtual laboratory, but at the same time, the effectiveness of the use of virtual laboratories for science education has been proven by several studies. Furthermore, they are great tools for ensuring as well as promoting the sustainability of scientific teaching in higher education.
Finally, the tools presented in this paper are a generic framework that can be applied to many scientific and technical courses that need to provide virtual experimentation as a complement to the theoretical courses. As another perspective of this work, we are working on the development of a virtual laboratory for chemical practical activities by utilizing the same methodologies and tools.
Author Contributions
For this article, contributions have been done in agreement between authors as follows. Conceptualization, K.E.K. and K.B.; methodology, K.B.; software, K.E.K.; validation, K.E.K., K.B. and D.B.; formal analysis, K.E.K.; investigation, K.E.K.; resources, K.E.K., K.B.; data curation, K.E.K.; writing—original draft preparation, K.E.K.; writing—review and editing, K.E.K., K.B. and D.B.; visualization, K.E.K.; supervision, K.B. and D.B. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The data presented in this study are available on request from the corresponding author.
Acknowledgments
The authors would like to thank all our partners for their involvement in the EXPERES project. Our thanks also to the European Commission for funding and supporting EXPERES in Moroccan universities. Special thanks to the University of Murcia and the University of Abdelmalek Essaadi for offering us the opportunity to work in consortium and for their coordination of EXPERES. Thanks also to all UCA team members for believing in this idea from the beginning and for their engagement, which was the success of the project.
Conflicts of Interest
The authors declare no conflict of interest.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Figures and Tables
Figure 1. The ADDIE (Analysis, Design, Development, Implementation, and Evaluation) model.
Figure 2. The 12 practical activities scheduled for the physics modules in the first year.
Figure 3. An example of the conceptualization and scripting sheets: (a) the conceptualization sheet; (b) the scripting sheet.
Figure 4. The Easy JavaScript Simulations (EJSS) development interface with an example of JavaScript code for creating the prism object.
Figure 5. The Moodle activities and resources used for displaying the digital resources and contents on the platform.
Figure 6. The architecture of the virtual laboratory deployed on the Moodle platform.
Figure 7. Optical prism: (a) the traditional geometrical shape of an optical prism; (b) the propagation and dispersion of a white light ray by a prism; (c) light propagation by the prism and its formed angles.
Figure 8. Experiment 1: study of the path of a light ray by the prism: (a) image from the laboratory video; (b,c) images from the simulation.
Figure 9. Experiment 2: study of the minimum of deviation: (a,c) images from the laboratory video; (b,d) images from the simulation.
Figure 10. Experiment 3: study of the dispersion of the white light by a prism: (a,b) images from the laboratory video; (c) image from the simulation.
Figure 12. Learners’ global level of satisfaction regarding the platform of the physics virtual practical work.
Figure 13. Teachers’ opinions on using virtual learning to improve or maintain the practical teaching provided in the first year for the physics subject.
Figure 14. Teachers’ opinions on the contribution of virtual practical activities to improve learning.
Figure 15. Teachers’ opinions on the use of virtual practical activities to support practical teaching.
Figure 17. Teachers’ global level of satisfaction regarding the platform of the physics virtual practical work.
Presentation of the Moodle activities and resources used to display the virtual laboratory digital resources and contents.
Moodle Activities and Resources | Description |
---|---|
Lesson | The lesson activity module enables to delivery of the content and practice activities in exciting and flexible ways. It is used to create a linear set of content pages or instructional activities that offer a variety of paths or options for the learner. It offers the possibility to progress to the next page, be taken back to a previous page, or be redirected down a different path entirely according to the learner’s answer or choice, and also on how the lesson activity was developed. |
File | The file module is used to display the simulation file created in the EJSS. It is used also to provide the theoretical resources, the simulation operating mode, and the experimental protocol in Word and Pdf format. |
URL | The URL module is used to provide a web link to teasers and laboratory videos that were put in a Google Drive repository. |
Quiz | The quiz activity is used to create the MCQs for the self-assessment of some parts of the theoretical course. |
Assignment | The assignment activity module is used to collect the learner’s simulation report by typing the answers directly into the text editor and to provide grades and feedback. |
Forum | The forum activity module is used to enable learners to have asynchronous discussions. |
The different resources of a virtual practical activity.
The Different Resources of the Prism Virtual Activity | ||
---|---|---|
[Image omitted. Please see PDF.] | [Image omitted. Please see PDF.] | [Image omitted. Please see PDF.] |
Theoretical resources | Teaser | MCQ |
[Image omitted. Please see PDF.] | [Image omitted. Please see PDF.] | [Image omitted. Please see PDF.] |
Experimental protocol & Simulations report | Laboratory video | |
[Image omitted. Please see PDF.] | [Image omitted. Please see PDF.] | [Image omitted. Please see PDF.] |
Operating mode | Simulation | Assessment activity |
Presentation of virtual practical work produced for the mechanics module.
Simulations Developed for |
Manipulation Title | Objective of the Virtual Practical Activity |
---|---|---|
[Image omitted. Please see PDF.] | Simple pendulum | Determine the period of a simple pendulum and study the influences of the mass and length of the wire on this period and prove the theoretical relationship between the period and the length of the wire. Finally, deduce the acceleration of gravity and the mass of the earth. |
[Image omitted. Please see PDF.] | Static and dynamic study of springs | Discover and demonstrate the movement of an elastic pendulum, identify and measure the amplitude and period of the oscillations, and determine the spring stiffness constant by two methods: static and dynamic. Also, study a mechanical system composed of two springs in parallel or series and verify the Archimedes thrust on an object immersed in a liquid. |
[Image omitted. Please see PDF.] | Conservation of mechanical energy | Study the evolution of kinetic, potential, and mechanical energies over time. Also, understand the principle of total energy conservation through studying the conservation or not of mechanical energy: (a) for the free fall of an object and the fall into a fluid, and (b) for an oscillating system with or without dissipation. |
Presentation of virtual practical work produced for the thermodynamics module.
Simulations Developed for the |
Manipulation Title | Objective of the Virtual Practical Activity |
---|---|---|
[Image omitted. Please see PDF.] | Calorimetry | Determine the mass heat of a liquid and a solid by calorimetric methods, which are: (a) the mixing method for solids, (b) the electrical method for liquids. |
[Image omitted. Please see PDF.] | Measurement of the adiabatic coefficient γ of gas | Study the characteristics of various reversible thermodynamic transformations of a perfect gas. Also, determine the value of the adiabatic coefficient of a perfect gas. |
[Image omitted. Please see PDF.] | Thermal machines | Discover and understand the operation of a thermal machine operating between two heat sources. |
Presentation of virtual practical work produced for the electricity module.
Simulations Developed |
Manipulation Title | Objective of the Virtual Practical Activity |
---|---|---|
[Image omitted. Please see PDF.] | Resistance measurements | Demonstrate Ohm’s law through an experiment. Also, study the variation in the intensity of the electric current flowing through a resistor in terms of the voltage U at its terminals. Finally, plot the characteristic U = f (I) of the resistance graphically. |
[Image omitted. Please see PDF.] | Wheatstone bridge | Become familiar with measuring devices, and measure an unknown resistance. |
[Image omitted. Please see PDF.] | Cathodic oscilloscope | Become familiar with the use of the oscilloscope as a measuring instrument used both in the laboratory and in industry. |
Presentation of virtual practical work produced for the optics module.
Simulations Developed |
Manipulation Title | Objective of the Virtual Practical Activity |
---|---|---|
[Image omitted. Please see PDF.] | Diopter | Study the refraction and reflection of light as it passes between two media with different indices. Find the laws of reflection and refraction. Also, study the refraction from a less refractive medium to a more refractive medium and vice versa. Finally, highlight the phenomenon of total reflection. |
[Image omitted. Please see PDF.] | Prism | Study the propagation of a light ray: the refraction, reflection, deviation, and dispersion of white light by the prism and the determination of the prism equations. |
[Image omitted. Please see PDF.] | Focometry | Visualize the position and size of the image according to the position of the object and verify the magnification relationship. Also, verify the conjugate relation of a lens. Finally, determine, by different methods, the focal length of a thin converging lens and a diverging lens. |
Learners’ opinions about the platform and the virtual laboratory activities produced.
I Don’t Know | No! Not at All | Medium | Yes! Perfectly | |
---|---|---|---|---|
Was the novelty of the work environment motivating for you? | 1.67% | 4.17% | 17.50% | 76.67% |
Was it easy to access the platform? | 3.33% | 2.50% | 36.67% | 57.50% |
Was it easy to register on the platform? | 2.50% | 5% | 16.67% | 75.83% |
Was it easy to navigate in the platform? | 4.17% | 8.33% | 26.67% | 60.83% |
Were all of the platform’s activities functional and easily accessible? | 6.67% | 5% | 13.33% | 75% |
Did the pre-test support the learning of theoretical knowledge? | 3.33% | 11.67% | 30% | 55% |
Was the proposed activity on the knowledge test clearly organized and achievable? | 6.67% | 5.83% | 41.67% | 45.83% |
Was the proposed activity proposed on the simulation report clearly organized? | 7.50% | 5% | 20.83% | 66.67% |
Was the proposed activity on the assessment test clearly organized? | 5.83% | 8.33% | 26.67% | 59.17% |
Were the simulation instructions for the practical activities clear and sufficient? | 7.50% | 3.33% | 24.17% | 65% |
Was the simulation understandable, making it possible to approach the experimental conditions and assimilate the theoretical aspects? | 9.17% | 3.33% | 30% | 57.50% |
Did the assessment focus on the skills/knowledge taught? | 7.50% | 5.83% | 24.17% | 62.50% |
Was the average duration of a practical work suitable? | 8.33% | 2.50% | 42.50% | 46.67% |
Did the platform meet your expectations? | 5.83% | 10% | 41.67% | 42.50% |
Have these virtual practical activities been beneficial to you? | 6.67% | 5% | 20.00% | 68.33% |
Teachers’ opinions about the platform and the virtual laboratory activities produced.
Not at All | Rather No | Rather Yes | Absolutely | |
---|---|---|---|---|
Was the novelty of the work environment motivating for the learners? | 0% | 0% | 40% | 60% |
Was the virtual learning environment well structured? | 0% | 0% | 40% | 60% |
Are all of the platform’s activities functional and easily accessible? | 0% | 0% | 47% | 53% |
Were the virtual activities well structured? | 0% | 3% | 37% | 60% |
Did the content of the virtual hands-on activities support the learning of theoretical knowledge? | 0% | 3% | 17% | 80% |
Was the simulation understandable, allowing you to approach the experimental conditions and assimilate the theoretical aspects? | 0% | 3% | 27% | 70% |
Were the additional resources very helpful? | 0% | 0% | 23% | 77% |
Was it easy to navigate the platform? | 0% | 0% | 40% | 60% |
Did the platform meet your expectations? | 0% | 0% | 37% | 63% |
In the absence of the first year physics laboratory activities, were these virtual activities useful for learners? | 0% | 0% | 20% | 80% |
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2021 by the authors.
Abstract
Laboratory experimentation has a vital role in science education. With the potential offered by information and communication technologies for the educational domain, virtual laboratories have emerged as a valuable alternative to face-to-face, hands-on laboratories. Moreover, the possibility of virtual laboratories opens new perspectives for higher education sustainability. They are a perfect approach for training learners to understand scientific principles in many fields of science by offering them the possibility to illustrate the scientific phenomena through automated and virtual practical activities that employ computer simulation. In this work, we present the use of computer simulation combined with the JavaScript programming language for the development of a low-cost virtual laboratory integrated into an interactive learning environment based on the Moodle platform. The methodology was based on the instructional design model ADDIE (Analysis, Design, Development, Implementation, and Evaluation), which structures the development planning of online teaching resources in different stages (analysis, design, development, implementation, and evaluation). The virtual laboratory was developed by Moroccan universities, with the help of European partners, and it was implemented in the 12 science faculties in Morocco. It presents a great choice for supporting laboratory activities for learners in the first year of their bachelor’s degree program. This virtual laboratory includes 12 virtual practical activities mapped to the physics curriculum, and they can be operated via the Internet on computers. The proposed virtual learning environment was evaluated by teachers and learners from the science faculties. The obtained results, together with similar findings from other studies, indicate the positive impact of the use of a virtual laboratory on learning outcomes, and support the adoption of the proposed learning environment in laboratory educational procedures as an alternative to physical laboratories.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details



1 Trans ERIE—Faculty of Sciences Semlalia, Cadi Ayyad University, Marrakech 40000, Morocco;
2 Research Institute for Innovation & Technology in Education (UNIR iTED), Universidad Internacional de La Rioja (UNIR), 26006 Logroño, Spain