Utrecht Work Engagement Scale in Dominican Teachers: Dimensionality, Reliability, and Validity

Abstract

La implicación en el trabajo se describe por la dedicación, el vigor y la absorción. La medida más utilizada de implicación es la Escala de Utrecht de Implicación en el Trabajo (UWES), cuyo propósito es medir la implicación en cualquier grupo ocupacional. Esta investigación tiene como objetivo estudiar las propiedades psicométricas de la UWES para su uso en la República Dominicana y otros países del Caribe de habla hispana. Se calculó el Índice de Fiabilidad Compuesto (CRI), así como el alfa, indicando una buena consistencia interna. Se llevaron a cabo análisis factoriales confirmatorios para probar su dimensionalidad. Ambos modelos se ajustaron muy bien a los datos, lo que llevó a la comparación entre estos. La solución de tres factores resultó ser la que mostraba el mejor ajuste relativo. Sin embargo, las tres dimensiones de la escala se correlacionaban en buena medida, lo que prueba evidencia de solapamiento. En relación con la validez de criterio, como se esperaba, los tres factores correlacionaron con las tres dimensiones de burnout, con el clima de trabajo y con las condiciones de trabajo.

Alternate abstract:

Work engagement is described by dedication, vigor, and absorption. The most widely used measure of engagement is the Utrecht Work Engagement Scale (UWES), intended to measure engagement for any occupational group. This research aims to study psychometric properties of the UWES for its use in the Dominican Republic and other Caribbean Spanish-speaking countries. The Composite Reliability Index (CRI) as well as alphas were calculated, indicating good internal consistency. Confirmatory factor analyses were carried out to test its dimensionality. Both tested models showed extremely good fit to the data, which called for model comparison. The three-factor solution was retained as the one showing the best relative fit. However, the three dimensions of the scale were largely correlated, providing evidence for some overlapping. Regarding criterion-related validity, the three factors were correlated as expected with the three dimensions of burnout, working climate, and working conditions.

Introducción

Work engagement is a relatively young concept. Since the beginning of the 21^st century, there has been an increasing trend towards positive psychology. In this way, there has been a shift in attention from ill-health and unwellbeing towards the promotion of health and wellbeing. For this reason, occupational psychology has started to focus its attention on the positive aspects of work and, among those, on work engagement. Work engagement has been defined as a positive, encouraged, and accomplished attitude towards the job, characterizey vigor, dedication, and absorption (Schaufeli, Salanova, González-Romá, & Bakker, 2002). Vigor is illustratey the presence of mental resilience and high levels of energy at the workplace, as well as the motivation to invest effort in one’s work despite alpposition. Dedication relates to “being strongly involved in one’s work and experiencing a sense of significance, enthusiasm, inspiration, pride, and challenge” (Schaufeli & Bakker, 2003, p. 5). Finally, the thirimension, absorption, refers to achieving high levels of concentration and the sense that time passes quickly while being at work, to the point that it becomes difficult tetach oneself from work. Schaufeli, Taris, and van Rhenen (2008) have compared absorption to the concept of flow, a fully focused state of mind (Csikszentmihalyi, 1990). However, these researchers note that the concept of absorption is one of a more pervasive and persistent nature.

Burnout may be seen as a natural criterion for the validity of work engagement dimensions, as burnout is defined as a state of mental and physical exhaustion characterizey feelings of emotional exhaustion and cynicism, as well as a reduced feeling of personal accomplishment.

Accordingly, Maslach aneiter (1997) argued that vigor anedication coule conceived respectively as the opposite poles of emotional exhaustion and cynicism. Later on, Schaufeli et al. (2002) labelled the first dimension as energy and the seconne as identification. Still, there is an alternative theoretical position that argues that burnout and work engagement are distinct concepts and therefore shoule assessed independently (Schaufeli & Bakker, 2001). Either approach allows for burnout dimensions te used as validity criteria for work engagement.

Work engagement has been measurey two main scales. The Oldenburg Burnout Inventory (OLBI; Demerouti & Nachreiner, 1998) and the Utretch Work Engagement Scale (UWES; Schaufeli & Bakker, 2003). The OLBI was originally developed for the assessment of burnout but some researches argue that it can alse used to measure engagement (Bakker, Schaufeli, Leiter, & Taris, 2008). Following this perspective, the scale can be considered to measure twimensions: the energy (exhaustion-vigor) dimension and the identification (cynicism-dedication) dimension. This scale is in line with the theoretical proposition of work engagement anurnout as being opposite poles of the same general construct (Maslach & Leiter, 1997). The UWES is the most widely used instrument to measure engagement with the workplace that assesses work engagement as an independent construct composey three inter-related factors: vigor, dedication, and absorption. There are two versions of this scale. The original version, developey Schaufeli anakker (2003), which is composey 17 items, and a shortenene, developey Schaufeli, Bakker and Salanova (2006), containing 9 items.

The UWES has been validated in several countries, including the Netherlands (Xanthopoulou, Bakker, Demerouti, & Kantas, 2012), Finland (Seppälä et al., 2008), Norway (Nerstad, Richardsen, & Martinussen, 2009), Italy (Balducci, Fraccaroli, & Schaufeli, 2010), Greece (Xanthopoulou et al., 2012), China (Fong & Ng, 2011), Japan (Shimazu et al., 2008), Switzerland (Zecca et al., 2015), Malaysia (Shahrazad Wan Sulaiman & Aisyah Zahoni, 2016) and Nepal (Panthee, Shimazu, & Kawakami, 2014). Regarding Spanish-speaking samples, the UWES has been validated in Argentina (Spotón, Mendrano, Maffei, Spotón, & Castellano, 2012) and Puerto Rico (Rodríguez-Montalbán, Sánchez-Cardona, & Martínez-Lugo, 2014). Those validations had mixed results. For both the UWES-17 and the UWES-9, the three factor model is generally chosen as the one showing the best fit. In some of the studies (Fong & Ng, 2011; Panthee et al., 2014) both the one-factor and the three-factor solution showed adequate fit, but the three-factor solution was ultimately retained as the result of better model comparison.

This study is aimed at examining the psychometric properties of the Spanish version of the UWES for its use in the Dominican Republic anther Caribbean Spanish-speaking countries, basen a representative anarge sample of Dominican teachers. Validations with representative samples of occupational groups, such as teachers, at a nationaevel are rare. There has been an abundance of validations in western countries but this scale’s properties have been proven in only a few South American countries (Rodríguez-Montalbán et al., 2014; Spotón et al., 2012). The particular objectives are threefold: a) to establish the factor structure of the UWES, b) to estimate the reliability of the scale, and c) tffer evidence on its criterion-related and nomological validity. The hypotheses of this study are: a) the theoretical three factor structure of UWES (vigor, dedication, and absorption) will fit the data well; b) the three dimensions of work engagement will correlate positively and high with the two seconrder factors of the Q-Labors scale, working climate, and working environment; and c) there wile positive and high correlations among the three dimensions of engagement and professional efficacy (as measurey the MBI-GS), and negative and high correlations among dimensions of engagement animensions of cynicism and emotional exhaustion (also measurey the MBI-GS).

Method

Sample, Design, and Procedure

Data come from a cross-sectional survey of teachers from the Dominican Republic. Stratified sampling with proportional allocation was carrieut, and simple random sampling was applied within each stratum. Strata were educationaistricts. The margin of error and the confidence level tbtain the sample size were 3% and 95%, respectively. The sample size needed was a totaf 931. Up to a 5% of the sample was predicted not to complete the data-gathering process due to unpredictable circumstances and sample size was proportionally increased accordingly. Thus, the final aimed sample size was 978 (931*1.05). Their average age was 42.9 years old (SD = 8.7); 73.65% were women. With respect to the marital status: 24.8% were single, 63.3% were married, 5.5% were divorced, 3.8% were separated, and finally, 2.6% were widow/widower.

Instruments

The battery included multiple job-related questionnaires, as well as socio-demographic information. For the purposes of this research three scales were used.

The Maslach Burnout Inventory-General Survey (Schaufeli, Leiter, Maslach, & Jackson, 1996). This questionnaire is composey 16 items covering three dimensions: cynicism, emotional exhaustion, and professional efficacy. The questionnaire is measured using a Likert scale, ranging from one (totally disagree) to five (totally agree). Internal consistency as estimated with the Composite Reliability Index (CRI; Raykov, 2004) showed estimated values of .78 for emotional exhaustion, .86 for professional efficacy, and .74 for cynicism. An a priori confirmatory factor analysis reasonably supported the three-factor structure with the following fit indices and statistics: χ² = 612.87, df = 101, p < .001, RMSEA = .072 (.067-.078) and CFI = .93.

The Utrecht Work Engagement Scale (UWES; Schaufeli & Bakker, 2003). The UWES is a 17-item instrument, again Likert-type, ranging from one (completely disagree) to five (completely agree). Theoretically, six items measure vigor (1, 4, 8, 12, 15, 17), five others are indicators of dedication (2, 5, 7, 10, 13), and six conform to absorption (3, 6, 9, 11, 14, 16). Example items of vigor are: “At my work, I feeursting with energy” or “At my job, I am very resilient, mentally”. Dedication includes items such as “I find the work that I do fulf meaning and purpose” and “I am proun the work that I do”. Finally the dimension of absorption is tappey items such as “Time flies when I’m working” or “It is difficult tetach myself from my job”.

The Q-Labors Scale (Casas, Repullo, Lorenzo, & Cañas, 2002), consists of 58 sentences with responses in the form of a Likert scale with five options (completely disagree to completely agree). It measures eight first order dimensions of work life quality: hierarchical relations, interpersonal relations, personal fulfillment, planning and management, timetable and personaife, physical and technological environment, workload, and management concern with the worker. These eight first order factors may be aggregated into two seconrder dimensions, namely work climate that comprises the first factors, and working conditions on which the other four factors loaded. These two seconrder dimensions were used for nomological validity estimates. Internal consistency estimated with the Composite Reliability Index was .89 for work climate and .84 for working conditions. An a priori seconrder confirmatory factor analysis supported the structure with the following fit indices and statistics: χ² = 7337.49, df = 1943, p < . 001, RMSEA = .05 (.049-.051) and CFI = .92.

Statistical Analyses

Two a priori confirmatory factor analyses were specified: the theoretical three factor model and the more parsimonious one factor model. These models were estimated with robust maximum likelihood estimation (MLR), given the strong non-normality and with weighteeast square mean and variance corrected (WLSMV) given the ordinal nature of the data. Both types of estimation work well with non-normaata, but WLSMV works better with non-normal anrdinaata (Finney & DiStefano, 2006). However, WLSMV does not compute the Bayesian information criteria (BIC), which is particularly relevant when comparing models. Therefore, both types of estimations were conducted. Model fit was assessed using several fit criteria: the chi-square statistic, the comparative fit index (CFI), the root mean squared error of approximation (RMSEA), the standardized root mean square residual (SRMR), and the Bayesian information criteria (BIC). BIC is used to compare models with a lower score indicating better relative fit. Cut-off criteria for reasonable fit were a CFI of at least .90, RMSEA less than .06, and SRMR less than .08 (Hu & Bentler, 1999). In addition, Cronbach’s alpha and composite reliability indexes (CRI) were used to estimate internal consistency of the scale. Finally, criterion-related validity between burnout and work engagement was tested. Data analyses were conducted with SPSS 21 and Mplus 6.

Results

Internal Consistency and Factorial Validity

As a first result, descriptive statistics were calculated. Means, standareviations, and correlations among the 17 items in the UWES scale are presented in Table 1. Means are, in general, quite high, and correlations are consistently statistically significant.

Table 1 Means, Standareviation, and Correlation Matrix of the UWES’ Items

Table 2 Goodness of Fit Indices for the Tested Models

Factor loadings allowed us to estimate internal consistency via the CRI index. CRIs were .85 (WLSMV) and .85 (MLR) for vigor, .85 (WLSMV) and .82 (MLR) for dedication, and .74 (WLSMV) and .85 (MLR) for absorption. Following CRI, internal consistency of the scale can be considered adequate. Additionally, Cronbach’s alphas were also estimated for the three-factor modef the UWES and the estimates were: .73 for vigor, .63 for dedication, and .58 for absorption.

Table 3 Standardized Factor Loadings for the Best-fitting Model

Criterion-related and Nomological Validity

The correlations among the three engagement factors and their criteria (burnout dimensions) are presented in Table 4. The correlations were large, statistically significant, and in the expecteirection. Vigor, absorption, anedication positively correlated with professional efficacy and negatively with emotional exhaustion and cynicism. Additionally, work climate and working conditions were considered as nomological criteria, as positive relations are expecteetween good climate and conditions at work and feelings of engagement. These correlations are also shown in Table 4. The relationships were indeed positive, anarger in general with climate.

Table 4 Correlations of the Three Factors of Engagement with the Three Dimensions of Burnout (Emotional Exhaustion, Cynicism and Professional fficacy), Work Climate and Working Conditions

Discussion

A main conclusion of this study is that the internal consistency, structure, and validity of the UWES were very good in a large and representative sample of teachers in the Dominican Republic. Therefore, and given that this is the first validation of the UWES in the Dominican Republic, these are good news. Apparently, the UWES may be successfully employed in Central and South American countries in an important public service (teachers) and that makes a good psychometric behavior likely with other populations in the same context. Once the main conclusion is clear, going intetails is needed. Internal consistency estimates, as measurey means of CRI, were extremely good. Alphas estimates, on the other hand, showeess adequate results. However, it is well-known that CRI outperforms alpha as an internal consistency estimate (Raykov, 2004), so the results here presented are considered to support a good internal consistency of alimensions of the UWES. This is consistent with the very good fit that the structural models had, with very large factor loadings.

Regarding factor structure, things were not so clear. On one hand, the theoretical three factor structure for the UWES was empirically supported, as the model fit was excellent. This is in line with all evidence from the developers of the scale (for example, Schaufeli & Bakker, 2003; Balducci et al., 2010) as well as many other validations (Nerstad et al., 2009; Rodríguez-Montalbán et al., 2014; Seppälä et al., 2008; Shahrazad Wan Sulaiman & Aisyah Zahoni, 2016; Shimazu et al., 2008; Spotón et al., 2012; Xanthopoulou et al., 2012; Zecca et al., 2015). On the other hand, severather researchers have founoth support for a one-factor solution and the theoretical three-factor structure (Fong & Ng, 2011; Panthee et al., 2014), although it is also true that they finally adopted the three factor structure. This last evidence is the one supportey our data. Both models fitted the data extremely well anifferences in fit were scarce. Moreover, there were extremely large correlations among the three dimensions, thus providing evidence of a huge overlapping among the engagement factors. We finally decided to retain the three factor structure, but more evidence is needed to know what the generalizability of this result is in other working populations in the Dominican Republic anther countries.

Finally, the criterion-related validity of the three dimensions was in accordance with expectations, as the relationships with the dimensions of burnout were large and in the expecteirection. Either from the perspective supportey Maslach aneiter (1997), in which vigor anedication are conceived respectively as the opposite poles of emotional exhaustion and cynicism, or from the theoretical position that argues that burnout and work engagement are distinct concepts and therefore shoule assessed independently (Schaufeli & Bakker, 2001), burnout is always a construct tightly related to work engagement. Finally, we also included two measures (work climate and working conditions) that coule considered part of the nomological net associated with engagement. In the case of work climate, there is evidence that a positive work climate predicts/relates to an engaged worker (Putter, 2010), exactly the result found in our study. In the same vein, there is also extensive evidence on the strong relationships between working conditions such as job resources, including social support from colleagues and supervisors, performance feedback, skill variety, autonomy, or workload with work engagement (Bakker & Demerouti, 2007; Schaufeli & Salanova, 2007). Our results strongly support the positive association between good working conditions and engagement.

There is a large amount of accumulated evidence on the psychometric characteristics of the UWES. However, the new evidence we are presenting possesses two strengths. Firstly, all the analyses have been made in a representative sample of the population of teachers at nationaevel in the Dominican Republic, and secondly, this sample represents an underrepresented population usually not covered in the (mainly) Western-European validations. In short, the UWES has been demonstrated te a valid and reliable instrument for the measurement of engagement in a large and representative sample of teachers in a Central American country. The research also has limitations. Even though a cross-sectional study is enough to prove some psychometric properties as factor structure, internal consistency, and convergent/discriminant and/or nomological validity, other psychometric characteristics shoule studied with a longitudinal (time-related) perspective, including the temporal stability of the scale and the stability of the factor structure along time, a stability that is needed in order to make meaningful comparisons among time points (for example when treatments or intervention effects are te studied). Additionally, comparison of these psychometric properties in other occupational groups from the Dominican Republic shoule welcomed. Finally, further research is needed tisentangle if the large degree of overlapping among dimensions is sample/population/country specific or general across populations.

References

Bakker, A. B., & Demerouti, E. (2007). The joemands-resources model: State of the art. Journaf Managerial Psychology, 22, 309-28. https://doi.org/10.1108/02683940710733115

Bakker, A. B., Schaufeli, W. B., Leiter, M., & Taris, T. (2008). Work engagement: An emerging concept in occupational health psychology. Work & Stress, 22, 187-200. https://doi.org/10.1080/02678370802393649

Balducci, C., Fraccaroli, F., & Schaufeli, W. B. (2010). Psychometric properties of the Italian version of the Utrecht Work Engagement Scale (UWES-9). European Journaf Psychological Assessment, 26, 143-149. https://doi.org/10.1027/1015-5759/a000020

Casas, J., Repullo, J. R., Lorenzo, S., & Cañas, J. J. (2002). Dimensiones y calidae vida laboral en profesionales sanitarios [Dimensions and work quality of life in health professionals]. Revista de Asistencia Sanitaria, 6, 143-160.

Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience. New York, NY: Harper.

Demerouti, E., & Nachreiner, F. (1998). Zur spezifität von burnout für dienstleistungsberufe: Fakt oder artefakt? [The specificity of burnout in human services: Fact or artifact?]. NingunoZeitschrift für Arbeitswissenschaft, 52, 82-89.

Finney, S. J., & DiStefano, C. (2006). Non-normal and categoricaata in structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (pp. 269-314). Greenwich, CT: Information Age.

Fong, T., & Ng, S. (2011). Measuring engagement at work: Validation of the Chinese version of the Utrecht Work Engagement Scale. NingunoInternational Journaf Behavioural Medicine, 19, 391-397. https://doi.org/10.1007/s12529-011-9173-6

Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1-55. https://doi.org/10.1080/10705519909540118

Maslach, C., & Leiter, M. P. (1997). The truth about burnout: How organizations cause personal stress and what to about it. San Francisco, CA: Jossey-Bass.

Nerstad, C., Richardsen, A., & Martinussen, M. (2009). Factorial validity of the Utrecht Work Engagement Scale (UWES) across occupational groups in Norway. Scandinavian Journaf Psychology, 51, 326-333. https://doi.org/10.1111/j.1467-9450.2009.00770.x

Panthee, B., Shimazu, A., & Kawakami, N. (2014). Validation of Nepalese version of Utrecht Work Engagement Scale. Journaf Occupational Health, 56, 421-429. https://doi.org/10.1539/joh.14-0041-OA

Putter, L. (2010). The relation between organizational climate and performance and an investigation of the antecedents of organizational climate (Graduation thesis). Delft University of Technology.

Raykov, T. (2004). Behavioral scale reliability and measurement invariance evaluation using latent variable modeling. Behavioral Therapy, 35, 299-331. https://doi.org/10.1016/S0005-7894(04)80041-8

Rodríguez-Montalbán, R., Sánchez-Cardona, I., & Martínez-Lugo, M. (2014). Análisis de las propiedades psicométricas de la Utrecht Work Engagement Scale en una muestra de trabajadores en Puerto Rico [Analysis of psychometric properties of the Utrecht Work Engagement Scale in a sample of workers in Puerto Rico]. Universitas Psychologica, 13, 1255-1266. https://doi.org/10.11144/javeriana.upsy13-4.appu

Schaufeli, W. B., & Bakker, A. D. (2001). Werk en welbevinden. Naar een positieve benadering in de arbeids- en gezondheidspsychologie [Work en well-being: Towards a positive approach in occupational health psychology]. Gedrag & Organisatie, 5, 229-253.

Schaufeli, W. B., & Bakker, A. B. (2003). UWES – Utrecht Work Engagement Scale: Test Manual. Utrecht, The Netherlands: Department of Psychology, Utrecht University.

Schaufeli, W. B., Bakker, A. B., & Salanova, M. (2006). The measurement of work engagement with a short questionnaire: A cross-national study. Educational and Psychological Measurement, 66, 701-716. https://doi.org/10.1177/0013164405282471

Schaufeli, W. B., Leiter, M. P., Maslach, C., & Jackson, S. E. (1996). MBI-General Survey. In C. Maslach, S. E. Jackson, & M. P. Leiter (Eds.), Maslach Burnout Inventory ManualNinguno (3rd ed.). Palo Alto, CA: Consulting Psychologists Press.

Schaufeli, W. B., & Salanova, M. (2007). Work engagement: An emerging psychological concept and its implications for organizations. In S. W. Gilliland, D. D. Steiner, & D. P. Skarlicki (Eds.), Research in social issues in management: Managing social and ethical issues in organizations (Vol. 5). Greenwich, CT: Information Age Publishers.

Schaufeli, W. B., Salanova, M., González-Romá, V., & Bakker, A. B (2002). The measurement of engagement anurnout: A two sample confirmatory factor analytic approach. Journaf Happiness Studies, 3, 71-92. https://doi.org/10.1023/A:1015630930326

Schaufeli, W. B., Taris, T., & van Rhenen, W. (2008). Workaholism, burnout, and work engagement: Three of a kinr three different kinds of employee well-being? Applied Psychology, 57, 173-203. https://doi.org/10.1111/j.1464-0597.2007.00285.x

Seppälä, P., Mauno, S., Feldt, T., Hakanen, J., Kinnunen, U., Tolvanen, A., & Schaufeli, W. (2008). The construct validity of the Utrecht Work Engagement Scale: Multisample anongitudinal evidence. Journaf Happiness Studies, 10, 459-481. https://doi.org/10.1007/s10902-008-9100-y

Shahrazad Wan Sulaiman, W., & Aisyah Zahoni, N. (2016). Validation of the Utrecht Work Engagement Scale (UWES) in the Malaysian context. International Journaf Social Science and Humanity, 6, 672-676. https://doi.org/10.18178/ijssh.2016.6.9.730

Shimazu, A., Schaufeli, W., Kosugi, S., Suzuki, A., Nashiwa, H., Kato, A., …Kitaoka-Higashiguchi, K. (2008). Work engagement in Japan: Validation of the Japanese version of the Utrecht Work Engagement Scale. Applied Psychology, 57, 510-523. https://doi.org/10.1111/j.1464-0597.2008.00333.x

Spotón, C., Mendrano, L. A., Maffei, L., Spotón, M., & Castellano, E. (2012). Validación del Cuestionarie Engagement UWES a la población de trabajadores de Córdoba, Argentina [Validation of the Engagement Questionnaire UWES for the Population of Workers of Cordoba, Argentina]. Liberabit, 18, 147-154.

Xanthopoulou, D., Bakker, A. B., Demerouti, E., & Kantas, A. (2012). Measuring burnout and work engagement: Factor structure, invariance, anatent mean differences across Greece and the Netherlands. International Journaf Business Science and Applied Management, 7, 40-52

Zecca, G., Györkös, C., Becker, J., Massoudi, K., de Bruin, G., & Rossier, J. (2015). Validation of the French Utrecht Work Engagement Scale and its relationship with personality traits and impulsivity. European Review of Applied Psychology, 65, 19-28. https://doi.org/10.1016/j.erap.2014.10.003