Psychometric properties of the Russian version of the utrecht Work engagement scale (UWES9)
Published: Jan. 1, 2017
This article is published under the license
This article aims to analyze the psychometric properties of the Russian version of the Utrecht Work Engagement Scale (UWES9) by using a sample of 1783 employees of a large Russian organization. We conducted a series of Confirmatory Factor Analysis (CFA) tests of the factorial structure and the configural, metric, scalar, factor variance, factor covariance, and factor means invariances of the model across gender and age groups. The validity of the Russian version of the UWES9 was investigated by study ing its relationship with burnout, job satisfaction, life satisfaction, and turnover inten tion. The CFA showed that both the 1factor and the 3factor models of the UWES9 fit well with the data, but the 3factor model demonstrates a significantly better fit. however, the differences are minor; therefore, in practical terms, the models are iden tical. Thus the Russian version of the UWES9 can be used both as a threescale mea surement and as a single scale of work engagement. Results from the multigroup CFA provided evidence of factorial invariance of the 3factor model across gender and age groups. Internal consistencies of the vigor, dedication, and absorption subscales are acceptable. The results also suggested the convergent, discriminant, and incremental validity of the UWES9, as shown by its relationship with burnout, job satisfaction, life satisfaction, and turnover intention. The article also discusses the differences in levels of work engagement within different gender and age groups. Overall, the results show that the Russian version of the UWES9 demonstrates acceptable psychometric properties comparable with the original version and those in other languages. The Russian version of the UWES9 can therefore be recommended for use in research and practice.
Keywords
Work engagement, positive organizational behavior, burnout, UWES, mea surement
Since the early 2000s, work and organizational psychology has seen the emergence of a new approach called positive organizational behavior, which concentrates on the study of positivelyoriented human resources and psychological capabilities that could improve daily working life (Luthans, 2002). Part of this movement emphasizes the importance of studying not only the working conditions affecting employees negatively, creating conditions such as stress and burnout, but also positive ones, one of the results of which is work engagement. Work engagement is defined as “a positive, fulfilling, workrelated state, characterized by vigor, dedication, and absorption” (Schaufeli, Salanova, Bakker, & GonzálezRomá, 2002, p. 74). Vigor refers to a high level of energy and mental resilience while working, the willingness to invest effort in one’s work, and persistence even in the face of difficulties. Dedication is characterized by experiencing a sense of significance, enthusiasm, inspiration, pride, and involvement in one’s work. Full concentration and being happily engrossed in one’s work, in turn, characterize absorption (Schaufeli, Salanova, et al., 2002).
Most research on engagement has been carried out with the job demands– resources model (Bakker & Demerouti, 2007; Demerouti, Bakker, Nachreiner, & Schaufeli, 2001). Research over the past 15 years has shown that work engagement is positively correlated with job resources such as social support, positive feedback, the employee’s selfefficacy, work autonomy, and a diversity of work tasks, which help workers cope with job demands. Potential consequences of the high level of work engagement include positive job attitudes (job satisfaction, organizational commitment), physical and psychological health, organizational citizenship behavior, and high level of performance (for reviews see Schaufeli & Taris, 2014).
Schaufeli et al. (2002) developed the Utrecht Work Engagement Scale, which is the most popular work engagement measure. Multigroup confirmatory factor analyses showed that the UWES is a culturally universal scale (Schaufeli, Bakker, & Salanova, 2006; Seppälä et al., 2009); therefore, it is extensively used in research worldwide. The psychometric properties of the UWES have been confirmed in many languages: Swedish (Hallberg & Schaufeli, 2006); Finnish (Seppälä et al., 2009); Japanese (Schaufeli, Shimazu, & Taris, 2009; Shimazu et al., 2008); Italian (Balducci, Fraccaroli, & Schaufeli, 2010); Norwegian (Nerstad, Richardsen, & Martinussen, 2010); Spanish (Extremera, SanchezGarcia, Duran, & Rey, 2012); Chinese (Fong & Ng, 2012); Hebrew (LittmanOvadia & Balducci, 2013); Nepali (Panthee, Shimazu, & Kawakami, 2014); French (Zecca et al., 2015); Portuguese (Vazquez, Magnan, Pacico, Hutz, & Schaufeli, 2015); Korean (Römer, 2016); and others.
There is also a Russian language version of the UWES translated by Kutuzova (2006). It was used in research involving Russianspeaking participants (Berezovskaya, 2013; Mandrikova & Gorbunova, 2012; Polunina, 2009; Shestakova, 2012), but a full psychometric analysis of its performance has not yet been conducted. There has been no published study that has focused on the psychometric analysis of the Russian version of the UWES. The purpose of this study is to test the psychometric properties of the Russian language version of the short Utrecht Work Engagement Scale (UWES9) (Schaufeli & Bakker, 2004b). It will examine the factorial structure of the Russian language version of the UWES9, its internal consistency, and correlations with different measures of jobrelated wellbeing. The differences in work engagement according to the main sociodemographic characteristics (gender, age) will also be explored.
There are two versions of the UWES: the full one, which includes 17 items, and the short one comprising 9 items (three for each component of work engagement). Both versions possess similar psychometric properties (Schaufeli & Bakker, 2004b). Research using multiple samples from a range of countries showed that the UWES fit well with empirical data and showed good factorial validity as a 3factor construct (Schaufeli & Bakker, 2004a; Schaufeli, Martinez, Pinto, Salanova, & Bakker, 2002; Schaufeli, Salanova, et al., 2002; Schaufeli, Taris, & van Rhenen, 2008; Seppälä et al., 2009). However, the 1factor construct, which reflects a single scale of engagement, also showed an acceptable fit because of high correlations between the latent factors which reflect the UWES subscales (Schaufeli et al., 2006). Although the 3factor model fit significantly better with the data than the alternative 1factor model, in effect both the 3factor scores for vigor, dedication, and absorption, and the total 9item score, can be used as indicators of work engagement.
There are two views of the relationship between work engagement and burnout. The first argues that work engagement and burnout are the opposite poles of a common continuum (Maslach & Leiter, 2008), whereas the alternative view claims that work engagement and burnout are distinct psychological states, and hence require separate measurements (Schaufeli et al., 2006; Schaufeli, Salanova, et al., 2002). Both views have empirical evidence backing them up. One metaanalysis supported the distinctiveness and nonredundancy of these two constructs (Crawford, LePine, & Rich, 2010) while the other questioned their distinctiveness and independence (Cole, Walter, Bedeian, & O’Boyle, 2012).
The UWES was developed in the framework of the second perspective. Research in this field has found that the dimensions of burnout relate differently to the UWES scales. Several confirmatory factor analytical studies have shown that the personal accomplishment subscale overlaps with the UWES scales more than other subscales, as evidenced by the better fit of the model with two latent factors: the burnout core factor (exhaustion and depersonalization), and the extended engagement factor, including professional efficacy (Extremera et al., 2012; Schaufeli, Salanova, et al., 2002; Schaufeli et al., 2008; Shimazu et al., 2008).
There are several reasons for the overlap between the professional efficacy scale and the UWES scales. First, the professional efficacy scale is formulated in positive terms, while the emotional exhaustion and depersonalization scales are formulated in negative terms. Since all the items of the UWES are also formulated positively, there is a possibility that the positive orientation may be the cause for additional common variance between these scales. Second, the expansion of the construct of work engagement, due to the component associated with accomplishments, is also consistent with the conceptualization of work engagement as proposed by Maslach and Leiter (1997). This difference in the personal accomplishments from the remaining two components of burnout (exhaustion and depersonalization) is also confirmed by other research (Lee & Ashforth, 1996; Leiter, 1993). Thus, work engagement measured by the UWES and burnout measured by Maslach Burnout Inventory (MBI) are separate, independent constructs.
Their antecedents and consequences confirm this conclusion. On the basis of a review of the literature, Bakker et al. (2014, p. 402) conclude that “[w]hereas job demands are the most important antecedents of burnout, job resources are the most important antecedents of work engagement. In addition, whereas burnout has a negative impact on employee wellbeing and organizational performance, work engagement is a desirable state with positive consequences.” Therefore, we may use the relationship between the UWES scales and burnout scales to investigate the validity of the Russian version of the UWES9.
Work engagement is conceptually related to the employee’s subjective wellbeing. GonzalezRoma, Schaufeli, Bakker, and Lloret (2006) suggested that burnout and work engagement are both indicators of employee wellbeing. Salanova, Del Líbano, Llorens, and Schaufeli (2014) further developed this model and proposed four types of workrelated wellbeing (relaxed, enthusiastic, tense, and fatigued). According to their taxonomy, the enthusiastic type or engaged employee is characterized by experiencing the lowest job demands, the highest job and personal resources, and the highest positive outcomes.
This is in line with previous research. Hakanen and Schaufeli (2012) found that work engagement as measured by the UWES had a positive effect on life satisfaction over time. Christian, Garza, and Slaughter (2011) found that work engagement measured by the UWES is moderately correlated with job satisfaction, and has discriminant validity with respect to it. This result was confirmed by subsequent research (Extremera et al., 2012; LittmanOvadia & Balducci, 2013). LittmanOvadia and Balducci (2013) reported that the UWES9 and its subscales have stronger correlations with intrinsic job satisfaction than with the extrinsic one. Salanova, Del Líbano, Llorens, and Schaufeli (2014) suggest that engaged employees take pleasure in and are challenged by their jobs. Previous findings also showed that engaged employees have lower turnover intentions (Halbesleben, 2010; Saks, 2006; Schaufeli & Bakker, 2004a). Thus we may expect that if the Russian version of the UWES9 is equal to original, it should be positively related to job and life satisfaction, and negatively related to turnover intention.
The sample included 1783 employees: 516 (29%) men, 1213 (68%) women, and 54 participants who did not specify their gender) of a major Russian energy company, which engages in the production and sale of heat and electricity in several regions of Russia (response rate = 53%). The mean age of the participants was 36.36 years (SD = 9.55), although 57 participants did not indicate their age. The mean general length of employment stood at 15.58 years (SD = 9.99), while the mean length of employment at this organization was 6.90 years (SD=6.86). The majority of the participants (1341) held nonmanagerial positions; 249 were line managers, 178 were middlelevel managers, and 15 were senior executives.
The participants were invited to fill in the anonymous survey they received via corporate email. They received a message that described the purpose and procedure of the survey, and contained a link to the webquestionnaire. Before starting, the respondents were informed of their right to withdraw from the survey at any time, and that their answers would be kept confidential and used only for research purposes.
Work Engagement
Work engagement was measured by the Russian version of the short Utrecht Work Engagement Scale (UWES9) (Kutuzova, 2006; Schaufeli & Bakker, 2004b). The measure consists of three subscales: Vigor (VI), Dedication (DE), and Absorption (AB). Each scale consists of three items. Each item needs to be assessed on a 7point scale (1 = Never, 7 = Always) (the measure can be downloaded from http:// www.wilmarschaufeli.nl/). Cronbach’s alphas of the scales range from .75 to .87.
Burnout
Burnout was measured by the Russian analogue of the MBI (Maslach & Jackson, 1986), which was developed by Vodopiyanova and Starchenkova (2009). The measurement includes 22 items integrated into three subscales: emotional exhaustion, depersonalization, and personal accomplishment. Each item should be assessed on a 7point scale (1 = Never, 7 = Daily). Cronbach’s alphas of the subscales range from .80 to .88.
Job satisfaction
Job satisfaction was measured by the Brief Index of Affective Job Satisfaction (Thompson & Phua, 2012). The scale consists of 7 items, 4 of which are used to measure job satisfaction (for example, “I like my job better than the average person”), the remaining three being distractors (for example, “My job is unusual”) and thus not included in the analysis. Each item should be assessed using a 7point scale (1 = Strongly disagree, 7 = Strongly Agree). The items were translated into Russian by the first author of this study. The translation was discussed with a bilingual professional who was not aware of the research objectives. When necessary, the translation of the items was corrected. Cronbach’s alpha was .91.
Life satisfaction
Life satisfaction was measured with the use of the Russian version of the Satisfaction with Life Scale (Diener, Emmons, Larsen, & Griffin, 1985), which was translated and adapted by Osin and Leontiev (2008). The scale consists of 5 items (for example, “In most ways my life is close to my ideal”), each of which needs to be assessed using a 5point scale (1 = Strongly disagree, 5 = Strongly agree). Cronbach’s alpha was .89.
Turnover intention
Turnover intention was measured by a single item (“I will look for a new job in the near future”) (Bozeman & Perrewe, 2001), which needs to be assessed using a 7point scale (1=Strongly disagree, 7=Strongly agree).
To check the factor structure of the Russian version of the UWES9, a series of confirmatory factor analyses (CFA) were performed with the lavaan R package (Rosseel, 2012), using the maximum likelihood parameter estimates with standard errors and chisquare test statistics that are robust to nonnormality (MLR). We compared the two alternative models: the 1factor model, in which all 9 items were assessed as one common scale of work engagement, and the 3factor model, in which items were divided into three factors (each including three items) reflecting the three subscales of work engagement. The CFA results were evaluated by using several indicators: χ2, the root mean square error of approximation (RMSEA); the standardized root mean square residual (SRMR); the comparative fit index (CFI); and the Tucker Lewis Index (TLI). Models showing values of greater than .93 for the CFI and TLI, up to .08 for the RMSEA, and up to .06 for the SRMR were judged as showing a good fit (Byrne, 2011; Hu & Bentler, 1999).
In order to investigate the measurement invariance of the UWES9, we performed a series of multigroup CFAs, which tested the configural (same structure across groups), metric (same factor loadings across groups), scalar (same factor loadings and item intercepts across groups), factor variance, factor covariance, and factor means invariances of the model across the gender and age groups (Vandenberg & Lance, 2000). The differences between the nested models were evaluated by using Δχ2 (Satorra & Bentler, 2001) and ΔCFI. We relied on the ΔCFI > .01 criterion of significant difference (Cheung & Rensvold, 2002). For evidence of convergent and discriminant validity, we used the Spearman correlation coefficients between the UWES9 and other dimensions such as burnout, and job and life satisfaction.
To examine the incremental validity, we conducted a series of hierarchical regression analyses (ordinary least squares method) to determine the additional power of the UWES9 in predicting job and life satisfaction and turnover intention, controlling for burnout subscales.
Descriptive analysis of the items of the Russian version of the UWES9 Table 1 shows the descriptive statistics for each item of the Russian version of the UWES9. The average values of the individual items lie within the range of 4.23– 5.36. For all items, there is a small but nonsignificant negative skew, reflecting the average value of displacement in the direction of high scores. Items 1, 2, and 8 show a small positive kurtosis, and item 5 shows a small negative kurtosis. The distribution of the scores is “approximately normal” because the skewness and kurtosis are not significant.
Table 1. Descriptive statistics of the items of the Russian version of the UWES9
Item  M  SD  Median  Skew  Kurtosis 
1. VI1 [1]  4.63  1.13  5  0.47  1.05 
2. VI2 [4]  4.85  1.20  5  0.40  0.48 
3. DE1 [5]  5.05  1.18  5  0.31  0.24 
4. DE2 [7]  4.73  1.31  5  0.23  0.04 
5. VI3 [8]  4.23  1.49  4  0.21  0.34 
6. AB1 [9]  4.76  1.37  5  0.40  0.04 
7. DE3 [10]  5.16  1.35  5  0.49  0.01 
8. AB2 [11]  5.36  1.16  5  0.53  0.58 
9. AB3 [14]  4.40  1.43  4  0.31  0.03 
Note. VI = Vigor. DE = Dedication. AB = Absorption. The square brackets indicate the number of the item in the full version of the UWES17.
Table 2 shows the χ2 statistics and other fit indices obtained by the CFA of the Russian version of the UWES9. The 1factor model with all 9 items loading on the common factor of work engagement did not show a good fit with the data. The value of the CFI and the TLI were below the threshold of .93, and the value of the RMSEA was above .08. The analysis of the modification indices revealed an error covariance between three pairs of items: VI1 (1) (“At my work, I feel bursting with energy”) and VI2 (2) (“At my job, I feel strong and vigorous”); VI3 (5) (“When I get up in the morning, I feel like going to work”), and AB1 (6) (“I feel happy when I am working intensely”); and AB2 (8) (“I am immersed in my work”) and AB3 (9) (“I get carried away when I’m working”) (value varies from .26 to .41). Error covariances between VI1 and VI2 and AB2 and AB3 were also noted in the UWES9 versions in other languages (Balducci et al., 2010; LittmanOvadia & Balducci, 2013; Seppälä et al., 2009; Zecca et al., 2015).
Since the covariances can be meaningfully explained (sequence, similar wording), we followed the practice of previous authors and decided to include them in the model; we modified the 1factor model by freeing error covariances VI1/ VI2 and AB2/AB3. The error covariance between VI3 and AB1 is not in line with previous literature, and both items belong to different subscales; thus it was not included in the model. The modified 1factor model showed an acceptable fit with data (see Table 2). All factor loadings differed significantly from zero (p < .001) and exceeded .55. The general 9item work engagement scale has high internal consistency (α = .92 [95% CI: .90–.93]). Relatively high correlation coefficients between the UWES9 subscales (r varies from .68 to .79) (see Table 3) also confirm the similarity in scores on the UWES9 items. In other words, the UWES9 can be considered a single work engagement scale.
The 3factor model, in which the items are grouped into three subscales (Vigor, Dedication, and Absorption), also did not show good fit with the data. The values of the CFI and the TLI were below the threshold of .93, and the value of the RMSEA was above .08. The analysis of the modification index showed the same error covariances as in the 1factor model (values ranging from .29 to .43). Once modified by freeing the same VI1/VI2 and AB2/AB3 error covariances, the 3factor model showed an acceptable fit with the data. All factor loadings differed significantly from zero (p < .001) and exceeded .58. The correlations between latent factors exceeded .90. All three subscales (Vigor, Dedication, and Absorption) had good internal consistency (α varies from .75 to .87). In other words, the UWES9 can be considered a threecomponent measure with three separate subscales. Therefore, both the 1factor and the 3factor models fit well with the data. However, the 3factor model showed a significantly better fit with the data (Δχ2 = 10.75, Δdf = 3, p = .013).
Table 2. Goodness of fit indicators for measuring models of the UWES9
Models  χ^{2}  p  df  RMSEA [90% CI]  CFI  TLI  SRMR  AIC 
1factor model  630.39  < .001  27  .11 [.11–.12]  .90  .87  .05  44475.79 
1factor model (modified)  323.66  < .001  25  .08 [.08–.09]  .95  .93  .03  44001.99 
3factor model  616.75  < .001  24  .12 [.11–.13]  .90  .85  .05  44409.60 
3factor model (modified)  319.73  < .001  22  .09 [.08–.09]  .95  .92  .03  43987.83 
Note. df – degree of freedom; RMSEA – root mean square error of approximation; CFI – comparative fit index; TLI – Tucker Lewis index; SRMR – standardized root mean square residual; AIC – Akaike information criterion.
A series of multigroup CFAs across gender and age groups was conducted to provide evidence of the UWES9 measurement invariance across different groups. The results of the model fit tests and the model comparison are summarized in Table 4. First, a multigroup CFA was conducted across male and female samples. Models of configural invariance (Model 1a), metric invariance (Model 2a), and scalar invariance (Model 3a) showed an acceptable fit and did not statistically differ from their predecessor models (Δχ2 test not significant, ΔCFI < .01). These results suggested an invariant 3factor structure of the UWES9 in both samples so that it is possible to compare scores across gender groups. Models of factor variance invariance (Model 4a) and factor covariance invariance (Model 5a) also demonstrated an acceptable fit and did not statistically differ from Model 3a. Thus the ranges of scores on the UWES9 subscales do not vary across gender groups, and the subscales have the same relationship in male and female samples. Finally, the model of factor mean invariance (Model 6a) also demonstrated an acceptable fit, and statistically did not differ from Model 3a. These results suggest that the 3factor model of the UWES9 is invariant across the male and female samples, and thus allows for the comparison of male and female groups on work engagement.
Table 3. Mean values, standard deviations, and correlations between the scales of the Russian version of the UWES9 and other variables
M  SD  1  2  3  4  5  6  7  8  9  10  11  12  
UWES9  4.80  1.00  (.92) 
 
Vigor  4.57  1.08  .90**  (.79) 
 
Dedication  4.98  1.14  .93**  .79**  (.87) 
 
Absorption  4.84  1.08  .88**  .68**  .73**  (.75) 
 
Emotional exhaustion  3.24  0.96  .49**  .51**  .50**  .33**  (.88) 
 
Depersonalization  2.69  1.06  .37**  .37**  .40**  .26**  .67**  (.80) 
 
Personal accomplishments  5.11  0.80  .52**  .45**  .51**  .47**  .39**  .31**  (.84) 
 
Job satisfaction  4.66  1.15  .72**  .63**  .74**  .60**  .52**  .43**  .48**  (.91) 
 
Life satisfaction  3.31  0.85  .35**  .33**  .36**  .29**  .35**  .26**  .33**  .43**  (.89) 
 
Turnover intention  2.73  1.54  .44**  .38**  .48**  .35**  .48**  .48**  .28**  .53**  .28**  – 


Age  36.36  9.55  .15**  .16**  .14**  .11**  .10**  .08**  .04  .11**  .04  .14**  –  
Length of employment at organization  6.90  6.86  .06**  .05*  .05  .06**  .04  .07**  .01  .03  .08**  .03  .54**  – 
General length of employment  15.58  9.99  .13**  .14**  .12**  .10**  .09**  .07**  .05*  .09**  .03  .11**  .92**  .54** 
Note. *p < .05; **p < .01. On the diagonal in parentheses are values of the αCronbach.
Table 4. The fit of multigroup models of the modified 3factor model of the UWES9
Models  χ^{2}  p  df  RMSEA [90% CI]  CFI  TLI  SRMR  Model comparison  Δχ^{2}, p  Δdf  ΔCFI 
Males/Females 











Model 1a (configural)  345.23  < .001  44  .09 [.08–.10]  .95  .92  .04 




Model 2a (metric)  354.26  < .001  50  .08 [.08–.09]  .95  .93  .04  2a vs 1a  4.87, p = .560  6  .004 
Model 3a (scalar)  371.12  < .001  56  .08 [.07–.09]  .95  .93  .04  3a vs 2a  6.09, p = .412  6  .002 
Model 4a (factor variance)  376.27  < .001  59  .08 [.07–.09]  .95  .93  .04  4a vs 3a  0.58, p = .900  3  .001 
Model 5a (factor variance and covariance)  381.08  < .001  62  .08 [.07–.08]  .95  .94  .04  5a vs 3a  9.77, p = .135  6  .001 
Model 6a (factor mean)  403.54  < .001  59  .08 [.08–.09]  .94  .93  .04  6a vs 3a  38.99, p < .001  3  .005 
Age groups 











Model 1b (configural)  401.63  < .001  66  .10 [.09–.10]  .94  .91  .04 




Model 2b (metric)  412.97  < .001  78  .09 [.08–.09]  .94  .92  .04  2b vs 1b  11.10, p = .520  12  .000 
Model 3b (scalar)  470.02  < .001  90  .09 [.08–.09]  .94  .92  .05  3b vs 2b  54.26, p < .001  12  .008 
Model 4b (factor variance)  485.33  < .001  96  .08 [.08–.09]  .94  .93  .07  4b vs 3b  12.60, p = .050  6  .001 
Model 5b (factor variance and covariance)  485.04  < .001  102  .08 [.08–.09]  .94  .93  .07  5b vs 3b  16.78, p = .158  12  .000 
Model 6b (factor mean)  514.86  < .001  96  .09 [.08–.09]  .93  .92  .06  6b vs 3b  47.77, p < .001  6  .006 
Note. df – degree of freedom; RMSEA – root mean square error of approximation; CFI – comparative fit index; TLI – Tucker Lewis index; SRMR – standardized root mean square residual; AIC – Akaike information criterion.
Second, a multigroup CFA was conducted across different age groups. Participants were divided into three age groups: under 30 (career start), 3150 (in prime of working lives), and over 50 (past the peak of one’s career and approaching retirement). Models of configural invariance (Model 1b), metric invariance (Model 2b), and scalar invariance (Model 3b) had an acceptable fit, but the Δχ2 test determined a considerable deterioration in Model 3b fit in comparison to Model 2b. However, a ΔCFI was below the benchmark of .01; consequently, it was decided not to proceed to examine partial invariance and consider the following models nested within the scalar invariance model (Model 3b). The models of factor variance invariance (Model 4b) and factor covariance invariance (Model 5b) showed an acceptable fit and did not statistically differ from Model 3b. Thus the range of scores on the UWES9 subscales does not vary, and has the same relationship across different age groups. The model of factor mean invariance (Model 6b) also demonstrated an acceptable fit and did not significantly differ from Model 3b. This means that the 3factor model of the UWES9 is invariant across the age groups and allow for comparison on work engagement.
Table 3 demonstrates the correlations between the subscales of the UWES9 and burnout. The UWES9 subscales correlated slightly more strongly with personal accomplishments (r ranging from .45 to .51), than with the other burnout subscales (r ranges from –.26 to –.51). All subscales and the total UWES9 score revealed a significant positive correlation with job satisfaction (r ranges from .60 to .74) and life satisfaction (r ranges from .29 to .36), although the correlations with the former were stronger than with the latter. These results support the convergent and discriminant validity of the Russian version of the UWES9.
Table 5. Hierarchical multiple regression models
 Job satisfaction  Life satisfaction  Turnover intention  
 Step 1  Step 2  Step 1  Step 2  Step 1  Step 2 
Emotional exhaustion  .385*** (.032)  .174*** (.027)  .244*** (.027)  .198*** (.028)  0.394*** (0.046)  0.265*** (0.046) 
Depersonalization  .109*** (.028)  .081*** (.023)  .000 (.024)  .006 (.023)  0.426*** (0.040)  0.409*** (0.039) 
Personal accomplishments  .471*** (.030)  .133*** (.027)  .265*** (.025)  .192*** (.027)  0.146*** (0.042)  0.060 (0.045) 
UWES9 
 .668*** (0.023) 
 .145*** (.023) 
 0.407*** (0.038) 
Intercept  3.799*** (.197)  1.563*** (.177)  2.743*** (.164)  2.257*** (.179)  1.056*** (0.281)  2.421*** (0.301) 
F  326.32***  587.34***  133.88***  112.78***  220.80***  204.51*** 
R^{2}  .362  .577  .189  .207  .277
 .322

AIC  4613  3906  3985  3947  5849  5741 
ΔR^{2} 
 .215 
 .018 
 .045 
Wald test (Step 2 vs Step 1) 
 874.61*** 
 40.314*** 
 112.72*** 
Note. Standard errors in parentheses. ***p < .001. AIC – Akaike information criterion.
Finally, a series of hierarchical regression analyses were conducted, where job satisfaction, life satisfaction, and turnover intention were dependent variables. The first step included the burnout subscales in the regression equations; the second step added the UWES9 general score (we did not use the UWES9 subscales because of multicollinearity problem — r between subscales ranging from .68 to .79). The results of the regression analyses are summarized in Table 5. In all the cases, models including the UWES9 predicted dependent variables more accurately. Wald tests showed that the models in the second steps are significantly better than in the first steps. Changes in the AICs and R2 from step 1 to step 2 confirm this conclusion. This means that the UWES9 added a significant amount of variance for predicting job satisfaction (20%), life satisfaction (2%), and turnover intention (5%). This supports the incremental validity of the Russian version of the UWES9.
An additional descriptive analysis of the UWES9 was held in different gender (male/female) and age (under 30, 31–50, and over 50) groups. A series of ANOVAs were conducted, in which the UWES9 and its subscale scores were the dependent variables. The analysis showed that the mean values of the UWES9 scores and the scores on the vigor and absorption subscales differed significantly between groups of men and women (see Table 6), with women, on average, having higher scores. However, these differences are extremely small (the effect size [η_{p}^{2}] did not exceed .008). Employees from different age groups also differed on the mean level of work engagement (see Table 6). Employees who are in their early career stages (under 30) displayed the lowest level of the overall UWES9 and its subscales except on the absorption subscale, whereas employees who are past the peak of their careers and approaching retirement (over 50) had highest level. There is a linear relationship between work engagement and age. However, age had only a minor effect on work engagement (the effect size [η_{p}^{2}] ranges from .007 to .022). This was also confirmed by the correlations between the overall UWES9 and its subscales and age, which are positive and small (r ranges from .11 to .16).
Table 6. Gender and age differences in UWES9
 Men n = 516  Women 
 ^{ }  ^{ }  
 M (SD)  M (SD)  F (1, 1727)  η_{p}^{2} 
 
UWES9  4.70 (1.02)  4.84 (1.00)  6.90 (p = .009)  0.004 
 
Vigor  4.47 (1.09)  4.62 (1.07)  7.32 (p = .007)  0.004 
 
Dedication  4.95 (1.18)  5.00 (1.12)  0.58 (p = .447)  <0.001 
 
Absorption  4.69 (1.11)  4.91 (1.07)  14.62 (p < .001)  0.008 
 
 Gr. 1  Gr. 2  Gr. 3 


 
 M (SD)  M (SD)  M (SD)  F (2, 1723)  η_{p}^{2}  Posthoc comparisons  
UWES9  4.64 (1.05)  4.84 (0.96)  5.13 (1.01)  17.83 (p < .001)  0.020  1<2<3  
Vigor  4.36 (1.14)  4.65 (1.02)  4.87 (1.12)  19.36 (p < .001)  0.022  1<2<3  
Dedication  4.82 (1.19)  5.01 (1.10)  5.37 (1.09)  15.88 (p < .001)  0.018  1<2<3  
Absorption  4.72 (1.12)  4.86 (1.05)  5.17 (1.08)  11.33 (p < .001)  0.007  1=2<3 
Note. η_{p}^{2} – effect size (Lakens, 2013). Posthoc comparisons performed by the Tukey HSD test.
The purpose of this study was to analyze the psychometric properties of the Russian version of the short Utrecht Work Engagement Scale (UWES9) (Kutuzova, 2006; Schaufeli & Bakker, 2004b). The Russian version on the UWES9 has shown good internal consistency reliability; all Cronbach’s alphas (both for subscales and for the general scale) exceed the recommended threshold of .70. A series CFA shows that after the addition of two error covariances (VI1/VI2, AB2/AB3), both the 1factor and the 3factor models fit well with the data. It is possible that these covariances are associated with the order of the items; VI1/VI2 and AB2/AB3 are sequential and have a similar wording, which creates an additional overlap in their dispersion. These two error covariances were also reported in previous research (Balducci et al., 2010; LittmanOvadia & Balducci, 2013; Seppala et al., 2009; Zecca et al., 2015).
Despite the fact that the 3factor model fits better than the 1factor model, the latent factor correlations exceed .90, which makes them virtually identical. This is a typical finding in other countries as well (LittmanOvadia & Balducci, 2013; Mills, Culbertson, & Fullagar, 2012; Schaufeli et al., 2006; Seppala et al., 2009). Thus the Russian version of the UWES9 can also be used both as a 3scale measure and as a single scale of work engagement. Schaufeli et al. (2006) recommend using the single indicator of the UWES9 in regression analysis to avoid the problem of multicollinearity caused by the high correlation between the UWES9 subscales; and also using the values subscales as indicators of the latent factor of work engagement when testing structural equation models. In addition, the three subscales could potentially be used for diagnostic purposes, but only after validation cutoff scores using representative samples. Moreover, our results provide evidence of factorial invariance by gender and age. Thus, the 3factor structure is an adequate representation of work engagement, and can be used for comparing male and female and different age groups of employees.
Our study suggests that the Russian version of the UWES9 has convergent and discriminant validity. In line with previous research (Extremera et al., 2012; Schaufeli, Salanova, et al., 2002; Schaufeli et al., 2008; Shimazu et al., 2008), the UWES9 subscales correlate more strongly with the personal accomplishments subscale of burnout compared with the other two subscales. The analysis also shows that burnout subscales and the UWES9 predict different parts of variance in job and life satisfaction and turnover intention. Overall, these results indicate that the Russian version of the UWES9 corresponds to the theoretical construct of work engagement, and provides evidence for its construct, convergent, and discriminant validity.
This study has found a link between work engagement and various demographic characteristics of employees. First, the results show that there is a difference in the mean values of two out of three subscales, and the total UWES9 score, between men and women. Gender differences in work engagement were also reported in some other studies. They showed that women have higher levels of vigor (Fong & Ng, 2012), and men have higher levels of dedication and absorption, as well as a higher total score of work engagement (Schaufeli & Bakker, 2004b).
However, other studies did not report any difference in the level of work engagement between men and women (Extremera et al., 2012; Zecca et al., 2015). Samples from some countries (Belgium, Germany, Finland, Norway, South Africa, Spain, the Netherlands) reveal this relationship (in different countries men and women differ in different subscales and in different directions), while samples from other countries (Australia, Canada, France) do not (Schaufeli et al., 2006). Altogether, these studies suggest an ambiguous relationship between work engagement and gender, which can be mediated by both the kind of the work, and social or psychological factors. However, the gender differences identified in our research are rather small and have no practical value; therefore, they can be regarded as neither a confirmation nor refutation of previous results.
Second, the results show a weak positive correlation between work engagement and age. This correlation reflects a linear effect of age on engagement, which is confirmed by differences between the three age groups; the older the employee, the higher his/her level of work engagement. A similar weak positive correlation was obtained in several previous studies (LittmanOvadia & Balducci, 2013; Panthee et al., 2014; Schaufeli et al., 2006; Schaufeli & Bakker, 2004b; Zecca et al., 2015). A possible explanation is the “healthy worker effect,” meaning that those who are not engaged leave the organization or profession, so that only the engaged workers remain. But as in the previous case, this relationship is relatively weak (r does not exceed .16) and has no practical value.
Summing up, we can conclude that the Russian version of the UWES9 shows acceptable psychometric properties in terms of reliability, factor structure, and factorial invariance across gender and age, comparable with the original version, as well as versions in other languages. The scale has high internal consistency and shows good construct validity. Thus, the Russian version of the UWES9 can be recommended for use in research and practice. However, to use it in practice, a preliminary development of statistical norms is necessary.
There are several limitations in the current study. First, the study was based only on crosssectional selfreported data, which has implications regarding the data’s endogeneity and reliability. This is especially crucial in the case of the measurements of wellbeing (job and life satisfaction), because the participants’ responses partially depend on the situation and their emotional state at the moment of measurement. Therefore, there arises a need for studies with more objective and reliable measurements of wellbeing. The endogeneity problem can be partially overcome by longitudinal design and repeated measurements. Second, the study involved employees from only one organization. In this case, there is a risk that the specific characteristics of this organization (features of selection, motivation, leadership, etc.) influenced the results, which opens the way for further studies with multiple samples.