Skip to main content
Log in

Factorial invariance and stability of the effort-reward imbalance scales: A longitudinal analysis of two samples with different time lags

  • Published:
International Journal of Behavioral Medicine Aims and scope Submit manuscript

Abstract

Background; Key measures of Siegrist’s (1996) Effort-Reward Imbalance (ERI) Model (i.e., efforts, rewards, and overcommitment) were psychometrically tested. Purpose: To study change in organizational interventions, knowledge about the type of change underlying the instruments used is needed. Next to assessing baseline factorial validity and reliability, the factorial stability over time—known as alpha-beta-gamma change—of the ERI scales was examined. Methods: Psychometrics were tested among 383 and 267 healthcare workers from two Dutch panel surveys with different time lags. Results: Baseline results favored a five-factor model (i.e., efforts, esteem rewards, financial/career-related aspects, job security, and overcommitment) over and above a three-factor solution (i.e., efforts, composite rewards, and overcommitment). Considering changes as a whole, particularly the factor loadings of the three ERI scales were not equal over time. Findings suggest in general that moderate changes in the ERI factor structure did not affect the interpretation of mean changes over time. Conclusion: Occupational health researchers utilizing the ERI scales can feel confident that self-reported changes are more likely to be due to factors other than structural change of the ERI scales over time, which has important implications for evaluating job stress and health interventions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures.Psychological Bulletin, 88, 588–606.

    Article  Google Scholar 

  • Bollen, K. A. (1989).Structural equations with latent variables. New York: Wiley.

    Google Scholar 

  • Byrne, B. M. (1989).A primer ofLISREL: Basic applications and programming for confirmatory factor analytic models. Berlin: Springer- Verlag.

    Google Scholar 

  • Dormann, C., & Zapf, D. (2002). Social stressors at work, irritation, and depressive symptoms: Accounting for unmeasured third variables in a multi-wave study.Journal of Occupational and Organizational Psychology, 75, 33–58.

    Article  Google Scholar 

  • Dragano, N., von dem Knesebeck, O., Rodel, A., & Siegrist, J. (2003). Psychosoziale Arbeitsbelastungen und muskulo- skeletale Beschwerden: Bedeutung für die Prävention [Psy- chosocial work stress and musculoskeletal diseases: Significance for prevention].Zeitschrift fur Gesundheitswissenschaften, 11, 196–207.

    Google Scholar 

  • Frese, M., & Zapf, D. (1988). Methodological issues in the study of work stress: Objective vs subjective measurement of work stress and the question of longitudinal studies. In C. L. Cooper & R. Payne (Eds.),Causes, coping and consequences of stress at work (pp. 375–411). Chichester, UK: Wiley & Sons.

    Google Scholar 

  • Golembiewski, R. T., Billingsley, K., & Yeager, S. (1976). Measuring change and persistence in human affairs: Types of change generated by OD designs.Journal of Applied Behavioral Science, 12, 133–157.

    Article  Google Scholar 

  • Goodman, J., & Blum, T. (1996). Assessing the non-random sampling effects of subject attrition in longitudinal research.Journal of Management, 22, 627–652.

    Article  Google Scholar 

  • Hair, Jr., J. F., Black, W. C., Babin, B. J., Anderson, R.E., & Tatham, R. L. (2006).Multivariate data analysis (Sixth Edition). Upper Saddle River, NJ: Pearson Education.

    Google Scholar 

  • Hanson, E. K. S., Schaufeli, W., Vrijkotte, T., Plomp, N. H., & Godaert, G. L.R. (2000). The validity and reliability of the Dutch effort-reward imbalance questionnaire.Journal of Occupational Health Psychology, 5, 142- 155.

    Article  PubMed  Google Scholar 

  • Joksimovic, L., Starke, D., von dem Knesebeck, O., & Siegrist, J. (2002). Perceived work stress, overcommitment, and self- reported musculoskeletal pain: A cross-sectional investigation.International Journal of Behavioral Medicine, 9, 122- 138.

    Article  PubMed  Google Scholar 

  • Jöreskog, K. G., & Sörbom, D. (1996).LISREL 8: User’s reference guide (2nd Edition). Chicago: Scientific Software International.

    Google Scholar 

  • Marmot, M., Siegrist, J., & Theorell, T. (2006). Health and the psy- chosocial environment at work. In M. Marmot & R. G. Wilkinson (Eds.),Social determinants of health (2nd Edition) (pp. 97–130). Oxford: Oxford University Press.

    Google Scholar 

  • Peter, R., Alfredsson, L., Hammar, N., Siegrist, J., Theorell, T., & Westerholm, P. (1998). High effort, low reward, and cardiovascular risk factors in employed Swedish men and women: Baseline results from the WOLF study.Journal of Epidemiology and Community Health, 52, 540–547.

    Article  PubMed  Google Scholar 

  • Rödel, A., Siegrist, J., Hessel, A., & Brähler, E. (2004). Fragebogen zur Messung beruflicher Gratifikationskrisen [Questionnaire for measuring occupational reward problems].Zeitschrift für Differentielle und Diagnostische Psychologie, 25, 227- 238.

    Article  Google Scholar 

  • Schaubroeck, J., & Green, S. G. (1989). Confirmatory factor analytic procedures for assessing change during organizational entry.Journal of Applied Psychology, 74, 892–900.

    Article  Google Scholar 

  • Siegrist, J. (1996). Adverse health effects of high-effort/low-reward conditions.Journal of Occupational Health Psychology, 1, 27- 41.

    Article  PubMed  Google Scholar 

  • Siegrist, J., & Peter, R. (1996). Measuring effort-reward imbalance at work: Guidelines. Düsseldorf: Heinrich Heine University.

    Google Scholar 

  • Siegrist, J., Siegrist, K., & Weber, I. (1986). Sociological concepts in the etiology of chronic disease: The case of ischemic heart disease.Social Science & Medicine, 22, 247–253.

    Article  Google Scholar 

  • Siegrist, J., Starke, D., Chandola, T., Godin, I., Marmot, M., Niedhammer, I., & Peter, R. (2004). The measurement of effort- reward imbalance at work: European comparisons.Social Science & Medicine, 58, 1483–1499.

    Article  Google Scholar 

  • Tsutsumi, A. (2004).Development and application of the Japanese version of effort-reward imbalance questionnaire. Okayama, Japan: Okayama University School of Medicine and Dentistry.

    Google Scholar 

  • Tsutsumi, A., Ishitake, T., Peter, R., Siegrist, J., & Matoba, T. (2001). The Japanese version of the Effort-Reward Imbalance Questionnaire: A study in dental technicians.Work and Stress, 15, 86–96.

    Google Scholar 

  • Tsutsumi, A., & Kawakami, N. (2004). A review of empirical studies on the model of effort-reward imbalance at work: Reducing occupational stress by implementing a new theory.Social Science & Medicine, 59, 2335–2359.

    Article  Google Scholar 

  • Tsutsumi, A., Nagami, M., Morimoto, K., & Matoba, T. (2002). Responsiveness of measures in the effort-reward imbalance questionnaire to organizational changes: A validation study.Journal of Psychosomatic Research, 52 (4), 249–256.

    Article  PubMed  Google Scholar 

  • Vandenberg, R. J., & Self, R. M. (1993). Assessing newcomers’ changing commitments to the organization during the first 6 months of work.Journal of Applied Psychology, 78, 557–568.

    Article  Google Scholar 

  • van Vegchel, N., de Jonge, J., Bosma, H., & Schaufeli, W. (2005). Reviewing the effort-reward imbalance model: Drawing up the balance of 45 empirical studies.Social Science & Medicine, 60, 1117–1131.

    Article  Google Scholar 

  • van Vegchel, N., de Jonge, J., Bakker, A. B., & Schaufeli, W. B. (2002). Testing global and specific indicators of rewards in the Effort-Reward Imbalance Model: Does it make any difference?European Journal of Work and Organizational Psychology, 11, 403–421.

    Article  Google Scholar 

  • Zapf, D., Dormann, C., & Frese, M. (1996). Longitudinal studies in organizational stress research: A review of the literature with reference to methodological issues.Journal of Occupational Health Psychology, 1, 145–169.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jan de Jonge.

Additional information

We would like to thank Magnus Sverke for his statistical advice during the analytical process and the two anonymous reviewers of this manuscript for their very helpful comments.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jonge, J.d., Linden, S.v.d., Schaufeli, W. et al. Factorial invariance and stability of the effort-reward imbalance scales: A longitudinal analysis of two samples with different time lags. Int. J. Behav. Med. 15, 62–72 (2008). https://doi.org/10.1007/BF03003075

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03003075

Key words

Navigation