You are here

Article Text

Article menu
Download PDFPDF
Original article
The validity and reliability of diagnoses of work-related mental ill-health
  1. E O’Neill1,
  2. R McNamee3,
  3. R Agius2,
  4. M Gittins3,
  5. L Hussey2,
  6. S Turner2
  1. 1
    Department of Occupational Health and Safety, Central Manchester and Manchester Children’s University Hospitals NHS Trust, Manchester, UK
  2. 2
    Occupational and Environmental Health Research Group, University of Manchester, Manchester, UK
  3. 3
    Biostatistics, Health Methodology Research Group, University of Manchester, Manchester UK
  1. Elizabeth O’Neill, Department of Occupational Health and Safety, Central Manchester and Manchester Children’s University Hospitals NHS Trust, Cobbett House, Oxford Road, Manchester M13 9WL, UK; Elizabeth.O'Neill{at}CMMC.nhs.uk

Abstract

Objectives: To establish the reliability and validity of work-related mental ill-health diagnoses.

Background: A UK-based surveillance scheme for work-related ill-health involving occupational physicians (OPs) reporting suggests that mental ill-health incidence is increasing by around 13% per year, with anxiety, depression and “other work-related stress” being the most common diagnoses. There have been no studies of the validity and reliability of such diagnoses. Given the existence of a large network of psychiatrists (PSYs) also involved in surveillance of work-related ill-health, an opportunity arose to measure the concurrent validity and reliability of work-related mental ill-health diagnoses.

Methods: 100 anonymised summaries of cases previously reported by OPs or PSYs were collected; each was sent to 5 PSYs and 5 OPs, who assigned a diagnosis and judged whether the case was work-related. Concurrent validity of the ill-health aspect of the diagnoses, and of the opinion as to work-relatedness, was assessed by comparing the overall classifications of cases by OPs and PSYs. Reliability of the diagnostic classification was measured by kappa matrices.

Results: Diagnostic proportions for PSYs and OPs demonstrated good agreement for anxiety, depression, anxiety plus depression and “stress” (11%, 34%, 27%, 14%) and (14%, 30%, 27%, 17%), respectively. In both groups, kappa coefficients were high for a psychotic diagnosis (0.78, 95% CI: 0.74 to 0.83), but not as high for anxiety (0.27, 95% CI: 0.23 to 0.32), depression (0.34, 95% CI: 0.29 to 0.38) and “stress” (0.15, 95% CI: 0.10 to 0.19). The odds ratio of classifying a case as work-related among PSYs compared to OPs was 2.39 (95% CI: 1.68 to 3.38), p<0.001.

Conclusions: The overall agreement between OPs and PSYs on mental ill-health diagnoses suggests that OP diagnoses are valid for epidemiological purposes. However, the within-group reliability of the diagnosis “stress” is low. Given differences in judgements about work-relatedness, further research is needed to investigate this aspect of a diagnosis.

http://dx.doi.org/10.1136/oem.2008.039008

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    View Full Text

    Footnotes

    • Competing interests: None declared.

    • Funding: THOR is partially funded by the Health and Safety Executive (HSE ref: 4307/R56.069 & 4496/R60.002) awarded to RA and co-investigators. This paper expresses the views of the authors, and not necessarily of the funders.

    • Contributors: The contributions of the authors to the study were as follows: study concept — RA; study design — RA, RM, EO and ST; acquisition of data — LH and EO; study supervision — RM, EO and ST; statistical analysis — MG and RM; preparation of manuscript — RM, EO and ST.

    • Ethics approval: Multicentre Research Ethics Committee (MREC) approval has been given for THOR (reference number MREC 02/8/72). Local Research Ethics Committee (LREC) approval was given for this diagnostic study (reference number 03/CM/580).