Article Text

PDF

Methodological problems in a case-referent study based on a register of occupational asthma
  1. B Jarvholm1
  1. 1Department of Public Health and Clinical Medicine, Umea University, SE-901 85 Umea, Sweden; bengt.jarvholm{at}envmed.umu.se
    1. S Meredith2,
    2. J Bugler2,
    3. R Clark2
    1. 2MRC Clinical Trials Unit, 222 Euston Road, London NW1 2DA, UK

      Statistics from Altmetric.com

      Meredith et al,1 performed a case-referent study to investigate asthma caused by isocyanates. They claimed that the results indicated that isocyanate asthma occurs at low 8 hour average exposure (around 1.5 ppb); for exposures above 1.125 ppb there was about a threefold increased risk, however, this was of limited significance (odds ratio (OR)=3.2, 95% confidence interval (95% CI) 0.96 to 10.6; p=0.06). They also concluded that their study, by contrast with other studies, had a higher risk of isocyanate asthma in smokers and people with atopy.

      The study design is original as cases were recruited from a register of occupational asthma. A case-referent study based on a register of cases with both the disease and the exposure of interest is new. I think the design requires some discussion as it may introduce severe bias.

      A typical case-referent study selects cases with a certain disease—for example, asthma—from a hospital register or in a population survey.2 The referents should be selected to give an unbiased estimate of frequency of exposure in the study base.3 The study base of a register, including cases of occupational asthma, is the population that if the case had asthma would be reported to the register. Therefore, the authors of this study matched the referents to the cases by reporting doctor and factory or production area. Then they measured or estimated the exposure level for both cases and referents and found that the average 8 hour exposure was higher among cases. This design has certain weaknesses illustrated by the following hypothetical situations:

      (1) Assume that the exposure in the production area is homogenous. Then both cases and referents would have the same exposure and the conclusion would be that the risk was independent of exposure level.

      (2) Assume that the reporting doctor only knows a proportion of incident cases, a reasonable assumption. If seeing the doctor is dependent on exposure level, a bias is obvious.

      (3) Assume that there was no increased risk at all in the workplaces at the current exposure but that there was exposure to irritants, which varied within the production area. Then cases with asthma would probably be more likely to report problems with their asthma to the occupational health physician. There would also be an association with all substances the concentration of which was correlated with the irritant.

      (4) Assume that there was no causal association between the exposure and the occurrence of asthma at the current levels. As asthma is common among people with atopy, the study would certainly indicate that atopy was a risk factor in combination with the exposure.

      Some of these biases could be avoided if there was some specific test that with certainty established the causal association between asthma and the exposure among the cases. Asthma caused by isocyanates can with some certainty be established by provocation, but the study by Meredith et al included no routine provocation test.

      If it is presumed that all the reported cases really are caused by isocyanates, a rather improbable assumption according to the case definition, the conclusion by the authors that isocyanate asthma occurs also at very low exposures without any threshold could be made without doing any case-referent analysis. They could just simply measure the exposure of the cases and conclude that the lowest measured exposure obviously caused isocyanate asthma. It is obviously impossible to determine any other threshold.

      Is there a proper design of a case-referent study based on cases identified through a register where the association between exposure and outcome is already established? If the disease is caused by short term high exposure a case cross over design seems possible.3 However, that design requires a very accurate determination of when the disease started, which rarely is possible for asthma. Another possibility is to estimate the study base from which the cases are recruited—for example, in the study by Meredith et al1 the number of person-years in the different production areas where the cases were detected should have been estimated. This requires that all or most incident cases from that area are known or there should at least not be any differential reporting of cases between the areas. Thus, the design of this study is interesting but includes many possibly biases of which a just a few were discussed in the paper. The conclusions that the risk of isocyanate asthma is increased at concentrations around 125 ppb, and is more common among people with atopy and smokers are questionable.

      References

      Authors' reply

      We are grateful to Jarvolm for his comme nts on our paper. The specified aim of our study was to quantify the relation between the level of occupational isocyanate exposure and risk of developing asthma. The usual approach to this problem is a cohort study in an exposed workforce, possibly with a nested case-referent analysis. A register based case referent study of the type described by Jarvolm would be unsuitable for this purpose because the source population would be ill defined, selection of a appropriate referents difficult, and reliable assessment of their exposure almost impossible. We used the SWORD reporting scheme, not as a register, but as a convenient means of identifying workplaces from which clusters of cases of asthma attributed to isocyanates have been reported, and in which exposure to isocyanate had been assessed by an occupational hygienist; we then investigated those sites. A few additional cases were identified during the course of the investigation and were included in the analysis. In company A, where most of our cases worked, all employees were subject to close respiratory supervision throughout their employment, including pre-employment assessment; in company B, the occurrence of the cluster of cases was recognised by the occupational health department and the workers in the relevant areas investigated. We are therefore reasonably confident that no cases were missed.

      We were careful to select referents from workers who were exposed to isocyanates and were under the same level of surveillance as the cases to avoid some of the biases outlined by Jarvolm. We agree that the close matching of cases and referents probably reduced the sensitivity of the study, but we thought that it was more important to do that than to risk selection bias as described in his second hypothetical scenario. As we also acknowledged in the article, we cannot exclude the theoretical possibility that the cases of asthma were not caused by isocyanates, but by other chemicals present in the plants. Confounding is a risk in any observational study, although not necessarily a source of bias, but the other agent would have to be closely correlated with the isocyanate exposure to account for our findings.

      The cases had work related asthma as diagnosed by an occupational physician. Nearly all had a history of symptoms associated with work that improved on days away from work and had had serial respiratory function tests that supported the diagnosis. Challenge tests are rarely used in the United Kingdom; very few centres undertake them, and without proper facilities are considered dangerous. However, as explained in the article, in company A people with respiratory symptoms were removed from exposure to isocyanates until they had recovered and then gradually returned to their previous work under very close supervision with serial respiratory function testing, which in practice was a form of challenge test.

      The purpose of undertaking a case-referent study was not to establish that it is possible to develop isocyanate asthma at low exposures, but to examine the exposure-response relation. We do not conclude from our data that there is a threshold below which isocyanate exposure is safe. The concentration of 1.25 ppb was arbitrarily chosen because it was the median time weighted average exposure in the referent group in company A. Despite the fact that all estimated 8 hour time weighted average exposures were within the maximum exposure limits, those subjects whose estimated 8 hour time weighted average was greater than 1.25 ppb seemed to be at increased risk of occupational asthma. However, the data were also compatible with a linear exposure-response relation in which the odds of asthma increased by 1.08 for every 0.1 ppb. A much larger study would be needed to test these two possible exposure-response relations fully.

      View Abstract

      Request permissions

      If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.