Abstract
A study on the reliability of information on smoking habits and coffee drinking collected via interview was conducted among 500 subjects enrolled in a case–control study on bladder cancer in Brescia, North Italy. A total of 215 cases (incident and prevalent) and 285 controls were interviewed personally in the hospital setting by a first interviewer, and then re-interviewed by telephone by either the same interviewer or another one. Agreement between the first and second interview was evaluated using the kappa statistic and the intra-class correlation coefficient and via multiple logistic regression modelling. No important differences in reliability were found according to sex, education or case/control status, while agreement was better among subjects below 65 than among older ones, and among incident than prevalent cases. A slightly better agreement was found among subjects interviewed twice by the same interviewer than those interviewed by two different individuals, which may reflect the presence of inter-observer reliability for the latter. Overall, these results show a very high reliability of data on smoking and a fairly high reliability regarding coffee drinking as collected through face-to-face interviews.
Similar content being viewed by others
References
Armstrong BK, White E, Saracci R. Principles of exposure measurement in epidemiology. New York: Oxford Medical Publications, 1992.
Dunn G. Design and analysis of reliability studies. New York: Oxford University Press, 1989.
Fleiss JL. Statistical methods for rates and proportions. New York: John Wiley and Sons, 1981.
Maclure M, Willet WC. Misinterpretations and misuse of the kappa statistic. Am J Epidemiol 1987; 126: 161–169.
Müller R, Büttner P. A critical discussion of intraclass correlation coefficients. Stat Med 1994; 13: 2465–2476.
Viscoli CM, Lachs MS, Horwitz RI. Bladder cancer and coffee drinking: A summary of case–control research. Lancet 1993; 341: 1432–1437.
Porru S, Aulenti V, Donato F, Boffetta P, Fazioli R, Cosciani Cunico S, Alessio L. Bladder cancer and occupation: A case control study in northern Italy. Occup Environ Med 1995; 53: 6–10.
Donato F, Boffetta P, Fazioli R, Aulenti V, Gelatti U, Porru S. Bladder cancer, tobacco smoking, coffee and alcohol drinking in Brescia, northern Italy. Eur J Epidemiol 1997; 13: 795–800.
Tammemagi MC, Frank JW, Leblank M, Artsob H, Streiner DL. Methodological issues in assessing reproducibility – a comparative study of various indices of reproducibility applied to repeat ELISA serologic tests for Lyme disease. J Clin Epidemiol 1995; 48: 1123–1132.
Thompson WG, Walter DW. A reappraisal of the kappa coefficient. J Clin Epidemiol 1988; 41: 949–958.
Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 1990; 43: 543–549.
Agresti A. Categorical data analysis. New York: John Wiley and Sons, 1990.
Brennan P, Silman A. Statistical methods for assessing observer variability in clinical measures. Br Med J 1992; 304: 1491–1494.
Armitage P, Berry G. Statistical methods in medical research. London: Blackwell Scientific Publications, 1994.
Coughlin SC, Pickle LW, Goodman MT, Wilkens LR. The logistic modeling of interobserver agreement. J Clin Epidemiol 1992; 45: 1237–1241.
Stein AD, Courval JM, Lederman RI, Shea S. Reproducibility of responses to telephone interviews: Demographic predictors to discordance in risk factor status. Am J Epidemiol 1995; 141: 1097–1106.
Armstrong BK, White E, Saracci R. Principles of exposure measurements in epidemiology. Oxford, UK: Oxford Medical Publications, 1992: 121–123.
Bashir SA, Duffy SW, Qizilbash N. Repeat measurement of case-control data: Corrections for measurement error in a study of ischaemic stroke and haemostatic factors. Int J Epidemiol 1997; 26: 64–70.
Duffy SW, Maximovitch DM, Day NE. External validation, repeat determination, and precision of risk estimation in misclassified exposure data in epidemiology. J Epidemiol Community Health 1992; 46: 620–624.
Dixon WJ, Brown MB, Engelman L, Jennrich NI. BMDP statistical software manual. Los Angeles, CA: University of California Press, 1993.
Lindsted KD, Kuzma JW. Reliability of eight-year recall in cancer cases and controls. Epidemiology 1990; 1: 392–401.
Cumming RG, Klineberg RJ. A study of the reproducibility of long-term recall in the elderly. Epidemiology 1994; 5: 116–119.
Kelly JP, Rosenberg L, Kaufman DK, Shapiro S. Reliability of personal interview data in a hospital-based case–control study. Am J Epidemiol 1990; 131: 79–90.
Luepker RV, Pallonen UE, Murray DM, Pirie PL. Validity of telephone surveys in assessing cigarette smoking in young adults. Am J Public Health 1989; 79: 202–204.
Bowlin SJ, Morrill BD, Nafziger AN, et al. Validity of cardiovascular disease risk factors assessed by telephone survey: The Behavioral Risk Factor Survey. J Clin Epidemiol 1992; 46: 561–572.
D'Avanzo B, La Vecchia C, Katsouyanni K, Negri E, Trichopoulos D. Reliability of information on cigarette smoking and beverage consumption provided by hospital controls. Epidemiology 1996; 7: 312–315.
Jackson C, Jatulis DE, Fortmann SP. The Behavioral Risk Factor Survey and the Stanford Five-City Project Survey: A comparison of cardiovascular risk behavior estimates. Am J Pub Health 1992; 82: 412–416.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Donato, F., Boffetta, P., Fazioli, R. et al. Reliability of data on smoking habit and coffee drinking collected by personal interview in a hospital-based case-control study. Eur J Epidemiol 14, 259–267 (1998). https://doi.org/10.1023/A:1007463620130
Issue Date:
DOI: https://doi.org/10.1023/A:1007463620130