Article Text


182 English-speaking reviewers can correctly identify foreign-language articles that meet eligibility criteria for a systematic review of management for fibromyalgia
  1. J W B Busse1,
  2. Bruno2,
  3. Mailk1,
  4. Connell3,
  5. Torrance3,
  6. Ngo3,
  7. Kirmayr4,
  8. Avrahami3,
  9. Riva1,
  10. Ebrahim1,
  11. Struijs5,
  12. Brunarski6,
  13. Burnie3,
  14. Le Blanc3,
  15. Coomes7,
  16. Steenstra8,
  17. Slack,
  18. Rodine9,
  19. Jim10,
  20. Montori11,
  21. Guyatt1
  1. 1McMaster University, Hamilton, Canada
  2. 2University of Regina, Regina, Canada
  3. 3Canadian Memorial Chiropractic College, Toronto, Canada
  4. 4German Hospital, Buenos Aires, Argentina
  5. 5Academic Medical Center, Amsterdam, The Netherlands
  6. 6Ontario Chiropractic Association, Toronto, Canada
  7. 7University of Toronto, Toronto, Canada
  8. 8Institute for Work & Health, Toronto, Canada
  9. 9Restorative Health, Smiths Falls, Canada
  10. 10Jointworks Chiropractic Inc., Vancouver, Canada
  11. 11Mayo Clinic, Rochester, United States of America


Objective To assess whether English-speaking reviewers can identify foreign-language articles that are eligible for a systematic review of all treatments for fibromyalgia.

Methods Systematic review of AMED, CINAHL, EMBASE, MEDLINE, HealthSTAR, PsycINFO, Papers First, Proceedings First and CENTRAL, from inception of each database to April, 2011, to identify all randomised controlled trials exploring any form of therapy for fibromyalgia. All non-English language articles were identified and screened for eligibility by native-language reviewers. English-speaking reviewers screened all non-English language, guided by 10 questions, in order to identify those that were eligible for review.

Results Of 15,466 potentially eligible studies we retrieved 763 in full text, of which 133 were published in 19 non-English languages; 431 studies proved eligible of which 53 were published in languages other than English. Agreement between English and native-language reviewers for assessment of eligibility of the 133 foreign language articles was 89% and the chance-corrected agreement was substantial (kappa = 0.77). Use of a simple 4-step rule (excluding languages with only one or two articles, reviewing titles and abstracts for clear indications of eligibility, noting the lack of a clearly reported statistical analysis unless the word ‘random’ appears, and noting features of systematic review) preserved the highest proportion of eligible articles (96%) with the fewest number of foreign-language reviewer teams needed (n = 9).

Conclusions We identified strategies that English-speaking reviewers can implement to ameliorate the burden associated with including eligible non-English language studies in systematic reviews.

Statistics from

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.