- Study Protocol
- Open Access
Allergen immunotherapy for insect venom allergy: protocol for a systematic review
- Sangeeta Dhami1Email authorView ORCID ID profile,
- Ulugbek Nurmatov2,
- Eva-Maria Varga3,
- Gunter Sturm4,
- Antonella Muraro5,
- Cezmi A. Akdis6, 7,
- Darío Antolín-Amérigo8,
- M. Beatrice Bilò9,
- Danijela Bokanovic10,
- Moises A. Calderon11, 12,
- Ewa Cichocka-Jarosz13,
- Joanna N. G. Oude Elberink14,
- Radoslaw Gawlik15,
- Thilo Jakob16,
- Mitja Kosnik17,
- Joanna Lange18,
- Ervin Mingomataj19, 20,
- Dimitris I. Mitsias21,
- Holger Mosbech22,
- Oliver Pfaar23,
- Constantinos Pitsios24, 25,
- Valerio Pravettoni26,
- Graham Roberts27, 28,
- Franziska Ruëff29,
- Betül Ayşe Sin30 and
- Aziz Sheikh31
© Dhami et al. 2016
Received: 25 November 2015
Accepted: 11 January 2016
Published: 16 February 2016
The Erratum to this article has been published in Clinical and Translational Allergy 2017 7:30
The European Academy of Allergy and Clinical Immunology (EAACI) is in the process of developing the EAACI Guidelines for Allergen Immunotherapy (AIT) for the Management of Insect Venom Allergy. We seek to critically assess the effectiveness, cost-effectiveness and safety of AIT in the management of insect venom allergy.
We will undertake a systematic review, which will involve searching international biomedical databases for published, in progress and unpublished evidence. Studies will be independently screened against pre-defined eligibility criteria and critically appraised using established instruments. Data will be descriptively and, if possible and appropriate, quantitatively synthesised.
The findings from this review will be used to inform the development of recomendations for EAACI’s Guidelines on AIT.
Hymenoptera venom allergy is a potentially life-threatening allergic reaction following one or more stings to bees, wasps, polistes, hornets or fire ants. The risk of anaphylaxis to hymenoptera stings is greater in adults when compared to children due to increased sting exposure, co-morbidities and concomitant medications in this age group. Systemic reactions have been reported in up to 3 % of adults and 0.34 % of children [1, 2].
Symptoms range from large local reactions at the sting site to mild, moderate, and severe systemic reactions. Mild systemic reactions are usually generalized skin symptoms such as flush, urticaria and angioedema. Typically, dizziness, dyspnea, nausea are moderate symptoms while anaphylactic shock, asthma, loss of consciousness, or even cardiac or respiratory arrest all indicate a severe sting reaction. The fear of future reactions usually greatly impairs quality of life. Around a quarter of fatalities from anaphylaxis are triggered by venom allergy [3–5].
Patients are advised to carry an emergency kit containing H1-antihistamines, corticosteroids, and adrenaline (epinephrine) depending on their previous sting reaction. The only treatment that can potentially prevent further severe reactions is venom immunotherapy (VIT). This may be effective with long-term clinical benefit and improved quality of life [6, 7]. However, despite its life-saving potential, VIT is still being under-prescribed and under-used in Europe .
The European Academy of Allergy and Clinical Immunology (EAACI) is in the process of developing the EAACI Guidelines for AIT. This systematic review is one of five inter-linked evidence syntheses that are being undertaken in order to provide a state-of-the-art synopsis of the current evidence base in relation to evaluating AIT for the treatment of insect venom allergy, allergic rhinoconjunctivitis, food allergy and allergic asthma, and allergy prevention. These will be used to inform the formulation of key clinical recommendations for subsequent clinical guidelines. The focus of this review is on assessing the effectiveness, safety and cost-effectiveness of VIT in the treatment of insect venom allergy.
To retrieve systematic reviews, we will use the systematic review filter developed at McMaster University Health Information Research Unit (HIRU) (http://hiru.mcmaster.ca/hiru/HIRU_Hedges_MEDLINE_Strategies.aspx#Reviews). To retrieve randomized controlled trials (RCTs), we will apply the Cochrane highly sensitive search strategy for identifying RCTs in MEDLINE . To retrieve non-randomized studies, i.e. controlled clinical trials (CCTs), controlled before-and-after (CBA) and interrupted time-series (ITS) studies, we will use the Cochrane Effective Practice and Organisation of Care (EPOC) filter Version 2.4, available on request from the EPOC Group [10, 11]. To retrieve case series, we will use the filter developed by librarians at Clinical Evidence: http://clinicalevidence.bmj.com/x/set/static/ebm/learn/665076.html.
Cochrane Library including:
Cochrane Database of Systematic Reviews (CDSR)
Database of Reviews of Effectiveness (DARE)
Health Technology Assessments (HTA)
Economic Evaluations Database (EED)
ISI Web of Science (Thomson Web of Knowledge)
TRIP Database (www.tripdatabase.com)
Clinicaltrials.gov (NIH web).
Current controlled trials (www.controlled-trials.com)
Australian and New Zealand Clinical Trials Registry (http://www.anzctr.org.au).
The search strategy has been developed on OVID MEDLINE and then adapted for the other databases (see “Appendix”). In all cases, the databases will be searched from inception to October 31, 2015. Additional references will be located through searching the references cited by the identified studies, and unpublished work and research in progress will be identified through discussion with experts in the field. We will invite experts who are active in the field from a range of disciplines and regions to add to the list of included studies by identifying additional published and unpublished papers they are aware of and research in progress. There will be no language restrictions employed; where possible, all relevant literature will be translated into English.
We are interested in identifying studies conducted on patients of any age with a physician confirmed diagnosis of systemic sting reaction to a venom sting from fire ants, bees and bumble bees, and paper wasps and wasps.
Interventions of interest
This review is focused on VIT using different products (purified and non-purified aqueous or depot) and different treatment protocols (conventional, cluster, rush and ultra-rush) adminsitered through the SCIT or SLIT routes.
We are interested in studies comparing VIT with placebo or no treatment (i.e. a natural course of the disease).
Systematic reviews of RCTs, and RCTs, will be used to investigate effectiveness; health economic analysis will be used to assess cost-effectiveness; and systematic reviews, and RCTs and case series with a minimum of 300 patients will be used to assess safety. We will appraise the evidence by looking at higher levels of evidence such as systematic reviews and/or meta-analyses of RCTs, together with individual RCTs. However, given the likelihood that we will find only a limited number of RCTs, we will also search for and include quasi-RCTs—[i.e. non-randomized CCTs, controlled before and after (CBA) studies and interrupted time series (ITS) analyses]. Given the high inherent risk of bias in making inferences from quasi-RCTs, clinical recommendations will be based on the findings from randomized controlled trials and the quasi-randomized controlled trials will only be used to guide suggestions on which areas need to be prioritized in future research .
Efficacy assessed by tolerated sting challenge or field sting both short-term and long-term, where long-term is defined as sustained clinical efficacy after discontinuation of treatment (VIT).
Reviews, discussion papers, non-research letters and editorials;
Quantitative studies not employing systematic review or RCT or quasi-RCT designs;
Case series (<300 patients).
All references will be uploaded into the systematic review software Distiller and undergo initial de-duplication. Study titles will be independently checked by two reviewers according to the above selection criteria and categorized as: included, not included or unsure. For those papers in the unsure category, we will retrieve the abstract and re-categorize as above. Any discrepancies will be resolved through discussion and, if necessary, a third reviewer will be consulted. Full text copies of potentially relevant studies will be obtained and their eligibility for inclusion independently assessed. Studies that do not fulfil all of the inclusion criteria will be excluded.
Quality assessment strategy
Quality assessments will independently be carried out on each study by two reviewers using the relevant version of the Critical Appraisal Skills Programme (CASP) quality assessment tool for systematic reviews and health economic evaluations . We will assess the risk of bias of experimental studies using the criteria suggested by the Cochrane EPOC Group . RCTs, CCTs and CBAs will be assessed for generation of allocation sequence, concealment of allocation, baseline outcome measurements, baseline characteristics, incomplete outcome data, blinding of outcome assessor, protection against contamination, selective outcome reporting and other risks of bias using the Cochrane risk of bias tool. For ITS designs, we will also assess the independence of the intervention from secular trends, the pre-specified shape of the intervention and if the intervention may have had an impact on data collection. These methodological assessments will draw on the principles incorporated into the Cochrane EPOC guidelines for assessing intervention studies . Similarly, we will use the quality assessment form produced by the National Institute for Health and Clinical Excellence (NICE) to critically appraise case series . Any discrepancies will be resolved by discussion or, if agreement could not be reached, by arbitration by a third reviewer.
Analysis, data synthesis and reporting
Data will be independently extracted onto a customized data extraction sheet in Distiller by two reviewers, and any discrepancies will be resolved by discussion or, if agreement cannot be reached, by arbitration by a third reviewer.
A descriptive summary with data tables will be produced to summarize the literature. If clinically and statistically appropriate, meta-analysis using either fixed-effect or random-effects modeling will be undertaken . A narrative synthesis of the data will also be undertaken.
Sensitivity and subgroup analyses, and assessment for publication bias
Sensitivity analyses will be undertaken by comparing the summary estimates obtained by excluding studies judged to be at high risk of bias.
Children (5–11 years) versus adolescents (12–17 years) versus adults (≥18 years);
Conventional versus cluster versus rush versus ultra-rush protocols in SCIT;
Conventional in SLIT versus SCIT;
3 versus 5 years of treatment;
Different allergen doses (50 vs. 100 vs. 200 µg of maintenance VIT);
Bee versus wasp venom;
Comparing outcomes between those with and without co-existent mast cell disease .
Registration and reporting
This review will be registered with the International Prospective Register of Systematic Reviews (PROSPERO): http://www.crd.york.ac.uk/prospero/. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist will be used to guide the reporting of the systematic review: http://www.prisma-statement.org/.
This review will involve systematically identifying, critiquing and synthesizing the evidence on the efficacy/effectiveness, cost-effectiveness and safety of VIT for the management of venom allergy. The findings from this review will be used to inform the development of recommendations for EAACI’s Guidelines on AIT. We anticipate that this review will be reported in 2016.
This protocol was drafted by S Dhami and the search strategy was developed by U. Nurmatov. It was revised following critical review initially by A. Sheikh, E.-V. Varga and G. Sturm and then by all the co-authors. All authors read and approved the final manuscript.
S. Dhami: support to undertake the systematic review; U. Nurmatov: support to undertake the review; E-M Varga: Steering Committee Member and National Study Co-ordinator of the GAP trial (ALK-Abello), Speakers honoraria recipient from Stallergenes, Meda,Nutricia, Alk-Abello, Bencard; G Sturm: Materials for research programme (ALK-Abello), research grant (ALK-Abello), advisory board (ALK-Abello, Meda), speaker (ALK-Abello, Stallergens, Bencard, Thermo Fisher); A Muraro: Acting in consulting capacity for ALK, Meda Pharma, Nestle, Nutricia, Novartis. Grants from: Nestlé: Co-investigator for research protocol, Nutricia: Co-investigator for research protocols; C Akdis: Materials for research programme (Allergopharma), research grant (Allergopharma, Swiss National Science Foundation, EU MeDall, EU Predicta, Swiss Polish Research Program), advisory board (Boehringer Ingelheim, Allergopharma, Novartis, Davos Diagnostics, Actellion, Alimentary Health Pharma Davos), speaker (none) D. Antolín-Amérigo: advisory board (Merck, Novartis, Sandoz), Medical expert of the ALK web for general public (ALK-Abelló), research grant (Merck-Serono-Fundación 2000), clinical trials (Diater Laboratorios, Stallergenes), educational grants (Merck, Pfizer), speaker (Allergy Therapeutics, GlaxoSmithKline, Merck, Stallergenes), honoraria for articles (Ferrer Laboratorios, Meda, Stallergenes); M. Beatrice Bilò: advisory board (ALK-Abello, Allergopharma, Novartis), speaker (ALK-Abello, Allergopharma, Stallergens, Thermo Fisher); D. Bokanovic: research grant (MEDA), speaker (ALK-Abello); Moises A. Calderon: lectures honorarium (ALK, Stallergens, Merck and Allergopharma), consultancy honorarium (ALK, Stallergenes and Hal); E. Cichocka-Jarosz: none; J.O. Elberink, speaker (Chiesi, Meda, Novartis); R. Gawlik: speaker (Stallergens, Hal); T. Jakob: Materials for research (Allergopharma GmbH, Thermo Fisher Scientific), research grant (Allergopharma GmbH, Thermo Fisher Scientific, Dr. Fooke Laboratories GmbH, Novartis, Birken AG, Cosmetics Europe), advisory board (ALK-Abello, Allergy Therapeutics, Novartis, Leti GmbH, Allergopharma), speaker (ALK-Abello, Allergy Therapeutics, Thermo Fisher Scientific); Mitja Kosnik: none; J Lange: none; E. Mingomataj: none; D. I. Mitsias: none; H. Mosbech: none; C. Pitsios: none; V. Pravettoni: consultant for an advisory board (ALK Abellò), speaker (Thermo Fisher); G. Roberts: Materials for research programme (ALK-Abello), research grant (ALK-Abello), advisory board (ALK-Abello), speaker (Allergy Therapeutics, ALK-Abelo); B. A. Sin: none; A. Sheikh: support to co-ordinate the undertaking of the systematic review and development of the guidelines.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Golden DB. Anaphylaxis to insect stings. Immunol Allergy Clin N Am. 2015;35(2):287–302. doi:10.1016/j.iac.2015.01.007.View ArticleGoogle Scholar
- Novembre E, Cianferoni A, Bernardini RA, Ingargiola A, Lombardi E, Vierucci A. Epidemiology of insect venom sensitivity in children and its correlation to clinical and atopic features. Clin Exp Allergy. 1998;28:834–8.View ArticlePubMedGoogle Scholar
- Clark S, Camargo CA Jr. Epidemiology of anaphylaxis. Immunol Allergy Clin N Am. 2007;27(2):145–63.View ArticleGoogle Scholar
- Liew WK, Williamson E, Tang ML. Anaphylaxis fatalities and admissions in Australia. J Allergy Clin Immunol. 2009;123(2):434–42.View ArticlePubMedGoogle Scholar
- Pumphrey RSH. Lessons for management of anaphylaxis from a study of fatal reactions. Clin Exp Allergy. 2000;30(8):1144–50.View ArticlePubMedGoogle Scholar
- Krishna MT, Ewan PM, Diwakar L, Durham SR, Frew AJ, Leech SC, Nasser SM. Diagnosis and management of hymenoptera venom allergy: British Society for Allergy and Clinical Immunology (BSACI) guidelines. Clin Exp Allergy. 2011;41:1201–20.View ArticlePubMedGoogle Scholar
- Stritzke AI, Eng PA. Age-dependent sting recurrence and outcome in immunotherapy-treated children with anaphylaxis to hymenoptera venom. Clin Exp Allergy. 2013;43(8):950–5.View ArticlePubMedGoogle Scholar
- Bilò BM, Bonifazi F. Epidemiology of insect-venom anaphylaxis. Curr Opin Allergy Clin Immunol. 2008;8(4):330.View ArticlePubMedGoogle Scholar
- Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions version 5.1.0 (updated March 2011). UK: The Cochrane Collaboration; 2011. www.cochrane-handbook.org. (Last accessed on 3 Sept 2015).
- Effective Practice and Organisation of Care (EPOC). How to develop a search strategy. EPOC Resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2014. http://epoc.cochrane.org/epoc-specific-resources-review-authors.
- Cochrane Effective Practice and Organisation of Care (EPOC) Group. Personal communication Michelle Fiander, Information Specialist and Trial Search Co-ordinator. Ottawa: EPOC; 2012.Google Scholar
- Effective Practice and Organisation of Care (EPOC). What study designs should be included in an EPOC review? EPOC Resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2013. http://epoc.cochrane.org/epoc-specific-resources-review-authors. (Last accessed on 11 Nov 2015).
- Passalacqua G, Baena-Cagnani CE, Bousquet J, Canonica GW, Casale TB, Cox L, Durham SR, Larenas-Linnemann D, Ledford D, Pawankar R, Potter P, Rosario N, Wallace D, Lockey RF. Grading local side effects of sublingual immunotherapy for respiratory allergy: speaking the same language. J Allergy Clin Immunol. 2013; 132(1):93–8. http://www.jacionline.org/article/S0091-6749(13)00528-9/pdf.
- World Allergy Organization Subcutaneous Immunotherapy Systemic Reaction Grading System. https://www.aaaai.org/Aaaai/media/MediaLibrary/PDF%20Documents/Immunotherapy%20Forms/7b-World-Allergy-Organization-Systemic-Reaction-Grading-systemx.pdf.
- CASP checklist for systematic reviews. ©Critical Appraisal Skills Programme (CASP) Systematic Review Checklist 31.05.13. http://media.wix.com/ugd/dded87_a02ff2e3445f4952992d5a96ca562576.pdf. (Last accessed on 13 Nov 2015).
- Effective Practice and Organisation of Care Group. EPOC website. http://epoc.cochrane.org/epoc-specific-resources-review-authors. (Last accessed on 4 Jan 2016).
- Cochrane Effective Practice and Organisation of Care Group. Methods papers. UK: The Cochrane Collaboration. http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/baseline.pdf. (Last accessed on 4 Jan 2016).
- Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions. Version 5.0.2. (chapter 11, section 11). UK: The Cochrane Collaboration.Google Scholar
- Bonadonna P, Bonifacio M, Lombardo C, Zanotti R. Hymenoptera allergy and mast cell activation syndromes. Curr Allergy Asthma Rep. 2016;16(1):5. doi:10.1007/s11882-015-0582-5.View ArticlePubMedGoogle Scholar
- Egger M, Davey Smith G, Schneider M, et al. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315:629–34.View ArticlePubMedPubMed CentralGoogle Scholar
- Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50:1088–101.View ArticlePubMedGoogle Scholar