- Study Protocol
- Open Access
Allergen immunotherapy for insect venom allergy: protocol for a systematic review
Clinical and Translational Allergy volume 6, Article number: 6 (2016)
The Erratum to this article has been published in Clinical and Translational Allergy 2017 7:30
The European Academy of Allergy and Clinical Immunology (EAACI) is in the process of developing the EAACI Guidelines for Allergen Immunotherapy (AIT) for the Management of Insect Venom Allergy. We seek to critically assess the effectiveness, cost-effectiveness and safety of AIT in the management of insect venom allergy.
We will undertake a systematic review, which will involve searching international biomedical databases for published, in progress and unpublished evidence. Studies will be independently screened against pre-defined eligibility criteria and critically appraised using established instruments. Data will be descriptively and, if possible and appropriate, quantitatively synthesised.
The findings from this review will be used to inform the development of recomendations for EAACI’s Guidelines on AIT.
Hymenoptera venom allergy is a potentially life-threatening allergic reaction following one or more stings to bees, wasps, polistes, hornets or fire ants. The risk of anaphylaxis to hymenoptera stings is greater in adults when compared to children due to increased sting exposure, co-morbidities and concomitant medications in this age group. Systemic reactions have been reported in up to 3 % of adults and 0.34 % of children [1, 2].
Symptoms range from large local reactions at the sting site to mild, moderate, and severe systemic reactions. Mild systemic reactions are usually generalized skin symptoms such as flush, urticaria and angioedema. Typically, dizziness, dyspnea, nausea are moderate symptoms while anaphylactic shock, asthma, loss of consciousness, or even cardiac or respiratory arrest all indicate a severe sting reaction. The fear of future reactions usually greatly impairs quality of life. Around a quarter of fatalities from anaphylaxis are triggered by venom allergy [3–5].
Patients are advised to carry an emergency kit containing H1-antihistamines, corticosteroids, and adrenaline (epinephrine) depending on their previous sting reaction. The only treatment that can potentially prevent further severe reactions is venom immunotherapy (VIT). This may be effective with long-term clinical benefit and improved quality of life [6, 7]. However, despite its life-saving potential, VIT is still being under-prescribed and under-used in Europe .
The European Academy of Allergy and Clinical Immunology (EAACI) is in the process of developing the EAACI Guidelines for AIT. This systematic review is one of five inter-linked evidence syntheses that are being undertaken in order to provide a state-of-the-art synopsis of the current evidence base in relation to evaluating AIT for the treatment of insect venom allergy, allergic rhinoconjunctivitis, food allergy and allergic asthma, and allergy prevention. These will be used to inform the formulation of key clinical recommendations for subsequent clinical guidelines. The focus of this review is on assessing the effectiveness, safety and cost-effectiveness of VIT in the treatment of insect venom allergy.
A highly sensitive search strategy has been developed, and validated study design filters will be applied to retrieve all articles pertaining to the use of VIT for insect venom allergy from electronic bibliographic databases. We have conceptualized the search to incorporate the four elements below as shown in Fig. 1.
To retrieve systematic reviews, we will use the systematic review filter developed at McMaster University Health Information Research Unit (HIRU) (http://hiru.mcmaster.ca/hiru/HIRU_Hedges_MEDLINE_Strategies.aspx#Reviews). To retrieve randomized controlled trials (RCTs), we will apply the Cochrane highly sensitive search strategy for identifying RCTs in MEDLINE . To retrieve non-randomized studies, i.e. controlled clinical trials (CCTs), controlled before-and-after (CBA) and interrupted time-series (ITS) studies, we will use the Cochrane Effective Practice and Organisation of Care (EPOC) filter Version 2.4, available on request from the EPOC Group [10, 11]. To retrieve case series, we will use the filter developed by librarians at Clinical Evidence: http://clinicalevidence.bmj.com/x/set/static/ebm/learn/665076.html.
We will search the following databases:
Cochrane Library including:
Cochrane Database of Systematic Reviews (CDSR)
Database of Reviews of Effectiveness (DARE)
Health Technology Assessments (HTA)
Economic Evaluations Database (EED)
ISI Web of Science (Thomson Web of Knowledge)
TRIP Database (www.tripdatabase.com)
Clinicaltrials.gov (NIH web).
Current controlled trials (www.controlled-trials.com)
Australian and New Zealand Clinical Trials Registry (http://www.anzctr.org.au).
The search strategy has been developed on OVID MEDLINE and then adapted for the other databases (see “Appendix”). In all cases, the databases will be searched from inception to October 31, 2015. Additional references will be located through searching the references cited by the identified studies, and unpublished work and research in progress will be identified through discussion with experts in the field. We will invite experts who are active in the field from a range of disciplines and regions to add to the list of included studies by identifying additional published and unpublished papers they are aware of and research in progress. There will be no language restrictions employed; where possible, all relevant literature will be translated into English.
We are interested in identifying studies conducted on patients of any age with a physician confirmed diagnosis of systemic sting reaction to a venom sting from fire ants, bees and bumble bees, and paper wasps and wasps.
Interventions of interest
This review is focused on VIT using different products (purified and non-purified aqueous or depot) and different treatment protocols (conventional, cluster, rush and ultra-rush) adminsitered through the SCIT or SLIT routes.
We are interested in studies comparing VIT with placebo or no treatment (i.e. a natural course of the disease).
Systematic reviews of RCTs, and RCTs, will be used to investigate effectiveness; health economic analysis will be used to assess cost-effectiveness; and systematic reviews, and RCTs and case series with a minimum of 300 patients will be used to assess safety. We will appraise the evidence by looking at higher levels of evidence such as systematic reviews and/or meta-analyses of RCTs, together with individual RCTs. However, given the likelihood that we will find only a limited number of RCTs, we will also search for and include quasi-RCTs—[i.e. non-randomized CCTs, controlled before and after (CBA) studies and interrupted time series (ITS) analyses]. Given the high inherent risk of bias in making inferences from quasi-RCTs, clinical recommendations will be based on the findings from randomized controlled trials and the quasi-randomized controlled trials will only be used to guide suggestions on which areas need to be prioritized in future research .
Efficacy assessed by tolerated sting challenge or field sting both short-term and long-term, where long-term is defined as sustained clinical efficacy after discontinuation of treatment (VIT).
Assessment of disease specific quality of life;
Health economic analysis from the perspective of the health system/payer.
Reviews, discussion papers, non-research letters and editorials;
Quantitative studies not employing systematic review or RCT or quasi-RCT designs;
Case series (<300 patients).
All references will be uploaded into the systematic review software Distiller and undergo initial de-duplication. Study titles will be independently checked by two reviewers according to the above selection criteria and categorized as: included, not included or unsure. For those papers in the unsure category, we will retrieve the abstract and re-categorize as above. Any discrepancies will be resolved through discussion and, if necessary, a third reviewer will be consulted. Full text copies of potentially relevant studies will be obtained and their eligibility for inclusion independently assessed. Studies that do not fulfil all of the inclusion criteria will be excluded.
Quality assessment strategy
Quality assessments will independently be carried out on each study by two reviewers using the relevant version of the Critical Appraisal Skills Programme (CASP) quality assessment tool for systematic reviews and health economic evaluations . We will assess the risk of bias of experimental studies using the criteria suggested by the Cochrane EPOC Group . RCTs, CCTs and CBAs will be assessed for generation of allocation sequence, concealment of allocation, baseline outcome measurements, baseline characteristics, incomplete outcome data, blinding of outcome assessor, protection against contamination, selective outcome reporting and other risks of bias using the Cochrane risk of bias tool. For ITS designs, we will also assess the independence of the intervention from secular trends, the pre-specified shape of the intervention and if the intervention may have had an impact on data collection. These methodological assessments will draw on the principles incorporated into the Cochrane EPOC guidelines for assessing intervention studies . Similarly, we will use the quality assessment form produced by the National Institute for Health and Clinical Excellence (NICE) to critically appraise case series . Any discrepancies will be resolved by discussion or, if agreement could not be reached, by arbitration by a third reviewer.
Analysis, data synthesis and reporting
Data will be independently extracted onto a customized data extraction sheet in Distiller by two reviewers, and any discrepancies will be resolved by discussion or, if agreement cannot be reached, by arbitration by a third reviewer.
A descriptive summary with data tables will be produced to summarize the literature. If clinically and statistically appropriate, meta-analysis using either fixed-effect or random-effects modeling will be undertaken . A narrative synthesis of the data will also be undertaken.
Sensitivity and subgroup analyses, and assessment for publication bias
Sensitivity analyses will be undertaken by comparing the summary estimates obtained by excluding studies judged to be at high risk of bias.
Subgroup analyses will be undertaken to compare:
Children (5–11 years) versus adolescents (12–17 years) versus adults (≥18 years);
Conventional versus cluster versus rush versus ultra-rush protocols in SCIT;
Conventional in SLIT versus SCIT;
3 versus 5 years of treatment;
Different allergen doses (50 vs. 100 vs. 200 µg of maintenance VIT);
Bee versus wasp venom;
Comparing outcomes between those with and without co-existent mast cell disease .
Registration and reporting
This review will be registered with the International Prospective Register of Systematic Reviews (PROSPERO): http://www.crd.york.ac.uk/prospero/. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist will be used to guide the reporting of the systematic review: http://www.prisma-statement.org/.
This review will involve systematically identifying, critiquing and synthesizing the evidence on the efficacy/effectiveness, cost-effectiveness and safety of VIT for the management of venom allergy. The findings from this review will be used to inform the development of recommendations for EAACI’s Guidelines on AIT. We anticipate that this review will be reported in 2016.
Golden DB. Anaphylaxis to insect stings. Immunol Allergy Clin N Am. 2015;35(2):287–302. doi:10.1016/j.iac.2015.01.007.
Novembre E, Cianferoni A, Bernardini RA, Ingargiola A, Lombardi E, Vierucci A. Epidemiology of insect venom sensitivity in children and its correlation to clinical and atopic features. Clin Exp Allergy. 1998;28:834–8.
Clark S, Camargo CA Jr. Epidemiology of anaphylaxis. Immunol Allergy Clin N Am. 2007;27(2):145–63.
Liew WK, Williamson E, Tang ML. Anaphylaxis fatalities and admissions in Australia. J Allergy Clin Immunol. 2009;123(2):434–42.
Pumphrey RSH. Lessons for management of anaphylaxis from a study of fatal reactions. Clin Exp Allergy. 2000;30(8):1144–50.
Krishna MT, Ewan PM, Diwakar L, Durham SR, Frew AJ, Leech SC, Nasser SM. Diagnosis and management of hymenoptera venom allergy: British Society for Allergy and Clinical Immunology (BSACI) guidelines. Clin Exp Allergy. 2011;41:1201–20.
Stritzke AI, Eng PA. Age-dependent sting recurrence and outcome in immunotherapy-treated children with anaphylaxis to hymenoptera venom. Clin Exp Allergy. 2013;43(8):950–5.
Bilò BM, Bonifazi F. Epidemiology of insect-venom anaphylaxis. Curr Opin Allergy Clin Immunol. 2008;8(4):330.
Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions version 5.1.0 (updated March 2011). UK: The Cochrane Collaboration; 2011. www.cochrane-handbook.org. (Last accessed on 3 Sept 2015).
Effective Practice and Organisation of Care (EPOC). How to develop a search strategy. EPOC Resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2014. http://epoc.cochrane.org/epoc-specific-resources-review-authors.
Cochrane Effective Practice and Organisation of Care (EPOC) Group. Personal communication Michelle Fiander, Information Specialist and Trial Search Co-ordinator. Ottawa: EPOC; 2012.
Effective Practice and Organisation of Care (EPOC). What study designs should be included in an EPOC review? EPOC Resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2013. http://epoc.cochrane.org/epoc-specific-resources-review-authors. (Last accessed on 11 Nov 2015).
Passalacqua G, Baena-Cagnani CE, Bousquet J, Canonica GW, Casale TB, Cox L, Durham SR, Larenas-Linnemann D, Ledford D, Pawankar R, Potter P, Rosario N, Wallace D, Lockey RF. Grading local side effects of sublingual immunotherapy for respiratory allergy: speaking the same language. J Allergy Clin Immunol. 2013; 132(1):93–8. http://www.jacionline.org/article/S0091-6749(13)00528-9/pdf.
World Allergy Organization Subcutaneous Immunotherapy Systemic Reaction Grading System. https://www.aaaai.org/Aaaai/media/MediaLibrary/PDF%20Documents/Immunotherapy%20Forms/7b-World-Allergy-Organization-Systemic-Reaction-Grading-systemx.pdf.
CASP checklist for systematic reviews. ©Critical Appraisal Skills Programme (CASP) Systematic Review Checklist 31.05.13. http://media.wix.com/ugd/dded87_a02ff2e3445f4952992d5a96ca562576.pdf. (Last accessed on 13 Nov 2015).
Effective Practice and Organisation of Care Group. EPOC website. http://epoc.cochrane.org/epoc-specific-resources-review-authors. (Last accessed on 4 Jan 2016).
Cochrane Effective Practice and Organisation of Care Group. Methods papers. UK: The Cochrane Collaboration. http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/baseline.pdf. (Last accessed on 4 Jan 2016).
Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions. Version 5.0.2. (chapter 11, section 11). UK: The Cochrane Collaboration.
Bonadonna P, Bonifacio M, Lombardo C, Zanotti R. Hymenoptera allergy and mast cell activation syndromes. Curr Allergy Asthma Rep. 2016;16(1):5. doi:10.1007/s11882-015-0582-5.
Egger M, Davey Smith G, Schneider M, et al. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315:629–34.
Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50:1088–101.
This protocol was drafted by S Dhami and the search strategy was developed by U. Nurmatov. It was revised following critical review initially by A. Sheikh, E.-V. Varga and G. Sturm and then by all the co-authors. All authors read and approved the final manuscript.
S. Dhami: support to undertake the systematic review; U. Nurmatov: support to undertake the review; E-M Varga: Steering Committee Member and National Study Co-ordinator of the GAP trial (ALK-Abello), Speakers honoraria recipient from Stallergenes, Meda,Nutricia, Alk-Abello, Bencard; G Sturm: Materials for research programme (ALK-Abello), research grant (ALK-Abello), advisory board (ALK-Abello, Meda), speaker (ALK-Abello, Stallergens, Bencard, Thermo Fisher); A Muraro: Acting in consulting capacity for ALK, Meda Pharma, Nestle, Nutricia, Novartis. Grants from: Nestlé: Co-investigator for research protocol, Nutricia: Co-investigator for research protocols; C Akdis: Materials for research programme (Allergopharma), research grant (Allergopharma, Swiss National Science Foundation, EU MeDall, EU Predicta, Swiss Polish Research Program), advisory board (Boehringer Ingelheim, Allergopharma, Novartis, Davos Diagnostics, Actellion, Alimentary Health Pharma Davos), speaker (none) D. Antolín-Amérigo: advisory board (Merck, Novartis, Sandoz), Medical expert of the ALK web for general public (ALK-Abelló), research grant (Merck-Serono-Fundación 2000), clinical trials (Diater Laboratorios, Stallergenes), educational grants (Merck, Pfizer), speaker (Allergy Therapeutics, GlaxoSmithKline, Merck, Stallergenes), honoraria for articles (Ferrer Laboratorios, Meda, Stallergenes); M. Beatrice Bilò: advisory board (ALK-Abello, Allergopharma, Novartis), speaker (ALK-Abello, Allergopharma, Stallergens, Thermo Fisher); D. Bokanovic: research grant (MEDA), speaker (ALK-Abello); Moises A. Calderon: lectures honorarium (ALK, Stallergens, Merck and Allergopharma), consultancy honorarium (ALK, Stallergenes and Hal); E. Cichocka-Jarosz: none; J.O. Elberink, speaker (Chiesi, Meda, Novartis); R. Gawlik: speaker (Stallergens, Hal); T. Jakob: Materials for research (Allergopharma GmbH, Thermo Fisher Scientific), research grant (Allergopharma GmbH, Thermo Fisher Scientific, Dr. Fooke Laboratories GmbH, Novartis, Birken AG, Cosmetics Europe), advisory board (ALK-Abello, Allergy Therapeutics, Novartis, Leti GmbH, Allergopharma), speaker (ALK-Abello, Allergy Therapeutics, Thermo Fisher Scientific); Mitja Kosnik: none; J Lange: none; E. Mingomataj: none; D. I. Mitsias: none; H. Mosbech: none; C. Pitsios: none; V. Pravettoni: consultant for an advisory board (ALK Abellò), speaker (Thermo Fisher); G. Roberts: Materials for research programme (ALK-Abello), research grant (ALK-Abello), advisory board (ALK-Abello), speaker (Allergy Therapeutics, ALK-Abelo); B. A. Sin: none; A. Sheikh: support to co-ordinate the undertaking of the systematic review and development of the guidelines.
An erratum to this article is available at https://doi.org/10.1186/s13601-017-0165-8.
Appendix: Search strategy
Appendix: Search strategy
Search strategy 1 (MEDLINE, EMBASE)
insect sting.mp. or exp insect sting/
insect bite.mp. or exp insect bite/
insect allergy.mp. or exp insect allergy/
exp immediate type hypersensitivity/or exp delayed hypersensitivity/or exp hypersensitivity/or hypersensitivity.mp.
hypersensitivity reaction.mp. or allergic reaction/
systemic anaphylaxis/or exp anaphylaxis/or anaphylaxis.mp.
shock.mp. or anaphylactic shock/or exp traumatic shock/or exp shock/
hives.mp. or exp urticaria/
laryngeal obstruction.mp. or exp larynx stenosis/
airway obstruction.mp. or exp airway obstruction/
exp Hymenoptera venom/or exp Hymenoptera/or hymenoptera.mp.
exp bee venom/or exp bee/or bee.mp.
honey bee.mp. or exp honeybee/
wasp*.mp. or wasp venom.mp. or exp wasp venom/
exp ant sting/or ant.mp. or exp ant/or exp ant venom/
(apis mellifera or vespid or vespula or white hornet or yellow jacket or yellow hornet or polistes or arthropod venom or solenopsis invicta or myrmecia pilosula).mp.
immunotherapy.mp. or exp subcutaneous immunotherapy/or exp immunotherapy/
specific immunotherapy for hymenoptera venom.mp.
immunomodulation.mp. or exp immunomodulation/
immunologic response.mp. or exp immune response/
subcutaneous immunotherapy.mp. or exp subcutaneous immunotherapy/or sublingual immunotherapy.mp. or exp sublingual immunotherapy/
(intradermal immunotherapy or intralymphatic immunotherapy).mp.
exp systematic desensitization/or exp desensitization/or desensitization.mp.
intervention stud*.mp. or exp intervention study/
exp “clinical trial (topic)”/or exp “controlled clinical trial (topic)”/or exp “randomized controlled trial (topic)”/or trial.mp. or exp controlled clinical trial/
(randomi?ed controlled trial or non-randomi?ed trial or quasi-randomi?ed trial).mp.
placebos.mp. or exp placebo/
random allocation.mp. or exp randomization/
double blind procedure/
(double-blind or double blind).mp.
(single-blind or single blind).mp.
(triple-blind or triple blind).mp.
interrupted time series.mp.
(controlled before and after stud* or controlled before-and-after stud*).mp.
controlled before after design.mp.
exp health care costs/
(costs and costs analysis).mp.
((cost effective* adj1 analys*) or cost minimi?ation analys* or cost benefit analys* or cost utility analys* or cost consequence analys* or finances).mp.
21 and 33 and 59
Search strategy 2: (Cochrane library, HTA, EED, CINAHL, ISI Web of Science, TRIP)
(Insect sting or insect bite or bee sting or bumble bee sting or wasp sting or paper wasp sting or ant sting or fire ant sting or insect allergy or venom allergy or insect venom allergy or bee sting allergy or wasp sting allergy or fire ant allergy or hypersensitivity or immediate type hypersensitivity or delayed hypersensitivity or allergic reaction or severe allergic reaction or anaphylaxis or anaphylactic shock)
(Immunologic, desensiti* or immunotherapy or venom immunotherapy or specific immunotherapy for hymenoptera venom or subcutaneous immunotherapy or sublingual immunotherapy or intradermal immunotherapy or intralymphatic immunotherapy or specific immunotherapy)
(Intervention stud* or experimental stud* or trial or clinical trial* or controlled clinical trial or randomi* controlled trial or quasi-ranomi* controlled trial or random allocation or single blind method or double blind method or triple blind method or random* or interrupted time series or controlled before and after stud* or systematic review or meta-analysis or case series or economic evaluation* or cost effective* analys* or cost minimi?ation analys* or cost benefit analys* or cost utility analys* or cost consequence analys* or finances).