Research Article Volume 9 Issue 2
1Hospital Cayetano Heredia, Peru
2Universidad Peruana Cayetano Heredia, Peru
3Universidad Peruana de Ciencias Aplicadas – UPC, Perú
Correspondence: Aldo Maruy Saito, Universidad Peruana Cayetano Heredia, Lima, Perú
Received: December 22, 2017 | Published: April 13, 2018
Citation: Saito AM, Rodríguez JCH, Galarza RR. Methodological quality of clinical practice guidelines on probiotics in acute gastroenteritis in children using the appraisal of guidelines for research & evaluation II instrument (Agreeii). Gastroenterol Hepatol Open Access. 2018;9(2):78-81. DOI: 10.15406/ghoa.2018.09.00299
Acute Gastroenteritis (AGE) is one of the diseases that most frequently affects paediatric population. Successful treatment in AGE has been mainly based on prevention and treatment of its complications; however every day, we find more publications on the use of adjuvants to decrease its duration. Some probiotics report benefits, particularly in terms of reducing duration of the episode or stool frequency. We look for clinical guidelines that recommend their use in AGE in children and we assessed their methodology quality by the Appraisal of Guidelines for Research & Evaluation (AGREE II) instrument. All of the CPG consider that the administration of Lactobacillus rhamnosus GG and Saccharomyces boulardii should be considered in the management of children with AGE as an adjunct to rehydration therapy with different levels of evidence. Four CPG had one rating higher than 60% in 4 or more domains and one in only one domain. Only a CPG was greater than 60% in all domains. Four had an overall score greater than or equal to 5 and were 'recommended', and one with modifications, according to the instrument AGREE II. In conclusion: the selected GPC have good methodological quality, but are not specific to probiotics. Despite, they should be spread for better decision making.
Keywords: acute gastroenteritis, AGREE instrument, child, guidelines, probiotics
Acute gastroenteritis (AGE) remains a major cause of morbidity and mortality in children around the world, accounting for 1.34 million deaths annually in children younger than 5 years, or roughly 15% of all child deaths.1 Successful treatment in AGE has been mainly based on prevention and treatment of its complications; however every day, we find more publications on the use of adjuvants to decrease its duration. Probiotics are live microorganisms that, when administered in adequate amounts, confer a health benefit on the host and have gained greater importance because some of them report benefits, particularly in terms of reducing duration of the episode or stool frequency.2
Clinical practice guidelines (CPGs) are systematically developed statements to assist practitioners in making decisions about appropriate health care in specific clinical circumstances.3 Their purpose is to make recommendations with a definite intent to influence what clinicians do. The benefits of guidelines are only as good as the quality of the guidelines themselves. The quality of guidelines can be extremely variable and some often fall short of basic standards.4,5
The Appraisal of Guidelines for REsearch & Evaluation (AGREE) Instrument was developed to address the issue of variability in guideline quality.6 To that end, the AGREE instrument is a tool that assesses the methodological rigour and transparency in which a guideline is developed. The aim was to assess the methodological quality of clinical practice guidelines (CPG) on the use of probiotics in infant diarrhoea.
The search was conducted in December 2016, of CPG based on the evidence, the last 10 years and unrestricted language, PubMed, ScienceDirect, and Lilacs. In PubMed, the search terms were: probiotics AND infants; limit: 'guideline'. In ScienceDirect: Probiotics AND infants; limit: Medicine and Dentistry and LILACS: 'probiotics' AND 'infants' and 'probióticos' AND 'guía'. The CPG selected were evaluated with the instrument AGREE II by two evaluators who were independent one from the other and by a third evaluator, when there were discrepancies. The concordance of the evaluations was measured with the index of kappa.
Ten documents were recovered in PubMed, and selected only 03 that fulfilled the criteria about probiotics. No documents were recovered in the other two searchers. The other two were located in a direct way. The 5 CPG were: 1. Diarrhea and vomiting caused by gastroenteritis - NICE (2009);7 2. CPG on the diagnosis and treatment of the AID in Pediatrics - Peru (2009);8,9 3. ESPGHAN-ESPID evidence-based guidelines for the management of AGE in children in Europe. Update (2014);10,11 4. Clinical practice guideline ILA on the management of GEA in children under 5 years (2014)12 and 5. Use of probiotics for management of AGE. A position paper by the ESPGHAN Working Group for Probiotics and Prebiotics (2014).13 All of the CPG consider that the administration of Lactobacillus rhamnosus GG and Saccharomyces boulardii should be considered in the management of children with AGE as an adjunct to rehydration therapy with different levels of evidence. The concordance between evaluators was >0.9 and <1.0 for all guidelines.
Four CPG had one rating higher than 60% in 4 or more domains and one in only one domain. Only a CPG was greater than 60% in all domains. Four had an overall score greater than or equal to 5 and were 'recommended', and one with modifications, according to the instrument AGREE II.
As a result of our study, using the AGREE II instrument, 4 CPGs of 'Recommendable' quality were identified for the AGE, which recommended the use of probiotics as coadjuvant therapy. A publication, called CPG, was globally rated as 'Recommendable with modifications' because it is a consensus and the AGREE II instrument, only values CPGs. Our study is one of the first and few studies that evaluates the CPG on AGE with the AGREE II instrument and that allows the elaboration of a hierarchical table of recommendations on the use of probiotics in AGE, different from the study that uses the AGREE I instrument(Table 1).14
Domain |
NICE |
Gonzales et al.8 |
Guarino et al.10 |
Polanco et al.12 |
Szajewska et al.13 |
1. Scope and Purpose |
97.22% |
100.00% |
83.33% |
88.89% |
19.44% |
2. Stakeholder Involvement |
88.89% |
80.56% |
77.78% |
69.44% |
30.56% |
3. Rigour of Development |
79.17% |
75.00% |
73.96% |
67.71% |
54.16% |
4. Clarity of Presentation |
97.22% |
100.00% |
80.56% |
69.44% |
61.11% |
5. Applicability |
68.75% |
58.33% |
54.17% |
41.67% |
27.08% |
6. Editorial Independence |
70.83% |
75.00% |
62.5 |
62.50% |
58.33% |
Rate Overall Quality |
7 |
6 |
5 |
5 |
3 |
Recommendation |
YES |
YES |
YES |
YES |
YES, with modifications |
Table 1 Recommendations on the use of probiotics in AGE
The use of probiotics as adjuvant therapy for AGE in pediatrics has solid arguments.2,15 Therefore, the need to evaluate the quality of the CPGs that recommend them is important because, as shown in other studies, both nationally and internationally, the quality of CPG preparation is variable.16,17 The study showed that the overall quality of the CPGs evaluated is 'high' ('Recommendable'), but that despite this, the assessment of the Applicability domain is low, as was found in another publication,18 leading to think that the probability of implementation is controversial. This could explain, in part, the poor adherence shown by physicians in following CPG recommendations.19–21 In the domains of Scope and objectives and Presentation, all the guides obtain their best assessment, which reflects that the developers are standardizing to whom is directed and how to present the CPG, however, due to the variability in the process of development and scientific content there is still no confidence in following the CPG, as has been analyzed in some noncommunicable diseases, for example.22
Globally, there is an attempt to reduce inequality in the provision of health services; this will not be possible if a quality health care is not delivered and above all measurable, in order to improve it continuously, as an analysis of the improvement model in Europe has shown.23 Thus, the AGREE II instrument is used by health institutions and health policymakers to discriminate on recommended or not recommended guidelines for infectious24 and non-infectious diseases in pediatrics.25 The evaluation methodology of the CPGs with the AGREE II instrument is known and has been the subject of publications to explain the influence of the evaluation and the importance of the components of the instrument, to try to be as objective as possible.26
It is important to notice that the position paper by the ESPGHAN13 has a search methodology and elaboration of recommendations of the most updated, disseminated and recognized which is the GRADE methodology,27 but it is not a GPC. For our study, when evaluated by the AGREE II instrument, its assessment is 'recommended with modifications' without diminishing its quality in the content or in the elaboration. Therefore, its use as a 'source' in decision-making, although it is not known if it has been evaluated, could be one of the most consulted.
In recent years, medical malpractice lawsuits have turned traditional medicine into a 'defensive' type medicine,28,29 increasing the costs of medical care and generating distrust in the system. The possibility of a medical malpractice judgement will always be present each time an attention is made. The practice of evidence-based medicine is not an infallible practice and the legal influence of CPGs has been evaluated, especially to help the courts decide whether a negligence claim is sustainable or not.30 For this reason, quality CPGs that help in decision-making, with scientific and trustworthy information, will not only benefit the patient (since health care, with high probability, will be of quality), but will help the health system to be safer and more useful to the patient.
The results of our study can be extrapolated to other medicine topics, both in communicable diseases,31 as in non-communicable diseases.32,33 The main limitation is the number of documents that are 'cataloged' as CPG and they are not and this can increase the documents quantity to be selected and also, that the same documents have a 'Not recommended' assessment by the AGREE II instrument. The concordance in the evaluation of the documents evaluated, measured by the Kappa index, was between 0.9 and 1.0 (almost perfect correlation).34,35 But it is important to notice that the methodologists who conducted the evaluation and their mastery on the AGREE II instrument are a scarce resource for similar work, because the evaluation methodology, although it is widespread, is not necessarily of interest to health policymakers at national level and for that reason, the promotion of these competences for later works will depend on the professionals who dominate the assessment methodology.
The value of CPGs that have 'Recommendable' quality is difficult to implement by physicians and this makes it controversial.36,37 Thus, proposals to improve Applicability, which include both assistance measures (attention feedback, analysis of implementation barriers) and administrative measures (economic opinion in health, audits), acquire great importance.18
With the selection and evaluation of CPG carried out, it is possible to elaborate a hierarchical table with recommendations, from the GPC of 'Recommendable' quality; this would benefit the pediatric population and allow the optimization and rationalization of the use of resources in one of the main pathologies of pediatric, such as the AGE. The future analysis should focus on identifying the 'Recommended' CPGs and working with them on the Applicability, to improve their adherence and thus the offer of health services provided to the patient. Finally, we believe that the results of this study will be of great interest to health policymakers and health institutions.
The selected GPC have good methodological quality, but are not specific to probiotics. Despite, they should be spread for better decision making.
Nilton Yhuri Carreazo-Pariasca and Miguel Chipana-Osiro .
Biocodex who sponsored the open access editorial cost of this publication
The author declares no conflict of interest.
©2018 Saito, et al. This is an open access article distributed under the terms of the, which permits unrestricted use, distribution, and build upon your work non-commercially.