Analysis of heterogeneity in cardiology systematic reviews published be-tween 2000-2005 and 2011-2016

Main Article Content

Andrés David Aranzazu Ceballos
Juan Sebastián Marín Cárdenas
Daniel Gallego González
Jorge Hernando Donado Gómez

Abstract

Introduction: cardiology is one of the medical specialties with the most systematic reviews and meta-analyses. Studying the methodology of the reviews and analyzing their statistical heterogeneity is essential to guarantee their scientific validity.


Objective: to describe the comparison of association measures, statistical models and degree of heterogeneity in meta-analyses of systematic reviews of pharmacological interventions in cardiology, published between 2000-2005 and 2011-2016.


Methodology: analytical study based on the description and comparison of statistical methods of systematic reviews of pharmacological interventions in cardiology, published in the Cochrane library. For the qualitative variables, absolute and relative frequencies were estimated, while for the quantitative ones, means and standard deviations, or medians and interquartile ranges, were determined, depending on their distribution. The Student’s t test was used to establish the difference in means and the Chi square for the difference in proportions.


Results: 54 systematic reviews were included, with a total of 1.053 meta-analyses, 6 reviews with 240 meta-analyses between 2000-2005, and 48 reviews with 813 meta-analyses between 2011-2016. Most meta-analyses used standard treatment as the comparison group (56.6%), measured nominal qualitative outcomes (86.3%), determined relative risks (63.3%), and applied fixed-effect models (57.8%). In the 2011-2016 period, an average of the Higgins Index was found to be 17.5 lower than in the 2000-2005 (p<0.05).


Conclusion: there was evidence of a decrease in statistical heterogeneity and an increase in the implementation of random effects models, which accounts for greater rigor when it comes to demonstrating truly significant results.

Keywords:
systematic review, meta-analysis, epidemiology and biostatistics, methodology, cardiology, pharmaceutical preparations

Article Details

Author Biographies

Andrés David Aranzazu Ceballos, Pontifical Bolivarian University

School of Health Sciences, Faculty of Medicine, Systems Biology Research Group, Research Hotbed, Faculty of Medicine, Pontifical Bolivarian University. Medellin Colombia.

Juan Sebastián Marín Cárdenas, Pontifical Bolivarian University

School of Health Sciences, Faculty of Medicine, Systems Biology Research Group, Research Hotbed, Faculty of Medicine, Pontifical Bolivarian University. Medellin Colombia.

Daniel Gallego González, Pontifical Bolivarian University

School of Health Sciences, Faculty of Medicine, Systems Biology Research Group, Research Hotbed, Faculty of Medicine, Pontifical Bolivarian University. Medellin Colombia.

Jorge Hernando Donado Gómez, Hospital Pablo Tobon Uribe

Pablo Tobon Uribe Hospital. Medellin Colombia.

References

Clark L, Fairhurst C, Hewitt CE, Birks Y, Brabyn S, Cockayne S, et al. A methodological review of recent meta-analyses has found significant heterogeneity in age between randomized groups. J Clin Epidemiol. 2014; 67(9):1016-24.

Doi SA, Barendregt JJ, Khan S, Thalib L, Williams GM. Advances in the meta-analysis of heterogeneous clinical trials I: The inverse variance heterogeneity model. Contemp Clin Trials. 2015; 45(Pt A):130-8.

Giménez A. ¿Qué es un meta-análisis? y ¿cómo leerlo? Biomed. 2012; 7(1):16-27.

de Sousa MR, Ribeiro ALP. Revisión Sistemática y Metanálisis de Estudios de Diagnóstico y Pronóstico: una Guía. Arq Bras Cardiol. 2009; 92(3):235-45.

Higgins JPT, Green S. Análisis de los datos y realización de los metanálisis. En: Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. The Cochrane Collaboration; 2011. p. 256-300.

Rucker G, Schwarzer G, Carpente JR, Schimacher M. Undue reliance on I2 in assessing heterogeneity may mislead. BMC Medical Research Methodology 2008;8:79.

Alba AC, Alexander PE, Chang J, MacIsaac J, DeFry S, Guyatt GH. High statistical heterogeneity is more frequent in meta-analysis of continuous than binary outcomes. J Clin Epidemiol. 2016;70:129-35.

Rhodes KM, Turner RM, Higgins JP. Predictive distributions were developed for the extent of heterogeneity in meta-analyses of continuous outcome data. J Clin Epidemiol. 2015;68(1):52-60.

Fletcher J. What is heterogeneity and is it important? BMJ. 2007; 334(7584):94-96.

Huedo-Medina T, Sánchez-Meca J, Marín-Martínez F, Botella J. Assessing heterogeneity in meta-analysis: Q statistic or I² index? Psychological Methods. 2006;11(2):193-206.

Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta−analyses. BMJ. 2003;327:557-60.

Bonfilla X, Gabriel R, Cabello J. La medicina basada en la evidencia. Rev Esp Cardiol. 1997;50:819-25.

Sandoya E. Ensayos clínicos que cambiaron la práctica de la cardiología: fortalezas y debilidades. Rev Urug Cardiol. 2007;22(1):53-71.

Apéndice con las referencias de las revisiones sistemáticas incluidas

Cosmi B, Rubboli A, Castelvetri C, Milandri M. Ticlopidine versus oral anticoagulation for coronary stenting. Cochrane Database Syst Rev. 2001;(4):CD002133.

Magee KD, Sevcik W, Moher D, Rowe BH. Low molecular weight heparins versus unfractionated heparin for acute coronary syndromes. Cochrane Database Syst Rev. 2003;(1):CD002132.

Amsallem E, Kasparian C, Haddour G, Boissel JP, Nony P. Phosphodiesterase III inhibitors for heart failure. Cochrane Database Syst Rev. 2005;(1):CD002230.

Hooper L, Thompson RL, Harrison RA, Summerbell CD, Moore H, Worthington HV, et al. Omega 3 fatty acids for prevention and treatment of cardiovascular disease. Cochrane Database Syst Rev. 2004;(4):CD003177.

Salvador DR, Rey NR, Ramos GC, Punzalan FE. Continuous infusion versus bolus injection of loop diuretics in congestive heart failure. Cochrane Database Syst Rev. 2005;(3):CD003178.

Ciapponi A, Pizarro R, Harrison J. Trimetazidine for stable angina. Cochrane Database Syst Rev. 2005;(4):CD003614.

Squizzato A, Keller T, Romualdi E, Middeldorp S. Clopidogrel plus aspirin versus aspirin alone for preventing cardiovascular disease. Cochrane Database

Syst Rev. 2011;(1):CD005158.

Brito V, Ciapponi A, Kwong J. Factor Xa inhibitors for acute coronary syndromes. Cochrane Database Syst Rev. 2011;(1):CD007038.

Dieleman JM, van Paassen J, van Dijk D, Arbous MS, Kalkman CJ, Vandenbroucke JP, et al. Prophylactic corticosteroids for cardiopulmonary bypass in adults. Cochrane Database Syst Rev. 2011;(5):CD005566.

Romme JJ, Reitsma JB, Black CN, Colman N, Scholten RJ, Wieling W, et al. Drugs and pacemakers for vasovagal, carotid sinus and situational syncope. Cochrane Database Syst Rev. 2011;(10):CD004194.

Heran BS, Musini VM, Bassett K, Taylor RS, Wright JM. Angiotensin receptor blockers for heart failure. Cochrane Database Syst Rev. 2012;(4):CD003040.

Mahtani KR, Heneghan CJ, Nunan D, Bankhead C, Keeling D, Ward AM, et al. Optimal loading dose of warfarin for the initiation of oral anticoagulation. Cochrane Database Syst Rev. 2012;12:CD008685.

Taylor F, Huffman MD, Macedo AF, Moore TH, Burke M, Davey Smith G, et al. Statins for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2013;(1):CD004816.

Rees K, Hartley L, Day C, Flowers N, Clarke A, Stranges S. Selenium supplementation for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2013;(1):CD009671.

Zheng GH, Liu JP, Chu JF, Mei L, Chen HY. Xiongshao for restenosis after percutaneous coronary intervention in patients with coronary heart disease. Cochrane Database Syst Rev. 2013;(5):CD009581.

Moazzami K, Roohi A, Moazzami B. Granulocyte colony stimulating factor therapy for acute myocardial infarction. Cochrane Database Syst Rev. 2013;(5):CD008844.

Massel DR, Little SH. Antiplatelet and anticoagulation for patients with prosthetic heart valves. Cochrane Database Syst Rev. 2013;(7):CD003464.

Wakai A, McCabe A, Kidney R, Brooks SC, Seupaul RA, Diercks DB, et al. Nitrates for acute heart failure syndromes. Cochrane Database Syst Rev. 2013;(8):CD005151.

Cabello JB, Burls A, Emparanza JI, Bayliss SE, Quinn T. Oxygen therapy for acute myocardial infarction. Cochrane Database Syst Rev. 2016;12:CD007160.

Chen HS, Wang W, Wu SN, Liu JP. Corticosteroids for viral myocarditis. Cochrane Database Syst Rev. 2013;(10):CD004471.

Bosch X, Marrugat J, Sanchis J. Platelet glycoprotein IIb/IIIa blockers during percutaneous coronary intervention and as the initial medical treatment of non-ST segment elevation acute coronary syndromes. Cochrane Database Syst Rev. 2013;(11):CD002130.

Penninga L, Møller CH, Gustafsson F, Gluud C, Steinbrüchel DA. Immunosuppressive T-cell antibody induction for heart transplant recipients. Cochrane Database Syst Rev. 2013;(12):CD008842.

Unverzagt S, Wachsmuth L, Hirsch K, Thiele H, Buerke M, Haerting J, et al. Inotropic agents and vasodilator strategies for acute myocardial infarction complicated by cardiogenic shock or low cardiac output syndrome. Cochrane Database Syst Rev. 2014;(1):CD009669.

Lip GY, Shantsila E. Anticoagulation versus placebo for heart failure in sinus rhythm. Cochrane Database Syst Rev. 2014;(3):CD003336.

de Cates AN, Farr MR, Wright N, Jarvis MC, Rees K, Ebrahim S, et al. Fixed-dose combination therapy for the prevention of cardiovascular disease. Cochrane Database Syst Rev. 2014;(4):CD009868.

Hood WB Jr, Dans AL, Guyatt GH, Jaeschke R, McMurray JJ. Digitalis for treatment of heart failure in patients in sinus rhythm. Cochrane Database Syst Rev. 2014;(4):CD002901.

Mahtani KR, Heneghan CJ, Nunan D, Roberts NW. Vitamin K for improved anticoagulation control in patients receiving warfarin. Cochrane Database Syst Rev. 2014;(5):CD009917.

Villar JC, Pérez JG, Cortés OL, Riarte A, Pepper M, Marin-Neto JA, et al. Trypanocidal drugs for chronic asymptomatic Trypanosoma cruzi infection. Cochrane Database Syst Rev. 2014;(5):CD003463.

Madmani ME, Yusuf Solaiman A, Tamr Agha K, Madmani Y, Shahrour Y, Essali A, et al. Coenzyme Q10 for heart failure. Cochrane Database Syst Rev. 2014;(6):CD008684.

Andrade-Castellanos CA, Colunga-Lozano LE, Delgado-Figueroa N, Magee K. Heparin versus placebo for non-ST elevation acute coronary syndromes. Cochrane Database Syst Rev. 2014;(6):CD003462.

Alabed S, Cabello JB, Irving GJ, Qintar M, Burls A. Colchicine for pericarditis. Cochrane Database Syst Rev. 2014;(8):CD010652.

Vale N, Nordmann AJ, Schwartz GG, de Lemos J, Colivicchi F, den Hartog F, et al. Statins for acute coronary syndrome. Cochrane Database Syst Rev. 2014;(9):CD006870.

McCaul M, Lourens A, Kredo T. Pre-hospital versus in-hospital thrombolysis for ST-elevation myocardial infarction. Cochrane Database Syst Rev. 2014;(9):CD010191.

Flowers N, Hartley L, Todkill D, Stranges S, Rees K. Co-enzyme Q10 supplementation for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2014;(12):CD010405.

Boardman HM, Hartley L, Eisinga A, Main C, Roqué i Figuls M, Bonfill Cosp X, et al. Hormone therapy for preventing cardiovascular disease in post-menopausal women. Cochrane Database Syst Rev. 2015;(3):CD002229.

Burkhardt BE, Rücker G, Stiller B. Prophylactic milrinone for the prevention of low cardiac output syndrome and mortality in children undergoing surgery for congenital heart disease. Cochrane Database Syst Rev. 2015;(3):CD009515.

Lafuente-Lafuente C, Valembois L, Bergmann JF, Belmin J. Antiarrhythmics for maintaining sinus rhythm after cardioversion of atrial fibrillation. Cochrane Database Syst Rev. 2015;(3):CD005049.

Su Q, Nyi TS, Li L. Adenosine and verapamil for no-reflow during primary percutaneous coronary intervention in people with acute myocardial infarction. Cochrane Database Syst Rev. 2015;(5):CD009503.

Robinson J, Hartling L, Vandermeer B, Klassen TP. Intravenous immunoglobulin for presumed viral myocarditis in children and adults. Cochrane Database Syst Rev. 2015;(5):CD004370.

Cilliers A, Adler AJ, Saloojee H. Anti-inflammatory treatment for carditis in acute rheumatic fever. Cochrane Database Syst Rev. 2015;(5):CD003176.

Hartley L, Lee MS, Kwong JS, Flowers N, Todkill D, Ernst E, et al. Qigong for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2015;(6):CD010390.

Bennett MH, Lehm JP, Jepson N. Hyperbaric oxygen therapy for acute coronary syndrome. Cochrane Database Syst Rev. 2015;(7):CD004818.

Martí-Carvajal AJ, Simancas-Racines D, Anand V, Bangdiwala S. Prophylactic lidocaine for myocardial infarction. Cochrane Database Syst Rev. 2015;(8):CD008553.

Hartley L, Clar C, Ghannam O, Flowers N, Stranges S, Rees K. Vitamin K for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2015;(9):CD011148.

Wang D, Liu B, Tao W, Hao Z, Liu M. Fibrates for secondary prevention of cardiovascular disease and stroke. Cochrane Database Syst Rev. 2015;(10):CD009580.

Al-Khudairy L, Hartley L, Clar C, Flowers N, Hooper L, Rees K. Omega 6 fatty acids for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2015;(11):CD011094.

Hurley KF, Magee K, Green R. Aminophylline for bradyasystolic cardiac arrest in adults. Cochrane Database Syst Rev. 2013;(8):CD006781.

Claro JC, Candia R, Rada G, Baraona F, Larrondo F, Letelier LM. Amiodarone versus other pharmacological interventions for prevention of sudden cardiac death. Cochrane Database Syst Rev. 2015;(12):CD008093.

Hemkens LG, Ewald H, Gloy VL, Arpagaus A, Olu KK, Nidorf M, et al. Colchicine for prevention of cardiovascular events. Cochrane Database Syst Rev. 2016;(1):CD011047.

Alabed S, Sabouni A, Al Dakhoul S, Bdaiwi Y, Frobel-Mercier AK. Beta-blockers for congestive heart failure in children. Cochrane Database Syst Rev. 2016;(1):CD007037.

Martí-Carvajal AJ, Dayer M, Conterno LO, González Garay AG, Martí-Amarista CE, Simancas- Racines D. A comparison of different antibiotic regimens for the treatment of infective endocarditis. Cochrane Database Syst Rev. 2016;4:CD009880.

Martí-Carvajal AJ, Kwong JS. Pharmacological interventions for treating heart failure in patients with Chagas cardiomyopathy. Cochrane Database Syst Rev. 2016;7:CD009077.

Thiago L, Tsuji SR, Nyong J, Puga ME, Gois AF, Macedo CR, et al. Statins for aortic valve stenosis. Cochrane Database Syst Rev. 2016;9:CD009571.

Shantsila E, Lip GY. Antiplatelet versus anticoagulation treatment for patients with heart failure in sinus rhythm. Cochrane Database Syst Rev. 2016;9:CD003333.

Jakob T, Nordmann AJ, Schandelmaier S, Ferreira-González I, Briel M. Fibrates for primary prevention of cardiovascular disease events. Cochrane Database Syst Rev. 2016;11:CD009753.

Izquierdo-Palomares JM, Fernández-Tabera JM, Plana MN, Añino Alba A, Gómez Álvarez P, Fernández-Esteban I, et al. Chronotherapy versus conventional statins therapy for the treatment of hyperlipidaemia. Cochrane Database Syst Rev. 2016;11:CD009462.

Most read articles by the same author(s)

<< < 1 2