Performance of model-based network meta-analysis (MBNMA) of time-course relationships: A simulation study.

Item request has been placed! ×
Item request cannot be made. ×
loading   Processing Request
  • Additional Information
    • Source:
      Publisher: Wiley Blackwell Country of Publication: England NLM ID: 101543738 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1759-2887 (Electronic) Linking ISSN: 17592879 NLM ISO Abbreviation: Res Synth Methods Subsets: MEDLINE
    • Publication Information:
      Publication: : Chichester : Wiley Blackwell
      Original Publication: Malden, MA : John Wiley & Sons, 2010-
    • Subject Terms:
    • Abstract:
      Time-course model-based network meta-analysis (MBNMA) has been proposed as a framework to combine treatment comparisons from a network of randomized controlled trials reporting outcomes at multiple time-points. This can explain heterogeneity/inconsistency that arises by pooling studies with different follow-up times and allow inclusion of studies from earlier in drug development. The aim of this study is to explore using simulation: (a) how MBNMA model parameters are affected by the quantity/location of observed time-points across studies/comparisons, (b) how reliably an appropriate MBNMA model can be identified, (c) the robustness of model estimates and predictions under different dataset characteristics. Our results indicate that model parameters for a given treatment comparison are estimated with low mean bias even when no direct evidence was available, provided there was sufficient indirect evidence to estimate the time-course. A staged model selection strategy that selects time-course function, then heterogeneity, then covariance structure, identified the true model most reliably and efficiently. Predictions and parameter estimates from selected models had low mean bias even in the presence of high heterogeneity/correlation between time-points. However, failure to properly account for heterogeneity/correlation could lead to high error in precision of the estimates. Time-course MBNMA provides a statistically robust framework for synthesizing direct and indirect evidence to estimate relative effects and predicted mean responses whilst accounting for time-course and incorporating correlation and heterogeneity. This supports the use of MBNMA in evidence synthesis, particularly when additional studies are available with follow-up times that would otherwise prohibit their inclusion by conventional meta-analysis.
      (© 2020 The Authors. Research Synthesis Methods published by John Wiley & Sons Ltd.)
    • References:
      Dias S, Ades AE, Welton NJ, Jansen JP, Sutton AJ. Network Meta-Analysis for Decision Making. Hoboken: Wiley; 2018.
      Lu G, Ades AE. Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004;23(20):3105-3124.
      Dias S, Welton NJ, Sutton AJ, Caldwell DM, Lu G, Ades AE. Evidence synthesis for decision making 4: inconsistency in networks of evidence based on randomized controlled trials. Med Decis Making. 2013;33(5):641-656.
      Dias S, Welton NJ, Caldwell DM, Ades AE. Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010;29(7-8):932-944.
      Riley RD, Abrams KR, Lambert PC, Sutton AJ, Thompson JR. An evaluation of bivariate random-effects meta-analysis for the joint synthesis of two correlated outcomes. Stat Med. 2007;26(1):78-97.
      Ishak KJ, Platt RW, Joseph L, Hanley JA, Caro JJ. Meta-analysis of longitudinal studies. Clin Trials. 2007;4(5):525-539.
      Dakin HA, Welton NJ, Ades AE, Collins S, Orme M, Kelly S. Mixed treatment comparison of repeated measurements of a continuous endpoint: an example using topical treatments for primary open-angle glaucoma and ocular hypertension. Stat Med. 2011;30(20):2511-2535.
      Jansen JP, Vieira MC, Cope S. Network meta-analysis of longitudinal data using fractional polynomials. Stat Med. 2015;34(15):2294-2311.
      Ding Y, Fu H. Bayesian indirect and mixed treatment comparisons across longitudinal time points. Stat Med. 2013;32(15):2613-2628.
      Pedder H, Dias S, Bennetts M, Boucher M, Welton NJ. Modelling time-course relationships with multiple treatments: model-based network meta-analysis for continuous summary outcomes. Res Synth Methods. 2019;10(2):267-286.
      Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15(12):1833-1840.
      Dias S, Sutton AJ, Ades AE, Welton NJ. Evidence synthesis for decision making 2: a generalized linear modeling framework for pairwise and network meta-analysis of randomized controlled trials. Med Decis Making. 2013;33(5):607-617.
      Morris TP, White IR, Crowther MJ. Using simulation studies to evaluate statistical methods. arXiv:171203198v1. 2017.
      Dias S, Welton NJ, Sutton AJ, Ades AE. Evidence synthesis for decision making 5: the baseline natural history model. Med Decis Making. 2013;33(5):657-670.
      Spiegelhalter DJ, Best NG, Carlin BP, van der Linde A. Bayesian measures of model complexity and fit. J R Statistic Soc B. 2002;64(4):583-639.
      Gelman A, Carlin JB, Stern HS, Rubin DB. Bayesian Data Analysis. 2nd ed. Abingdon, Oxforshire: Taylor & Francis Inc; 2003.
      R: A language and environment for statistical computing [computer program]. Vienna, Austria, 2018.
      Matsumoto M, Nishimura T. Mersenne twister: a 623-dimensionally equidistributed uniform psuedorandom number generator. ACM Trans Model Comput Simul. 1998;8(1):3-30.
      JAGS [computer program]. Version 4.3.0, 2017.
      MBNMAtime [computer program]. Version 0.1.0. figshare, 2019.
      Betancourt MJ, Girolami M. Hamiltonian Monte Carlo for Hierarchical Models. arXiv 13120906. 2013.
      Brooks SP, Gelman A. General methods for monitoring convergence of iterative simulations. J Comput Graph Stat. 1998;7(4):434-455.
      Dias S, Sutton AJ, Welton NJ, Ades AE. Evidence synthesis for decision making 3: heterogeneity-subgroups, meta-regression, bias, and bias-adjustment. Med Decis Making. 2013;33(5):618-640.
      Dutta S, Matsumoto Y, Ebling WF. Is it possible to estimate the parameters of the sigmoid Emax model with truncated data typical of clinical studies? J Pharm Sci. 1996;85(2):232-239.
      Aarons L, Ogungbenro K. Optimal design of pharmacokinetic studies. Basic Clin Pharmacol Toxicol. 2010;106(3):250-255.
      Riley RD. Multivariate meta-analysis: the effect of ignoring within-study correlation. J R Statistic Soc A. 2009;172:789-811.
      Ahn JE, French JL. Longitudinal aggregate data model-based meta-analysis with NONMEM: approaches to handling within treatment arm correlation. J Pharmacokinet Pharmacodyn. 2010;37(2):179-201.
      Chan JSK, Choy STB. Analysis of covariance structures in time series. J Data Sci. 2007;6:573-589.
      Huedo-Medina TB, Sanchez-Meca J, Marin-Martinez F, Botella J. Assessing heterogeneity in meta-analysis: Q statistic or I2 index? Psychol Methods. 2006;11:193-206.
      Lambert PC, Sutton AJ, Burton PR, Abrams KR, Jones DR. How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS. Stat Med. 2005;24(15):2401-2428.
      MBNMAtime: Run Time-Course MBNMA Models. R package version 0.1.3. [computer program]. CRAN; 2020.
      Mavridis D, Chaimani A, Efthimiou O, Leucht S, Salanti G. Addressing missing outcome data in meta-analysis. Evid Based Ment Health. 2014;17(3):85-89.
      Mavridis D, White IR, Higgins JP, Cipriani A, Salanti G. Allowing for uncertainty due to missing continuous outcome data in pairwise and network meta-analysis. Stat Med. 2015;34(5):721-741.
      Caldwell DM, Dias S, Welton NJ. Extending treatment networks in health technology assessment: how far should we go? Value Health. 2015;18(5):673-681.
      Salanti G, Kavvoura F, Ioannidis JP. Exploring the geometry of treatment networks. Ann Intern Med. 2008;148:544-553.
      Konig J, Krahn U, Binder H. Visualizing the flow of evidence in network meta-analysis and characterizing mixed treatment comparisons. Stat Med. 2013;32(30):5414-5429.
      Rucker G. Network meta-analysis, electrical networks and graph theory. Res Synth Methods. 2012;3:312-324.
      Salanti G, Higgins JP, Ades A, Ioannidis JP. Evaluation of networks of randomized trials. Stat Methods Med Res. 2008;17:279-301.
      Lu G, Ades AE. Assessing evidence inconsistency in mixed treatment comparisons. J Am Statist Assoc. 2006;101:447-459.
    • Grant Information:
      Pfizer UK; MR/M005232/1 United Kingdom MRC_ Medical Research Council; NIHR Biomedical Research Centre at University Hospitals Bristol NHS Foundation Trust; University of Bristol; MR/M005615/1 United Kingdom MRC_ Medical Research Council; MR/R025223/1 United Kingdom MRC_ Medical Research Council
    • Contributed Indexing:
      Keywords: MB; NMA; longitudinal; meta-analysis; simulation; time
    • Publication Date:
      Date Created: 20200715 Date Completed: 20210802 Latest Revision: 20210802
    • Publication Date:
      20221216
    • Accession Number:
      10.1002/jrsm.1432
    • Accession Number:
      32662206