The use of continuous data versus binary data in MTC models: A case study in rheumatoid arthritis
- Susanne Schmitz^{1}Email author,
- Roisin Adams^{2} and
- Cathal Walsh^{1, 2}
DOI: 10.1186/1471-2288-12-167
© Schmitz et al.; licensee BioMed Central Ltd. 2012
Received: 23 May 2012
Accepted: 30 October 2012
Published: 6 November 2012
Abstract
Background
Estimates of relative efficacy between alternative treatments are crucial for decision making in health care. When sufficient head to head evidence is not available Bayesian mixed treatment comparison models provide a powerful methodology to obtain such estimates. While models can be fit to a broad range of efficacy measures, this paper illustrates the advantages of using continuous outcome measures compared to binary outcome measures.
Methods
Using a case study in rheumatoid arthritis a Bayesian mixed treatment comparison model is fit to estimate the relative efficacy of five anti-TNF agents currently licensed in Europe. The model is fit for the continuous HAQ improvement outcome measure and a binary version thereof as well as for the binary ACR response measure and the underlying continuous effect. Results are compared regarding their power to detect differences between treatments.
Results
Sixteen randomized controlled trials were included for the analysis. For both analyses, based on the HAQ improvement as well as based on the ACR response, differences between treatments detected by the binary outcome measures are subsets of the differences detected by the underlying continuous effects.
Conclusions
The information lost when transforming continuous data into a binary response measure translates into a loss of power to detect differences between treatments in mixed treatment comparison models. Binary outcome measures are therefore less sensitive to change than continuous measures. Furthermore the choice of cut-off point to construct the binary measure also impacts the relative efficacy estimates.
Keywords
Bayesian mixed treatment comparison models Rheumatoid arthritis Anti-TNF agentsBackground
Meta-analysis has developed to be a widely used tool to combine trials evaluating the same intervention. This allows more powerful conclusions when a single study group is too small, and it fits naturally in the Bayesian framework where the inclusion of all available evidence into an analysis is anticipated [1]. A natural extension of a meta-analysis is a mixed treatment comparison (MTC) where more than two treatments are compared in a network of evidence. While direct evidence is preferable it is often not available due to ethical or financial reasons and MTC models provide a powerful tool to estimate relative efficacy among treatments which are not directly compared in a trial. A Bayesian approach to indirect comparison allows the inclusion of a wide range of evidence and is flexible to deal with increasingly complex evidence structures [2].
The variance of an indirect comparison is typically larger than the variance of a comparable direct comparison; the variance increases with every indirect link in the chain. It is therefore crucial to make the greatest use of available data.
Using a case study in rheumatoid arthritis this paper presents a MTC model on a range of efficacy measures illustrating the increased power of continuous outcome measures in such models compared to using binary measures. For the presentation of the analysis we follow the checklist suggested by Spiegelhalter et al. [3].
Dichotomized outcome measures
Dichotomized outcome measures are widespread in medical research. The perceived advantage of simplicity in the interpretation comes at a cost, however [4]. The loss of information results in a loss of power to detect relationships, furthermore the type I error rate may be inflated [5] and there is a risk of underestimating the variance parameter. These issues have been discussed in the literature relating to a number statistical analyses [6–9].
In this work we demonstrate the consequences of dichotomized outcome measures in the context of MTC modelling. It has been pointed out that dichotomization can be used when designing trials to quantify a treatment effect [10, 11]. This is the primary aim of many clinical trials aiming for license approval. The anticipated efficacy level is taken as a cut-off point and results allow a straightforward interpretation. Pharmacoeconomic assessments of healthcare interventions are now a formal component of decision making in many countries [12]. Evidence syntheses typically rely on published clinical trials to estimate the relative efficacy among alternative agents to inform decision making. This has created an additional use of clinical trials demonstrating treatment efficacy, for which dichotomized measures suffer from disadvantages compared to the underlying continuous effect measure. The loss of power due to dichotomization adds to the increased variance in indirect comparisons. This is especially problematic for MTCs (vs. pairwise meta-analysis), since they typically have large standard errors due to the indirect nature of the comparison.
The intervention
Rheumatoid arthritis (RA) is a chronic, progressive and disabling auto-immune disease, causing swelling and damaging cartilage and bone around the joints. Any joint may be affected but it is commonly the hands, feet and wrists. Common symptoms are joint swelling, pain, morning joint stiffness, poor sleep, fatigue and weight loss [13].
Over the past decade, enhanced understanding of the molecular pathogenesis has led to the development of biologic agents that target specific parts of the immune system. These innovative treatments have altered the path and face of RA and outcomes for patients and society. Tumour necrosis factor alpha antagonists (anti-TNF-α) are the first of the biologic treatment groups used in RA. There are currently five anti-TNF agents licensed for RA in Europe; adalimumab, certolizumab, etanercept, golimumab and infliximab. All of these agents have demonstrated considerable efficacy in placebo controlled randomized controlled trials (RCTs) in patients who have had an inadequate response to conventional Disease Modifying Anti-Rheumatic Drugs (DMARDs) such as methotrexate (MTX) or sulphasalazine.
While there is a wealth of RCT evidence available for these agents compared to either placebo or conventional DMARDs, there are currently very limited head-to-head RCTs of anti-TNF agents. Despite this, some estimate of relative efficacy in order to inform choice of agent is needed. In the absence of head-to-head trials of relevant comparators, it is necessary to combine evidence from placebo controlled trials of different treatments and thereby derive an estimate of effect of one treatment against another. This can be broadly termed as mixed treatment comparison (MTC), an extension of meta-analysis. Different methodologies have been described for MTC; one such method uses Bayesian hierarchical models. Such models provide more flexibility than classical methods to include more data and handle more complex modelling structures [14].
Aim of the analysis
The aim of this analysis is to demonstrate the advantage of using continuous measures in MTC models compared to using binary measures. In the present analysis a MTC model is fitted to estimate all pair-wise comparisons among the five TNF-αinhibitors and placebo for a range of outcome measures.
Nixon et al. [15] have developed a MTC model to fit the binomial American College of Rheumatology (ACR) outcome measure; it is possible to include trials with multiple treatment arms and to adjust for study level covariates. Jansen et al. [16] have presented a MTC model on the outcome of the Health Assessment Questionnaire (HAQ), which is measured on a continuous scale. However, they did not allow for multiple treatment arms or the inclusion of baseline characteristics. The present analysis extends Jansen’s methods to allow for these.
While binary measures are useful for demonstrating a certain level of efficacy in clinical trials, we will show that the loss of information when changing from the underlying continuous scale to the binary outcome measure results in a loss of power to detect differences between treatments in MTC analyses.
Fitting models for a continuous improvement measure and a discretised version thereof as well as for binary outcome measures and a continuous version of these illustrates the enhanced power to detect differences of continuous measures compared to binary measures.
The chosen outcome measures are based on the ACR criteria and the HAQ score. Details are described in the next section.
Efficacy Measures
Measuring improvement in RA: ACR (American College of Rheumatology); HAQ (Health Assessment Questionnaire); DAS28 (Disease Activity Score)
ACR | HAQ | DAS28 | |
---|---|---|---|
continuous | meanACR | HAQ %-improvement | DAS28 |
ACRhybrid | |||
binary | ACR 20 | HAQ 20^{∗} | |
ACR 50 | HAQ 50^{∗} | ||
ACR 70 |
The ACR response criteria is a binary combination measure including the number of tender and swollen joints, patient’s global assessment, physician’s global assessment, pain, degree of disability and level of acute-phase reactant. In order to achieve an ACR 20, ACR 50 or ACR 70 result, an improvement of 20%, 50% or 70% respectively is required in the swollen and tender joint counts as well as in 3 of the 5 remaining dimensions [18, 19].
Continuous measures based on the ACR criteria have been introduced including the meanACR and the ACR hybrid measure [20]. The meanACR measures the mean % improvement in the seven ACR core set measures. The ACR hybrid measure combines the ACR 20, ACR 50 and ACR 70 with the ACRmean. A patient’s ACR hybrid outcome is the same as the ACRmean, but restricted by his binary ACR response. For example, the outcome for a patient who is an ACR 20 responder, but not an ACR 50 responder is restricted to the interval [0.2, 0.5).
The HAQ score represents the result of a self-report questionnaire in which patients rate their ability to perform daily life activities such as washing one’s hair or getting in and out of a car. Values range from 0 to 3 in steps of 0.125, where high values indicate a more severe disease status. The improvement in HAQ score is measured on a continuous scale.
For the purpose of demonstrating the enhanced power of continuous measures in MTC models we have defined a discretised version of the HAQ score: HAQ 20 and HAQ 50. They are defined analogously to ACR 20 and ACR 50. A patient achieves a HAQ 20 outcome, if his HAQ score has improved by at least 20%; a 50% improvement is required for HAQ 50.
Methods
Data
A systematic literature review following the PRISMA method [22] was performed to identify trials meeting our inclusion criteria. The search included published studies up to and including October 2010 in PubMed, Embase and the Cochrane Database. Rheumatological inflammatory diseases other than RA, such as ankylosing spondylitis, psoriatic arthritis and connective tissue diseases were excluded from the search. The inclusion criteria were randomised controlled trials (RCTs), patients with established RA who have had an inadequate response to methotrexate (MTX) and who have been treated for at least 24 weeks (where 24 week data were not available, data within 6 weeks either before or after 24 weeks were used). Both monotherapy and combination therapy were included with an explicit term in the statistical model allowing for the additional effect of MTX. More details on the selection process can be found elsewhere [23].
The outcome measures chosen were those described in the previous section based on the ACR criteria, the HAQ score and the DAS28. Unfortunately the DAS28 was reported in too few trials to fit a MTC model (DAS28 was only reported in 6 trials, not representing each of the treatments). The total number of responders achieving ACR 20, ACR 50 and ACR 70 response and the mean improvement and standard deviations (SDs) for the continuous HAQ measure were extracted. Authors were contacted in cases where the required data were not reported. Where no access to the missing data was provided, the following methodology was applied: in cases where the mean was not reported, the median was used; in the absence of SDs, interquartile ranges (IQRs) were used to estimate SDs using a normal approximation, and, in the remaining cases, the maximum of clinical trial SDs was used. The doses of biological agents included are those included in the RCTs. Demographic data including age, gender, mean disease duration, baseline HAQ score and number of previous DMARDs were recorded.
Statistical Model
In a simple meta-analysis evidence from a range of trials comparing the same two interventions A and B is combined yielding an overall A vs. B estimate (see evidence network in Figure 1(a)). The underlying methodology is well explored and used extensively in practice. The simplest case of a MTC occurs when this situation is extended to include a third intervention, drug C, which has also been compared to drug A in clinical trials (see Figure 1(b)). MTC modelling assumes that the combined evidence from A vs. B and A vs. C trials contains some information about the relative efficacy of B vs. C; in particular B vs. C is assumed to be the difference between A vs. B and A vs. C (see Figure 1(c)). MTC models can be fitted for all underlying evidence structures as long as the network diagram is connected. Combining evidence this way evokes the assumption of treatment exchangeability, a similarity assumption among the trials. The effect of B in the A vs. B trials is assumed to occur if C was replaced by B in the A vs. C trials. Unfortunately this assumption can only be tested in networks of closed loop design, where consistency measures can be obtained; methods are described elsewhere [24]. When this is not the case, great care has to be taken in selecting the trials for the analysis.
All models can be fitted in a Bayesian or in a classical framework. The Bayesian approach to MTC modelling is the most flexible, allowing the inclusion of a wide range of data and borrowing strength across the network ensures the optimal use of the data. Details on classical methods can be found elsewhere [25, 26]. This analysis focuses on the Bayesian approach only.
In the remainder of this section the mathematical models for binary and continuous outcome measures are described beginning with simple meta-analytic models which are then extended to MTC models including baseline characteristics and other assumptions necessary for the RA model.
Simple Meta Analysis
Δ_{ i } is the observed relative treatment effect in study i; σ_{ i }the associated sampling error; i=1,…N, where N is the number of trials included in the analysis. The model assumes random effects, meaning the study specific true effects δ_{ i }are drawn from a normal distribution with mean d and between trial variance parameter ${\sigma}_{\delta}^{2}$. Prior distributions need to be specified for the basic parameter d and the between trial standard deviation σ_{ δ }. The choice of prior distribution is discussed in section “Prior distributions”, in this section we simply indicate which parameters require a prior distribution.
A binomial likelihood is assumed for the number of patients and number of responders in control arm and treatment arm of each study; n. c_{ i }, n. t_{ i }, r. c_{ i }, r. t_{ i }respectively. The model calculates log odds ratios (LORs) for each study, δ_{ i }, for which random effects are assumed yielding an overall log odds ratio estimate d and a between trial standard deviation σ_{ δ }. Prior distributions need to be assigned to d, the logits in the control group μ_{ i } and σ_{ δ }.
Extension to MTC
As before Δ_{ i }refers to the observed relative treatment effects of the comparison in study i with respective measure of variability σ_{ i }. k and l indicate the anti-TNF agent evaluated in the trials; 1 indicates adalimumab, 2 infliximab, 3 etanercept, 4 golimumab and 5 certolizumab. The baseline treatment is placebo, indicated by P. Assuming random effects, the study specific true effects are drawn from a normal distribution with a mean specific to the comparison; i.e. the effects of all trials comparing the same two interventions are drawn from the same normal distribution. The between trial variance parameter is assumed to be the same for all comparisons. Each comparison of drug k versus drug l, I C_{k,l}, can be written in terms of basic parameters d_{k,P}. Prior distributions are required for basic parameters and between trial standard deviation σ_{ δ }.
Again n. c_{ i }, n. t_{ i }, r. c_{ i } and r. t_{ i } refer to the number of patients and number of responders in the control and treatment arm of each study. The model calculates LORs δ_{i,k,P}for each study, which are combined assuming random effects with a common mean for each baseline comparison d_{k,P}. The between trial SD is assumed to be the same for all drugs. All other comparisons I C_{k,l}can be estimated from the baseline parameters. Prior distributions need to be defined for d_{k,P}, μ_{ i } and σ_{ δ }.
Further extensions
For the use of the model for RA data three more adjustments have to be made. We want to allow for more than one treatment arm per study; adjustments have to be made for the concurrent treatment with MTX. Furthermore, we would like to model the improvement relative to baseline disease activity, since disease activity at baseline influences the effectiveness of the intervention [27]. Also, the results of this analysis provide the basis for an economic analysis, which requires the percentage improvement in HAQ score as input parameters.
A step by step approach is taken to include these assumptions into the model described in (4) for the continuous case and (5) for the binomial case.
For each treatment arm the observed effect relative to the comparator arm is calculated as Δ_{ j }, which as before has a normal distribution with measure of variability σ_{ j }. The model makes the assumptions that effects in treatment arms of the same study are constant, we therefore assume fixed effects for within study effects. This assumption is described in line 3 of equation (6). Between trials we assume random effects, as before and each comparison I C_{k,l} can be written in terms of basic parameters d_{k,P}. Prior distribution need to be defined for basic parameters and between trial standard deviation σ_{ δ }.
Changes from equation (5) to (7) are analogous to changes in the continuous case. A LOR δ_{j,k,P} is obtained for each treatment arm; treatment arms of the same study are assumed to estimate the same treatment effect, hence line 4 in equation (7). Everything else remains the same.
γ refers to the regression parameter for the baseline HAQ score.
Models described in equations 10 and 11 enable the estimation of relative efficacy of a number of treatments while allowing for multiple treatment arms, concurrent treatment with additional medication and dependence of treatment effect on baseline disease activity for both continuous and binary outcome measures. In the continuous case differences in efficacy are estimated; odds ratios are estimated in the binary case. Using methods by Warn et al. [28] the model can be modified to calculate other measures, such as risk ratios.
Prior distributions
The same prior can be used for both continuous and binary models, since the risk difference and the log odds ratios take values on the real line where 0 represents no difference. The priors do not favour any of the drugs and allows for a wide range of likely values in favour for each. This is a widely used vague prior on treatment effects.
To test whether the range of the uniform prior was chosen appropriately the analysis has been rerun using wider ranges (dunif(0,5) and dunif(0,7)) and estimates did not change.
Computation/ Software
The MTC models were fitted in WinBUGs, a MCMC software using Gibbs sampling [30]. The DAG in Figure 3 is drawn in WinBUGs. Square shaped nodes represent constants; oval shaped nodes are either random or logical. A random dependency between two nodes can be found where a single arrow connects both nodes, a double arrow shows that there is a logical relationship. Loops are represented by boxes. The complete code and input data is provided in Additional file 1. Computational feasability allowed for a large number of iterations. Each model discarded 50,000 burnin iterations and was run with 100,000 iterations and two chains. Convergence was analysed using CODA; the effective sample size was checked, and visual inspection of the autocorrelation and the chains confirmed convergence.
Results and discussion
Data
Trial Data: Number of patients N; improvement in HAQ score Δ HAQ; number of ACR20, ACR50, ACR70 responders; HAQ score at baseline HAQ _{ base } ; + indicates additional treatment with MTX
Trial | Arm | N | ΔHAQ(SD) | ACR20 | ACR50 | ACR70 | HA Q _{ base } |
---|---|---|---|---|---|---|---|
Weinblatt et al. [31] | P+ | 62 | 0.27 (0.6) | 9 | 5 | 3 | 1.64 |
Ada+ | 69 | 0.54 (0.6) | 33 | 22 | 7 | 1.52 | |
Ada+ | 67 | 0.62 (0.6) | 45 | 37 | 18 | 1.55 | |
Ada+ | 73 | 0.59 (0.5) | 48 | 31 | 14 | 1.55 | |
Keystone et al. [32] | P+ | 200 | 0.24 (0.5) | 59 | 19 | 5 | 1.45 |
Ada+ | 207 | 0.56 (0.5) | 131 | 81 | 43 | 1.44 | |
Ada+ | 212 | 0.60 (0.5) | 129 | 87 | 37 | 1.48 | |
Van de Putte et al. [33] | P | 110 | 0.07 (0.5) | 21 | 9 | 2 | 1.88 |
Ada | 112 | 0.39 (0.6) | 44 | 23 | 11 | 1.88 | |
Ada | 106 | 0.29 (0.6) | 38 | 20 | 9 | 1.88 | |
Ada | 103 | 0.49 (0.5) | 55 | 36 | 19 | 1.84 | |
Ada | 113 | 0.38 (0.6) | 52 | 25 | 14 | 1.83 | |
Miyasaka [34] | P | 87 | -0.1 (0.6) | 12 | 5 | 1 | 1.39 |
Ada | 87 | 0.2 (0.5) | 25 | 14 | 9 | 1.57 | |
Ada | 91 | 0.2 (0.6) | 40 | 22 | 11 | 1.64 | |
Ada | 87 | 0.4 (0.6) | 44 | 28 | 13 | 1.77 | |
Kim at el. [35] | P+ | 63 | 0.2 (0.5) | 23 | 9 | 5 | 1.3 |
Ada+ | 65 | 0.5 (0.6) | 40 | 28 | 14 | 1.4 | |
Maini et al. [36] | P+ | 88 | 0.3 (0.5)† | 18 | 7 | 0 | 1.8 |
Inf+ | 86 | 0.3 (0.5)† | 45 | 22 | 7 | 1.8 | |
Inf+ | 86 | 0.5 (0.5)† | 47 | 25 | 9 | 1.8 | |
Inf+ | 87 | 0.5 (0.6)† | 51 | 26 | 15 | 1.8 | |
Inf+ | 81 | 0.4 (0.5)† | 49 | 21 | 9 | 1.5 | |
Westhoven et al.[37] | P+ | 363 | - | 87 | 33 | 16 | 1.5 |
Inf+ | 360 | - | 199 | 110 | 48 | 1.5 | |
Inf+ | 361 | - | 205 | 119 | 54 | 1.5 | |
Zhang et al. [38] | P+ | 86 | 0.45 (-) | 42 | 22 | 12 | 1.6 |
Inf+ | 87 | 0.76 (-) | 66 | 38 | 20 | 1.6 | |
Schiff et al. [39] | P+ | 110 | - | 49 | 22 | 10 | 1.8 |
Inf+ | 165 | - | 98 | 61 | 40 | 1.7 | |
Moreland et al. [40] | P | 80 | 0.03 (-) | 9 | 4 | 1 | 1.7 |
Eta | 76 | 0.58 (-) | 39 | 18 | 7 | 1.7 | |
Eta | 78 | 0.62 (-) | 46 | 31 | 12 | 1.6 | |
Weinblatt et al. [41] | P+ | 30 | 0.4 (-) | 8 | 1 | 0 | 1.5 |
Eta+ | 59 | 0.7 (-) | 42 | 23 | 9 | 1.5 | |
Keystone et al. [42] | P+ | 133 | 0.13red* (0.4)‡ | 37 | 18 | 7 | 1.25* |
Gol | 133 | 0.13* (0.7)‡ | 47 | 26 | 15 | 1.38* | |
Gol+ | 89 | 0.38* (0.5)‡ | 53 | 33 | 18 | 1.38* | |
Gol+ | 89 | 0.5* (0.5)‡ | 53 | 29 | 16 | 1.38* | |
Kay et al. [43] | P+ | 35 | - | 13 | 2 | 0 | 1.3 |
Gol+ | 35 | - | 21 | 13 | 3 | 1.7 | |
Gol+ | 34 | - | 19 | 10 | 6 | 1.8 | |
Keystone et al. [44] | P+ | 199 | 0.18 (-) | 27 | 15 | 6 | 1.7 |
Cert+ | 393 | 0.60 (-) | 231 | 146 | 84 | 1.7 | |
Cert+ | 390 | 0.63 (-) | 237 | 156 | 79 | 1.7 | |
Smolen et al. [45] | P+ | 127 | 0.14 (0.5) | 11 | 4 | 1 | 1.6 |
Cert+ | 246 | 0.5 (0.5) | 141 | 80 | 39 | 1.6 | |
Cert+ | 246 | 0.5 (0.5) | 142 | 81 | 26 | 1.6 | |
Fleischmann et al. [46] | P | 109 | -0.07 (0.4)† | 10 | 4 | 0 | 1.6 |
Cert | 111 | 0.39 (0.7)† | 51 | 25 | 9 | 1.4 |
The MTC models described previously are fit to the data; the continuous model for the improvement in HAQ score and the binary model for the ACR 20, ACR 50 and ACR 70 outcome measures.
The aim of this paper is to demonstrate the increased power of continuous outcome measures to detect differences in MTC models compared to binary measures. To explore this hypothesis the HAQ score was discretised to a binary outcome measure and the ACR criteria were transformed into a continuous measure; the resulting measures were analysed in addition to the trial reported outcome measures and results compared. The rationale for doing this was that comparing HAQ and ACR outcomes is not comparing like with like; they measure quite different aspects of disease and additional significant findings using the HAQ score could be because of this rather than there being any effect of a continuous vs. a binary outcome measure. Estimating a discrete version of the HAQ and a continuous measure of the ACR allows us to compare binary and continuous outcomes while the measure is kept fixed.
Discretised HAQ: HAQ 20 and HAQ 50
For the purpose of comparing continuous and binary outcome measures based on the same data, the HAQ 20 and HAQ 50 measures defined previously are estimated based on the continuous HAQ improvement. These discretised HAQ outcomes are not validated outcome measures for RA and are therefore not reported in the trials.
Input Data for discretised HAQ score and continuous ACR: Number of patients N; number of HAQ20 and HAQ50 responders; continuous ACR response ACRcont; + indicates additional treatment with MTX
Trial | Arm | N | HAQ20 | HAQ50 | ACRcont (SD) |
---|---|---|---|---|---|
Weinblatt et al. [31] | P+ | 62 | 30 | 12 | 0.08 (0.22) |
Ada+ | 69 | 45 | 24 | 0.35 (0.20) | |
Ada+ | 67 | 47 | 26 | 0.46 (0.22) | |
Ada+ | 73 | 52 | 26 | 0.42 (0.21) | |
Keystone et al. [32] | P+ | 200 | 95 | 32 | 0.13 (0.22) |
Ada+ | 212 | 141 | 81 | 0.42 (0.21) | |
Ada+ | 207 | 154 | 82 | 0.41 (0.21) | |
Van de Putte et al. [33] | P | 110 | 29 | 4 | 0.09 (0.20) |
Ada | 112 | 47 | 16 | 0.31 (0.19) | |
Ada | 106 | 60 | 19 | 0.30 (0.19) | |
Ada | 103 | 57 | 20 | 0.38 (0.22) | |
Ada | 113 | 60 | 21 | 0.33 (0.20) | |
Miyasaka [34] | P | 87 | 23 | 8 | 0.07 (0.17) |
Ada | 87 | 37 | 10 | 0.28 (0.19) | |
Ada | 91 | 39 | 16 | 0.33 (0.20) | |
Ada | 87 | 48 | 18 | 0.37 (0.21) | |
Kim et al. [35] | P+ | 63 | 28 | 10 | 0.18 (0.27) |
Ada+ | 65 | 43 | 24 | 0.42 (0.22) | |
Maini et al. [36] | P+ | 88 | 40 | 9 | 0.09 (0.19) |
Inf+ | 86 | 40 | 12 | 0.35 (0.19) | |
Inf+ | 86 | 54 | 19 | 0.36 (0.20) | |
Inf+ | 87 | 52 | 23 | 0.38 (0.21) | |
Inf+ | 81 | 48 | 20 | 0.37 (0.19) | |
Westhoven et al. [37] | P+ | 363 | - | - | 0.12 (0.23) |
Inf+ | 360 | - | - | 0.37 (0.20) | |
Inf+ | 361 | - | - | 0.38 (0.21) | |
Zhang et al. [38] | P+ | 86 | 52 | 28 | 0.27 (0.31) |
Inf+ | 87 | 61 | 39 | 0.46 (0.20) | |
Schiff et al. [39] | P+ | 110 | - | - | 0.22 (0.29) |
Inf+ | 165 | - | - | 0.41 (0.22) | |
Moreland et al. [40] | P | 80 | 25 | 8 | 0.06 (0.16) |
Eta | 76 | 47 | 26 | 0.34 (0.19) | |
Eta | 78 | 53 | 31 | 0.40 (0.21) | |
Weinblatt et al. [41] | P+ | 30 | 16 | 8 | 0.10 (0.17) |
Eta+ | 59 | 45 | 29 | 0.43 (0.19) | |
Keystone et al. [42] | P+ | 133 | 49 | 13 | 0.14 (0.25) |
Gol | 133 | 56 | 29 | 0.30 (0.20) | |
Gol+ | 89 | 51 | 24 | 0.40 (0.22) | |
Gol+ | 89 | 60 | 31 | 0.39 (0.21) | |
Kay et al. [43] | P+ | 35 | - | - | 0.14 (0.20) |
Gol+ | 35 | - | - | 0.39 (0.20) | |
Gol+ | 34 | - | - | 0.38 (0.21) | |
Keystone et al. [44] | P+ | 199 | 83 | 35 | 0.07 (0.20) |
Cert+ | 393 | 263 | 146 | 0.40 (0.22) | |
Cert+ | 390 | 249 | 137 | 0.41 (0.22) | |
Smolen et al. [45] | P+ | 127 | 46 | 10 | 0.04 (0.14) |
Cert+ | 246 | 163 | 66 | 0.38 (0.21) | |
Cert+ | 246 | 155 | 67 | 0.38 (0.20) | |
Fleischmann et al. [46] | P | 109 | 19 | 2 | 0.04 (0.14) |
Cert | 111 | 60 | 34 | 0.33 (0.19) |
Continuous ACR: ACRcont
While the continuous ACR measures were proposed by the Americal College of Rheumatology [20], they were not assessed in any of the trials. Therefore a continuous ACR measure ACRcont is generated based on the ACR 20, ACR 50 and ACR 70 outcomes reported in the trials. This enables us to compare the outcomes of the binary measures with those resulting from the continuous scale. ACRcont takes a value between 0 and 1 representing the percentage improvement in the dimensions which are combined for the binary ACR criteria.
Mean improvement estimated from patient level data
group 1 | group 2 | group 3 | group 4 | |
---|---|---|---|---|
meanACR | 0.17 | 0.41 | 0.57 | 0.72 |
ACRhybrid | 0.10 | 0.41 | 0.59 | 0.77 |
Control Group | 0.00 | 0.35 | 0.60 | 0.85 |
The patient level estimates are based on patients receiving biologic treatment; estimates can therefore be applied to the treatment arms of the studies. Unfortunately no patient level data representing the control groups is available to us. Given the lack of further information the analysis assumes interval midpoints as mean ACRcont estimates for the control groups. Group 1 is assumed to have a response in [-1, 0.2), group 2 in [0.2, 0.5), group 3 in [0.5, 0.7) and the response of group 4 lies in [0.7, 1]. The interval for non responders is very broad covering a wide range of extreme values. The baseline analysis therefore assumes a conservative mean value of 0.00 for this group. This yields the control group estimates in Table 4. Alternative scenarios assuming the same mean response for the control group as estimated for the treatment group are analysed in the sensitivity analysis. The estimated input data for the continuous ACR model based on meanACR is summarised in Table 3.
Efficacy Results
The models calculate the relative efficacy among all anti-TNF agents and placebo. Relative efficacy for the continuous measures (HAQ improvement and ACRcont) was measured as difference in improvement. Relative improvement was modelled as a multiplier to baseline HAQ score. Odds ratios were calculated for the binomial measures ACR 20, ACR 50, ACR 70 and HAQ 20 and HAQ50. Thirteen trials were included for the HAQ analysis and sixteen for the ACR analysis.
Results from HAQ analysis: Mean estimate with 80% credible intervals for each pair-wise comparison
Comparison | HAQ | HAQ20 | HAQ50 |
---|---|---|---|
Ada vs P | 0.20 (0.17,0.23)* | 2.6 (2.2,3.1)* | 3.1 (2.1,4.4)* |
Inf vs P | 0.10 (0.06,0.15)* | 1.6 (1.2,2.1)* | 2.0 (1.2,3.5)* |
Eta vs P | 0.31 (0.25,0.37)* | 3.6 (2.6,5.2)* | 4.1 (2.2,7.7)* |
Gol vs P | 0.23 (0.17,0.29)* | 2.8 (2.0,4.1)* | 4.2 (1.9,8.8)* |
Cert vs P | 0.25 (0.22,0.29)* | 3.3 (2.7,4.0)* | 5.0 (3.0,7.6)* |
Inf vs Ada | -0.10 (-0.15,-0.05)* | 0.6 (0.4,0.8)* | 0.7 (0.3,1.3) |
Eta vs Ada | 0.11 (0.04,0.17)* | 1.4 (0.9,2.1) | 1.3 (0.7,2.7) |
Eta vs Inf | 0.21 (0.13,0.28)* | 2.3 (1.4,3.6)* | 2.0 (0.9,4.9) |
Gol vs Ada | 0.02 (-0.05,0.08) | 1.1 (0.7,1.6) | 1.4 (0.6,3.3) |
Gol vs Inf | 0.12 (0.05,0.20)* | 1.8 (1.1,2.8)* | 2.1 (0.8,5.4) |
Gol vs Eta | -0.09 (-0.17,0.00)* | 0.8 (0.5,1.3) | 1.0 (0.4,2.7) |
Cert vs Ada | 0.05 (0.00,0.09)* | 1.2 (0.97,1.6) | 1.6 (0.8,2.8) |
Cert vs Inf | 0.15 (0.10,0.21)* | 2.0 (1.5,2.9)* | 2.4 (1.1,4.7)* |
Cert vs Eta | -0.06 (-0.13,0.01) | 0.9 (0.6,1.3) | 1.2 (0.5,2.5) |
Cert vs Gol | 0.03 (-0.04,0.09) | 1.1 (0.8,1.7) | 1.2 (0.4,2.7) |
σ | 0.03 (0.01,0.05) | 0.1 (0.0,0.3) | 0.4 (0.1,0.6) |
Results from ACR analysis: Mean estimate with 80% credible intervals for each pair-wise comparison
Comparison | ACR 20 | ACR 50 | ACR 70 | ACRcont |
---|---|---|---|---|
Ada vs P | 4.2 (3.4,5.3)* | 5.6 (4.3,7.2)* | 7.0 (4.3,10.9)* | 0.27 (0.25,0.29)* |
Inf vs P | 3.5 (2.8,4.4)* | 3.4 (2.7,4.4)* | 3.7 (2.3,5.5)* | 0.24 (0.22,0.27)* |
Eta vs P | 8.8 (5.5,13.9)* | 12.1 (5.7,23.2)* | 30.9 (4.2,123.8)* | 0.32 (0.28,0.35)* |
Gol vs P | 3.3 (2.3,4.8)* | 4.2 (2.7,6.5)* | 6.5 (2.8,13.3)* | 0.25 (0.21,0.28)* |
Cert vs P | 10.6 (8.0,14.1)* | 9.5 (6.7,13.5)* | 14.3 (6.8,27.0)* | 0.32 (0.30,0.35)* |
Inf vs Ada | 0.8 (0.6,1.1) | 0.6 (0.4,0.9)* | 0.5 (0.3,1.0)* | -0.03 (-0.06,0.00)* |
Eta vs Ada | 2.1 (1.2,3.4)* | 2.2 (0.96,4.2) | 4.4 (0.6,19.0) | 0.05 (0.01,0.09)* |
Eta vs Inf | 2.5 (1.5,4.1)* | 3.5 (1.5,6.9)* | 8.3 (1.1,37.7)* | 0.08 (0.03,0.12)* |
Gol vs Ada | 0.8 (0.5,1.2) | 0.8 (0.4,1.2) | 0.9 (0.4,2.2) | -0.02 (-0.06,0.02) |
Gol vs Inf | 0.9 (0.6,1.5) | 1.2 (0.7,2.0) | 1.7 (0.7,4.1) | 0.01 (-0.04,0.05) |
Gol vs Eta | 0.4 (0.2,0.7)* | 0.3 (0.2,0.8)* | 0.2 (0.0,1.8) | -0.07 (-0.12,-0.02)* |
Cert vs Ada | 2.5 (1.8,3.6)* | 1.7 (1.1,2.6)* | 2.1 (0.9,4.7) | 0.05 (0.02,0.09)* |
Cert vs Inf | 3.0 (2.1,4.3)* | 2.8 (1.8,4.3)* | 3.8 (1.7,8.3)* | 0.08 (0.05,0.12)* |
Cert vs Eta | 1.2 (0.7,2.0) | 0.8 (0.4,1.8) | 0.5 (0.1,3.6) | 0.01 (-0.04,0.05) |
Cert vs Gol | 3.2 (2.0,5.1)* | 2.3 (1.3,3.9)* | 2.2 (0.8,6.4) | 0.08 (0.03,0.12)* |
σ | 0.2 (0.0,0.4) | 0.2 (0.0,0.4) | 0.5 (0.0,0.8) | 0.03 (0.01,0.04) |
The key point is that all differences between agents detected by the binary HAQ measures are also detected by the continuous HAQ improvement measure, while not all differences detected in the continuous HAQ model are detected using the binary HAQ data; the differences detected by the binary HAQ measures are subsets of the differences detected by the continuous HAQ improvement measure. This is also demonstrated in the ACR analysis. It illustrates the point made that a continuous measure of effect has a greater power to detect a difference between treatments in an evidence synthesis.
Conclusion
This analysis illustrates the enhanced sensitivity to change of continuous measures in MTC models compared to using binary outcome measures, which was recently highlighted for epidemiological studies [48]. While binary measures work well for demonstrating a certain level of response, which is the primary aim of many clinical trials, the information lost when categorizing the underlying continuous response can have significant impact on the results of a mixed treatment comparison.
MTC models are often utilized when faced with a choice of agents rather than for demonstrating efficacy. In the above application, for example, it is already known that all of the anti-TNF agents provide improvement in the treatment of RA. What remains is to determine whether some of these agents work better than others. Therefore it would be of interest to know whether an agent provides a 30% improvement or a 60% improvement. When looking at the ACR 20 outcome, no difference would be seen between the two response rates.
The above analyses have shown two things. Firstly, the enhanced power to detect differences of a continuous measure as opposed to a binary measure was shown for both, the HAQ and the ACR measures. Secondly, the choice of cut-off level (e.g. 20%, 50% or 70%) has shown to have a strong impact on the results. Different significant results were detected when choosing different cut-offs; even the sequence of treatments when ordering from best to worse changes.
It may be argued that binary outcomes are clear and easy to interpret. However, where binary outcome measures are required, results based on continuous measures can be transformed subsequently using cut-off points, [49].
From a clinical point of view these results show that a MTC model based on continuous outcome measures provides greater precision of estimates of efficacy. This is of great benefit when carrying out an economic evaluation.
Sensitivity Analysis
The trials included for the analysis were conducted over a time period of 10 years. The model was extended to a meta-regression to include potential confounding parameters such as duration of disease, number of previous DMARDs and year of publication. None of these were found to have a significant impact and therefore were not included in the main analysis.
Different prior distributions on the between trial variance parameter allowing for a wider range of values were tested, but did not alter the conclusions. Varying the precision parameter of the normal prior distributions for the remaining parameters between 1,000 and 100,000 did not alter the results either.
The continuous ACR response underlying the binary ACR 20, ACR 50 and ACR 70 measures is estimated using the mean ACRcont response for each of the four responder groups. For the baseline analysis meanACR was used as the underlying continuous effect. In a sensitivity analysis a model was fit using the ACR hybrid as the underlying effect. This did not alter the results much, however, adalimumab was not found to be superior to infliximab in this scenario. There was substantial uncertainty regarding the mean ACRcont response in the control arms, as no patient level data was available. An additional model has been fit assuming the mean response in each group to be the same for treatment arms and control arms. While this did influence the biologic treatment effect versus control, the relative efficacy between biologic treatments was not affected much. Again, these models did not detect a difference between adalimumab and infliximab. Outcomes of the various MTCs can be accessed in Additional file 3.
The scale chosen for dichotomized outcome measures has been shown to influence outcomes of MTC models [50]. In addition to the OR scale we therefore also fitted an analysis based on risk ratios (RRs). The OR model can be adapted to estimate RRs making a few changes, for further details see Schmitz et al. [23]. The results can be accessed in Additional file 4; the findings of increased power of continuous outcomes are confirmed.
Limitation
Doses across treatments and treatment arms varied, which has not been accounted for in the analysis. Generalising the model to include a meta-regression for dose would raise difficulties of comparability; doses across treatments are hard to compare as well as within one treatment when the same dose is given, but with different frequency.
The analysis only includes RCT evidence. However, there exists a large body of observational data collected via registries and open label studies. The inclusion of such evidence is possible within this framework, helping to reduce uncertainty further [51].
Patient level data allowed the estimation of mean ACR response within each of the responder groups. While this provided some additional information towards estimating the continuous ACR response measure, it did not replace the full information lost. The estimated ACRcont measure is still subject to high uncertainty. Patient level data of the RCTs included in the analysis would allow the exact calculation of the continuous ACR measure.
The evidence network has a star design, which does not allow testing of the assumption of treatment exchangeability. Baseline characteristics across the trials were compared and and the model was extended to a meta-regression to explain the potential influence of differing demographics.
This paper confirms the effectiveness of anti-TNF agents in the treatment of RA. The study illustrates the enhanced ability to detect differences between treatments when using continuous measures and shows the high dependency of MTC outcomes on the cut-off level when using binary data.
Rather than steering away from binary measures, we would like to advocate the additional reporting of underlying continuous effect measures in clinical trials to facilitate further analyses. The importance of the involvement of statisticians in the choice of clinical measures has been recently highlighted [10].
Declarations
Authors’ Affiliations
References
- Sutton A, Higgins JPT: Recent developments in meta-analysis. Stat Med. 2008, 27: 625-650. 10.1002/sim.2934.View ArticlePubMed
- Lu G, Ades AE: Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004, 23: 3105-3124. 10.1002/sim.1875.View ArticlePubMed
- Spiegelhalter DJ, Abrams KR, Jonathan PM: Bayesian Approaches to Clinical Trials and Health-Care Evaluation. 2004, Wiley: NewYork
- Royston P, Altman D, Sauerbrei W: Dichotomizing continuous predictors in multiple regression: a bad idea. Stat Med. 2006, 25: 127-141. 10.1002/sim.2331.View ArticlePubMed
- Austin P, Brunner L: Inflation of the type I error rate when a continuous confounding variable is categorized in logistic regression analyses. Stat Med. 2004, 23: 1159-1178. 10.1002/sim.1687.View ArticlePubMed
- Chen H, Cohen P, Chen S: Biased odds ratios from dichotomization of age. Stat Med. 2007, 26: 2487-3497.
- Sauerbrei W, Royston P, Zapien K: Detecting an interaction between treatment and a continuous covariate: A comparison of two approaches. Comput Stat Data Anal. 2007, 51: 4054-4063. 10.1016/j.csda.2006.12.041.View Article
- Breitling L, Brenner H: Odd odds interactions introduced through dichotomisation of continuous outcomes. J Epidemiol Community Health. 2010, 64: 300-303. 10.1136/jech.2009.089458.View ArticlePubMed
- Dawson N, Weiss R: Dichotomizing continuous variables in statistical analysis: a practice to avoid. Med Decision Making. 2012, 32: 225-226. 10.1177/0272989X12437605.View Article
- Senn S, Julious S: Measurement in clinical trials: A neglected issue for statisticians?. Stat Med. 2009, 28: 3189-3209. 10.1002/sim.3603.View ArticlePubMed
- Julious S, George S, Machin D, Stephens R: Sample sizes for randomized trials measuring quality of life in cancer patients. Qual Life Res. 1997, 6: 109-117.View ArticlePubMed
- Hutton J, McGrath C, Frybourg J, Tremblay M, Bramley-Harker E, Henshall C: Framework for describing and classifying decision-making systems using technology asesessment to determine the reimbursement of health technologies (fourth hurdle systems). Int J Technol Assess Health Care. 2006, 22: 10-18.View ArticlePubMed
- Klareskog L, Catrina A, Paget S: Rheumatoid arthritis. The Lancet. 2009, 979: 659-672.View Article
- Sutton A, Abrams KR: Bayesian methods in meta-analysis and evidence synthesis. Stat Methods Med Res. 2001, 10: 277-303. 10.1191/096228001678227794.View ArticlePubMed
- Nixon R, Bansback N, Brennan A: Using mixed treatment comparisons and meta-regression to perform indirect comparisons to estimate the efficacy of biologic treatments in rheumatoid arthritis. Stat Med. 2007, 26: 1237-1254. 10.1002/sim.2624.View ArticlePubMed
- Jansen J, Crawford B, Bergman G, Stam W: Bayesian meta-analysis of multiple treatment comparisons: an introduction to mixed treatment comparisons. Value in Health. 2008, 11: 956-964. 10.1111/j.1524-4733.2008.00347.x.View ArticlePubMed
- Saag K, Teng G, Patkar N, Anuntiyo J, Finney C, Curtis J, Paulus H, Mudano A, Piso M, Outman R, Allison J, Suarez Almazor M, Bridges A, Chatham W, Hochberg M, Maclea C, Mikuls T, Moreland L, O’Dell J, Turkiewicz A, Furst D, Elkins-Melton M: American College of Rheumatology 2008 Recommendations for the use of nonbiologic and biologic disease-modifying antirheumatic drugs in rheumatoid arthritis. Arthritis & Rheumatism. 2008, 59: 762-784. 10.1002/art.23721.View Article
- Felson D, Anderson J, Boers M, Combarier C, Furst D, Goldsmith C, Katz L, Lightfoot R, Paulus H, Strand V, Tugwell P, Weinblatt M, Williams H, Wolfe F, Kieszak S: American College of Rheumatology preliminary definition of improvement in rheumatoid arthritis. Arthritis & Rheumatism. 1995, 38: 727-735. 10.1002/art.1780380602.View Article
- Van Riel P, van Gelstel A: Clinical outcome measures in rheumatoid arthritis. Ann Rheumatic Diseases. 2000, 59: 128-131.View Article
- American College of Rheumatology: A proposed revision to the ACR20: The hybrid measure of american college of rheumatology response. Arthritis & Rheumatism. 2007, 57: 193-202. 10.1002/art.22552.View Article
- Prevoo M, van’t Hof M, Kuper H, van Leeuwen M, van de Putte L, van Riel P: Modified disease activity scores that include twenty-eight-joint counts. Development and validation in a prospective longitudinal study of patients with rheumatoid arthritis. Arthritis & Rheumatism. 1995, 38: 44-48. 10.1002/art.1780380107.View Article
- Moher D, Liberati A, Tetzlaff J, Altman D, PRISMA Group: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine. 2009, 6: e1000097-10.1371/journal.pmed.1000097.PubMed CentralView ArticlePubMed
- Schmitz S, Adams R, Walsh C, Barry M, FitzGerald O: A mixed treatment comparison of the efficacy of anti-TNF agents in rheumatoid arthritis for methotrexate non-responders demonstrates differences between treatments: a Bayesian approach. Ann rheumatic diseases. 2012, 71: 225-230. 10.1136/annrheumdis-2011-200228.View Article
- Dias S, Welton N, Caldwell D, Ades A: Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010, 29: 932-944. 10.1002/sim.3767.View ArticlePubMed
- Bucher HC, Guyatt GH, Griffith LE, Walter SD: The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol. 1997, 50: 683-691. 10.1016/S0895-4356(97)00049-8.View ArticlePubMed
- Lumley T: Network meta-analyis for indirect treatment comparisons. Stat Med. 2002, 21: 2313-2324. 10.1002/sim.1201.View ArticlePubMed
- Hyrich K, Watson K, Silman A, Symmons D The BSR Biologics Register: Predictors of response to anti-TNF-α therapy among patients with rheumatoid arthritis: results from the British Society for Rheumatology Biologics Register. Rheumatology. 2006, 45: 1558-1565. 10.1093/rheumatology/kel149.View ArticlePubMed
- Warn D, Thompson D, Spiegelhalter D: Bayesian random effects meta-analysis of trials with binary outcomes: methods forthe absolute risk difference and relative risk scales. Stat Med. 2002, 21: 1601-1623. 10.1002/sim.1189.View ArticlePubMed
- Gelman A: Prior distributions for variance parameters in hierarchical models. Bayesian analysis. 2006, 1: 133-151.
- Lunn D, Thomas A, Best N, Spiegelhalter D: WinBUGS – a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput. 2000, 10: 325-337. 10.1023/A:1008929526011.View Article
- Weinblatt M, Keystone E, Furst D, Moreland L, Weisman M, Birbara C, Teoh L, Fischkoff S, Chartash E: Adalimumab, a fully human anti-tumour necrosis factor alpha monoclonal antibody, for the treatment of rheumatoid arthritis in patients taking concomitant methotrexate: the ARMADA trial. Arthitis & Rheumatism. 2003, 48: 35-45. 10.1002/art.10697.View Article
- Keystone E, Kavanaugh A, Sharp J, Tannenbaum H, Hua Y, Teoh L, Fischkoff S, Chartash E: Radiographic, clinical, and functional outcomes of treatment with adalimumab (a human anti-tumor necrosis factor monoclonal antibody) in patients with active rheumatoid arthritis receiving concomitant methotrexate therapy: A randomized, placebo-controlled, 52-week trial. Arthritis & Rheumatism. 2004, 50: 1400-1411. 10.1002/art.20217.View Article
- Van De Putte L, Atkins C, Malaise M, Sany J, Russell A, van Riel P, Settas L, Bijlsma J, Todesco A, Dougados M, Nash P, Emery P, Walter N, Kaul M, Fischkoff A, Kupper H: Efficacy and safety of adalimumab as monotherapy in patients with rheumatoid arthritis for whom previous disease modifying antirheumatic drug treatment has failed. Ann Rheumatic Diseases. 2004, 63: 508-516. 10.1136/ard.2003.013052.View Article
- Miyasaka N: Clinical investigation in highly disease-affected rheumatoid arthritis patients in Japan with adalimumab applying standard and general evaluation: the CHANGE study. Modern Rheumatology. 2008, 18: 252-262. 10.1007/s10165-008-0045-0.PubMed CentralView ArticlePubMed
- Kim H, Lee K, Song Y, Dae-Hyun Y, Koh E, Yoo B, Luo A: A randomized, double-blind, placebo-controlled, phase III study of the human anti-tumor necrosis factor antibody adalimumab administered as subcutaneous injections in Korean rheumatoid arthritis patients treated with methotrexate. APLAR J Rheumatology. 2007, 10: 9-16. 10.1111/j.1479-8077.2007.00248.x.View Article
- Maini R, St Clair E, Breedveld F, Furst D, Kalden J, Weisman M, Smolen J, Emery P, Harriman G, Feldmann M, Lipsky P: Infliximab (chimeric anti-tumour necrosis factor [alpha] monoclonal antibody) versus placebo in rheumatoid arthritis patients receiving concomitant methotrexate: a randomised phase III trial. The Lancet. 1999, 353: 1932-1939.View Article
- Westhovens R, Yocum D, Han J, Berman A, Strusberg I, Geusens P, Rahman M: The safety of infl iximab, combined with background treatments, among patients with rheumatoid arthritis and various comorbidities: a large, randomized, placebo-controlled trial. Arthritis & Rheumatism. 2006, 54: 1075-1086. 10.1002/art.21734.View Article
- Zhang F, Hou Y, Huang F, Wu D, Bao C, Ni L, Yao C: Infliximab versus placebo in rheumatoid arthritis patients receiving concomitant methotrexate: A preliminary study from China. APLAR J Rheumatology. 2006, 9: 127-130. 10.1111/j.1479-8077.2006.00186.x.View Article
- Schiff M, Keiserman M, Codding C, Songcharoen A, Berman A, Nayiager S, Saldate C, Li T, Aranda R, Becker J, Lin C, Cornet P, Dougados M: Efficacy and safety of abatacept or infliximab vs placebo in ATTEST: a phase III, multi-centre, randomised, double-blind, placebo-controlled study in patients with rheumatoid arthritis and an inadequate response to methotrexate. Ann rheumatic diseases. 2008, 67: 1096-1103. 10.1136/ard.2007.080002.View Article
- Moreland L, Schiff M, Baumgartner A, Tindall E, Fleischmann R, Bulpitt K, Weaver A, Keystone E, Furst D, Mease P, Ruderman E, Horwitz D, Arkfeld D, Garrison L, Burge D, Blosch C, Lange M, McDonnell N, Weinblatt M: Etanercept therapy in rheumatoid arthritis: A randomized, controlled trial. Ann Internal Med. 1999, 130: 478-486.View Article
- Weinblatt M, Kremer J, Bankhurst A, Bulpitt K, Fleischmann R, Fox R, Jackson C, Lange M, Burge D: A trial of etanercept, a recombinant tumor necrosis factor receptor:Fc fusion protein, in patients with rheumatoid arthritis receiving methotrexate. New England J Med. 1999, 340: 253-259. 10.1056/NEJM199901283400401.View Article
- Keystone E, Genovese M, Klareskog L, Hsia E, Hall A, Miranda P, Pazdur J, Bae S, Palmer W, Zrubek J, Wiekowski M, Visvanathan S, Wu Z, Rahman M: Golimumab, a human antibody to tumour necrosis factor (alpha) given by monthly subcutaneous injections, in active rheumatoid arthritis despite methotrexate therapy: The GO-FORWARD Study. Ann Rheumatic Diseases. 2009, 68: 769-289.
- Kay J, Matteson E, Dasgupta B, Nash P, Durez P, Hall A, Hsia E, Han J, Wagner C, Xu Z, Visvanathan S, Rahman M: Golimumab in patients with active rheumatoid arthritis despite treatment with methotrexate: a randomized, doubleblind, placebo-controlled, dose-ranging study. Arthritis & Rheumatism. 2008, 58: 964-975. 10.1002/art.23383.View Article
- Keystone E, Van Der Heijde D, Mason D, Landewe R, van Vollenhoven R, Combe B, Emery P, Strand V, Mease P, Desai C, Pavelka K: Certolizumab pegol plus methotrexate is significantly more effective than placebo plus methotrexate in active rheumatoid arthritis: Findings of a fifty-two-week, phase III, multicenter, randomized, double-blind, placebo-controlled, parallel-group study. Arthritis & Rheumatism. 2009, 58: 3319-3329.View Article
- Smolen J, Landewe R, Mease P, Brzezicki J, Mason D, Luijtens K, van Vollenhoven R, Kavanaugh A, Schiff M, Burmester G, Strand V, Vencovsky J, van der Heijde D: Efficacy and safety of certolizumab pegol plus methotrexate in active rheumatoid arthritis: the RAPID 2 study. A randomised controlled trial. Ann rheumatic diseases. 2008, 68: 797-804.View Article
- Fleischmann R, Vencovsky J, Van Vollenhoven R, Borenstein D, Box J, Coteur G, Goel N, Brezinschek H, Innes A, Strand V: Efficacy and safety of certolizumab pegol monotherapy every 4 weeks in patients with rheumatoid arthritis failing previous disease-modifying antirheumatic therapy: the FAST4WARD study. Ann rheumatic diseases. 2009, 68: 805-8011. 10.1136/ard.2008.099291.View Article
- Adams R, Walsh C, Veale D, Bresnihan B, FitzGerald O, Barry M: Understanding the relationship between the EQ-5D, SF-6D, HAQ and disease activity in inflammatory arthritis. Pharmacoeconomics. 2010, 28: 477-487. 10.2165/11533010-000000000-00000.View ArticlePubMed
- Bennette C, Vickers A: Against quantiles: categorization of continuous variables in epidemiologic research, and its discontents. BMC Med Res Methodology. 2012, 12: 21-10.1186/1471-2288-12-21.View Article
- Hasselblad V, Hedges L: Meta-analyses of screening and diagnostic tests. Quant Methods Psychology. 1995, 117: 167-178.
- Caldwell D, Welton N, Dias S, Ades A: Selecting the best scale for measuring treatment effect in a network meta-analysis: a case study in childhood nocturnal enuresis. Res Synth Methods. 2012, 3: 126-141. 10.1002/jrsm.1040.View ArticlePubMed
- O’Rourke K, Walsh C, Hutchinson M: Outcome of beta-interferon treatment in relapsing-remitting multiple sclerosis: a Bayesian analysis. J Neurology. 2007, 254: 1547-1554. 10.1007/s00415-007-0584-x.View Article
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/12/167/prepub
Pre-publication history
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.