Analysis of an ordinal outcome in a multicentric randomized controlled trial: application to a 3- arm anti- malarial drug trial in Cameroon

Solange Youdom Whegang; Leonardo K Basco; Henri Gwét; Jean-Christophe Thalabard

doi:10.1186/1471-2288-10-58

Research article
Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Analysis of an ordinal outcome in a multicentric randomized controlled trial: application to a 3- arm anti- malarial drug trial in Cameroon

Solange Youdom Whegang^{1, 2}Email author,
Leonardo K Basco³,
Henri Gwét¹ and
Jean-Christophe Thalabard²

BMC Medical Research Methodology201010:58

https://doi.org/10.1186/1471-2288-10-58

Received: 27 September 2009

Accepted: 18 June 2010

Published: 18 June 2010

Open Peer Review reports

Abstract

Background

Malaria remains a burden in Sub-Saharan Countries. The strategy proposed by the World Health Organization (WHO) is to systematically compare the therapeutic efficacy of antimalarial drugs using as primary outcome for efficacy, a four-category ordered criterion. The objective of the present work was to analyze the treatment effects on this primary outcome taking into account both a center-effect and individual covariates. A three-arm, three-centre trial of Amodiaquine (AQ), sulfadoxine-pyrimethamine (SP) and their combination (AQ + SP), conducted by OCEAC-IRD in 2003, in 538 children with uncomplicated Plasmodium falciparum malaria, is used as an illustration.

Methods

Analyses were based on ordinal regression methods, assuming an underlying continuous latent variable, using either the proportional odds (PO) or the proportional hazards (PH) models. Different algorithms, corresponding to both frequentist- and bayesian-approaches, were implemented using the freely available softwares R and Winbugs, respectively. The performances of the different methods were evaluated on a simulated data set, and then they were applied on the trial data set.

Results

Good coverage probability and type-1 error for the treatment effect were achieved. When the methods were applied on the trial data set, results highlighted a significance decrease of SP efficacy when compared to AQ (PO, odds ratio [OR] 0.14, 95% confidence interval [CI] 0.04-0.57; hazard ratio [HR] 0.605, 95% CI 0.42-0.82), and an equal effectiveness between AQ + SP and AQ (PO, odds ratio [OR] 1.70, 95% confidence interval [CI] 0.25-11.44; hazard ratio [HR] 1.40, 95% CI 0.88-2.18). The body temperature was significantly related to the responses. The patient weights were marginally associated to the clinical response.

Conclusion

The proposed analyses, based on usual statistical packages, appeared adapted to take into account the full information contained in the four categorical outcome in malaria trials, as defined by WHO, with the possibility of adjusting on individual and global covariates.

Keywords

MalariaAntimalarial DrugGeneralize Estimate EquationCoverage ProbabilityReference Treatment

Background

Many clinical trials have a primary outcome which is measured on a categorical scale. In these situations, the outcome categories are often ordered, either by a direct relationship to either a continuous measurement or a clinical score through pre-defined cut-points, or by a natural interpretation by the physician of a health condition or body reaction.

An overview and recent developments in the analysis of ordered categorical data have been presented in [1–4]. More specific developments for analyzing ordinal data in the context of meta-analysis of clinical trials have been proposed initially for summary statistics [5, 6], secondarily extended to meta-analysis with individual patient's data [7, 8].

The main objective of this paper was to adapt and implement the above-proposed methods in the specific context of malaria. A more specific objective was to study the effect of both different treatments and a set of covariates on the primary outcome.

In antimalarial trials, the WHO (World Health Organization) established a clinical study protocol [9, 10] to assess the efficacy of antimalarial drugs for uncomplicated malaria, in which the primary outcome is a four-category outcome, i) ACPR (adequate clinical and parasitological response); ii) LPF (late parasitological failure); iii) LCF (late clinical failure) and; iv) ETF (early treatment failure). Patient status reflects the ordinal character of the WHO criteria. Danger signs appearing on day 1, 2 or 3 with a persistent parasitaemia correspond to an ETF. The presence of fever and parasitaemia between day 4 and day 14 without an ETF is considered as LCF, whereas the presence of parasitaemia on day 14 without ETF and LCF is a LPF. ACPR corresponds to the absence of parasite regardless the body temperature on day 14 without being classified as either ETF, or LCF or a LPF previously. This suggests that there is an explicit order between the categories. A multi-centre randomized controlled trial of three antimalarial drugs, amodiaquine (AQ), sulfadoxine-pyrimethamine (SP) and their combination (AQ + SP), which was conducted in 2003 by OCEAC-IRD in patients with uncomplicated P. falciparum malaria from 3 health centers in Cameroon, according to the WHO protocol [9, 10] will be used to illustrate the statistical approach.

Briefly, the 3 centers were selected as they were known to be associated with different levels of transmission. Affected children, 0-5 years old, were the target population, according to the WHO recommendations for assessing antimalarial drug efficacy. The primary outcome of efficacy was the four category-variable: C₁ = ACPR, C₂ = LPF, C₃ = LCF, and C₄ = ETF, the first category being the best category and the last category being the worst, in terms of health condition. Table 1 describes the results for each arm of anti-malarial drug, in the three centers. The majority of patient outcomes were assigned in the first category, with very few treatment outcomes in the other categories, corresponding to various degrees of therapeutic failures. The protocol was approved by both the Ministry of Public Health and the Ethical National Committee. The person legally in charge of the children gave an informed consent before inclusion in the study. Study investigators were OCEAC field workers. A global analysis of the data, based on the rate of ACPR can be found in [11].

Table 1

Counts of treatment response by category stratified in all centers and treatments.

		C₁	C₂	C₃	C₄
Center	Treatment	ACPR	LPF	LCF	ETF	Total
	AQ	62	0	0	1	63
		[98.4]**	[0]	[0]	[1.6]	[100.0]
1	SP	53	2	0	6	61
		[86.8]	[3.27]	[0]	[9.8]	[100.0]
	AQ+SP	59	0	0	0	59
		[100.0]	[0]	[0]	[0]	[100.0]
	AQ	52	2	0	0	54
		[96.3]	[3.7]	[0]	[0]	[100.0]
2	SP	48	0	2	3	53
		[90.56]	[0]	[3.7]	[5.26]	[100.0]
	AQ+SP	55	1	0	0	56
		[98.2]	[1.8]	[0]	[0]	[100.0]
	AQ	57	0	0	1	58
		[98.2]	[0]	[0]	[1.7]	[100.0]
3	SP	52	2	0	3	57
		[91.2]	[3.5]	[0]	[5.26]	[100.0]
	AQ+SP	58	0	0	0	58
		[100.0]	[0]	[0]	[0]	[100.0]
	Total	496	7	2	14	519
		[95.5]	[1.3]	[0.38]	[2.7]	[100.0]

** Row percentage. The categories C₁, C₂, C₃, and C₄ represent ACPR, LPF, LCF and ETF, respectively.

Methods

Statistical methods

The proportional odds model

The statistical approach is based on the proportional odds model [12]. Consider the K = 3 centers. Each patient had a response into one of the m = 4 categories, (C ₁, .., C _m), with n _ipatients in center i. Let be the total number of patients overall.

Denote Z the response and π _ijc, the probability that the jth subject in study i had a response in category c; π _ijc= Pr(Z _ij= c). Let also Q _ijc= Pr(Z _ij≤ c) be the cumulative probability of a response in category c or better, so that Q _ijc= π _ij ₁ + ... + π _ijcand Q _ijm= 1; c = 1, ..., m-1. Hence c = m corresponding to the worst outcome (here an ETF) is the baseline level. The proportional odds model is defined by

(1)

where α _crepresents the cth intercept and η _ij= γ ₁ x ₁ _ij+ ...+ γ _p x _pij, is a linear combination of explanatory variables. The model assumes 1) an increasing order for the α _c: α ₁ < α ₂ < ... < α _m-1; 2) α ₀ = -∞ and α _m= ∞.

The assumption of proportional odds signifies that the ratio of the odds of the event Z _ij≤ c for any pair of sets of explanatory variables is independent of the category c. The cumulative logit model (1) results from the existence of a latent random variable with a logistic distribution, the (α _c, c = 0, ..., m) corresponding to the cut-off thresholds for categorizing the latent variable into m classes. Alternatives to the proportional odds model can be developed based on different assumptions regarding the latent variable, like a normal- or an extreme value distribution associated with the probit or complementary log- log links, respectively.

Fixed effect model

The basic model extends the proportional odds model (PO) proposed in [7] to a situation with L treatments (L > 2). For the sake of simplicity, the presentation will be restricted to the situation of L = 3 treatments corresponding to the real data set but the extension to more than 3 treatments is straightforward. Assuming that one particular treatment (here, AQ) was selected as the reference treatment, the treatment covariate is modeled using L-1 = 2 dummy variables T ₁ and T ₂, where T _l(l = 1, L-1) yields 1 if subject received the treatment l, and 0 otherwise (here, l = 1 corresponds to SP, l = 2 corresponds to AQ + SP)

(2)

where {j = 1, ..., n _i,} corresponds to the individuals within each arm, {i = 1, .., K}, corresponds to the centers and {c = 1, ..., m-1} to the categories. The parameter γ ₁ represents the log-odds ratio of efficacy associated to treatment 1 versus the reference treatment, and γ ₂ the log-odds ratio of efficacy associated to treatment 2 versus the reference treatment.

The center effects are modeled by γ _0iwhere γ ₀₁ = 0 for identifiability constraint.

Testing the proportional odds assumptions

It is worth noting that model (2) assumes that, within each center and for each outcome category c, (c = 1, .., m-1), there is a common log-odds ratio, γ ₁ for treatment l versus the reference treatment. Similarly, model (2) assumes also that, within each treatment group, and for each outcome category c there is a common log-odds ratio, γ _0i- γ _0i, between two centers i and i', independent of the outcome category.

Additional models were introduced to test the PO assumption. Model (3) allows for testing a global PO between treatments, without a center effect:

(3)

However, each treatment can have a different effect according to the outcome category.

Assuming a global PO for T ₁, the model (4) allows for testing PO between T ₂ and the reference treatment

(4)

where δ _hc= 1 if h = c and 0, otherwise.

Similarly, the model (5) assumes a global PO for T ₂, and allows for testing PO between T1 and the reference treatment (here AQ)

(5)

Mixed effects model

Discarding a center effect, and still assuming proportional odds between treatments, 2 random effects were added to the treatment variables.

where: β _1i= γ ₁ + δ _1iand β _2i= γ ₂ + δ _2i. Both δ _1iand δ _2iare normally distributed random effects with expected value 0 and variance , respectively.

By grouping separately the fixed and the random-effects, the model can be rewritten as follows:

(6)

where , where G', the transposed matrix of G, needs to be estimated from the data.

Estimation methods

The parameters of the fixed effects models were estimated using three different methods, i.e. maximum likelihood (ML), iterative generalized least squares (IGLS) and generalized estimating equations (GEE) [7]. In the IGLS and GEE methods, the ordinal response was considered as a set of correlated binary responses. Thus the proportional odds model is viewed as a member of the multivariate generalized linear models [13].

All these methods were implemented under the free Statistical Software R http://cran.r-project.org/. The various codes for the ML, GEE and IGLS methods are in the additional file 1. Models (3), (4) and (5) were implemented for the test of the proportional odds assumption between centers and treatments. The parameters of the random effects model were estimated using a Bayesian approach for hierarchical models. In the Bayesian paradigm, prior distributions for all unknown parameters θ need to be specified. The intercept α _cwere given non-informative N(0,10⁴) priors. Parameters β _1iand β _2iwere assumed to be from N(γ ₁, σ ₁ ²) and N(γ ₂, σ ₂ ²) respectively. We gave γ ₁, γ ₂ non-informative N(0,10^-6). The difficulty in the Bayesian paradigm is the choice of the a priori distribution for the inverse of the variances σ ₁ ² and σ ₂ ². Several forms of the a priori are available. We chose an a priori of the form Gamma(0.5η, 0.5ηζ ²), where η and ζ ² are either arbitrary chosen or calibrated from the data. Here we chose η = 2. The initial estimated values of ζ ² (0,007, 0,001) were obtained from our data, by adjusting a generalized linear mixed model. So 1/σ ₁ ² and 1/σ ₂ ² were given Gamma(1,0.007) and Gamma(1,0.001), respectively. All the Bayesian analyses were performed using 3 chains of 50000 samples, out of which the first 25000 were removed to allow for convergence. Thus, each posterior statistic was based on 75000 samples. Finally the 95% credibility interval was obtained for each statistic.

Simulations

To assess the performance of the fixed effect methods, we carried out analyses on simulated data based on model (6). The aim was to compare the methods when the treatment covariate was taken into consideration and random effects were introduced to account for center variability. We generated a data set of 3 centers, each containing 100 patients, comparing 3 treatments A, B, C, with equal size. We supposed that the treatment effects were the same in the 3 centers, and were set to be γ ₁ = -1 for B comparing to A and, γ ₂ = 1 for C comparing to A, respectively. Initial values for α _cwere α ₀₁ = -2, α ₀₂ = -1, α ₀₃ = 0. The initial value of the matrix G' was a diagonal matrix with diagonal elements σ ₁ = 0.01 and σ ₁ = 0.02, corresponding to the between center deviation.

The choice of the treatment initial values was guided by preliminary results from real data. The choice for the cut-point values was derived from [14].

Cumulative probabilities Q _ijcwere then obtained using model (6). For a subject j in study i, with vector of cumulative probabilities (0, Q _ij1, Q _ij2, Q _ij3, 1), the simulated outcome was generated using the quartile range category, to which an uniformly (0,1) distributed random value belonged. To check that the conclusions were not sensitive to the choice of the starting values, we repeated the simulations, for each method, with different initial values. An example of the simulated data set can be found in additional file 2.

For each method, bias and confidence levels were estimated through N 1000 = replications. For each estimation method, the treatment effect was assessed using the calculated coverage probability and the type I error.

In the Bayesian analysis, model (6) was implemented using the Bayesian Software WinBUGS. A program is provided in the additional file 3, showing how model (6) can be written in BUGS language.

Results

Simulated data set

Results are summarized in Table 2. The ML-, IGLS- and GEE- methods yielded similar results. For the detection bias, the ML estimate appeared less biased than the two other methods. Considering their coverage probabilities (CP = 1- β), all the three approaches appeared to be able to detect a significant treatment effect with a given type I error α.

Table 2

Simulation results.

			Methods			Bias (*)			1-β(α)
Parameters	Real values	ML	IGLS	GEE	ML	IGLS	GEE	ML	IGLS	GEE
Cut-points
α ₁	-2	-2.149	-2.149	-2.143	0.014	0.007	0.0137
		(0.236)	(0.237)	(0.237)	(7.34)	(1.98)	(6.76)
α ₁	-1	-1.053	-1.053	-1.040	0.012	0.002	0.0136
		(0.214)	(0.211)	(0.217)	(7.35)	(1.69)	(7.91)
α ₃	0	-0.106	-0.106	-0.103	0.0055	-0.0043	0.0025
		(0.206)	(0.204)	(0.207)	(3.57)	(1.6)	(1.56)
Treatment effects
γ ₀₁	-1	-1.016	-1.016	-0.941	0.0077	0.0195	0.0098	0.938	0.948	0.94
		(0.242)	(0.240)	(0.248)	(3.22)	(2.42)	(3.75)	(0.014)	(0.013)	(0.015)
γ ₀₂	1	1.078	1.078	1.082	-0.005	-0.0043	-0.0111	0.943	0.943	0.945
		(0.214)	(0.215)	(0.217)	(2.27)	(2.20)	(5.05)	(0.003)	(0.001)	(0.001)
Center effect
C₁		0.218	0.218	0.168
		(0.224)	(0.224)	(0.228)
C₂		-0.014	-0.014	0.013
		(0.228)	(0.226)	(0.230)

Fixed models. Column 2 corresponds to the real values used for simulating data.

Columns 3-5 correspond to the mean estimates according to different methods with the corresponding standard error estimates in brackets; columns 6-8 correspond to the corresponding absolute and relative biases (*); columns 9-11 corresponds to the coverage probability and, in brackets, the type I error for the treatment effect only.

Analysis of the Multi-centre trial

Results based on treatment and center effect only

Among the n = 538 patients from the three centers, 19 patients were lost to follow-up by day 14 and hence could not contribute to the analyses.

Results from the randomized trial are displayed in Table 3 with a general view of the fixed and the Bayesian approach. All the methods showed a significant decrease of the SP effect as compared with AQ. The SP treatment appeared less efficacious than AQ, by all the three fixed methods (ML: OR = e ^-1.93= 0.14; 95% CI 0.04-0.50; IGLS: OR = e ^-1.77= 0.17; 95% CI 0.04-0.58; GEE: OR = e ^-1.80= 0.16; 95% CI 0.04-0.57). The combination AQ-SP was not significantly different by the three approaches. The additional file 4 shows how practically these fixed estimates can be obtained with an example of the different output given in additional file 5.

Table 3

summary of parameter estimates using both the fixed effect models and the bayesian approach in the anti-malarial trial.

		Fixed Approach		Bayesian Approach
	ML	IGLS	GEE	WinBUGS
Category associated cut-points
α ₁	3.850	3.880	3.665	3.915
	(0.63)	(0.64)	(0.63)	(0.50)
α ₂	4.237	3.880	4.060	4.359
	(0.65)	(0.64)	(0.64)	(0.51)
α ₃	4.380	4.237	4.203	4.572
	(0.67)	(0.66)	(0.65)	(0.52)
Treatment (Reference: AQ)
SP/AQ	-1.938*	-1.776*	-1.800 *	-1.760*
	(0.63)	(0.64)	(0.63)	(0.57)
AQ+SP/AQ	0.537	1.797	2.081	1.601
	(0.97)	(1.53)	(1.72)	(1.09)
Center (Reference: Yaoundé)
Bertoua/Yaoundé	0.196	0.100	0.242
	(0.51)	(0.55)	(0.55)
Gardoua/Yaoundé	0.460	0.458	0.475
	(0.53)	(0.59)	(0.57)

*Treatment effect estimates in presence of a center effect. For each outcome category, the SP treatment was less efficacious than the AQ treatment.

The between center variability was

= 0.023 (95% credibility interval 0.001-0.107) for the SP/AQ treatment, and

= 0.020 (95% credibility interval 0.0001-0.024) for the AS+SP/AQ treatment. The assumption of proportional odds between treatments and centers was tested using the ML method by comparing the change in deviance of the various models (Table 4) to the chi-squared χ _1-α ² (2 df) which equals 5.99. The results indicate that the assumption was satisfactory.

Table 4

Test of the proportional odds between centers and treatments on the anti-malarial trial data set.

Tests	Model comparisons	ML results Change in deviance
Proportional odds	5 vs. 3	0.10 (2 d.f.)
between SP and AQ		p > 0.95
Proportional odds	4 vs. 3	2.24 (2 d.f.)
between AQ-SP and AQ		p > 0.32
Proportional odds	2 vs. 3	0.2 (2 d.f.)
between centers		p > 0.90

Results after covariates adjustment

Covariates known at the time of inclusion were the parasitaemia, the type of treatment, the gender, the patient's age, the bodyweight (kg), a previous treatment before the study enrollment, the haematocrit and the baseline body temperature. The patient's bodyweight was log-transformed; the initial parasitaemia counts were transformed to normality using a Box-Cox transformation (estimated power = 0.1028, p-value = 0.0056). The baseline haematocrit was categorized into two classes, below (A) and above (B) 25%. The patient's age was also categorized into 3 categories: i) less than 1 year old (A); ii) between 2 and 4 years old (B); iii) more than 5 years old (C).

First, a univariate analysis including each covariate of interest, in addition to the treatment covariates and the centre covariate was performed. Then only covariates with a p-value under 10% were selected for a multivariate analysis. Only the baseline temperature reached a statistical significance (Table 5). Multivariate analysis did not change the magnitude of the treatment effects.

Table 5

Effect of individual covariates on the ordinal outcome.

		Univariate			Multivariate
	Est	SD	Z-value	Est	SD	Z-value
Global covariates
- Treatment (Reference: AQ)
SP/AQ	-1.776	0.633	2.805	-1.638	0.566	2.893
AQ+SP/AQ	1.797	1.533	1.172	1.418	1.128	1.257
- Center (Reference: Yaoundé)
Bert/Ydé	0.100	0.550	0.181
Gar/Ydé	0.458	0.589	0.777
Individual covariates
- Baseline temperature*	-0.577	0.264	2.18	-0.614	0.266	2.308**
- Fever before inclusion	-0.003	0.070	0.05
- Parasitemia	-0.072	0.071	1.02
- Hematocrit Day 0	0.341	0.518	0.74
- Automedication Y/N	0.014	0.524	0.03
- Age B/A	0.391	0.511	0.77
- Age C/A	0.989	0.728	1.35
- Age (months)	0.010	0.012	0.87
- Gender M = 1/F = 0	0.279	0.468	0.60
- Bodyweights*	1.373	0.716	1.91	0.113	0.06	1.91

Univariate analysis of the individual covariate performed in presence of the treatment covariate.

*Only variable with a p-value below 10% were retained for the multivariate analysis. *: p < 0.05

As all the estimated intercept values were strictly positive, the assumption of a logistic distribution for the latent variable could be replaced with an extreme value distribution, using a model with a complementary log-log (cloglog) link function [2]. In Table 6, the corresponding results show that the intercept value-estimates were reduced as compared to the corresponding ones using the logistic distribution. However, the treatment parameter estimates did not change although the interpretation is not strictly the same. Indeed, as pointed out by Agresti [2], trying a complementary log-log link function is equivalent to fitting a proportional hazards model. Hence regarding the comparison of the SP treatment to the reference treatment AQ, the parameter e ^-0.502 = 0.605 (95% CI 0.44-0.82) is interpreted as a hazards ratio which is assumed constant regardless the response category. It suggests that the proportion of patients having positive response was more decreased with SP than with AQ. Between AQSP and AQ, the hazards ratio was 1.40 (95% CI 0.88-2.18), suggesting that there was no difference in efficacy.

Table 6

Model fitting with the complementary log-log link function and results comparisons.

	ML	ML	ML	ML
	Logit	Cloglog	Logit	Cloglog
Category cut-points
α ₁	3.850	1.297	25.980	8.201
	(0.63)	(0.16)	(10.65)	(3.54)
α ₂	4.237	1.431	26.39	8.346
	(0.65)	(0.17)	(10.66)	(3.54)
α ₃	4.380	1.478	26.540	8.401
	(0.6¬¬6)	(0.17)	(10.66)	(3.54)
Treatment (Reference AQ)
SP/AQ	-1.938	-0.524	-1.638	-0.502
	(0.63)	(0.16)	(0.57)	(0.16)
AQ+SP/AQ	0.537	0.348	1.416	0.329
	(0.97)	(0.24)	(1.13)	(0.23)
Center (Reference Yaoundé)
Bert/Ydé	0.196	-0.016
	(0.51)	(0.17)
Gar/Ydé	0.460	0.123
	(0.53)	(0.18)
Individual Covariate
Baseline temperature	-0.604	0.188
	(0.27)	(0.09)
Bodyweights	0.113	0.037
	(0.06)	(0.02)

Parameter estimates with the corresponding standard error estimates on the following line.

Discussion

The present work applied methods, initially presented in the context of a meta-analysis comparing 2 treatment effects with a categorical outcome, to the analysis of multi-center-antimalarial trials, comparing 3 treatments, with a 4-categorical primary outcome, using individual patient data. All the methods were implemented using free available softwares. Their performances were assessed using simulated data sets. Both a frequentist and Bayesian approaches were implemented. In the simulation settings, we considered a general case of a mixed effects model. The ML method was faster than the IGLS and GEE methods. All the methods produced minimal biases. Another R function can be used like lrm (Hmisc library using the library Design) which is more restricted at present in the choice of the link functions.

Our results from the multi-centre trial showed a significant decrease in efficacy in the sulfadoxine-pyrimethamine-arm as compared with the amodiaquine-arm. This means that there was less ACPR and more failures with SP. No significant difference was observed between amodiaquine and the combination AQ + SP. Similar results hold for both the frequentist and Bayesian approaches. The proportional odds assumption between treatments was not rejected. The proposed model can be a useful way when dealing with a small number of centers with more than 2 treatments.

Regarding the dependence between the outcome and the explanatory variables, a recent study [15] reported patient's age as a significant factor associated with antimalarial treatment failure, more specifically with artemisinin derivatives and quinine. Indeed, the study showed that children less than 5 years old had a significant risk of treatment failure as compared with children more than 5 years. In our analysis, no significant age effect was found, but our data concerned mostly children less than 5 years. Covariates, like haematocrit, gender, auto-medication before study enrollment, were not significant. In contrast, the baseline temperature was significantly associated with the outcome, showing that patients with a low temperature at inclusion were more likely to have a good treatment response. For the SP treatment, the decrease could be related to a gene mutation, responsible for a resistance towards SP [16–18]. The SP resistance was also confirmed in a recent study in South Africa [19]. The emergence of resistance led to the use of Artemisinin-based Combination Therapies (ACTs) which play an important role in the reduction of malaria transmission [20]. Thus, ACTs are widely used as first-line treatment of malaria in Africa [21–28].

The present work presented some statistical methods to handle the WHO criteria globally. They appear adapted for assessing antimalarial treatment in clinical trials, or in other studies with an ordinal outcome. It contrasts with previous methods [15], which reduced the outcome into a binary variable, for instance ACPR versus non ACPR. Only 3.5% were missing data. By eliminating drop-out or excluded patients in the final analysis, we assumed that they were missing completely at random (MCAR). Incorporating these into the analysis would require an imputation of the missing category. For such imputation, wide-range methods have been studied [29], but remain a topic to study in the case of malaria.

Other study designs are presently available in which patients have repeated standardized visits during their follow-up. Thus repeated categorical responses are available for each subject. All methods used in the case of a single categorical response, can however, be extended to repeated categorical responses [30].

Conclusion

The approach of modeling the WHO criterion as an ordinal criterion is innovative in the sense that, it gives a gain of information and precision on the estimate of the treatment effect using a global analysis of the four-category outcome instead of either comparing the rate of ACPR only, without being able to differentiate treatments when they present an identical percentages in the ACPR category but, different repartitions in the remaining three other categories, or repeating a similar binary analysis for each category, then exposing to the increase of the type-1 error. This analysis could help in avoiding a conclusion on an equal treatment effect whereas there is not or, vice-versa. In addition, this approach is able to take into account individual's covariates to improve the prediction of efficacy.

Abbreviations

OCEAC:: organisation de coordination pour la lutte contre les endémies en Afrique Centrale

IRD:: institut de recherche pour le développement

SP:: sulphadoxine-pyrimethamine

AQ:: amodiaquine.

Declarations

Acknowledgements

The authors thank OCEAC and IRD, for the use of the malaria data set. They would also like to thank Jean-Louis Foulley (INRA, Jouy en Josas, France), Chantal Guihenneuc (Paris Descartes), and Adeline Samson (Paris Descartes) for their advices in the choice of the prior distribution in the Bayesian analysis. The first author was supported in this work by an IRD (Institut de Recherche pour le Développement) doctoral Grant.

Electronic supplementary material

12874_2009_461_MOESM1_ESM.TXT Additional file 1: RUtilities. Some utility functions for the fixed effect model using R codes. (TXT 12 KB)

12874_2009_461_MOESM2_ESM.TXT Additional file 2: Data. The simulated data set on which we illustrated the different fixed effects methods. It contains 14 columns whose descriptions are detailed in the additional file 5. (TXT 14 KB)

12874_2009_461_MOESM3_ESM.TXT Additional file 3: MixedModelWinBUGSCode. WinBUGS code for the mixed effects model. To be run after having installed the WinBUGS 1.4 free software downloadable at http://www.mrc-bsu.cam.ac.uk/bugs/winbugs/contents.shtml. (TXT 6 KB)

12874_2009_461_MOESM4_ESM.TXT Additional file 4: FixedModelRCode. This file contains a code to estimate the different mixed effect models. They were run under the software R version 2.5. The order of execution is given in the corresponding file. (TXT 10 KB)

12874_2009_461_MOESM5_ESM.TXT Additional file 5: ExampleOutputFile. This file contains the description of the simulated data set. It provides some outputs of the programs written in the additional file 4. (TXT 8 KB)

Authors’ Affiliations

(1)

Université de Yaoundé I, Ecole Nationale Supérieure Polytechnique, Département de Mathématiques et Sciences Physiques, Yaounde, Cameroon

(2)

Université Paris Descartes, Laboratoire de Mathématiques Appliquées (MAP5), Unité Mixte de Recherche 8145, Centre National de la Recherche Scientifique, Paris, France

(3)

Université Aix-Marseilles 2, Unité de recherche sur les maladies infectieuses et tropicales émergentes (URMITE), Unité Mixte de Recherche 198-Institut de recherche pour le développement. Faculté de Médecine la Timone, Marseille, France

References

Agresti A: Categorical Data Analysis. 2002, New Jersey, Wiley, 2View ArticleGoogle Scholar
Liu I, Agresti A: The Analysis of Ordered Categorical Data: An Overview and a Survey of Recent Developments. Societas de Estadistica e Investigacion Operativa. 2005, 14: 1-73.Google Scholar
Harrell FE: Regression modeling strategies with applications to linear models, logistic regression, and survival analysis. 2001, New York, SpringerGoogle Scholar
Ryu E, Agresti A: Modeling and inference for an ordinal effect size measure. Statist Med. 2008, 27: 1703-1717. 10.1002/sim.3079.View ArticleGoogle Scholar
Whitehead A, Whitehead J: A general parametric approach to the meta-analysis of randomized clinical trials. Statist Med. 1991, 10: 1665-1677. 10.1002/sim.4780101105.View ArticleGoogle Scholar
Whitehead A, Jones NMB: A meta-analysis of clinical trials involving different classifications of response into ordered categories. Statist Med. 1994, 13: 2503-2515. 10.1002/sim.4780132313.View ArticleGoogle Scholar
Whitehead A, Omar RZ, Higgins JPT, Savaluny E, Turner RM, Thompson SG: Meta-analysis of ordinal outcomes using individual patient data. Statist Med. 2001, 20: 2243-2260. 10.1002/sim.919.View ArticleGoogle Scholar
Poon WY: A latent normal distribution model for analysing ordinal responses with applications in meta-analysis. Statist Med. 2004, 23: 2155-2172. 10.1002/sim.1814.View ArticleGoogle Scholar
World Health Organization: Assessment and monitoring of antimalarial drug efficacy for the treatment of uncomplicated falciparum malaria. 2003, Geneva: World Health Organization, WHO/HTM/RBM/2003.50Google Scholar
World Health Organization: Antimalarial Drug Combination Therapy. Report of a WHO Technical Consultation. 2001, Geneva: World Health Organization, WHO/CDS/RBM/2001.35Google Scholar
Whegang SY, Tahar R, Foumane VN, Soula G, Gwét H, Thalabard JC, Basco LK: Efficacy of non-artemisinin and artemisinin-based combination therapies for uncomplicated falciparum malaria in Cameroon. Malar J. 2010, 9: 56-10.1186/1475-2875-9-56.View ArticlePubMedPubMed CentralGoogle Scholar
McCullagh P: Regression models for ordinal data. J R Statist Soc. Series B. 1980, 42: 109-142.Google Scholar
Fahrmeir L, Tutz G: Multivariate statistical modeling based on generalized linear models. 2001, New York, Springer, 2View ArticleGoogle Scholar
Kim Williamson JM, Lyles CM: Sample-size calculations for studies with correlated ordinal outcomes. Statist Med. 2005, 24: 2977-2987. 10.1002/sim.2162.View ArticleGoogle Scholar
Adama Ishag, Elmardib Khalid, Malikb Elfatih: Predictors of antimalarial treatment failure in an area of unstable malaria transmission in eastern Sudan. Trans R Soc Trop Med Hyg. 2009, 103: 21-24. 10.1016/j.trstmh.2008.07.005.View ArticleGoogle Scholar
Basco LK: Molecular epidemiology of malaria in Cameroon. XIX. Quality of antimalarial drugs used for self-medication. Am J Trop Med Hyg. 2004, 70: 245-250.PubMedGoogle Scholar
Basco LK, Ngane VF, Ndounga M, Same-Ekobo A, Youmba JC, Abodo RT, Soula G: Molecular epidemiology of malaria in Cameroon. XXI. Baseline therapeutic efficacy of chloroquine, amodiaquine, and sulfadoxine-pyrimethamine monotherapies in children before national drug policy change. Am J Trop Med Hyg. 2006, 75: 388-395.PubMedGoogle Scholar
Basco LK: Molecular epidemiology of malaria in Cameroon. XXIII. Experimental studies on serum substitutes and alternative culture media for in vitro drug sensitivity assays using clinical isolates of Plasmodium falciparum. Am J Trop Med Hyg. 2006, 75: 777-782.PubMedGoogle Scholar
Karen Barnes, Little Francesca, Mabuza Aaron, Mngomezulu Nicros, Govere John, Durrheim David, Roper Cally, Watkins Bill, Nicholas White: Increased gametocytemia after treatment: an early parasitological indicator of emerging sulfadoxine-pyrimethamine resistance in falciparum malaria. J Infect Dis. 2008, 197: 1605-1613. 10.1086/587645.View ArticleGoogle Scholar
Okell LC, Drakeley CJ, Ghani AC, Bousema T, Sutherland CJ: Reduction of transmission from malaria patients by artemisinin combination therapies: a pooled analysis of six randomized trials. Malar J. 2008, 7: 125-10.1186/1475-2875-7-125.View ArticlePubMedPubMed CentralGoogle Scholar
Kayentao K, Maiga H, Newman RD, McMorrow ML, Hoppe A, Yattara O, Traore H, Kone Y, Guirou EA, Saye R, Traore B, Djimde A, Doumbo OK: Artemisinin-based combinations versus amodiaquine plus sulphadoxine-pyrimethamine for the treatment of uncomplicated malaria in Faladje, Mali. Malar J. 2009, 8: 5-10.1186/1475-2875-8-5.View ArticlePubMedPubMed CentralGoogle Scholar
Yeka A, Dorsey G, Kamya MR, Talisuna A, Lugemwa M, Rwakimari JB, Staedke SG, Rosenthal PJ, Wabwire-Mangen F, Bukirwa H: Artemether-lumefantrine versus dihydroartemisinin-piperaquine for treating uncomplicated malaria: a randomized trial to guide policy in Uganda. PLoS One. 2008, 3: e2390-10.1371/journal.pone.0002390.View ArticlePubMedPubMed CentralGoogle Scholar
Kabanywanyi AM, Mwita A, Sumari D, Mandike R, Mugittu K, Abdulla S: Efficacy and safety of artemisinin-based antimalarial in the treatment of uncomplicated malaria in children in southern Tanzania. Malar J. 2007, 6: 146-10.1186/1475-2875-6-146.View ArticlePubMedPubMed CentralGoogle Scholar
Van den Broek I, Kitz C, Al Attas S, Libama F, Balasegaram M, Guthmann JP: Efficacy of three artemisinin combination therapies for the treatment of uncomplicated Plasmodium falciparum malaria in the Republic of Congo. Malar J. 2006, 5: 113-10.1186/1475-2875-5-113.View ArticlePubMedPubMed CentralGoogle Scholar
Guthmann JP, Cohuet S, Rigutto C, Fortes F, Saraiva N, Kiguli J, Kyomuhendo J, Francis M, Noėl F, Mulemba M, Balkan S: High efficacy of two artemisinin-based combinations (artesunate + amodiaquine and artemether + lumefantrine) in Caala, Central Angola. Am J Trop Med Hyg. 2006, 75: 143-145.PubMedGoogle Scholar
Guthmann JP, Ampuero J, Fortes F, van Overmeir C, Gaboulaud V, Tobback S, Dunand J, Saraiva N, Gillet P, Franco J, Denoncin A, van Herp M, Balkan S, Dujardin JC, D'Alessandro U, Legros D: Antimalarial efficacy of chloroquine, amodiaquine, sulfadoxine-pyrimethamine, and the combinations of amodiaquine + artesunate and sulfadoxine-pyrimethamine + artesunate in Huambo and Bie provinces, central Angola. Trans R Soc Trop Med Hyg. 2005, 99: 485-492.View ArticlePubMedGoogle Scholar
Priotto G, Kabakyenga J, Pinoges L, Ruiz A, Eriksson T, Coussement F, Ngambe T, Taylor WR, Perea W, Guthmann JP, Olliaro P, Legros D: Artesunate and sulfadoxine-pyrimethamine combinations for the treatment of uncomplicated Plasmodium falciparum malaria in Uganda: a randomized, double-blind, placebo-controlled trial. Trans R Soc Trop Med Hyg. 2003, 97: 325-330. 10.1016/S0035-9203(03)90161-1.View ArticlePubMedGoogle Scholar
Adjuik M, Babiker A, Garner P, Olliaro P, Taylor W, White N: International Artemisinin Study Group. Artesunate combinations for treatment of malaria: meta-analysis. Lancet. 2004, 363: 9-17. 10.1016/S0140-6736(03)15162-8.View ArticlePubMedGoogle Scholar
Philipson PM, Ho WK, Henderson R: Comparative methods for handling drop-out in longitudinal studies. Statist Med. 2008, 27: 6276-6298. 10.1002/sim.3450.View ArticleGoogle Scholar
Parsons NR, Costa ML, Achten J, Stallard N: Repeated measures proportional odds logistic regression analysis of ordinal score data in the statistical software package R. Comput Stat Data Anal. 2009, 53: 632-641. 10.1016/j.csda.2008.08.004.View ArticleGoogle Scholar

Pre-publication history

The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/10/58/prepub

Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Analysis of an ordinal outcome in a multicentric randomized controlled trial: application to a 3- arm anti- malarial drug trial in Cameroon

Abstract

Background

Methods

Results

Conclusion

Keywords

Background

Methods

Statistical methods

The proportional odds model

Fixed effect model

Testing the proportional odds assumptions

Mixed effects model

Estimation methods

Simulations

Results

Simulated data set

Analysis of the Multi-centre trial

Results based on treatment and center effect only

Results after covariates adjustment

Discussion

Conclusion

Abbreviations

Declarations

Acknowledgements

Authors’ Affiliations

References

Pre-publication history

Copyright

BMC Medical Research Methodology

Contact us