 Research
 Open access
 Published:
A Bayesian approach to pilotpivotal trials for bioequivalence assessment
BMC Medical Research Methodology volumeĀ 23, ArticleĀ number:Ā 301 (2023)
Abstract
Background
To demonstrate bioequivalence between two drug formulations, a pilot trial is often conducted prior to a pivotal trial to assess feasibility and gain preliminary information about the treatment effect. Due to the limited sample size, it is not recommended to perform significance tests at the conventional 5% level using pilot data to determine if a pivotal trial should take place. Whilst some authors suggest to relax the significance level, a Bayesian framework provides an alternative for informing the decisionmaking. Moreover, a Bayesian approach also readily permits possible incorporation of pilot data in priors for the parameters that underpin the pivotal trial.
Methods
We consider twosequence, twoperiod crossover designs that compare test (T) and reference (R) treatments. We propose a robust Bayesian hierarchical model, embedded with a scaling factor, to elicit a Go/NoGo decision using predictive probabilities. Following a Go decision, the final analysis to formally establish bioequivalence can leverage both the pilot and pivotal trial data jointly. A simulation study is performed to evaluate trial operating characteristics.
Results
Compared with conventional procedures, our proposed method improves the decisionmaking to correctly allocate a Go decision in scenarios of bioequivalence. By choosing an appropriate threshold, the probability of correctly (incorrectly) making a NoGo (Go) decision can be ensured at a desired target level. Using both pilot and pivotal trial data in the final analysis can result in a higher chance of declaring bioequivalence. The false positive rate can be maintained in situations when T and R are not bioequivalent.
Conclusions
The proposed methodology is novel and effective in different stages of bioequivalence assessment. It can greatly enhance the decisionmaking process in bioequivalence trials, particularly in situations with a small sample size.
Introduction
Bioequivalence studies aim to demonstrate if two pharmaceutical products, or two formulations of the same drug, provide similar levels of therapeutic activity [1]. Typically characterized by pharmacokinetic parameters, e.g., area under the plasma concentrationtime curve (AUC) or maximum concentration (C\(_\text {max}\)), bioequivalence rests on the extent to which the active ingredientās availability at the site of drug action and the absorption rate are equivalent. One main application of bioequivalence studies is in developing generic version(s) of a companyās brandname drug that has gone through largescale confirmatory trials. The generic substitution is expected to be commercially viable, because it does not have to repeat the complete and costly drug development process.
Regulatory agencies have now established guidelines [2, 3] to evaluate socalled average bioequivalence, population bioequivalence, and individual bioequivalence [4, 5]. This paper will concentrate on average bioequivalence, for which twotreatment, twoperiod, twosequence (\(2 \times 2\)) crossover designs are a common approach to study design. The two onesided test (TOST) procedure [6] has been widely applied for the analysis of such studies, owing to its simplicity. Specifically, the TOST features two composite null hypotheses (each set at level \(\alpha\)) for testing if the observed trial data are more extreme than two equivalence bounds, \(\Delta _{L}\) and \(\Delta _{U}\), respectively. When both null hypotheses are rejected, an overall significance level of \(\alpha\) for the bioequivalence test can be claimed. Alternatively, one may compute a conventional \((1  2\alpha ) \times 100\%\) confidence interval for the geometric mean ratio of the AUC and/or C\(_\text {max}\) of the test drug over its predecessor drug (i.e., a reference or registered drug), and see if it falls within a predefined bioequivalence range, i.e., \(\Delta _{L}\) and \(\Delta _{U}\) [7].
Bioequivalence pivotal trials typically entail a large enough sample size to ensure sufficient statistical power which allows for the detection of differences between the test and reference drugs. The FDA guidance outlines that the optimal sample size for a standard bioequivalence pivotal trial ranges from 24 to 36 subjects, with a minimum of 12 subjects required for each group [8]. For good practice, smallscale pilot studies are often conducted in clinical research to examine feasibility and gather information about the treatment effect before carrying out a fullscale pivotal trial [9]. This thinking also applies to bioequivalence assessment. That is, a pilot bioequivalence trial would often be run in a small number of volunteers (usually 812 subjects [10]) to improve, e.g., the blood sampling schedule, as well as to understand the pharmacokinetic profiles, intrasubject variability, etc. Potential interest in the preliminary evidence on bioequivalence, however, does not mean performing the TOST procedure at a conventional 5\(\%\) significance level is appropriate, as is for pivotal bioequivalence trials. Some research has investigated the type I error rate control [11, 12] or estimation of the intrasubject variability [13] to determine the optimal sample size for bioequivalence assessment, under twostage \(2 \times 2\) crossover designs involving an internal pilot. Pan et al. [14] proposed a Pilot Acceptance Range (PAR) method to preliminarily establish bioequivalence for subsequent confirmation in a pivotal trial. In particular, the PAR method expands the specific range, i.e., (\(\Delta _{L}\), \(\Delta _{U}\)) which is typically (80\(\%\), 125\(\%\)), to a wider interval by accounting for the intrasubject variability as estimated from the pilot trial data. When two formulations are bioequivalent, the PAR method has a higher chance of recommending the conduct of a pivotal bioequivalence trial than the TOST procedure or the confidence interval approach.
Whilst a large majority of available methods for bioequivalence assessment are in the frequentist paradigm, several Bayesian analysis strategies have been proposed. These include Grieve (1994) [15], Ghosh and Khattree (2003) [16], Ghosh and Gonen (2008) [17], and Schuirmann et al. (2019) [18], wherein the use of vague priors is commonplace. In addition, Bayesian inference may be preferred over frequentist methods for crossover trials when advanced sampling techniques are thought as useful to obtain the joint distribution of parameters. In recent years, other enhancements of Bayesian applications in the bioequivalence field have been published. For example, de Souza et al. [19] developed a Bayesian methodology for bioequivalence trials in which a normality assumption on the data is not a prerequisite. Advantages of using a heavilytailed distribution were further illustrated from a Bayesian perspective in the interest of handling outliers [20]. As far as we are aware, though, statistical literature in this field has been written vastly for analysing pivotal bioequivalence trials, whereas scant attention has been paid to decisionmaking using the pilot data.
In this paper, we propose a novel Bayesian decision framework involving a robust Bayesian mixedeffects model to inform whether to conduct a pivotal bioequivalence trial following a pilot evaluation. We assume both the pilot and pivotal trials are carried out under a \(2 \times 2\) crossover design. If continuing the assessment with a pivotal trial, the proposed Bayesian model is also capable of using all available data to establish average bioequivalence in a final analysis. The operating characteristics of the proposed methodology are evaluated in a comprehensive simulation study, as elaborated in the Results section. As motivation for our work, the Methods section in the following also contains a real pilot trial that aimed to preliminarily establish bioequivalence of two Pantoprazole tablets, a proton pump inhibitor for reducing gastric acid secretion.
Methods
Motivating example
A total of 12 healthy volunteers were enrolled to a pilot trial, using a \(2 \times 2\) crossover design, to preliminarily assess the bioequivalence of two formulations of Pantoprazole tablet 40 mg in China. The venous blood was collected at 16 time points in each period, namely, within 10 min before drug administration (0 h), 20 min, 40 min, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4, 5, 6, 8, 10, 12 and 16 h after treatment. In this study, AUC\(_\text {0t}\) (the area under the concentration time curve from time 0 to the last time observed) was used to represent AUC. The pharmacokinetic parameters AUC\(_\text {0t}\) and C\(_\text {max}\) were calculated by Phoenix WinNonlin software (version 7.0, Certara, Inc., Princeton, NJ, USA). An ANOVA test was performed for each pharmacokinetic parameter based on the Pantoprazole data with the key results listed in Supplement Table S1.
Due to data confidentiality, we simulated a pharmacokinetic dataset based on some summarised study characteristics instead of sharing the original data. The simulated pilot trial data was analysed using the TOST procedure with a \(90\%\) confidence interval (CI). The geometric mean ratios were 116.78\(\%\) (96.59\(\%\)  141.20%) for C\(_\text {max}\) and 105.13% (93.10%  118.72%) for AUC. Comparing the \(90\%\) CIs, with the conventional bioequivalence limits (i.e., 80\(\%\)  125\(\%\)), inference using C\(_\text {max}\) does not suggest preliminary bioequivalence in the pilot trial. The investigation would then be halted and no fullscale pivotal trial was to take place for formal bioequivalence assessment. By inspecting the subjectlevel data, we found that plasma concentrations of two subjects differed substantially from the others. The conclusion would change if the outliers are removed to mitigate the sampling error. With such an approach, the 90\(\%\) CI method suffers even more from the small sample size of the pilot trial.
The following two questions are raised:

i.
How should a \(2 \times 2\) crossover pilot trial be analysed to inform a Go/NoGo decision for a pivotal bioequivalence trial?

ii.
On the completion of the pivotal bioequivalence trial, is there scope for using pilot data, particularly in situations of data consistency?
A robust Bayesian mixedeffects model for pilotpivotal trials
Consider a \(2 \times 2\) crossover design for comparing a test drug (labelled T) with a reference drug (labelled R). Patients are randomised into two treatment sequence groups: the first sequence will administer T during the first period and R during the second period, while the second sequence will administer the same treatments in reverse order. FigureĀ 1 is a schema of such \(2 \times 2\) crossover trials. We assume a washout period is included, between the two treatment periods, that is sufficiently long and thorough so that there is no carryover effect across the periods.
We let \(Y_{ijk}\) be the continuous outcome, i.e., the logarithmic AUC or C\(_\text {max}\), measured from subject i in sequence j during the kth period, for \(i = 1, \dots , m_j\), \(j = 1, 2\), and \(k = 1, 2\). We define dummy variables \(P_j\) to indicate the period and \(X_{i[jk]}\) the treatment specific to the ith subject. Precisely, \(j \ne k\) specifies the administration of R whilst \(j = k\) specifies that of T by the design. We further stipulate that \(X_{i[jk]} = 0\) (for \(j\ne k\)) or 1 (for \(j=k\)); \(P_j = 0\) (for period 1) or 1 (for period 2). The following linear mixedeffects model has been widely considered to fit the trial data:
where \(\beta _{01}\) is an intercept term (i.e., the mean response on receiving R in period 1), \(\beta _{11}\) is a fixed period effect, and \(\theta _1\) is a fixed direct treatment effect specific to the pilot trial. This model also accommodates withinsubject random error and a betweensubject random effect, denoted by \(\sigma _w^2\) and \(\sigma _b^2\) respectively.
We now focus on the pivotal trial. Likewise, we let \(Y^{\star }_{ijk}\) denote the continuous outcome and \(\mu _{ijk}^\star\) the mean for subject i in sequence j during the kth period, where \(i = 1, \dots , n_j\), \(j = 1, 2\), and \(k = 1, 2\). Letting \(P_j^\star\) and \(X_{i[jk]}^\star\) denote the corresponding dummy variables, we fit the following data model
where \(\xi _w^2\) and \(\xi _b^2\) are the respective withinsubject and betweensubject variances, and \(\theta _2\) is a direct treatment effect specific to the pivotal trial.
We consider a metaanalytic framework [21] to accommodate both the pilot and pivotal data, by stipulating a Bayesian hierarchical randomeffects models. A predictive distribution can thus be obtained for \(\theta _2\) based on the pilot data, hereafter denoted by \(\varvec{Y}_p\). To relate the studyspecific treatment effects, a normalnormal hierarchical model assumes that \(\theta _1\) and \(\theta _2\) are exchangeable, i.e., random samples drawn from an underlying normal distribution with unknown mean \(\lambda\) and variance \(\tau ^2\). That is, \(\theta _1, \theta _2 \mid \lambda , \tau ^2 \sim N(\lambda , \tau ^2)\). The unknown population variance \(\tau ^2\) characterises the betweenstudy heterogeneity. A small value of \(\tau ^2\) suggests considerable data consistency, so pilot data can be used to a large extent to predict the bioequivalence in the pivotal trial. In light of possible data inconsistency, we follow Neuenschwander et al. [22] to consider a robust version of the normalnormal hierarchy for the parameter model
Model (3) comprises a robust component such that \(\theta _2\) could have its own \(N(m, s^2)\) prior. The prior variance \(s^2\) is often set to a large value, so that inference about \(\theta _2\) can utilize the pivotal data alone in situations of nonexchangeability. These prior probabilities reflect the level of confidence in data consistency a priori across the pilot and pivotal trials. More detail will be given in the next subsection about the specification of w at different stages of the bioequivalence assessment. Our Bayesian model is completed by specifying the hyperprior distributions:
where HN(c) denotes a halfnormal distribution. That is, a \(N(0, c^2)\) distribution truncated to positive real numbers only. In general, a and \(b^2\), are chosen to make the hyperprior weakly informative, while c chosen to capture the plausible degree of betweenstudy variability in terms of the treatment effects.
This robust Bayesian hierarchical model features a pair of prior probabilities of exchangeability and nonexchangeability, and thus accounts for situations where \(\theta _2\) is not exchangeable with \(\theta _1\). Setting w to a value close to 1 would mean high level of confidence in the relevance of the pilot trial and the data consistency. This robust model can also well accommodate situations of data inconsistency: if drastically different from the treatment effect based on pilot data, \(\theta _2\) can be estimated using the pivotal trial data alone under a weaklyinformative prior, \(N(m, s^2)\). A similar modelling strategy was adopted by Zheng et al. [23] to incorporate preclinical data from one or multiple animal species in the design and analysis of phase I doseescalation trials and later extended for situations when the phase I trial involves potentially heterogeneous patient subpopulations [24].
Recall that the data models (1) and (2) include covariates, that is, the treatment period. We do not consider exchangeability for the coefficients of the period effects, since it is more plausible that these may differ considerably between the pilot and pivotal bioequivalence trials. However, this could be an option for further research or considered as plausible in a context wherein the investigator has sufficient assurance. Vague priors are specified for these coefficients, as well as for the intercept terms, and within and betweensubject variances in each data model:
The established Bayesian hierarchical model leads to a predictive distribution for \(\theta _2\), denoted by \(p(\theta _2 \mid \varvec{Y}_p)\). It can be approximated by a mixture of two component distributions [21]. In what follows, we illustrate how this predictive distribution can be (i) used to yield a Go or NoGo decision for carrying out a pivotal bioequivalence trial, and (ii) updated by the pivotal trial data, denoted by \(\varvec{Y}^\star _p\), to a robust posterior distribution for the formal bioequivalence assessment. For probabilistic inference, one can sample the predictive distribution, \(p(\theta _2 \mid \varvec{Y}_p)\), as well as the posterior distribution, \(p(\theta _2 \mid \varvec{Y}_p, \varvec{Y}^\star _p)\), using Markov Chain Monte Carlo methods.
Bayesian decision criteria to establish bioequivalence in two steps
In line with the convention, we stipulate that a Go decision would be allocated on the basis of pilot data if the following criteria is met
and a NoGo decision otherwise. Here, \(\gamma\) is a scaling factor that should be set to a value not smaller than 1, and \(\eta\) is a probability threshold. With \(\gamma = 1\), this decision criterion becomes a Bayesian analogue to the conventional method of assessing bioequivalence. By contrast, \(\gamma > 1\) results in a wider interval than \((\Delta _L, \Delta _U)\) that is required by regulatory agencies, so the criterion is less stringent. The latter is particularly useful to establish preliminary bioequivalence based on pilot data alone.
The sample sizes for both the pilot and pivotal trials would typically be chosen before the conduct of either trial. More often than not, maximally 12 subjects are included in a pilot trial; whereas, the sample size for a pivotal trial is calculated formally to ensure a desired statistical power of the TOST procedure at a certain significance level. Such calculation relies on a plausible value for the withinsubject variance, rather than the estimate of \(\sigma _w^2\) based on the pilot data, unless the assumed value is found very unreasonable. Despite the potential utility of, and interest in, sample size (re)calculation, we consider this to be beyond the scope of this paper. In what follows, we concentrate on defining the scaling factor, \(\gamma\), given known sample sizes for the pilot and pivotal trials.
After the pilot data becomes available, a posterior for \(\theta _1\) can be obtained. Let an interval \((a, a +\ell _1)\) be symmetric about the posterior mean of \(\theta _1\). The halfwidth of the interval can be defined to retain a coverage probability of \((a, a +\ell _1)\) as \(100(12\alpha )\%\); that is, \(\ell _1/2 = z_\alpha \sigma _{\theta _1}\), where \(z_\alpha\) is the upper \(\alpha\)th quantile of the standard normal distribution and \(\sigma _{\theta _1}\) the posterior standard deviation of \(\theta _1\). Its counterpart in the pivotal trial is denoted by \(\ell _2/2 = z_\alpha \sigma _{\theta _2}\). The (half)width of the credible interval varies with the sample size, that is, a larger sample size yields narrower width of the interval. Following the notation defined in the last subsection, we denote the number of subjects by \(m_j\) for sequence \(j = 1, 2,\) in the pilot trial and likewise by \(n_j\) in the pivotal trial. Specifying the scaling factor as
can potentially account for the possible sampling error arising from the typically small sample size of the pilot trial. For the convention, by which \(m_j < n_j\) for \(j = 1, 2\), this stipulation leads to \(\gamma > 1\) and gives a relaxed condition for declaring preliminary bioequivalence. In the special case when the pilot trial has a sample size equivalent to that of the pivotal trial, \(\gamma = 1\) such that the same standard for a formal bioequivalence assessment applies.
We would like to add one more note on the specification of the prior mixture weight, as it affects the estimation of \(\theta _2\). A general recommendation would be setting w to a high value close to 1 for eliciting a Go/NoGo decision using the pilot data alone, yet to a low value such as 0.1 or 0.2 for the final analysis to formally establish the bioequivalence largely based on the pivotal trial data. This would then allow \(\varvec{Y}^\star _p\) to dominate the posterior distribution. Numerical exploration of various choice for w will be performed in the subsequent section. Finally, average bioequivalence can then be established, using all available data on the completion of a pivotal trial, if
Results
Simulation setup
In this section, we evaluate the operating characteristics of the proposed Bayesian hierarchical model in comparison with two alternative methods in the frequentist hypothesis testing framework.
Motivated by an analysis of the original Pantoprazole pilot trial (see Supplement Table S1 for the summary of results), we construct nine simulation scenarios in Supplement Table S2 that feature various geometric mean ratios (\({\text {GMR}} = \exp \left( \mu _{\textrm{T}}\right) / \exp \left( \mu _{\textrm{R}}\right)\)) for a wide range of direct treatment effects. Pilot data are generated according to these nine scenarios, assuming a total sample size of 12 throughout. In Scenarios 3 ā 7 (with 0.80 \(\le\) GMR \(\le\) 1.25), the two formulations T and R are bioequivalent. Accordingly, it would thus be desirable to yield a Go decision for conducting the subsequent pivotal trial. By contrast, a NoGo decision would be expected in the other scenarios.
In addition, it is of interest to understand how the proposed methodology reacts to potential data (in)consistency across the pilot and pivotal trials. We performed additional simulations of pivotal trial data under five bioequivalent cases (labelled AE, with GMR = 0.8, 0.9, 1.0, 1.1, 1.25) and four inequivalent cases (with GMR = 0.5, 0.7, 1.43, 2.0). All scenarios assumed a total sample size of 24. After a Go decision is allocated following the pilot trial, the pivotal trial will be undertaken. To formally establish bioequivalence using both pilot and pivotal trial data, we utilized the perfect bioequivalence scenario of the pilot trial, which had a GMR of 1.0. The power of the bioequivalence assessment was estimated in simulations where treatment effects were consistent between the pilot (GMR = 1.0) and pivotal trials (0.80 \(\le\) GMR \(\le\) 1.25). Conversely, the probability of incorrectly declaring bioequivalence was estimated in simulations with inconsistent treatment effects between the pilot (GMR = 1.0) and pivotal trials (GMR \(< 0.80\) or \(> 1.25\)).
Per simulation scenario and per case of data (in)consistency, a total of 10,000 replicates are simulated for the pilot and pivotal trials.
Simulation results
In this simulation study, the withinsubject variance \(\sigma _w^2\) is higher in C\(_\text {max}\) (23.7%) than AUC (12.2%) , as Table S1 shows.
Focusing on the analysis of pilot data first. The computed probability of a correct Go can be regarded as a sensitivity measure, while the probability of correct a NoGo can be regarded as the specificity in the analogue of terms typically used when evaluating a diagnostic test. TableĀ 1 shows the probability of making a Go decision towards a subsequent pivotal trial by the conventional CI method (for \(\alpha = 0.05\), 0.1 and 0.2) and the PAR method. Details on these conventional approaches is given in Appendix I. Not surprisingly, the conventional CI method (\(\alpha = 0.05\) and 0.1) gives overly conservative results for a NoGo decision in Scenarios 37, where preliminary bioequivalence should be suggested. By contrast, the PAR method yields a higher the probability of a Go by accounting for varying extents of the intrasubject variance. The advantage of the PAR method manifests, as compared with the CI method (\(\alpha = 0.05\) and 0.1), especially when the pilot trial has a small sample size and/or the data within the trial has large variability. For example, it increases from 31.19% or 56.28% by the CI method (corresponding to \(\alpha = 0.05\) or 0.1, respectively) but to 76.41% by the PAR method in Scenario 5 for C\(_\text {max}\); whereas the increase appears more marginal for AUC, given the much smaller withinpatient variability. The probability using the CI method (\(\alpha\) = 0.2) is slightly higher compared to the PAR method, with the difference within 5%. In the evaluation of our proposed Bayesian method below, we report the simulation results for both C\(_\text {max}\) and AUC to understand the operating characteristics dependence on the level of variability.
We implement the proposed method with two configurations of the probability threshold and the prior mixture weight, i.e., (i) \(\eta = 0.85\), \(w = 0.9\), and (ii) \(\eta = 0.95\), \(w = 1.0\). As TableĀ 1 illustrates, our Bayesian method outperforms both the CI method and the PAR method. In Scenarios 4  6, the probability of a Go decision is 62.75%, 81.90%, and 64.61%, respectively (under the configuration of \(\eta = 0.85\), \(w = 0.9\)). This becomes 78.48%, 92.88%, 80.91%, when \(\eta = 0.85\) and \(w = 1.0\). In comparison with the PAR method, which yields 55.44%, 76.41% and 58.89% in scenarios 46, and the CI method (\(\alpha\) = 0.2), which yields 59.70%, 79.67% and 62.38% in the same scenarios. By contrast, the proposed method improves upon the decision making to correctly allocate a Go decision in scenarios of bioequivalence and not to allocate a Go otherwise. The probability of a Go decision decreases to 58.14%, 78.13%, 59.66%, when \(\eta\) is raised to 0.95 alongside a full prior mixture weight, \(w = 1.0\). The choice of \(\eta\) will evidently impact the likelihood of making a Go decision. If \(\eta\) is calibrated to a lower value whilst retaining all other parameters, the probability of a Go decision increases. Accordingly, the proposed method could have performed far superior to the conventional approaches with a lower threshold in this simulation study. It is nonetheless worth noting that the probability of an incorrect Go decision would be higher. The proposed method may yield high probability of bioequivalence for borderline values of 0.8 or 1.25, if not coupled with a stringent threshold, leading to an increased likelihood of conducting a pivotal study. In contrast, the CI method adheres to the \(\alpha\) level.
In practice, we recommend investigators perform extensive simulations to understand how the operating characteristics would be modified by \(\eta\) so as to choose an appropriate value. To illustrate how this could be achieved, we expand the simulation study to quantify the likelihood of Go/NoGo decisions under various configurations of \(\eta\). FigureĀ 2 visualises the probability of a Go decision towards a pivotal trial, setting \(\eta = 0.85\), 0.86, 0.87, together with \(w = 0.9\), for the simulated C\(_\text {max}\) and AUC data. As one may observe, the lines cannot be disengaged in the inequivalent scenarios (i.e., when GMR = 0.5, 0.7, 1.43, 2.0). The differences eventually become observable, that is, the proposed Bayesian model surpasses the conventional methods in the bioequivalent scenarios (i.e., when GMR = 0.8, 0.9, 1.0, 1.1, 1.25). Here we have presented results by setting \(\eta\) to a value ranging from 0.85 to 0.87. The PAR method has comparable performance to the proposed method with \(\eta = 0.87\), whilst it becomes marginally inferior to our method when \(\eta = 0.85\) and 0.86. Although not shown in Fig.Ā 2, our method gains a higher chance of a correct Go decision if the value for \(\eta\) is further decreased. The user is thus recommended to adopt our method with the decision threshold set to be 0.85 at maximum in this illustration. More simulations have been performed for configurations of \(w = 0.8\) and \(w = 1.0\), as shown in Figs. S1āS2, to find an appropriate decision threshold that ensures the benefit of our proposed method.
FigureĀ 3 summarises the percentages of correct Go or correct NoGo decisions for the simulated pilot studies under the configuration with \(w = 0.9\). The proposed method (āadjustedā) specifies \(\gamma = 1\) following EquationĀ (7) and the āunadjustedā method specifies \(\gamma > 1\). The correct Go percentage can be resembles the frequentist power, while the correct NoGo percentage related to the frequentist type I error rate (specifically, 1  \(\alpha\)). For both metrics higher values are better. On the logscale, the results of CI, PAR and the proposed Bayesian models are symmetric around 0 in bioequivalence assessments. Furthermore, the results of the GMR, i.e. 0.8 and 1.25, 0.7 and 1.43, 0.9 and 1.11, are congruent. To enhance the figuresā legibility, we solely showcase the faceted plots for the GMR \(\le\) 1 in Figs.Ā 3 and S3. In Scenarios 3  7, the bioequivalent scenarios, the percentage of a correct Go decision declines as \(\eta\) increases. This ties well with our finding elaborated earlier. In Fig.Ā 3, panels (a) and (c) show that the correct Go decision rates of the proposed method (adjusted) exceed those of the CI and PAR methods in all scenarios for both C\(_\text {max}\) and AUC data. On the contrary, in the other biologically inequivalent scenarios, the percentage of correct NoGo decisions ascends as \(\eta\) increases, since a high value of \(\eta\) makes declaring bioequivalence harder (see Fig.Ā 3 (b) and (d)). Combining the results from panels (a) and (b), one may consider setting \(\eta = 0.8\) in the proposed method (adjusted) because this yields a high chance of 90.36% to give a correct Go decision under Sscenario 5 (i.e., GMR = 1.0) for C\(_\text {max}\), which drops to 81.9% by setting \(\eta = 0.85\), as reported in TableĀ 1 and Fig.Ā 2. The correct NoGo decision rate of the proposed models reaches 100% in scenarios with GMR = 0.5 and 2.0, which is the same as the CI and PAR methods. In the scenarios with GMR = 0.7 and 1.43, looking across Fig.Ā 3 (b) and (d), setting \(\eta\) to surpass 0.7 for C\(_\text {max}\) and 0.5 for AUC means that the 1  \(\alpha\) of the proposed method (adjusted) exceeds 90%. The proposed method thus works extremely well to render correct Go and NoGo decisions, with \(\eta\) set to an appropriate value following this pragmatic approach. More simulations have been performed under a different configuration of the prior mixture weight, with the results reported in Fig. S3.
We now carry on to interpret the results from our expanded simulation study that generates pivotal data following a Go decision given to the pilot trial under Scenario 5 (GMR = 1.0). The CI method is implemented using the pivotal data only. This is in contrast to implementing the proposed method that enables potential incorporation of pilot data in the final analysis on the completion of the pivotal trial. Here, we have assumed total 24 subjects would be enrolled. TableĀ 2 displays the probability of declaring bioequivalence following the pivotal trial. Four options for specifying w are considered for illustration, that is, prior ambivalence (\(w = 0.5\)), low prior confidence (\(w = 0.2\)), minimal prior confidence (\(w = 0.1\)) in the exchangeability assumption, and no borrowing from pilot data permitted (\(w = 0\)). In all cases, we set \(\eta = 0.75\), and the criterion in the form of EquationĀ (8) is applied for the formal bioequivalence assessment. As TableĀ 2 reveals, the proposed method enhances the chance of declaring bioequivalence substantially by incorporating the pilot data, as compared to the conventional CI method. Even if no borrowing from pilot data is permitted, the proposed method has around a 16% higher chance for the declaration for C\(_\text {max}\), when the pivotal trial would suggest the two formulations are just bioequivalent (i.e., the borderline Cases A and E). In Case C (with GMR = 1.0), the probability of bioequivalence for C\(_\text {max}\) almost reached 100%, for any level of prior confidence in the exchangeability assumption, whilst the CI method yields only 81.64%. Impressive operating characteristics are also observed for Cases B (GMR = 0.9) and D (GMR = 1.1): examining the C\(_\text {max}\) data, for example, the proposed models provides at least 82.93%, compared to the CI method with only around 47.4751.84%.
The effects of various configurations of \(\eta\) and w on C\(_\text {max}\) and AUC for bioequivalence evaluation can be found in Figs.Ā 4 and S4. Across various values set for \(\eta\), the probability of establishing average bioequivalence using the proposed method is higher than the conventional CI method in all truly equivalent scenarios. Finally, TableĀ 3 reports the false positive rate of the analysis when the pivotal trial discloses inequivalence, in conflict to what the pilot data implies: as \(\eta\) increases, the proposed method can maintain the probability of incorrectly declaring bioequivalence more effectively. This is applicable also for the boardline cases wherein the GMR = 0.8 or 1.25. For a strict control of false positive rate to be below 5%, practitioners may consider setting \(\eta > 0.9\) as used in this illustration. On the other hand, when the prior mixture weight w deviates much from 1, it becomes more challenging to maintain the error rate due to the incorporation of overly optimistic pilot data suggesting bioequivalence. This suggests the proposed method can quickly discount inconsistent pilot data in the final analysis especially when \(\eta\) and w can be set to values that are reasonably correct.
Revisiting the Pantoprazole pilot trial
We now return to the motivating trial, and use our proposed Bayesian decision framework to analyse one simulated dataset of this study. We set \(w = 0.9\) so that pilot data can be largely used to elicit a decision of Go or NoGo. The posterior means of \(\theta _2\), with a 90\(\%\) credible interval, are 0.1721 (0.1131, 0.4507) and 0.0772 (0.1332, 0.2776) obtained based on the C\(_\text {max}\) and AUC measurements. See TableĀ 4 for more summaries about the inference. Accordingly, \(\exp \left( \theta _{2}\right)\) is 118.78% (89.31%, 156.94%) for C\(_\text {max}\) and 108.03% (87.53%, 132.00%) for AUC, respectively. These contrast with the results of the conventional CI method, reported as 116.78% (with a 90% CI: 96.59%  141.20%) for C\(_\text {max}\) and 105.13% (93.10%  118.72%) for AUC. The predictive probabilities of bioequivalence (thus with a Go decision assigned) are 68.1% and 90.0% using C\(_\text {max}\) and AUC data, respectively. Furthermore, after the equivalence boundaries are modified by applying the scaling factor in the form of (7), the predictive probability of bioequivalence climbs to 83.1% for C\(_\text {max}\) measurements. Note that the withinsubject variance of C\(_\text {max}\) is higher than AUC (i.e., 23.7% versus 12.2%), which justifies the wider confidence interval yielded by the CI method for the latter. Be that as it may, the degree of variance is acceptable in practice as it is still below the regulatory guidelineās threshold of high withinsubject variability of 30% [25]. In this retrospective analysis, the proposed robust Bayesian model results in a higher chance to recommend a subsequent pivotal trial be conducted, unlike the conventional CI method that suffers severely from the data sparsity problem.
Discussion
Bayesian statistics offers an attractive alternative to classical approaches for prediction and estimation. It has also been widely recognised as advantageous in using relevant information from historical studies for more informed analysis within a solid decisiontheoretical framework. In this paper, we have established a robust Bayesian hierarchical model that accommodates the respective linear mixedeffects models fitted to the pilot and pivotal trials for bioequivalence assessment. Moreover, our novel Bayesian decision criteria are shown to be effective in both graduating a pilot study that suggests genuine bioequivalence with a Go decision and leveraging consistent, as well as discounting inconsistent, pilot data in the final analysis of the pivotal trial. We recommend including a nonexchangeability distribution to relate the studyspecific direct treatment effects for robust inferences. Specification of the prior mixture weight, w, reflects skepticism about the plausibility of an exchangeability assumption, which may be set to a value close to 1 for obtaining a Go/NoGo decision after the pilot trial, but a lower value in the final analysis. The proposed Bayesian decision framework has novelty in the inclusion of a scaling factor, \(\gamma\), which is defined based on the study sample sizes and intrasubject variations. This particularly benefits the inference about whether a pivotal trial should be undertaken.
Bayesian metaanalytic approaches have been considered to borrow historical data in phase I [23, 24] and phase II [21, 26] clinical trials. As far as we are aware, this paper represents a very first proposal to using pilot data in the pivotal trial with a crossover design to evaluate bioequivalence. Our methodology can potentially replace the TOST procedure, which is constrained by the limited sample sizes [10], in the inference of pilot trial data alone, or of both pilot and pivotal trial data. Revisiting the Pantoprazole pilot trial, the proposed Bayesian method would have led to a Go decision whilst a NoGo decision was made based on the TOST procedure. The simulation results have also affirmed the superiority of our model as compared to the traditional methods and one modified version, the PAR method. Surprisingly, no simulation study was performed when the PAR method was proposed [14]. The simulation study in our paper thus also fills this gap in the literature and further guides the specification of \(\eta\) for desired trial operating characteristics.
We acknowledge that the TOST method, when implemented with a higher significance level, can yield desirable operating characteristics that are comparable to the proposed Bayesian model. However, determining the significance level to ensure the performance poses a challenging decision. This approach can be further limited under small sample sizes that yield low estimation accuracy. In contrast, the proposed Bayesian approach provides the ability to elicit a Go/NoGo decision as well as to analyze data from both trials. The specification of key parameters, such as w and \(\eta\), is more naturally aligned with the intuition. Our simulation study suggests that the proposed methodology is moderately robust to data inconsistency between pilot and pivotal trials. When the chosen values deviate too far from the truth, it may experience difficulty in maintaining the false positive rate in the final analysis. To enable more effective down weighting of inconsistent pilot data, one may consider transforming the pivotal trial in a two or multistage manner. More specifically, investigators may specify w based on the best guess to initiate the pivotal trial, but reestimate the value at interim analyses for satisfactory operating characteristics in the final analysis [24].
The sample size of 12 subjects in a pilot trial for bioequivalence assessment has been regarded as the ruleofthumb in practice [27]. Nevertheless, different countries have different sample size requirements. For instance, the sample size in the United States is 1236 cases [8], but in Europe it is at least 12 [3]. In our simulation study the pivotal trial has a sample size of 24, which is in line with Chinese guidelines for bioavailability and bioequivalence studies [28]. In this work, we have defined the scaling factor, \(\gamma\), through the respective sample sizes in the pilot and pivotal trials. One area that deserves further research is sample size determination for a pivotal trial that uses available pilot data. On the other hand, the pivotal trial has been supposed to have a fixedsample design. Further efficiency could be leveraged by considering adaptive designs that enables, e.g., early stopping and/or sample size reestimation, at the interim. This is also an area where our future research looks towards.
Conclusion
In conclusion, we have proposed a robust Bayesian metaanalytic approach that facilitates the integration of pilot bioequivalence data. The proposed Bayesian methodology is novel and effective in different stages of bioequivalence assessment. It can greatly enhance the decisionmaking process in bioequivalence trials at various stages, and would be useful to the pharmaceutical industry and regulators.
Availability of data and materials
All data and programming code during the current study are available at the GitHub repository: https://github.com/yddrz/BEBayesianapproachtopilotpivotaltrials.
Abbreviations
 AUC:

Area under the plasma concentrationtime curve
 CI:

Confidence interval
 GMR:

Geometric mean ratios
 Cmax:

Maximum concentration
 PAR:

Pilot Acceptance Range
 TOST:

Two onesided test
References
Food and Drug Administration, Washington, DC. Guidance for industry, bioavailability and bioequivalence studies submitted in NDAs or INDs  general considerations. 2014. https://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM389370.pdf. Accessed 26 Oct 2022.
Food and Drug Administration, Washington, DC. FDA Guidance for Industry, Statistical Approaches to Establishing Bioequivalence. 2001. https://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM070244.pdf. Accessed 26 Oct 2022.
European Medicines Agency. Guideline on the investigation of bioequivalence. 2010. https://www.ema.europa.eu/en/documents/scientificguideline/guidelineinvestigationbioequivalencerev1_en.pdf. Accessed 26 Oct 2022.
Food and Drug Administration, Washington, DC. Statistical Approaches to Establishing Bioequivalence. 1999. https://www.fda.gov/media/70958/download. Accessed 26 Oct 2022.
Mandallaz D, Mau J. Comparison of different methods for decisionmaking in bioequivalence assessment. Biometrics. 1981;37(2):213ā22.
Schuirmann DJ. A comparison of the two onesided tests procedure and the power approach for assessing the equivalence of average bioavailability. J Pharmacokinet Biopharm. 1987;15(6):657ā80.
Chow SC. Bioavailability and bioequivalence in drug development. Wiley Interdiscip Rev Comput Stat. 2014;6(4):304ā12.
FDA. Guidance for industry: bioavailability and bioequivalence studies for orally administered drug productsgeneral considerations. Washington, DC: Food and Drug Administration; 2003.
Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10(1):1ā10.
Wang Y, Zhou S. Pilot trial for the assessment of relative bioavailability in generic drug product development: statistical power. J Biopharm Stat. 1999;9(1):179ā87.
Maurer W, Jones B, Chen Y. Controlling the type I error rate in twostage sequential adaptive designs when testing for average bioequivalence. Stat Med. 2018;37(10):1587ā607.
Molins E, Labes D, SchĆ¼tz H, Cobo E, OcaĆ±a J. An iterative method to protect the type I error rate in bioequivalence studies under twostage adaptive 2Ć2 crossover designs. Biom J. 2021;63(1):122ā33.
Rasmussen HE, Ma R, Wang JJ. Controlling type 1 error rate for sequential, bioequivalence studies with crossover designs. Pharm Stat. 2019;18(1):96ā105.
Pan G, Wang Y. Average bioequivalence evaluation: general methods for pilot trials. J Biopharm Stat. 2006;16(2):207ā25.
Grieve AP. Bayesian analyses of twotreatment crossover studies. Stat Methods Med Res. 1994;3(4):407ā29.
Ghosh P, Khattree R. Bayesian approach to average bioequivalence using Bayesā factor. J Biopharm Stat. 2003;13(4):719ā34.
Ghosh P, GĆ¶nen M. Bayesian modeling of multivariate average bioequivalence. Stat Med. 2008;27(13):2402ā19.
Schuirmann DJ, Grosser S, Chattopadhyay S, Chow SC. On Bayesian Analysis and Hypothesis Testing in the Determination of Bioequivalence. Clin Pharmacol Ther. 2019;105(2):304ā6.
de Souza RM, Achcar JA, Martinez EZ, Mazucheli J. The use of asymmetric distributions in average bioequivalence. Stat Med. 2016;35(15):2525ā42.
Burger DA, Schall R, van der Merwe S. A robust method for the assessment of average bioequivalence in the presence of outliers and skewness. Pharm Res. 2021;38(10):1697ā709.
Schmidli H, Gsteiger S, Roychoudhury S, OāHagan A, Spiegelhalter D, Neuenschwander B. Robust metaanalyticpredictive priors in clinical trials with historical control information. Biometrics. 2014;70(4):1023ā32.
Neuenschwander B, Matano A, Tang Z, Roychoudhury S, Wandel S, Bailey S. A Bayesian industry approach to phase I combination trials in oncology. In: Zhao W, Yang H, editors. Statistical Methods in Drug Combination Studies. New York: Chapman & Hall/CRC Biostatistics Series; 2014.
Zheng H, Hampson LV, Wandel S. A robust Bayesian metaanalytic approach to incorporate animal data into phase I oncology trials. Stat Methods Med Res. 2020;29(1):94ā110.
Zheng H, Hampson LV, Jaki T. Bridging across patient subgroups in phase I oncology trials that incorporate animal data. Stat Methods Med Res. 2021;30(4):1057ā71.
Midha K, Rawson M, Hubbard J. The bioequivalence of highly variable drugs and drug products. Int J Clin Pharmacol Ther. 2005;43(10):485ā98.
Neuenschwander B, Wandel S, Roychoudhury S, Bailey S. Robust exchangeability designs for early phase clinical trials with multiple strata. Pharm Stat. 2016;15(2):123ā34.
Julious SA. Sample size of 12 per group rule of thumb for a pilot study. Pharm Stat J Appl Stat Pharm Ind. 2005;4(4):287ā91.
National Medical Products Administration. Technical guidelines for the study of human bioavailability and bioequivalence of chemical pharmaceutical preparations. 2005. https://www.nmpa.gov.cn/wwwroot/gsz05106/08.pdf. Accessed 25 Oct 2022.
Acknowledgements
Not applicable.
Funding
Dr Zhengās contribution to this manuscript was supported by Cancer Research UK (RCCPDF\(\backslash\)100008). The funding body played no role in the design of the study and collection, analysis, interpretation of data, and in writing the manuscript.
Author information
Authors and Affiliations
Contributions
HZ and DL conceived the idea and set up the project for this article. DL, MJG and HZ developed the methodology. DL simulated and analyzed the data. XZ and DL visualised the results. All authors contributed to interpretation of the results. DL drafted the article. HZ and MJG commented and revised the article. DL, HZ, MJG and QWZ contributed to the revision. All authors reviewed and approved the submitted version.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was performed in accordance with the Declaration of Helsinki and approved by the Ethics Committee of the First Affiliated Hospital of Zhejiang University School of Medicine: Expedition review No. 633 in 2022. Due to the dataset of this retrospective study was simulated based on summarised study characteristics instead of sharing the original data. Informed consent for subjects was waived by the Ethics Committee of the First Affiliated Hospital of Zhejiang University School of Medicine. All methods were performed in accordance with relevant guidelines and regulations.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisherās Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Lv, D., Grayling, M., Zhang, X. et al. A Bayesian approach to pilotpivotal trials for bioequivalence assessment. BMC Med Res Methodol 23, 301 (2023). https://doi.org/10.1186/s12874023021202
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12874023021202