Net benefit in the presence of correlated prioritized outcomes using generalized pairwise comparisons: A simulation study

Abstract

Background The prioritized net benefit (Delta) is a measure of the benefit-risk balance in clinical trials, based on generalized pairwise comparisons (GPC) using several prioritized outcomes. Its estimation requires the classification as Wins or Losses of all possible pairs of patients, one from the experimental treatment (E) group and one from the control treatment (C) group. In this simulation study, we assessed the impact of the correlation between prioritized outcomes on Delta, its estimate, bias, size, and power. Methods The theoretical Delta value was derived for the specific case of two correlated binary outcomes when a normal copula is used. Focusing on one efficacy and one toxicity outcome, two situations frequently met in practice were simulated: binary efficacy outcome with binary toxicity outcome, or time to event efficacy outcome with categorical toxicity outcome. Several scenarios of efficacy and toxicity were generated, with various levels of correlation. Results When E was more effective than C, positive correlations were mainly associated with a decrease in the proportion of Losses, while negative correlations were associated with a decrease in the proportion of Wins on the toxicity outcome. This resulted in an increase of (Delta) over cap with the intensity of the positive correlation without adding any bias. Results were similar whatever the type of outcomes generated but led to power alteration. Conclusion Correlations between outcomes analyzed with GPC led to substantial but predictable modifications of Delta and its estimate. Correlations should be taken into consideration when performing sample size estimations in clinical trials.