Comparative effectiveness research: what to do when experts disagree about risks

Reidar K. Lie, Francis K.L. Chan, Christine Grady, Vincent H. Ng, David Wendler

Ethical issues related to comparative effectiveness research, or research that compares existing standards of care, have recently received considerable attention. In this paper we focus on how Ethics Review Committees (ERCs) should evaluate the risks of comparative effectiveness research. We discuss what has been a prominent focus in the debate about comparative effectiveness research, namely that it is justified when "nothing is known" about the comparative effectiveness of the available alternatives. We argue that this focus may be misleading. Rather, we should focus on the fact that some experts believe that the evidence points in favor of one intervention, whereas other experts believe that the evidence favors the alternative(s). We will then introduce a case that illustrates this point, and based on that, discuss how ERCs should deal with such cases of expert disagreement. We argue that ERCs have a duty to assess the range of expert opinions and based on that assessment arrive at a risk judgment about the study under consideration. We also argue that assessment of expert disagreement is important for the assignment of risk level to a clinical trial: what is the basis for expert opinions, how strong is the evidence appealed to by various experts, and how can clinical trial monitoring affect the possible increased risk of clinical trial participation.