pmc logo imageJournal ListSearchpmc logo image
Logo of bmjBMJ helping doctors make better decisionsSearchLatest content
BMJ. 2003 November 29; 327(7426): 1280–1282.
doi: 10.1136/bmj.327.7426.1280.
PMCID: PMC286254
Ethical problems of evaluating a new treatment for melioidosis
Allen C Cheng, infectious diseases physician,1 Michael Lowe, general physician,2 Dianne P Stephens, director,3 and Bart J Currie, professor in medicine1
1 Menzies School of Health Research and Northern Territory Clinical School, Flinders University, PO Box 41096, Casuarina NT 0811, Darwin, Australia
2 Division of Medicine, Royal Darwin Hospital, Tiwi NT 0811, Darwin, Australia
3 Intensive Care Unit, Royal Darwin Hospital
Correspondence to A C Cheng allenc/at/menzies.edu.au
Accepted September 11, 2003.
Short abstract
When mortality from melioidosis fell sharply after multiple changes in management at an Australian hospital, doctors wanted to identify whether a new drug was responsible. But designing a trial that was ethically acceptable proved impossible
 
Effective treatment of patients requires that is based on the best available evidence, ideally a randomised controlled trial. However, when observational evidence suggests that a treatment has a large benefit, the potential risks to participants make a randomised trial hard to justify. We had to abandon a trial to evaluate the use of granulocyte-colony stimulating factor (G-CSF) in patients with melioidosis in septic shock because we were unable to balance the risks to patients against the scientific uncertainty. This article describes the problems experienced and considers other methods of obtaining good evidence.
Our problem

Melioidosis, the infection caused by Burkholderia pseudomallei, is endemic in South East Asia1 and is the commonest cause of death from bacteraemic pneumonia in the Northern Territory of Australia.2 Patients with severe infection present with septic shock, a condition associated with a high mortality. The Royal Darwin Hospital has treated 341 patients with culture confirmed melioidosis over 13 years, with an overall 18% mortality. Forty two of these patients presented with severe sepsis.

In 1998, the hospital decided to start treating patients with melioidosis and septic shock with granulocyte-colony stimulating factor (G-CSF). The decision was based on the evidence available at that time (box). G-CSF was introduced at the same time as the hospital appointed a specialist in intensive care medicine. Previously, anaesthetists had supervised the unit, and the appointment resulted in appreciable changes to management protocols, including the more aggressive use of haemodynamic monitoring, empiric antibiotic protocols, the adoption of a closed intensive care model, and early enteric feeding.

Mortality from severe melioidosis fell from 95% (20 of 21 patients) to 10% (2 of 21 patients) (P < 0.001, Fisher's exact test).10 A more modest reduction also occurred in mortality from septic shock due to other pathogens.10 The fall in mortality was particularly surprising because newly published data suggested that G-CSF was of little benefit in non-neutropenic infection.8,11,12

Proposed trial

A trial was proposed to determine whether the fall in mortality from severe melioidosis was due to G-CSF or other management changes. We planned to randomise eligible patients to either G-CSF or placebo and assess the end points of death from any cause or deterioration to catecholamine resistant shock. Patients who declined to participate in the study would be treated with the usual protocol, which included routine use of G-CSF. However, it was clear from the outset that the study posed ethical problems.

Requirement for clinical, personal, and patient equipoise

Discussions of the ethics of randomised controlled trials emphasise the need for equipoise to exist before a trial can proceed. Equipoise has three components: clinical, personal, and patient. Clinical equipoise is usually taken to mean that uncertainty exists about the research question among researchers or the expert community as a whole. In this case the medical community disagreed about the value of G-CSF. This could be seen as evidence that a trial of G-CSF in severe melioidosis was both necessary and ethically justifiable.

Figure 1Figure 1
B pseudomallei—the bacteria that causes melioidosis

Rationale for treatment with G-CSF

  • B pseudomallei had been shown to survive and multiply within cells, including neutrophils
  • Coexisting conditions associated with mortality from and development of melioidosis (including diabetes, chronic renal failure, and alcohol misuse) were also associated with functional neutrophil defects
  • G-CSF factor had been shown to improve outcomes from sepsis in animal models and neutrophil function in vitro
  • A large multicentre trial had found G-CSF benefited patients with multilobar pneumonia
  • G-CSF had been shown to be generally well tolerated and had been extensively used to treat neutropenia

Although clinical equipoise was present, many local experts were uneasy about their personal equipoise and that of their patients. They felt that the risks to patients of forgoing G-CSF were too great. Randomised controlled trials are mostly advocated in situations where only a moderate or small effect is expected rather than the large effect that was possible in this case. Peto et al suggest that in these circumstances randomised trials may be unnecessary.13 For example, treatment of syphilis with penicillin has never been tested in a randomised controlled trial, but trials involving withdrawal of penicillin are rightly regarded as unethical.

In 1991, Royall et al attempted to deal with this issue by distinguishing truly experimental trials from unethical demonstration trials that are designed to show the superiority of already successful treatments more convincingly.14 Our situation shows the difficulties with this concept—does our potentially confounded series constitute sufficient evidence of effectiveness?

Traditionally, equipoise has been viewed from the paternalistic viewpoint of the medical community. However, awareness is growing of the need to consider the perspective of patients and the wider community (see bmj.com). For example, Brody has argued that patient equipoise is present if “a reasonable person of an average degree of altruism and risk adversiveness might consent to being randomised.” This is analogous to clinical equipoise being determined by the normative judgment of a community of physicians.15

In our case, information about the apparent value of G-CSF was already well known within the community. A local newspaper had described it as a “wonder drug.”16 It is difficult to see how our survival statistics (95% v 10% mortality) would lead anybody other than the most extreme altruist to agree to participate in the proposed trial, no matter what the experts thought.

How can the question be answered?

The proposal for the trial was eventually abandoned because of these ethical considerations. Yet the question remains whether G-CSF is of any value in the treatment of septic shock associated with melioidosis. Several variations to the proposed trial design were suggested in the hope that they would decrease the risks to participants.

One method would be to test the current dosing regimen against shorter, delayed, or less potent regimens rather than placebo. This is similar to the approaches used in trials of zidovudine to prevent vertical transmission of HIV in developing countries.17 Because smaller doses are likely to have some effect, a larger trial would be required, but the risks to the individual patient would be decreased. This approach did not prove practical because of the need for a greater sample size than was feasible.

A second method would be to use surrogate end points that might allow deteriorating patients to be withdrawn from the trial early. This approach was used in a trial of steroids in Pneumocystis carinii pneumonia.18 Unfortunately, appropriate surrogate end points have not been well defined for trials in patients with septic shock.

A third method of making the study safer would be to use an adaptive trial design such as “play the winner,”19 where allocation of patients to each arm of the trial is based on previous results of the intervention. These designs have been used in trials of extracorporeal membrane oxygenation.20 Although they limit the number of possible adverse outcomes, they are unable to prevent them altogether. Importantly, they do not limit the risks to an individual patient who enters early in the trial.

A fourth method would be to exclude the most seriously ill patients. This would potentially decrease the risk of omitting G-CSF but would also increase the number of patients required for the study and decrease the applicability of the results to seriously ill patients.

Other approaches

Researchers have attempted to use animal and in vitro models to explore the role of G-CSF in acute melioidosis.21 However, given that such models have failed to translate into improved outcomes in human trials of G-CSF in non-neutropenic infection,6 such evidence is no substitute for a clinical trial.

More than half of the Australian cases of melioidosis are treated at our institution. Thus, if a trial cannot be done at our hospital, it is unlikely to be feasible elsewhere within Australia. We have, however, proposed a trial in conjunction with colleagues in Thailand. Recent guidelines suggest that trials of new treatments may be ethical in developing countries if the results might benefit both the participants of the trial and others in the community. G-CSF is relatively expensive, but its use would be sustainable in Thailand if a substantial benefit could be shown. However, differences in the provision of intensive care between the two countries may mean the results are not directly applicable to patients in Australia.

Conclusion

The use of G-CSF in severe melioidosis remains unproved, and other institutions seem unlikely to start using it for patients with septic shock without additional evidence. Most trials take place in the context of limited but promising evidence of a modest benefit. Our situation shows the problems in defining the state of uncertainty necessary for the conduct of an ethical trial when a substantial benefit has been observed, however flawed this evidence might be. Future advances in the understanding of melioidosis may show other plausible reasons for the fall in mortality. If this were the case, G-CSF might come to be seen as an optional part of treatment and a trial would become possible. However, at present it does not seem possible to limit the risks to individual patients within the current constraints of sample size.

Summary points

Uncertainty about treatment options must be present in the minds of the medical community, clinicians, and potential trial participants before a clinical trial can proceed

Previous evidence of a substantial benefit, even if flawed, may disturb equipoise

Alternative trial designs may safeguard patients at risk of serious adverse outcomes

Supplementary Material
Notes
An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is webplus.f3.gifReferences to work on patient equipoise are available on bmj.com
We thank Susan Jacups for data support.
Contributors and sources: ACC, BJC, and DPS drafted the study protocol for the clinical trial and discussed the ethical issues arising with ML (an interim member of the ethics committee) and a clinical ethicist. The protocol was discussed extensively with junior and senior medical staff and medical researchers in Darwin as well as in correspondence with other colleagues in northern Australia and internationally. We also did a literature search to define the ethical issues involved and explore methods that had previously been used to approach such problems.
Funding: ACC is supported by an Australian National Health and Medical Research Council Training Scholarship.
Competing interests: None declared.
References
1.
Dance DAB. Melioidosis: the tip of the iceberg? Clin Microbiol Rev 1991;4: 52-60. [PubMed].
2.
Currie BJ, Fisher DA, Howard DM, Burrow JN, Lo D, Selva-Nayagam S, et al. Endemic melioidosis in tropical northern Australia: a 10-year prospective study and review of the literature. Clin Infect Dis 2000;31: 981-6. [PubMed].
3.
Jones AL, Beveridge TJ, Woods DE. Intracellular survival of Burkholderia pseudomallei. Infect Immun 1996;64: 782-90. [PubMed].
4.
Marhoffer W, Stein M, Schleinkofer L, Federlin K. Evidence of ex vivo and in vitro impaired neutrophil oxidative burst and phagocytic capacity in type 1 diabetes mellitus. Diabetes Res Clin Pract 1993;19: 183-8. [PubMed].
5.
Salant DJ, Glover AM, Anderson R, Meyers AM, Rabkin R, Myburgh JA, et al. Depressed neutrophil chemotaxis in patients with chronic renal failure and after renal transplantation. J Lab Clin Med 1976;88: 536-45. [PubMed].
6.
Nelson S, Summer W, Bagby G, Nakamura C, Stewart L, Lipscomb G, et al. Granulocyte colony-stimulating factor enhances pulmonary host defenses in normal and ethanol-treated rats. J Infect Dis 1991;164: 901-6. [PubMed].
7.
Serushago BA, Yoshikai Y, Handa T, Mitsuyama M, Muramori K, Nomoto K. Effect of recombinant human granulocyte colony-stimulating factor (rh G-CSF) on murine resistance against Listeria monocytogenes. Immunology 1992;75: 475-80. [PubMed].
8.
Nelson S, Belknap SM, Carlson RW, Dale D, DeBoisblanc B, Farkas S, et al. A randomized controlled trial of filgrastim as an adjunct to antibiotics for treatment of hospitalized patients with community-acquired pneumonia. CAP Study Group. J Infect Dis 1998;178: 1075-80. [PubMed].
9.
Welte K, Gabrilove J, Bronchud MH, Platzer E, Morstyn G. Filgrastim (r-metHuG-CSF): the first 10 years. Blood 1996;88: 1907-29. [PubMed].
10.
Stephens DP, Fisher DA, Currie BJ. An audit of the use of granulocyte colony-stimulating factor in septic shock. Intern Med J 2002;32: 143-8. [PubMed].
11.
Nelson S, Heyder AM, Stone J, Bergeron MG, Daugherty S, Peterson G, et al. A randomized controlled trial of filgrastim for the treatment of hospitalized patients with multilobar pneumonia. J Infect Dis 2000;182: 970-3. [PubMed].
12.
Root RK, Lodato RF, Patrick W, Cade JF, Fotheringham N, Milwee S, et al. Multicenter, double-blind, placebo-controlled study of the use of filgrastim in patients hospitalized with pneumonia and severe sepsis. Crit Care Med 2003;31: 367-73. [PubMed].
13.
Peto R, Collins R, Gray R. Large-scale randomized evidence: large, simple trials and overviews of trials. J Clin Epidemiol 1995;48: 23-40. [PubMed].
14.
Royall RM, Bartlett RH, Cornell RG, Byar DP, Dupont WD, Levine RJ, et al. Ethics and statistics in randomized clinical trials. Stat Sci 1991;6: 52-88. [PubMed].
15.
Brody BA. When are placebo-controlled trials no longer appropriate? Control Clin Trials 1997;18: 602-12 (discussion 661-6). [PubMed].
16.
New wonder drug beats killer bug. Sunday Territorian 2001 Sep 23.
17.
Shaffer N, Chuachoowong R, Mock PA, Bhadrakom C, Siriwasin W, Young NL, et al. Short-course zidovudine for perinatal HIV-1 transmission in Bangkok, Thailand: a randomised controlled trial. Bangkok Collaborative Perinatal HIV Transmission Study Group. Lancet 1999;353: 773-80. [PubMed].
18.
Montaner JS, Lawson LM, Levitt N, Belzberg A, Schechter MT, Ruedy J. Corticosteroids prevent early deterioration in patients with moderately severe Pneumocystis carinii pneumonia and the acquired immunodeficiency syndrome (AIDS). Ann Intern Med 1990;113: 14-20. [PubMed].
19.
Wei LSD. The randomized play-the-winner rule in medical trials. J Am Stat Assoc 1978;73: 840-3.
20.
Bartlett RH, Roloff DW, Cornell RG, Andrews AF, Dillon PW, Zwischenberger JB. Extracorporeal circulation in neonatal respiratory failure: a prospective randomized study. Pediatrics 1985;76: 479-87. [PubMed].
21.
Powell K, Ulett G, Hirst R, Norton R. G-CSF immunotherapy for treatment of acute disseminated murine melioidosis. FEMS Microbiol Lett 2003;224: 315-8. [PubMed].