Copyright © 2003, BMJ Publishing Group Ltd. Ethical problems of evaluating a new treatment for melioidosis Correspondence to A C Cheng allenc/at/menzies.edu.au Accepted September 11, 2003. | ||||
Short abstract When mortality from melioidosis fell sharply after multiple changes in management at an Australian hospital, doctors wanted to identify whether a new drug was responsible. But designing a trial that was ethically acceptable proved impossible | ||||
Effective treatment of patients requires that is based on the best available evidence, ideally a randomised controlled trial. However, when observational evidence suggests that a treatment has a large benefit, the potential risks to participants make a randomised trial hard to justify. We had to abandon a trial to evaluate the use of granulocyte-colony stimulating factor (G-CSF) in patients with melioidosis in septic shock because we were unable to balance the risks to patients against the scientific uncertainty. This article describes the problems experienced and considers other methods of obtaining good evidence. | ||||
Our problem Melioidosis, the infection caused by Burkholderia pseudomallei, is endemic in South East Asia1 and is the commonest cause of death from bacteraemic pneumonia in the Northern Territory of Australia.2 Patients with severe infection present with septic shock, a condition associated with a high mortality. The Royal Darwin Hospital has treated 341 patients with culture confirmed melioidosis over 13 years, with an overall 18% mortality. Forty two of these patients presented with severe sepsis. In 1998, the hospital decided to start treating patients with melioidosis and septic shock with granulocyte-colony stimulating factor (G-CSF). The decision was based on the evidence available at that time (box). G-CSF was introduced at the same time as the hospital appointed a specialist in intensive care medicine. Previously, anaesthetists had supervised the unit, and the appointment resulted in appreciable changes to management protocols, including the more aggressive use of haemodynamic monitoring, empiric antibiotic protocols, the adoption of a closed intensive care model, and early enteric feeding. Mortality from severe melioidosis fell from 95% (20 of 21 patients) to 10% (2 of 21 patients) (P < 0.001, Fisher's exact test).10 A more modest reduction also occurred in mortality from septic shock due to other pathogens.10 The fall in mortality was particularly surprising because newly published data suggested that G-CSF was of little benefit in non-neutropenic infection.8,11,12 | ||||
Proposed trial A trial was proposed to determine whether the fall in mortality from severe melioidosis was due to G-CSF or other management changes. We planned to randomise eligible patients to either G-CSF or placebo and assess the end points of death from any cause or deterioration to catecholamine resistant shock. Patients who declined to participate in the study would be treated with the usual protocol, which included routine use of G-CSF. However, it was clear from the outset that the study posed ethical problems. | ||||
Requirement for clinical, personal, and patient equipoise Discussions of the ethics of randomised controlled trials emphasise the need for equipoise to exist before a trial can proceed. Equipoise has three components: clinical, personal, and patient. Clinical equipoise is usually taken to mean that uncertainty exists about the research question among researchers or the expert community as a whole. In this case the medical community disagreed about the value of G-CSF. This could be seen as evidence that a trial of G-CSF in severe melioidosis was both necessary and ethically justifiable.
Although clinical equipoise was present, many local experts were uneasy about their personal equipoise and that of their patients. They felt that the risks to patients of forgoing G-CSF were too great. Randomised controlled trials are mostly advocated in situations where only a moderate or small effect is expected rather than the large effect that was possible in this case. Peto et al suggest that in these circumstances randomised trials may be unnecessary.13 For example, treatment of syphilis with penicillin has never been tested in a randomised controlled trial, but trials involving withdrawal of penicillin are rightly regarded as unethical. In 1991, Royall et al attempted to deal with this issue by distinguishing truly experimental trials from unethical demonstration trials that are designed to show the superiority of already successful treatments more convincingly.14 Our situation shows the difficulties with this concept—does our potentially confounded series constitute sufficient evidence of effectiveness? Traditionally, equipoise has been viewed from the paternalistic viewpoint of the medical community. However, awareness is growing of the need to consider the perspective of patients and the wider community (see bmj.com). For example, Brody has argued that patient equipoise is present if “a reasonable person of an average degree of altruism and risk adversiveness might consent to being randomised.” This is analogous to clinical equipoise being determined by the normative judgment of a community of physicians.15 In our case, information about the apparent value of G-CSF was already well known within the community. A local newspaper had described it as a “wonder drug.”16 It is difficult to see how our survival statistics (95% v 10% mortality) would lead anybody other than the most extreme altruist to agree to participate in the proposed trial, no matter what the experts thought. | ||||
How can the question be answered? The proposal for the trial was eventually abandoned because of these ethical considerations. Yet the question remains whether G-CSF is of any value in the treatment of septic shock associated with melioidosis. Several variations to the proposed trial design were suggested in the hope that they would decrease the risks to participants. One method would be to test the current dosing regimen against shorter, delayed, or less potent regimens rather than placebo. This is similar to the approaches used in trials of zidovudine to prevent vertical transmission of HIV in developing countries.17 Because smaller doses are likely to have some effect, a larger trial would be required, but the risks to the individual patient would be decreased. This approach did not prove practical because of the need for a greater sample size than was feasible. A second method would be to use surrogate end points that might allow deteriorating patients to be withdrawn from the trial early. This approach was used in a trial of steroids in Pneumocystis carinii pneumonia.18 Unfortunately, appropriate surrogate end points have not been well defined for trials in patients with septic shock. A third method of making the study safer would be to use an adaptive trial design such as “play the winner,”19 where allocation of patients to each arm of the trial is based on previous results of the intervention. These designs have been used in trials of extracorporeal membrane oxygenation.20 Although they limit the number of possible adverse outcomes, they are unable to prevent them altogether. Importantly, they do not limit the risks to an individual patient who enters early in the trial. A fourth method would be to exclude the most seriously ill patients. This would potentially decrease the risk of omitting G-CSF but would also increase the number of patients required for the study and decrease the applicability of the results to seriously ill patients. | ||||
Other approaches Researchers have attempted to use animal and in vitro models to explore the role of G-CSF in acute melioidosis.21 However, given that such models have failed to translate into improved outcomes in human trials of G-CSF in non-neutropenic infection,6 such evidence is no substitute for a clinical trial. More than half of the Australian cases of melioidosis are treated at our institution. Thus, if a trial cannot be done at our hospital, it is unlikely to be feasible elsewhere within Australia. We have, however, proposed a trial in conjunction with colleagues in Thailand. Recent guidelines suggest that trials of new treatments may be ethical in developing countries if the results might benefit both the participants of the trial and others in the community. G-CSF is relatively expensive, but its use would be sustainable in Thailand if a substantial benefit could be shown. However, differences in the provision of intensive care between the two countries may mean the results are not directly applicable to patients in Australia. | ||||
Conclusion The use of G-CSF in severe melioidosis remains unproved, and other institutions seem unlikely to start using it for patients with septic shock without additional evidence. Most trials take place in the context of limited but promising evidence of a modest benefit. Our situation shows the problems in defining the state of uncertainty necessary for the conduct of an ethical trial when a substantial benefit has been observed, however flawed this evidence might be. Future advances in the understanding of melioidosis may show other plausible reasons for the fall in mortality. If this were the case, G-CSF might come to be seen as an optional part of treatment and a trial would become possible. However, at present it does not seem possible to limit the risks to individual patients within the current constraints of sample size.
| ||||
References
| ||||
Notes References to work on patient equipoise are available on bmj.com We thank Susan Jacups for data support. Contributors and sources: ACC, BJC, and DPS drafted the study protocol for the clinical trial and discussed the ethical issues arising with ML (an interim member of the ethics committee) and a clinical ethicist. The protocol was discussed extensively with junior and senior medical staff and medical researchers in Darwin as well as in correspondence with other colleagues in northern Australia and internationally. We also did a literature search to define the ethical issues involved and explore methods that had previously been used to approach such problems. Funding: ACC is supported by an Australian National Health and Medical Research Council Training Scholarship. Competing interests: None declared. | ||||
References 1. 2. Currie BJ, Fisher DA, Howard DM, Burrow JN, Lo D, Selva-Nayagam S, et al. Endemic melioidosis in tropical northern Australia: a 10-year prospective study and review of the literature. Clin Infect Dis
2000;31: 981-6. [PubMed]. 3. Jones AL, Beveridge TJ, Woods DE. Intracellular survival of Burkholderia pseudomallei. Infect Immun
1996;64: 782-90. [PubMed]. 4. Marhoffer W, Stein M, Schleinkofer L, Federlin K. Evidence of ex vivo and in vitro impaired neutrophil oxidative burst and phagocytic capacity in type 1 diabetes mellitus. Diabetes Res Clin Pract
1993;19: 183-8. [PubMed]. 5. Salant DJ, Glover AM, Anderson R, Meyers AM, Rabkin R, Myburgh JA, et al. Depressed neutrophil chemotaxis in patients with chronic renal failure and after renal transplantation. J Lab Clin Med
1976;88: 536-45. [PubMed]. 6. Nelson S, Summer W, Bagby G, Nakamura C, Stewart L, Lipscomb G, et al. Granulocyte colony-stimulating factor enhances pulmonary host defenses in normal and ethanol-treated rats. J Infect Dis
1991;164: 901-6. [PubMed]. 7. Serushago BA, Yoshikai Y, Handa T, Mitsuyama M, Muramori K, Nomoto K. Effect of recombinant human granulocyte colony-stimulating factor (rh G-CSF) on murine resistance against Listeria monocytogenes. Immunology
1992;75: 475-80. [PubMed]. 8. Nelson S, Belknap SM, Carlson RW, Dale D, DeBoisblanc B, Farkas S, et al. A randomized controlled trial of filgrastim as an adjunct to antibiotics for treatment of hospitalized patients with community-acquired pneumonia. CAP Study Group. J Infect Dis
1998;178: 1075-80. [PubMed]. 9. Welte K, Gabrilove J, Bronchud MH, Platzer E, Morstyn G. Filgrastim (r-metHuG-CSF): the first 10 years. Blood
1996;88: 1907-29. [PubMed]. 10. Stephens DP, Fisher DA, Currie BJ. An audit of the use of granulocyte colony-stimulating factor in septic shock. Intern Med J
2002;32: 143-8. [PubMed]. 11. Nelson S, Heyder AM, Stone J, Bergeron MG, Daugherty S, Peterson G, et al. A randomized controlled trial of filgrastim for the treatment of hospitalized patients with multilobar pneumonia. J Infect Dis
2000;182: 970-3. [PubMed]. 12. Root RK, Lodato RF, Patrick W, Cade JF, Fotheringham N, Milwee S, et al. Multicenter, double-blind, placebo-controlled study of the use of filgrastim in patients hospitalized with pneumonia and severe sepsis. Crit Care Med
2003;31: 367-73. [PubMed]. 13. Peto R, Collins R, Gray R. Large-scale randomized evidence: large, simple trials and overviews of trials. J Clin Epidemiol
1995;48: 23-40. [PubMed]. 14. Royall RM, Bartlett RH, Cornell RG, Byar DP, Dupont WD, Levine RJ, et al. Ethics and statistics in randomized clinical trials. Stat Sci
1991;6: 52-88. [PubMed]. 15. Brody BA. When are placebo-controlled trials no longer appropriate? Control Clin Trials
1997;18: 602-12 (discussion 661-6). [PubMed]. 16. New wonder drug beats killer bug. Sunday Territorian
2001 Sep 23. 17. Shaffer N, Chuachoowong R, Mock PA, Bhadrakom C, Siriwasin W, Young NL, et al. Short-course zidovudine for perinatal HIV-1 transmission in Bangkok, Thailand: a randomised controlled trial. Bangkok Collaborative Perinatal HIV Transmission Study Group. Lancet
1999;353: 773-80. [PubMed]. 18. Montaner JS, Lawson LM, Levitt N, Belzberg A, Schechter MT, Ruedy J. Corticosteroids prevent early deterioration in patients with moderately severe Pneumocystis carinii pneumonia and the acquired immunodeficiency syndrome (AIDS). Ann Intern Med
1990;113: 14-20. [PubMed]. 19. Wei LSD. The randomized play-the-winner rule in medical trials. J Am Stat Assoc
1978;73: 840-3. 20. Bartlett RH, Roloff DW, Cornell RG, Andrews AF, Dillon PW, Zwischenberger JB. Extracorporeal circulation in neonatal respiratory failure: a prospective randomized study. Pediatrics
1985;76: 479-87. [PubMed]. 21. Powell K, Ulett G, Hirst R, Norton R. G-CSF immunotherapy for treatment of acute disseminated murine melioidosis. FEMS Microbiol Lett
2003;224: 315-8. [PubMed]. | ||||