{"id":5786,"date":"2011-01-10T15:00:40","date_gmt":"2011-01-10T20:00:40","guid":{"rendered":"http:\/\/blogs.nejm.org\/cardioexchange\/?p=5786"},"modified":"2011-07-19T17:44:19","modified_gmt":"2011-07-19T21:44:19","slug":"have-the-courage-to-critique-a-substudy","status":"publish","type":"post","link":"https:\/\/blogs.nejm.org\/cardioexchange\/2011\/01\/10\/have-the-courage-to-critique-a-substudy\/","title":{"rendered":"Have the COURAGE to Critique a Substudy"},"content":{"rendered":"<p>In this journal club, I compare the published data from an original trial with the authors\u2019 conclusions in a substudy from that trial. Often, a substudy provides valuable insights that complement the initial trial findings. Sometimes, however, you need to look closely to identify the additional insight. Case in point: COURAGE.<\/p>\n<p><strong>The Original COURAGE Trial<\/strong><\/p>\n<p><a title=\"COURAGE_original_trial\" href=\"http:\/\/www.nejm.org\/doi\/full\/10.1056\/NEJMoa070829\" target=\"_blank\">As reported in 2007 in the <em>NEJM<\/em><\/a>, 2287 patients with objective evidence of myocardial ischemia and significant epicardial coronary artery disease were randomized to receive either optimal medical therapy (OMT) alone or percutaneous coronary intervention (PCI) plus OMT. During a median follow-up of 4.6 years, incidence of the primary endpoint \u2014 death or nonfatal MI \u2014 was statistically similar in the two groups, but slightly higher with PCI (OMT alone, 18.5%; PCI, 19.0%; <em>P<\/em>=0.62). PCI also showed no advantage in the individual endpoints of death, nonfatal MI, or hospitalization for acute coronary syndrome \u2014 nor (<a title=\"COURAGE_quality_of_life\" href=\"http:\/\/www.nejm.org\/doi\/full\/10.1056\/NEJMoa072771\" target=\"_blank\">as reported subsequently<\/a>) in quality of life.<\/p>\n<p><strong>The Nuclear Substudy<\/strong><\/p>\n<p>In 2008, <a title=\"COURAGE_nuclear_substudy\" href=\"http:\/\/circ.ahajournals.org\/cgi\/content\/full\/117\/10\/1283\" target=\"_blank\">the COURAGE nuclear substudy<\/a> (the first substudy from the trial) was published in <em>Circulation<\/em>. It involved 314 patients who underwent serial rest\/stress myocardial perfusion single-photon-emission computed tomography (MPS), both before treatment and then 6 to 18 months after randomization. The primary endpoint was defined as \u22655% reduction in myocardial ischemia at follow-up. The investigators report that the PCI group had a significantly greater mean reduction in ischemic myocardium (\u20132.7% with PCI vs. \u20130.5% with OMT alone) and a significantly larger percentage of patients who achieved the \u22655% reduction endpoint (33% vs. 19%). The \u22655% reduction in ischemic burden was not significantly associated with better outcome in a multivariable analysis, and as the authors acknowledge, their study \u201cwas not powered to examine differences in clinical outcomes according to change in ischemic burden.\u201d In the conclusion of their abstract, the authors say that \u201cadding PCI to OMT resulted in greater reduction in ischemia compared with OMT alone.\u201d They further state, \u201cOur findings suggest a treatment target of \u22655% ischemia reduction with OMT with or without coronary revascularization.\u201d<\/p>\n<p><strong>The Leap in Logic<\/strong><\/p>\n<p>The authors\u2019 conclusion is quite provocative. The full trial showed that patients with ischemia did equally well with an initial strategy of PCI or OMT. In the substudy, the authors assert that, given their results, clinicians should seek a target of \u22655% ischemia reduction. The implications are that these patients should undergo MPS, that therapeutic strategies should be guided over time by the MPS results, and that PCI is better than OMT alone in reducing ischemia. How did the authors make this leap? Their reasoning appears to be as follows:<\/p>\n<p>The PCI strategy was better than OMT in reducing ischemia burden by \u22655%. The authors place emphasis on a significant <em>unadjusted<\/em> association between a reduction in ischemic burden and a reduction in risk (but a critical reader will note that the multivariable analysis was not significant). On the basis of the unadjusted result, the authors conclude that reducing ischemic burden by \u22655% should be a treatment goal and, by implication, that PCI plus OMT would be better than OMT alone for that purpose.<\/p>\n<p><strong>Untangling the Logic<\/strong><\/p>\n<p><!--StartFragment-->The substudy was not designed to test whether targeting treatment to a certain threshold of ischemia reduction benefits patients; it simply suggested that the PCI strategy was more effective than OMT alone in reducing ischemic burden. [Given that the subjects in this substudy represented a convenience sample of patients and the two treatment groups were not similar it is not clear that they have even demonstrated that PCI reduces ischemic burden more effectively &#8211; this is not a comparison of groups that were obtained by randomization &#8211; a nuance that is acknowledged but may be easy to miss &#8211; and they do not do what is necessary to control for the differences.] Notably, even if PCI reduced ischemic burden, PCI did not significantly reduce the risk for clinical events or substantially affect symptoms in the overall trial. Moreover, in the substudy,the reduction of ischemic burden also did not reduce the risk for events (according to the multivariable analysis in the substudy, which was important since those who had a reduction were likely different at baseline from those who did not &#8211; but they do not present this comparison). If ischemic burden reduction had really mattered, the trial should have shown evidence of\u00a0<em>clinical <\/em>differences between the two treatment groups.<\/p>\n<p>Another issue is that ischemic burden is a\u00a0<em>surrogate<\/em> for the clinical outcomes that affect patients. Surrogate endpoints can be useful when we do not have clinical outcomes to examine. In COURAGE, clinical outcomes were reported. Perhaps the most important finding in this substudy is the failure of ischemic burden\u00a0<em>as<\/em> a surrogate endpoint. If COURAGE had just used ischemic-burden reduction as the primary endpoint, the PCI advocates would have declared victory. However, the trial identified no difference between the groups in the major clinical endpoints that were measured, and the surrogate endpoint would have been useless in predicting the outcome of the trial. This finding suggests to me that treating to a target reduction in ischemic burden is not useful.<\/p>\n<p>There are also other issues to consider regarding the study design. In order for the trial participants to have their ischemic burden tracked over time, they had to be around for the follow-up study. They are, then, patients who survived at least 6 months and, in some cases, up to 18 months. We do not have information about who in this substudy was lost to follow-up or did not return for a follow-up MPS study \u2014 and whether the time to the follow-up MPS was similar in both intervention groups. That information is essential to evaluating the substudy.<\/p>\n<p><!--EndFragment--><strong>A Better Line of Inquiry<\/strong><\/p>\n<p>What nuclear substudy might have been most useful to a clinician? I personally would have wanted to know whether PCI was better than OMT alone among patients with a large ischemic burden at baseline. Such an analysis would have investigated an interaction \u2014 whether the difference between the PCI and OMT-alone groups varied according to baseline ischemic burden. A reasonable hypothesis would have been that the PCI strategy was superior for patients who initially had the most ischemia according to MPS. Unfortunately, the investigators could not do that analysis, probably due to lack of resources.<\/p>\n<p>Do you think this COURAGE substudy complements the original trial? How do you assess the authors\u2019 suggestion to target a certain reduction in ischemic burden for patients like those in this trial? How would you have written the conclusion to the abstract?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this journal club, I compare the published data from an original trial with the authors\u2019 conclusions in a substudy from that trial. Often, a substudy provides valuable insights that complement the initial trial findings. Sometimes, however, you need to look closely to identify the additional insight. Case in point: COURAGE. The Original COURAGE Trial [&hellip;]<\/p>\n","protected":false},"author":211,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11,1,9],"tags":[301,373],"class_list":["post-5786","post","type-post","status-publish","format-standard","hentry","category-cardiac-imaging","category-general","category-interventional-cardiology","tag-pci","tag-stable-angina"],"_links":{"self":[{"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/posts\/5786","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/users\/211"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/comments?post=5786"}],"version-history":[{"count":0,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/posts\/5786\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/media?parent=5786"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/categories?post=5786"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/tags?post=5786"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}