{"id":3425,"date":"2010-10-01T14:54:57","date_gmt":"2010-10-01T18:54:57","guid":{"rendered":"http:\/\/blogs.nejm.org\/cardioexchange\/?p=3425"},"modified":"2011-07-19T17:45:27","modified_gmt":"2011-07-19T21:45:27","slug":"a-case-of-exuberance-about-a-subgroup-in-a-clinical-trial","status":"publish","type":"post","link":"https:\/\/blogs.nejm.org\/cardioexchange\/2010\/10\/01\/a-case-of-exuberance-about-a-subgroup-in-a-clinical-trial\/","title":{"rendered":"A Case of Exuberance About a Subgroup in a Clinical Trial"},"content":{"rendered":"<p>In many clinical trials, researchers investigate whether an overall effect of an intervention is consistent across various subgroups, <a title=\"OASIS_JournalClub\" href=\"http:\/\/blogs.nejm.org\/cardioexchange\/a-rich-oasis-for-your-journal-club\/\" target=\"_blank\">as I discussed in this Journal Club Series last week<\/a>.\u00a0Such subgroup analyses require assessment of what is called an interaction \u2014 that is, whether the effect in one group differs from that in another.\u00a0Do the benefits differ, for example,\u00a0between\u00a0older and younger patients \u2014 or between men and women?\u00a0That may sound like an easy issue to explore, but penetrating it demands an appetite for methodological nuance. Are you ready? Here we go . . .<\/p>\n<p>The basic principle of subgroup analysis is that before you assess the effect of an intervention in each subgroup of interest, you must assess whether there is strong evidence of statistically meaningful differences among the subgroups. If older patients and younger patients benefit similarly from a drug, for example, there is no reason to look at one group alone, because the overall trial outcomes apply to both groups.<\/p>\n<p>This week, I focus specifically on a study showing that bleeding risk was significantly greater with prasugrel than with clopidogrel in ACS patients scheduled for PCI. The researchers published a subsequent article focusing just on the patients with ST-segment\u2013elevation MI (STEMI) and concluded that there was no excess risk for bleeding in that subgroup, even though the difference in that risk between STEMI and unstable angina\/non\u2013STEMI (UA\/NSTEMI) patients was not significant. These studies are instructive for thinking about how to interpret subgroup analyses accurately.<\/p>\n<p><strong>Results Recap<\/strong><\/p>\n<p>The articles are <a title=\"TRITON-TIMI 38_NEJM\" href=\"http:\/\/www.nejm.org\/doi\/full\/10.1056\/NEJMoa0706482\" target=\"_blank\">a 2007 <em>NEJM<\/em> paper<\/a> and <a title=\"TRITON-TIMI 38_Lancet\" href=\"http:\/\/www.thelancet.com\/journals\/lancet\/article\/PIIS0140-6736%2809%2960441-4\/abstract\" target=\"_blank\">a 2009 <em>Lancet <\/em>paper<\/a> from the industry-funded TRITON-TIMI 38 trial, in which 13,608 patients with moderate-to-high risk ACS who were scheduled for PCI were randomized to receive prasugrel or clopidogrel. Incidence of the primary endpoint \u2014 death from cardiovascular causes, nonfatal MI, or nonfatal stroke at 15 months \u2014 was significantly lower in the prasugrel group than in the clopidogrel group (9.9% vs. 12.1%), mostly because of fewer nonfatal MIs. However, the incidences of major and life-threatening bleeding were significantly higher with prasugrel. In <a title=\"FDAonPrasugrel_NEJM\" href=\"http:\/\/www.nejm.org\/doi\/full\/10.1056\/NEJMp0907122\" target=\"_blank\">a 2009 <em>NEJM<\/em> perspective piece<\/a>, an FDA official characterized the data as follows:<\/p>\n<p>\u201cFor each 1000 patients who were given prasugrel instead of clopidogrel, 24 end-point events were prevented \u2014 21 nonfatal myocardial infarctions and 3 cardiovascular deaths. (The rate of stroke was essentially the same with either drug.) The cost was 10 excess major or minor bleeding events, 2 of which were fatal.\u201d<\/p>\n<p><strong>What the Authors Analyzed<\/strong><\/p>\n<p>It\u2019s important to emphasize that this trial reported analyses for 7 subgroups on the primary outcome, as well as several secondary outcomes including safety outcomes \u2014 quite a few comparisons in all. When there are multiple subgroup comparisons, <em>P<\/em> values for analyses beyond the primary endpoint must be adjusted to more stringent levels than the usual <em>P<\/em>&lt;0.05, in order to account for the likelihood that the differences may be due to chance. A common approach is to divide 0.05 by the number of tests performed, but there are other ways to do this adjustment.<\/p>\n<p>When the <em>NEJM<\/em> findings were published, the authors reported the significant difference between prasugrel and clopidogrel in the overall cohort and reported no evidence of a difference (interaction) between treatment group and type of MI. They then looked specifically at the primary outcome in the\u00a0UA\/NSTEMI and STEMI subgroups and found an advantage of prasugrel, at the <em>P<\/em>&lt;0.05 level of significance, in each.<\/p>\n<p>In their 2009 <em>Lancet<\/em> article, the authors focused only on the STEMI subgroup. They declared the primary-endpoint advantage of prasugrel in STEMI patients, reiterating the finding earlier reported in the <em>NEJM<\/em>. So far, so good: There was no interaction reported in the <em>NEJM<\/em> paper, and the <em>Lancet<\/em> paper said the same thing \u2014 the result is similar. It\u2019s important to note that even if the effect had been reported as nonsignificant in the <em>Lancet<\/em> paper, the drug should not be considered ineffective in STEMI patients. Given that the interaction was negative, the efficacy of the intervention in the underpowered STEMI subgroup should be considered the same as it was in the overall cohort. In short, we have no evidence of an intervention-related difference between STEMI and UA\/NSTEMI patients.<\/p>\n<p>The authors also looked at safety endpoints. Specifically, they reported in the <em>Lancet <\/em>that the type of MI did not influence the excess risk for bleeding conferred by prasugrel (<em>P<\/em>=0.4). Therefore, the interaction between the bleeding risk with prasugrel and type of MI was negative (i.e., no evidence of heterogeneity for type of MI). However, the authors went on to assess the STEMI group alone and did not find a significantly increased risk for bleeding. They write, \u201cTIMI major bleeding unrelated to CABG surgery was similar in the prasugrel and clopidogrel groups at both 30 days and 15 months.\u201d This statement suggests that unlike patients with UA\/NSTEMI, those with STEMI are not at increased risk for bleeding.<\/p>\n<p>The problem is twofold: (1) the interaction, as noted, was not significant; and (2) the prasugrel versus clopidogrel hazard ratio for TIMI major bleeding unrelated to CABG was hardly reassuring (HR, 1.11; 95% CI, 0.70\u20131.77). That HR is not statistically significant, but it is in the direction of harm, and a 77% higher risk with prasugrel cannot be excluded. The best inference is that the excess bleeding risk in the STEMI subgroup is no different than that reported for the overall cohort.<\/p>\n<p><strong>How the Authors Interpreted Their Analyses<\/strong><\/p>\n<p>The authors conclude their <em>Lancet<\/em> abstract with this sentence: \u201cIn patients with STEMI undergoing PCI, prasugrel is more effective than clopidogrel for prevention of ischaemic events, without an apparent excess in bleeding.\u201d And they end the entire <em>Lancet<\/em> article with this sentence: \u201cOur findings suggest that prasugrel is an especially attractive alternative to clopidogrel to support PCI in the course of management of patients with STEMI.\u201d<\/p>\n<p>At the conclusion of your journal club, participants can decide whether the evidence from these articles is strong enough to say that STEMI patients gain a particular benefit from prasugrel. For now, please share your perspective with your colleagues here on CardioExchange.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In many clinical trials, researchers investigate whether an overall effect of an intervention is consistent across various subgroups, as I discussed in this Journal Club Series last week.\u00a0Such subgroup analyses require assessment of what is called an interaction \u2014 that is, whether the effect in one group differs from that in another.\u00a0Do the benefits differ, [&hellip;]<\/p>\n","protected":false},"author":211,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9],"tags":[239,334,301,335],"class_list":["post-3425","post","type-post","status-publish","format-standard","hentry","category-interventional-cardiology","tag-acs","tag-clopidogrel","tag-pci","tag-prasugrel"],"_links":{"self":[{"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/posts\/3425","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/users\/211"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/comments?post=3425"}],"version-history":[{"count":0,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/posts\/3425\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/media?parent=3425"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/categories?post=3425"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.nejm.org\/cardioexchange\/wp-json\/wp\/v2\/tags?post=3425"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}