PeptideStack
5.2kquestions
20kanswers
220users

What did the placebo arm of STEP 2 report for dizziness?

Asked 12 Sept 2024Modified 21 months agoViewed 20k times
25

Setup, so nobody has to ask: STEP 2 · dizziness.

I would like help reading this properly rather than being told what conclusion to reach.

I have the full report including the method section, so I can quote specifics if that helps.

What can I legitimately conclude from this figure?

clinical-trials
clinical-trials

Reading the primary literature properly: estimands, intention-to-treat versus per-protocol, confidence intervals, absolute versus relative…

745 questions
harm-reduction
harm-reduction

Reducing avoidable risk where a decision has already been made: independent verification before use, sterility practice, dose arithmetic checked…

472 questions
shareeditfollowflag
LQ
askedlipid_panel_q36k12712 Sept 2024

5 Answers

Accepted answer first, then by votes
24

Accepted answer

The STEP 2 placebo arm is the only thing that makes its treatment arm interpretable, and it is the row nobody quotes. Symptoms reported under placebo in these programmes are not rare, because the population is being asked about them weekly and would have had some of them regardless. The attributable figure is the treated rate minus the placebo rate, and that difference is routinely a fraction of the headline. Two cautions on the subtraction: the arms must have been assessed the same way, and a discontinuation for an event removes that participant from later time points in both arms, which flatters whichever arm loses more people.

Stated carefully, a trial establishes what happened to a defined group under a defined protocol. Extending it beyond that group is inference, and inference is allowed as long as it is labelled.

Placebo arms in this class are not nothing. Lifestyle-intervention placebo arms in the major obesity trials commonly lose two to three per cent of body weight, so an active-arm figure quoted without its comparator overstates the drug effect by roughly that much.

Non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.

Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.

If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.

edited 4 Nov 2024 by wren_calloway — added a caveat about sampling

shareimprove this answerflag
WC
answered · acceptedwren_calloway23k3821 Oct 2024
5Same experience here, different supplier. – tamsin_wray 5 months ago
6Adding that the endpoint definition differs between the two trials being compared here. – Dr_Fatima_Belkacem 6 months ago
add a comment
Sponsored

Sigma-Aldrich - Certified Reference Materials

Analytical standards and reagents with traceable certificates. Every quantitative result you read inherits the accuracy of the standard behind it.

Shop standards
22

Before comparing two trials, check whether they share an endpoint definition. Frequently they do not, and the numbers then are not comparable in any sense.

Trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.

Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.

Meta-analyses in this area are dominated by whichever trial contributed the most participants, so read the forest plot rather than the summary estimate.

When two sources disagree, the answer is almost always in the methods section of the one you have not read.

shareimprove this answerflag
NK
answerednadia_kowalczyk20k2829 Sept 2024
13

Start with what the trial was powered for. Everything else in the publication is secondary, exploratory, or a subgroup, and those three words mean three different things.

A composite endpoint is only as informative as its least serious component. Where a cardiovascular composite combines death, infarction and stroke, ask which component moved, because they are not interchangeable outcomes.

Concretely, intention-to-treat and per-protocol analyses answer different questions. ITT asks what happens if you offer the treatment; per-protocol asks what happens if it is taken as directed. The gap between the two is a measure of how tolerable the protocol was.

Where a result is quoted from a conference abstract rather than a peer-reviewed publication, the numbers routinely move between the two. It is worth checking which one you are reading.

The short version: check the endpoint, check the comparator, check who was excluded, then look at the number.

shareimprove this answerflag
DR
answeredDr_Priya_Raghunathan49k13710 Oct 2024
10

Look at the discontinuation rate alongside the efficacy figure. A large effect in the two thirds who stayed is a different result from a large effect in everyone.

Open-label extensions are not the same evidence as the randomised phase. Once everyone knows what they are taking, the reported outcomes acquire a bias that no analysis fully removes.

The cardiovascular outcome programme in this class runs to several large randomised trials — LEADER for liraglutide, SUSTAIN-6 and SELECT for semaglutide, REWIND for dulaglutide — and they are the reason the class is discussed as more than a weight intervention.

I am not a clinician and this is not medical advice; it is a reading of a published protocol.

Read the protocol and the statistical analysis plan if the result matters to you. Both are usually published alongside.

shareimprove this answerflag
DV
answeredDr_Ilse_Vandenberg113k2481 Nov 2024
6This should be linked from the help pages. – tandem_gradient 15 days ago
add a comment
5

The honest answer here is that the published evidence supports part of the claim and is silent on the rest, and it is worth being precise about which part is which.

Duration decides what can be seen. A 68-week trial can measure weight and glycaemia; it cannot measure anything whose event rate is one per cent per year without enrolling tens of thousands.

SELECT reported a hazard ratio of 0.80 (95% CI 0.72–0.90) for the primary composite major adverse cardiovascular event endpoint with semaglutide 2.4 mg in overweight or obese adults with established cardiovascular disease and without diabetes[1].

One qualification: absence of a signal in a trial of this size is not evidence of absence for a rare event. It is evidence that the event is rarer than the trial could detect.

Quote the interval alongside the estimate and half the disagreements on this site would not start.

shareimprove this answerflag
HV
answeredh_villanueva70k4812 Nov 2024
I would gently push back — that was a secondary endpoint, not the primary one. – per_haugen 7 months ago
2Minor: the trial name is hyphenated in the original publication. – rota_site 9 months ago
add a comment

Your answer

Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.

Not medical advice. Research-use-only compounds are not approved for human use.