Numbers first: STEP 8 · semaglutide.
This is presented as though it settles something, and I am not convinced it does.
I have two documents that appear to disagree, which is what prompted this.
What does this actually establish, and what does it not?
Whatever its primary endpoint was, at the power it was designed for, in the population it recruited — and nothing else. STEP 8 was sized to answer one question. Every other result in it is a secondary or exploratory endpoint, powered incidentally if at all, and a nominally significant secondary in a programme with twenty of them is what you would expect from chance alone. So the reading order is: primary endpoint, then whether the secondaries were pre-specified and hierarchically tested, then everything else as hypothesis-generating. A trial establishes one thing well and suggests several things badly, and the press coverage inverts that ranking reliably.
The honest answer here is that the published evidence supports part of the claim and is silent on the rest, and it is worth being precise about which part is which.
Duration decides what can be seen. A 68-week trial can measure weight and glycaemia; it cannot measure anything whose event rate is one per cent per year without enrolling tens of thousands.
| Quantity | Value | Derivation |
|---|---|---|
| Control-arm event rate | 8.0 % | From the trial table, not the abstract |
| Hazard ratio | 0.80 | Reported |
| Treated event rate | 6.4 % | 8.0 × 0.80 |
| Absolute risk reduction | 1.6 pp | 8.0 − 6.4 |
| Number needed to treat | 63 | 1 ÷ 0.016 |
| Relative risk reduction | 20 % | 1 − 0.80 |
The last two rows describe the same finding. Only one of them is used in headlines.
The relevant detail is that a composite endpoint is only as informative as its least serious component. Where a cardiovascular composite combines death, infarction and stroke, ask which component moved, because they are not interchangeable outcomes.
Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.
Be careful about generalising from a trial population to yourself. The exclusion criteria are usually the most informative page in the supplement.
When two sources disagree, the answer is almost always in the methods section of the one you have not read.
Analytical standards and reagents with traceable certificates. Every quantitative result you read inherits the accuracy of the standard behind it.
Shop standardsStart with what the trial was powered for. Everything else in the publication is secondary, exploratory, or a subgroup, and those three words mean three different things.
Intention-to-treat and per-protocol analyses answer different questions. ITT asks what happens if you offer the treatment; per-protocol asks what happens if it is taken as directed. The gap between the two is a measure of how tolerable the protocol was.
The underlying point is that trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.
Where a result is quoted from a conference abstract rather than a peer-reviewed publication, the numbers routinely move between the two. It is worth checking which one you are reading.
One qualification: absence of a signal in a trial of this size is not evidence of absence for a rare event. It is evidence that the event is rarer than the trial could detect.
The short version: check the endpoint, check the comparator, check who was excluded, then look at the number.
Put another way, the trial answers a narrower question than the headline suggests, and the narrowing is where the useful information is.
Non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.
Open-label extensions are not the same evidence as the randomised phase. Once everyone knows what they are taking, the reported outcomes acquire a bias that no analysis fully removes.
The caveat is that trial evidence is about licensed product administered under supervision. None of it transfers automatically to research-grade material of unverified content.
Read the protocol and the statistical analysis plan if the result matters to you. Both are usually published alongside.
edited 28 Jun 2026 by ellis_thorne — added the placebo-arm figures
The short version: the effect is real, the magnitude depends on the population, and the population is usually the part that gets dropped when a result is quoted second-hand.
Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.
Quote the interval alongside the estimate and half the disagreements on this site would not start.
This is answerable from the published record, but only if you take the placebo arm seriously rather than reading the active arm alone.
Placebo arms in this class are not nothing. Lifestyle-intervention placebo arms in the major obesity trials commonly lose two to three per cent of body weight, so an active-arm figure quoted without its comparator overstates the drug effect by roughly that much.
If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.
Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.