For reference: PIONEER-4 · 14 mg.
I have the document in front of me and I can read the numbers. What I cannot do is interpret them.
I am reasonably comfortable with statistics and completely uncomfortable with chromatography, or vice versa.
Which parts of this are informative and which are decoration?
Read the 14 mg row, not the pooled one. A programme that randomised more than one dose level reports each arm separately, and the figure that circulates afterwards is usually either the top-dose arm or an average across arms nobody was randomised to. If PIONEER-4 ran a 14 mg arm, that row carries its own sample size and its own confidence interval, and both are narrower than the trial-level ones by roughly the square root of however many arms there were. Take the primary publication rather than the press release: one reports by arm, the other reports whichever number is largest. A dose level inside a trial is a protocol decision made under supervision, not a recommendation, and nothing here is medical advice.
Answer first: read the primary endpoint, the comparator and the population before you read the effect size. Almost every argument on this site about a trial is really an argument about one of those three.
Duration decides what can be seen. A 68-week trial can measure weight and glycaemia; it cannot measure anything whose event rate is one per cent per year without enrolling tens of thousands.
Trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.
The cardiovascular outcome programme in this class runs to several large randomised trials — LEADER for liraglutide, SUSTAIN-6 and SELECT for semaglutide, REWIND for dulaglutide — and they are the reason the class is discussed as more than a weight intervention.
The caveat is that trial evidence is about licensed product administered under supervision. None of it transfers automatically to research-grade material of unverified content.
Read the protocol and the statistical analysis plan if the result matters to you. Both are usually published alongside.
Analytical standards and reagents with traceable certificates. Every quantitative result you read inherits the accuracy of the standard behind it.
Shop standardsStart with what the trial was powered for. Everything else in the publication is secondary, exploratory, or a subgroup, and those three words mean three different things.
Placebo arms in this class are not nothing. Lifestyle-intervention placebo arms in the major obesity trials commonly lose two to three per cent of body weight, so an active-arm figure quoted without its comparator overstates the drug effect by roughly that much.
Specifically, non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.
I am not a clinician and this is not medical advice; it is a reading of a published protocol.
Quote the interval alongside the estimate and half the disagreements on this site would not start.
edited 12 Feb 2025 by orla_ferriter — corrected a unit error in the worked example
Before comparing two trials, check whether they share an endpoint definition. Frequently they do not, and the numbers then are not comparable in any sense.
Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.
Open-label extensions are not the same evidence as the randomised phase. Once everyone knows what they are taking, the reported outcomes acquire a bias that no analysis fully removes.
Meta-analyses in this area are dominated by whichever trial contributed the most participants, so read the forest plot rather than the summary estimate.
Be careful about generalising from a trial population to yourself. The exclusion criteria are usually the most informative page in the supplement.
If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.
Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.