PeptideStack
5.2kquestions
20kanswers
220users

Is STEP 1 a fair comparison of a GLP-1 receptor agonist against its comparator arm?

Asked 24 Sept 2024Modified 19 months agoViewed 38k times
40

Setup, so nobody has to ask: STEP 1 · a GLP-1 receptor agonist.

This has the shape of a fact but I cannot find its origin.

What I found instead were three secondary sources all citing each other.

Has anyone verified this independently?

clinical-trials
clinical-trials

Reading the primary literature properly: estimands, intention-to-treat versus per-protocol, confidence intervals, absolute versus relative…

745 questions
semaglutide
semaglutide

A GLP-1 receptor agonist with a fatty-acid-acylated backbone and a roughly one-week half-life, marketed for type 2 diabetes and for weight…

470 questions
tirzepatide
tirzepatide

A dual GIP and GLP-1 receptor agonist. Questions here cover the SURPASS and SURMOUNT programmes, the practical differences from a pure GLP-1…

370 questions
shareeditfollowflag
DO
askedDr_Malik_Osei19k2724 Sept 2024

5 Answers

Accepted answer first, then by votes
36

Accepted answer

Fair depends on the comparator arm, and in STEP 1 that means asking whether the comparator was titrated to the same ambition as the experimental one. A head-to-head that runs its comparator to a dose below the one it is licensed at is not measuring the two agents, it is measuring one agent against a handicapped version of the other. Check three things: the maximum comparator dose reached, the proportion of the comparator arm that reached it, and whether the titration schedules had the same duration. If those match, the comparison is fair on dosing and the argument moves to the endpoint. If they do not, the effect size is partly an artefact of the protocol.

The relevant detail is that the trial answers a narrower question than the headline suggests, and the narrowing is where the useful information is.

Placebo arms in this class are not nothing. Lifestyle-intervention placebo arms in the major obesity trials commonly lose two to three per cent of body weight, so an active-arm figure quoted without its comparator overstates the drug effect by roughly that much.

Worth being precise here: a composite endpoint is only as informative as its least serious component. Where a cardiovascular composite combines death, infarction and stroke, ask which component moved, because they are not interchangeable outcomes.

Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.

I am not a clinician and this is not medical advice; it is a reading of a published protocol.

The short version: check the endpoint, check the comparator, check who was excluded, then look at the number.

shareimprove this answerflag
DK
answered · acceptedDr_Tomas_Kral53k3817 Nov 2024
2The number needed to treat is the framing that finally made this concrete for me. – ines_brandt 8 months ago
Adding that the endpoint definition differs between the two trials being compared here. – esther_vandeVelde 7 months ago
add a comment
Sponsored

Sigma-Aldrich - Certified Reference Materials

Analytical standards and reagents with traceable certificates. Every quantitative result you read inherits the accuracy of the standard behind it.

Shop standards
36

Before comparing two trials, check whether they share an endpoint definition. Frequently they do not, and the numbers then are not comparable in any sense.

Trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.

Open-label extensions are not the same evidence as the randomised phase. Once everyone knows what they are taking, the reported outcomes acquire a bias that no analysis fully removes.

Meta-analyses in this area are dominated by whichever trial contributed the most participants, so read the forest plot rather than the summary estimate.

Quote the interval alongside the estimate and half the disagreements on this site would not start.

shareimprove this answerflag
TG
answeredtandem_gradient61k24826 Oct 2024
15

This is answerable from the published record, but only if you take the placebo arm seriously rather than reading the active arm alone.

Duration decides what can be seen. A 68-week trial can measure weight and glycaemia; it cannot measure anything whose event rate is one per cent per year without enrolling tens of thousands.

Concretely, non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.

Where a result is quoted from a conference abstract rather than a peer-reviewed publication, the numbers routinely move between the two. It is worth checking which one you are reading.

When two sources disagree, the answer is almost always in the methods section of the one you have not read.

shareimprove this answerflag
CR
answeredcoring_risk27k2728 Nov 2024
Do you have a reference for the last claim? Not disputing it, just want to read it. – Dr_Nadia_Farsi 8 months ago
add a comment
15

A trial establishes what happened to a defined group under a defined protocol. Extending it beyond that group is inference, and inference is allowed as long as it is labelled.

Intention-to-treat and per-protocol analyses answer different questions. ITT asks what happens if you offer the treatment; per-protocol asks what happens if it is taken as directed. The gap between the two is a measure of how tolerable the protocol was.

The caveat is that trial evidence is about licensed product administered under supervision. None of it transfers automatically to research-grade material of unverified content.

Read the protocol and the statistical analysis plan if the result matters to you. Both are usually published alongside.

shareimprove this answerflag
DC
answeredDr_Idris_Coulibaly33k1379 Jan 2025
-3

The short version: the effect is real, the magnitude depends on the population, and the population is usually the part that gets dropped when a result is quoted second-hand.

Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.

One qualification: absence of a signal in a trial of this size is not evidence of absence for a rare event. It is evidence that the event is rarer than the trial could detect.

If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.

shareimprove this answerflag
FC
answeredforty_two_c66k586 Nov 2024

Your answer

Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.

Not medical advice. Research-use-only compounds are not approved for human use.