Accepted answer
Check the SURPASS-3 inclusion criteria against yourself in that order: entry BMI band, diabetes status, prior weight-loss attempts, and what the run-in excluded. Registration programmes recruit a population selected to show an effect if one exists, which is the right design and a poor basis for generalising. The run-in is the part that is easiest to miss: a programme that drops people during a placebo lead-in has already removed those least likely to tolerate or comply, and the published arms describe the survivors. External validity is not a property of the trial; it is a property of the distance between its population and yours, and that distance is yours to measure.
The short version: the effect is real, the magnitude depends on the population, and the population is usually the part that gets dropped when a result is quoted second-hand.
Open-label extensions are not the same evidence as the randomised phase. Once everyone knows what they are taking, the reported outcomes acquire a bias that no analysis fully removes.
Mechanically, non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.
Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.
I am not a clinician and this is not medical advice; it is a reading of a published protocol.
The short version: check the endpoint, check the comparator, check who was excluded, then look at the number.
Is the open-label extension included in that figure, or just the randomised phase? – samir_bennani 8 months ago 8Do you have a reference for the last claim? Not disputing it, just want to read it. – Dr_Hanne_Solberg 6 months ago add a comment