What did the placebo arm of SOUL report for early satiety?

Setup, so nobody has to ask: SOUL · early satiety.

I want to understand what this actually establishes, as opposed to what it is being used to imply.

My concern is that I am being invited to draw a conclusion the data does not support.

What is the correct interpretation, and what is the common misreading?

This is answerable from the published record, but only if you take the placebo arm seriously rather than reading the active arm alone.

Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.

Duration decides what can be seen. A 68-week trial can measure weight and glycaemia; it cannot measure anything whose event rate is one per cent per year without enrolling tens of thousands.

Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.

If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.

A trial establishes what happened to a defined group under a defined protocol. Extending it beyond that group is inference, and inference is allowed as long as it is labelled.

A composite endpoint is only as informative as its least serious component. Where a cardiovascular composite combines death, infarction and stroke, ask which component moved, because they are not interchangeable outcomes.

In practice, placebo arms in this class are not nothing. Lifestyle-intervention placebo arms in the major obesity trials commonly lose two to three per cent of body weight, so an active-arm figure quoted without its comparator overstates the drug effect by roughly that much.

Meta-analyses in this area are dominated by whichever trial contributed the most participants, so read the forest plot rather than the summary estimate.

I am not a clinician and this is not medical advice; it is a reading of a published protocol.

Quote the interval alongside the estimate and half the disagreements on this site would not start.

Look at the discontinuation rate alongside the efficacy figure. A large effect in the two thirds who stayed is a different result from a large effect in everyone.

Trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.

Be careful about generalising from a trial population to yourself. The exclusion criteria are usually the most informative page in the supplement.

When two sources disagree, the answer is almost always in the methods section of the one you have not read.

edited 25 Nov 2024 by Dr_Colm_Fitzhenry — corrected a unit error in the worked example

Start with what the trial was powered for. Everything else in the publication is secondary, exploratory, or a subgroup, and those three words mean three different things.

Non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.

Where a result is quoted from a conference abstract rather than a peer-reviewed publication, the numbers routinely move between the two. It is worth checking which one you are reading.

The short version: check the endpoint, check the comparator, check who was excluded, then look at the number.

edited 12 Sept 2024 by Dr_Hanne_Solberg — added the citation requested in comments