What does SOUL tell me about reflux at the 7 mg dose?

Setup, so nobody has to ask: SOUL · reflux · 7 mg.

I would like help reading this properly rather than being told what conclusion to reach.

I have the full report including the method section, so I can quote specifics if that helps.

How should I read this, and where are the traps?

Start with what the trial was powered for. Everything else in the publication is secondary, exploratory, or a subgroup, and those three words mean three different things.

Intention-to-treat and per-protocol analyses answer different questions. ITT asks what happens if you offer the treatment; per-protocol asks what happens if it is taken as directed. The gap between the two is a measure of how tolerable the protocol was.

Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.

Meta-analyses in this area are dominated by whichever trial contributed the most participants, so read the forest plot rather than the summary estimate.

Quote the interval alongside the estimate and half the disagreements on this site would not start.

edited 29 Mar 2024 by ellis_thorne — expanded the table to cover the lower concentration

The honest answer here is that the published evidence supports part of the claim and is silent on the rest, and it is worth being precise about which part is which.

Open-label extensions are not the same evidence as the randomised phase. Once everyone knows what they are taking, the reported outcomes acquire a bias that no analysis fully removes.

Trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.

The caveat is that trial evidence is about licensed product administered under supervision. None of it transfers automatically to research-grade material of unverified content.

If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.

Answer first: read the primary endpoint, the comparator and the population before you read the effect size. Almost every argument on this site about a trial is really an argument about one of those three.

Placebo arms in this class are not nothing. Lifestyle-intervention placebo arms in the major obesity trials commonly lose two to three per cent of body weight, so an active-arm figure quoted without its comparator overstates the drug effect by roughly that much.

Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.

I am not a clinician and this is not medical advice; it is a reading of a published protocol.

Read the protocol and the statistical analysis plan if the result matters to you. Both are usually published alongside.

The short version: the effect is real, the magnitude depends on the population, and the population is usually the part that gets dropped when a result is quoted second-hand.

Duration decides what can be seen. A 68-week trial can measure weight and glycaemia; it cannot measure anything whose event rate is one per cent per year without enrolling tens of thousands.

The cardiovascular outcome programme in this class runs to several large randomised trials — LEADER for liraglutide, SUSTAIN-6 and SELECT for semaglutide, REWIND for dulaglutide — and they are the reason the class is discussed as more than a weight intervention.

Be careful about generalising from a trial population to yourself. The exclusion criteria are usually the most informative page in the supplement.

When two sources disagree, the answer is almost always in the methods section of the one you have not read.