PeptideStack
5.2kquestions
20kanswers
220users

Why do two papers on STEP 5 report different headline figures?

Asked 17 Oct 2025Modified 6 months agoViewed 11k times
15

The clinician who ordered the panel was not concerned; I would still like to understand it.

I keep seeing this stated as a fact with no explanation attached, and unexplained facts make me suspicious.

My background is quantitative but not chemical, so I can follow an equation more easily than a hand-wave.

What is the causal chain, and where does it stop being established?

clinical-trials
clinical-trials

Reading the primary literature properly: estimands, intention-to-treat versus per-protocol, confidence intervals, absolute versus relative…

913 questions
dosing-math
dosing-math

The arithmetic itself: milligrams to millilitres to insulin units, concentration after reconstitution, dose per draw, and vial-days per vial. Show…

811 questions
semaglutide
semaglutide

A GLP-1 receptor agonist with a fatty-acid-acylated backbone and a roughly one-week half-life, marketed for type 2 diabetes and for weight…

360 questions
shareeditfollowflag
DB
askedDr_Aoife_Brennan50k4817 Oct 2025

5 Answers

Sorted by votes
64

Start with the population. The inclusion criteria of the trial determine what its result can be extrapolated to, and the extrapolation people want is usually to a population the trial excluded.

HbA1c is a weighted average, not a flat one: roughly half the signal comes from the most recent month. That is why a value drawn six weeks after a change already reflects most of the effect, and why a value drawn during rapid haematological turnover reflects something other than glycaemia.

Absolute risk reduction, worked: if the control-arm event rate is 8.0 per cent over the follow-up period and the hazard ratio is 0.80, the treated rate is approximately 6.4 per cent, the absolute risk reduction is 1.6 percentage points, and the number needed to treat is 1 ÷ 0.016 ≈ 63 over that period. A 20 per cent relative reduction and a number needed to treat of 63 are the same finding stated two ways, and only one of them sounds impressive.

FLOW tested a composite renal endpoint — kidney failure, sustained 50 per cent eGFR decline, or renal or cardiovascular death — in type 2 diabetes with chronic kidney disease, and was stopped early for efficacy[1].

The papers are readable. Read the paper rather than the summary of the paper, especially where the summary is enthusiastic.

shareimprove this answerflag
TW
answeredtare_weight47k3817 Nov 2025
Sponsored

Janoshik Analytical - Independent Third-Party Testing

HPLC purity, identity confirmation and quantified content on the vial you actually hold. Reports arrive with the chromatogram attached, not just a number.

Submit a sample
Sponsored — paired listing

GL Biochem (Shanghai) Ltd. - Direct Synthesis

Founded 1998. ISO 9001 and cGMP certified, 1,500+ staff and 200+ patents. The synthesis house behind a great many of the vials that get sent out for testing - batch-specific documentation with every order.

Visit GL Biochem
42

Mechanically, this is a question about what the trial was designed to answer, and the honest response is that it was not designed to answer this.

The early fall in estimated glomerular filtration rate on treatment is haemodynamic rather than structural. Reduced intraglomerular pressure lowers the filtration rate acutely and preserves the glomerulus chronically — the same pattern seen with renin-angiotensin blockade and with SGLT2 inhibition. A dip of a few millilitres per minute in the first weeks, followed by a shallower long-term slope, is the desired trajectory, not a warning sign.

A network meta-analysis can rank agents that were never compared directly, but only under a transitivity assumption — that the trials being linked are similar enough in population, duration and endpoint definition for the indirect comparison to hold. In this field that assumption is often visibly violated, which is why indirect rankings should be read as hypotheses.

SURMOUNT-1 reported mean weight reductions of approximately 15, 19 and 21 per cent at tirzepatide 5, 10 and 15 mg respectively at 72 weeks[1].

Convert everything to an absolute effect before you compare two interventions. Relative effects are not comparable across different baseline risks.

shareimprove this answerflag
KA
answeredkwn_analytical89k24828 Nov 2025
33

A single laboratory value is a point on a noisy curve. What you want is a trend across at least three draws under comparable conditions, and "comparable" is doing a lot of work in that sentence.

Estimated average glucose from HbA1c: eAG in mg/dL = 28.7 × A1c − 46.7, or in mmol/L, 1.59 × A1c − 2.59. An A1c of 6.5 per cent is therefore about 140 mg/dL or 7.8 mmol/L. The relationship is a population regression, so an individual can sit well off the line.

Mechanically, creatinine is a muscle-derived metabolite, so a substantial loss of lean mass lowers serum creatinine and mathematically raises estimated GFR without anything happening to the kidney. If you have lost twenty kilograms, your creatinine-based eGFR is flattering you. Cystatin C is not muscle-dependent and is the measure to use when the two disagree.

One qualification: a trial that demonstrates an endpoint at a given dose has demonstrated it at that dose. Extrapolating the endpoint down the dose ladder is an assumption, not a finding.

None of this replaces a clinician who can see the whole picture, and the whole picture is usually where the answer is.

edited 14 Dec 2025 by h_pergande — fixed an arithmetic slip in the third paragraph

shareimprove this answerflag
HP
answeredh_pergande86k25810 Dec 2025
26

Concretely, the confidence interval is the informative part. A point estimate with an interval spanning no effect is a different object from the same point estimate with a tight interval, and the abstract presents them identically.

Liver enzymes are a poor surrogate for hepatic histology in both directions: substantial steatohepatitis with normal transaminases is common, and modest enzyme elevation with minimal fibrosis is common. If the question is fibrosis, the answer comes from a non-invasive score such as FIB-4 or a stiffness measurement, not from ALT.

SURMOUNT-4 randomised participants after an open-label lead-in to continued tirzepatide or placebo, and the withdrawal arm regained a substantial proportion of the lost weight over the following year[1].

I would resist reading a subgroup finding as a result. Subgroups in these trials were not powered, and a striking subgroup in a large trial is the expected consequence of multiplicity.

Read the confidence interval, read the estimand, and compute the absolute effect yourself. It takes two minutes and it changes how the result feels.

edited 13 Jan 2026 by tyndall_haze — added the placebo-arm figures

shareimprove this answerflag
TH
answeredtyndall_haze48k4821 Dec 2025
6Is there a reason to prefer the second method over the first, other than cost? – Dr_Bram_Verhoeven 9 months ago
add a comment
20

More usefully, the hazard ratio is the relative effect. What changes decisions is the absolute effect, and converting between them requires the event rate in the control arm, which is usually in the same table and rarely in the abstract.

ApoB and LDL-C disagree because they measure different things: LDL-C is the cholesterol mass carried in the LDL fraction, ApoB is a count of atherogenic particles. Small dense particles carry less cholesterol each, so a person with many small particles has a concordantly higher ApoB than their LDL-C suggests. When they disagree, ApoB is the better risk marker.

The caveat is the population. Trial participants were screened, monitored and supported; the effect size in an unmonitored setting is not the trial effect size, and it is not obvious in which direction the difference runs.

If the trend across three draws is flat, the difference between draws one and two was noise. Most of what people react to is noise.

edited 29 Jan 2026 by dana_wexler — expanded the table to cover the lower concentration

shareimprove this answerflag
DW
answereddana_wexler15k271 Jan 2026
7This matches what I was told by a laboratory, for whatever that is worth. – tare_weight 8 months ago
6Minor: the trial name is hyphenated in the original publication. – tyndall_haze 6 months ago
add a comment

Your answer

Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.

Not medical advice. Research-use-only compounds are not approved for human use.