Would you re-test survodutide after four weeks at 37 °C, or accept the original certificate?

Conditions: survodutide · four weeks · 37 °C.

The failure mode I am trying to avoid is making this decision emotionally.

I have twelve months in view and I would like the plan to survive that long.

How would you structure this, and what thresholds would you set in advance?

The relevant detail is that the single most misleading statement on a research-grade certificate is a lot number with no statement of how many vials from that lot were tested.

The sample size determination requires choosing a confidence level and an acceptable error rate, and the smaller the error rate you want, the larger your sample must be.

Put another way, testing a vial that has been open in the lab for three months is testing aged material, not the fresh lot, and the result should be explicitly noted as a retest.

Lyophilised peptide homogeneity studies show that vial-to-vial variation is usually small but occasionally large, depending on the distribution in the freeze-dryer.

One qualification: testing more vials gives better confidence, but at some point the cost outweighs the benefit.

If testing multiple vials, state how many you tested and why you chose those vials.

Sampling plans exist precisely because testing everything is expensive, and they define the statistical relationship between sample size and lot-wide inference.

Under AQL sampling plans, testing two vials from a fifty-vial lot gives you an operating characteristic curve that tells you what risks you are accepting.

To be exact about it, for a quantitative result like content, the acceptable range determines how many vials you need to test to establish the lot complies.

I would treat a "complies with" statement without sampling details as a claim rather than as evidence.

Assume segregation is possible, and design your sampling to catch it if it exists.

edited 30 Nov 2024 by orla_sheridan — added the placebo-arm figures

Most suppliers test one vial per lot and report the result as lot homogeneity, which is sampling one item from one lot and extrapolating wildly.

If the lot was manufactured in multiple batches, testing vials from each batch separately establishes whether batch-to-batch variation is acceptable.

Concretely, stratified sampling — testing one vial from the top, one from the middle, and one from the bottom of a shipment — is cheap insurance against segregation.

Sampling plans for pharmaceutical manufacturing are defined in ISO 2859 and ANSI Z1.4, and they are based on statistical sampling theory.

The limitation is that you cannot know for certain without testing every vial, and you almost never can afford to do that.

The practical summary: a lot number without a sampling statement is a lot number without meaning.

Worth being precise here: start from the question: how many vials from this lot do I need to test to claim that the lot meets specification, and the answer depends on both the lot size and the acceptable risk.

The statistical foundation here is well-established, which is why sampling plans from decades ago are still valid.

Published data on lot homogeneity from manufacturers who sample multiple vials consistently find variation below the published specifications, suggesting the sampling plans work.

If testing multiple vials, state how many you tested and why you chose those vials.

Thermal history during shipping is different for every vial, so a lot that experienced thermal abuse may have internal variation even if it was originally homogeneous.

A statement that "lot 20260412 complies with specifications" is meaningless without stating which vials from the lot were tested and how many there were.

Lyophilised peptide homogeneity studies show that vial-to-vial variation is usually small but occasionally large, depending on the distribution in the freeze-dryer.

Assume segregation is possible, and design your sampling to catch it if it exists.

edited 29 Dec 2024 by Dr_Ingrid_Baumgartner — added the method parameters