Does a large published testing history at QST imply lot consistency?

The method section is present, which is unusual enough that I want to make use of it.

This is one of those things that everyone repeats and nobody derives.

This matters practically, not just academically, because it changes what I would do next.

Is the standard explanation correct, and if so, what is the evidence for it?

The honest statement is that unless you have tested multiple vials or have segregation data, you are making an assumption about lot homogeneity that may not hold.

A statement that "lot 20260412 complies with specifications" is meaningless without stating which vials from the lot were tested and how many there were.

The sample size determination requires choosing a confidence level and an acceptable error rate, and the smaller the error rate you want, the larger your sample must be.

Published data on lot homogeneity from manufacturers who sample multiple vials consistently find variation below the published specifications, suggesting the sampling plans work.

If testing multiple vials, state how many you tested and why you chose those vials.

Put another way, the practical consequence is that spot-testing one vial from a new supplier is better than assuming they are all the same.

If the lot was manufactured in multiple batches, testing vials from each batch separately establishes whether batch-to-batch variation is acceptable.

Stated carefully, if the entire lot failed qualification, a retest on a different vial is sometimes done, but reporting a retest result under the same lot number is misleading.

Lyophilised peptide homogeneity studies show that vial-to-vial variation is usually small but occasionally large, depending on the distribution in the freeze-dryer.

I would treat a "complies with" statement without sampling details as a claim rather than as evidence.

Assume segregation is possible, and design your sampling to catch it if it exists.

The relevant detail is that batch testing establishes what can be claimed about the lot as a whole, and the sample size determines how much you can actually claim.

If you have reason to suspect inhomogeneity — different appearance in different vials, or a long or warm shipment — testing more vials is the diagnostic move.

Published segregation failures show that even modern automated processes sometimes produce lots with measurable vial-to-vial variation.

The limitation is that you cannot know for certain without testing every vial, and you almost never can afford to do that.

The practical summary: a lot number without a sampling statement is a lot number without meaning.

Two vials tested from a lot of ten is very different from two vials tested from a lot of ten thousand, and most certificates do not state the lot size.

Testing a vial that has been open in the lab for three months is testing aged material, not the fresh lot, and the result should be explicitly noted as a retest.

Sampling plans for pharmaceutical manufacturing are defined in ISO 2859 and ANSI Z1.4, and they are based on statistical sampling theory.

If testing multiple vials, state how many you tested and why you chose those vials.

edited 23 Sept 2024 by esther_vandeVelde — fixed an arithmetic slip in the third paragraph

The part that matters: the single most misleading statement on a research-grade certificate is a lot number with no statement of how many vials from that lot were tested.

The statistical foundation here is well-established, which is why sampling plans from decades ago are still valid.

Assume segregation is possible, and design your sampling to catch it if it exists.