Intermediate precision

Written by Dr. Janet Thode Posted in Method validation

When evaluating quantitative analytical quality control methods regarding their fitness for purpose during method validation, the validation parameter “intermediate precision” must also be considered. The term “intermediate precision” might also appear under the following names:

  • within-laboratory reproducibility or intralaboratory reproducibility
  • within-lab(oratory) / within-device precision
  • inter-assay precision / between-run precision

and might include

  • day-to-day precision (between-day precision / inter-day precision), analyst-to-analyst-precision, instrument-to-instrument precision…

As can be seen from the different names and by the definition of the ICH Q2(R1) method validation guideline1, intermediate precision is a parameter that evaluates the variability in the results generated by different influences within one lab which will occur in the future routine analysis, such as performing the analysis by different analysts, on different days, using different instruments, lots of reagents or columns… It should be highlighted that apart from these variations, replicate measurements using the same measurement procedure and the same sample within the same lab could be / are made for intermediate precision. This is similar to repeatability which is evaluated under the same operating conditions over a short interval of time; whereas intermediate precision is evaluated over an extended period of time considered the variations mentioned above.

Intermediate precision as part of precision in general is giving us an indication of the degree of scatter of the results due to underlying random errors. Therefore, intermediate precision can be expressed by the relative standard deviation. Considering more variable conditions than applied for repeatability experiments, it is easily understandable that the relative standard deviation calculated for intermediate precision experiments is usually larger than the one observed for the repeatability experiments.

Data evaluation should be illustrated by the following examples. Image two analysts are performing a content determination of a drug substance, they are both doing 6 measurements at the same day while using the same instrument and are getting these results:

  Measurement Content [mg] Mean [mg] SD [mg] RSD [%]
 Analyst 1 1 1.44 1.46 0.019 1.29
2 1.46
3 1.45
4 1.49
5 1.45
6 1.44
Analyst 2    1 1.49 1.48 0.008 0.55
2 1.48
3 1.49
4 1.47
5 1.48
6 1.49
   Intermediate precision (n=12) 1.47  0.020 1.38

The mean values are quite similar in this example, but the variation of the results is slightly higher for analyst 1, which might be due to his operation. This can be seen by the standard deviation (SD) as well as by the relative standard deviation (RSD).

To underline the importance to use the relative standard deviation for the evaluation of intermediate precision, check the next example. Image the same scenario as before, but analyst 2 is performing his analysis on a different instrument:

  Measurement Content [mg] Mean [mg] SD [mg] RSD [%]
 Analyst 1 1 1.44 1.46 0.019 1.29
2 1.46
3 1.45
4 1.49
5 1.45
6 1.44
Analyst 2    1 1.35  1.35 0.008 0.56
2  1.34
3  1.35
4  1.36
5  1.34
6  1.35
   Intermediate precision (n=12)  1.40  0.057 4.09

It can be seen that analyst 2 is as precise as before (when you are just looking at his SD and RSD), but that there is obviously a strong influence of the second instrument (seen by the higher RSD which connects scatter and mean value).

For evaluating the data, you might also think about comparing two data sets (e.g. made by two analysts, comprising e.g. 6 measurements each, as in the example above) by statistical tests to show that they don’t differ significantly. I recommend avoiding such an approach, as it might occur in case of little scatter within each series and the small sample (e.g. n = 12) that the test results in a significant difference which leads to a problem in argumentation.

Also, according to the ICH Q2(R1) guideline, it not necessary (but still usual practice) to study each variation individually, instead using a so-called matrix approach is encouraged.

Considering the ongoing efforts of not performing method validation as “ticking check lists” just following generic approaches, but rather respecting QbD principles such as a risk-based evaluation of the important method influencing factors, it will be interesting on how this will be implemented by the new ICH Q14 guideline.

 

 

 

1 According to the ICH Q2(R1) “intermediate precision expresses within-laboratories variations: different days, different analysts, different equipment, etc”.