In the analysis of designed experiments, the Friedman test is the most common non-parametric test for complete block designs. The Durbin test is a nonparametric test for balanced incomplete designs that reduces to the Friedman test in the case of a complete block design.
In a randomized block design, k treatments are applied to b blocks. In a complete block design, every treatment is run for every block and the data are arranged as follows:
|Treatment 1||Treatment 2||Treatment k|
For some experiments, it may not be realistic to run all treatments in all blocks, so one may need to run an incomplete block design. In this case, it is strongly recommended to run a balanced incomplete design. A balanced incomplete block design has the following properties:
- Every block contains k experimental units.
- Every treatment appears in r blocks.
- Every treatment appears with every other treatment an equal number of times.
The Durbin test is based on the following assumptions:
- The b blocks are mutually independent. That means the results within one block do not affect the results within other blocks.
- The data can be meaningfully ranked (i.e., the data have at least an ordinal scale).
Let R(Xij) be the rank assigned to Xij within block i (i.e., ranks within a given row). Average ranks are used in the case of ties. The ranks are summed to obtain
The Durbin test is then
- H0: The treatment effects have identical effects
- Ha: At least one treatment is different from at least one other treatment
The test statistic is
where t is the number of treatments, k is the number of treatments per block, b is the number of blocks, and r is the number of times each treatment appears.
For significance level α, the critical region is given by
where Fα, k − 1, bk − b − t + 1 denotes the α-quantile of the F distribution with k − 1 numerator degrees of freedom and bk − b − t + 1 denominator degrees of freedom. The null hypothesis is rejected if the test statistic is in the critical region. If the hypothesis of identical treatment effects is rejected, it is often desirable to determine which treatments are different (i.e., multiple comparisons). Treatments i and j are considered different if
where Rj and Ri are the column sum of ranks within the blocks, t1 − α/2, bk − b − t + 1 denotes the 1 − α/2 quantile of the t-distribution with bk − b − t + 1 degrees of freedom.
T1 was the original statistic proposed by James Durbin, which would have an approximate null distribution of (that is, chi-squared with degrees of freedom). The T2 statistic has slightly more accurate critical regions, so it is now the preferred statistic. The T2 statistic is the two-way analysis of variance statistic computed on the ranks R(Xij).
Cochran's Q test is applied for the special case of a binary response variable (i.e., one that can have only one of two possible outcomes). Cochran's Q test is valid for complete block designs only.
- Conover, W. J. (1999). Practical Nonparametric Statistics (Third ed.). Wiley. pp. 388–395. ISBN 0-471-16068-7.