In statistics, expected mean squares (EMS) are the expected values of certain statistics arising in partitions of sums of squares in the analysis of variance (ANOVA). They can be used for ascertaining which statistic should appear in the denominator in an F-test for testing a null hypothesis that a particular effect is absent.
When the total corrected sum of squares in an ANOVA is partitioned into several components, each attributed to the effect of a particular predictor variable, each of the sums of squares in that partition is a random variable that has an expected value. That expected value divided by the corresponding number of degrees of freedom is the expected mean square for that predictor variable.
The following example is from Longitudinal Data Analysis by Donald Hedeker and Robert D. Gibbons.[1]
Each of s treatments (one of which may be a placebo) is administered to a sample of (capital) N randomly chosen patients, on whom certain measurements
are observed at each of (lower-case) n specified times, for
(thus the numbers of patients receiving different treatments may differ), and
We assume the sets of patients receiving different treatments are disjoint, so patients are nested within treatments and not crossed with treatments. We have
![{\displaystyle Y_{hij}=\mu +\gamma _{h}+\tau _{j}+(\gamma \tau )_{hj}+\pi _{i(h)}+\varepsilon _{hij}}](http://178.128.105.246/host-https-wikimedia.org/api/rest_v1/media/math/render/svg/8765768029e9bbda9d9ec1059e283e696c993ac4)
where
= grand mean, (fixed)
= effect of treatment
, (fixed)
= effect of time
, (fixed)
= interaction effect of treatment
and time
, (fixed)
= individual difference effect for patient
nested within treatment
, (random)
= error for patient
in treatment
at time
. (random)
= variance of the random effect of patients nested within treatments,
= error variance.
The total corrected sum of squares is
![{\displaystyle \sum _{hij}(Y_{hij}-{\overline {Y}})^{2}\quad {\text{where }}{\overline {Y}}={\frac {1}{n}}\sum _{hij}Y_{hij}.}](http://178.128.105.246/host-https-wikimedia.org/api/rest_v1/media/math/render/svg/57689d0d179e7fe55c12a92d90537f6a5f9e7b1b)
The ANOVA table below partitions the sum of squares (where
):
source of variability
|
degrees of freedom
|
sum of squares
|
mean square
|
expected mean square
|
treatment
|
|
|
|
|
time
|
|
|
|
|
treatment × time
|
|
|
|
|
patients within treatments
|
|
|
|
|
error
|
|
|
|
|
A null hypothesis of interest is that there is no difference between effects of different treatments—thus no difference among treatment means. This may be expressed by saying
(with the notation as used in the table above). Under this null hypothesis, the expected mean square for effects of treatments is
The numerator in the F-statistic for testing this hypothesis is the mean square due to differences among treatments, i.e. it is
The denominator, however, is not
The reason is that the random variable below, although under the null hypothesis it has an F-distribution, is not observable—it is not a statistic—because its value depends on the unobservable parameters
and
![{\displaystyle {\frac {\left.{\frac {{\text{SS}}_{\text{Tr}}}{\sigma _{\varepsilon }^{2}+n\sigma _{\pi }^{2}}}\right/(s-1)}{\left.{\frac {{\text{SS}}_{\text{E}}}{\sigma _{\varepsilon }^{2}}}\right/{\big (}(N-s)(n-1){\big )}}}\neq {\frac {{\text{SS}}_{\text{Tr}}/(s-1)}{{\text{SS}}_{\text{E}}/{\big (}(N-s)(n-1){\big )}}}}](http://178.128.105.246/host-https-wikimedia.org/api/rest_v1/media/math/render/svg/c8336c57ed1b2df789bf46325e5138564e7aadbf)
Instead, one uses as the test statistic the following random variable that is not defined in terms of
:
![{\displaystyle F={\frac {\left.{\frac {{\text{SS}}_{\text{Tr}}}{\sigma _{\varepsilon }^{2}+n\sigma _{\pi }^{2}}}\right/(s-1)}{\left.{\frac {{\text{SS}}_{{\text{S}}({\text{Tr}})}}{\sigma _{\varepsilon }^{2}+n\sigma _{\pi }^{2}}}\right/(N-s)}}={\frac {\left.{\text{SS}}_{\text{Tr}}\right/(s-1)}{\left.{\text{SS}}_{\text{S(Tr)}}\right/(N-s)}}}](http://178.128.105.246/host-https-wikimedia.org/api/rest_v1/media/math/render/svg/c15eb784bd4b90c8789e49fa17ecd0db14c8c784)
Notes and references
[edit]
- ^ Donald Hedeker, Robert D. Gibbons. Longitudinal Data Analysis. Wiley Interscience. 2006. pp. 21–24