The covariance between and is a summary of their relationship. It’s asking if one variable goes up in value, whether the other variable tends to go up as well (positive covariance) or down (negative).
While in practice we don’t use it as often directly (often, the Correlation is easier to interpret), it is involved in a lot of important topics.
Definition
Mathematically, it is defined as (using square brackets simply for differentiation):
Just like Variance, we have another formula that is much easier to work with in practice:
The similarity is not a coincidence. The variance is just a special case of the covariance. Given , we have .
Properties
- If and are Independent, then . However, the equation being true does not imply independence.
- for any constant .
- for any constant .