text: We have calculated << analytical expressions >> for how the bias and variance of the estimators provided by various temporal difference value estimation algorithms change with offline updates over trials in absorbing Markov chains using [[ lookup table representations ]] .