For convolutional layers, we want to be able to choose whether to do per-pixel or per-channel biases. In the per-pixel case, the biases are not a vector.