Compute features only for images and time steps with labels