Delay reading of seen manifest until stream starts