Once the milk has cooled down, there's really no point for the masala to continue to soak. You'll need to remove the thandai masala before consuming otherwise the texture is sandy and unappealing.