don't constantly hammer demuxer to get stream count

Note this could cause regressions in files where streams show
up during playback, but i think the demuxer signals such
situations now.