Handle alternating video streams a lot better

May fix #5075 in a not sketchy way.

-[Unknown]