Changed again, now the background script keeps track only of any currently playing video(s), and the active tab, so that when the tab changes it stops the old polling and starts the new, and if any tab sends that a video started the one(s) registered as playing get told to stop.
Downside of this method is that it has to message a tab everytime it blurs, and focusses, even if it's not a youtube tab.