Move video skip detection to WindowManager

Fixes a bug where skipping using Esc would not work if a mouse button had been pressed previously