Fix a timing issue with track skipping.

This is something I broke in the previous patch.  Holding the button
is supposed to trigger seeking mode (which is not implemented yet),
but it would instead skip tracks pretty quickly.  This made it a bit
hard to control, as it was easy to skip past the desired track.