Fixed this by changing
if (player.currentTime != sprite.start){
to
if (Math.round(player.currentTime) != Math.round(sprite.start)){