Don't block playlist remove for animations

Blocking removes for animations makes for plenty of headaches and timing
shenanigans.  Let's not do that.

Instead, store a reference to the generated element on the playlist and
original arrays and use that as the selector for removal and
highlighting.