Long press smilie in favorites to enter editing mode. Long press remove button to delete them.

Currently the way to get out of editing mode is to switch sections. I'm not sure how happy I am about that.

Bonus: factor smilie un-favoriting with index updates into a method on SmilieMetadata.