Handle songs being removed in a rescan