[fix] if we somehow fail to delete, lets try it again until it works to be deterministic

I believe i was running into this edge case somewhere. If we should delay the retries for any reason let me know