Retry removing memory components if not successful a fixed number of times.