Refreshes index after delete

Fix for https://jira.corp.squareup.com/browse/SHUTTLE-220