Log an error if removing the persistent store fails.