Clean up the previous commit a bit

The was_removed variable was rather unnecessary