Defragmenter: no null handling for cache removals

See https://github.com/airbnb/plog/pull/71#issuecomment-42583027 for the reasoning.