Actually maintaining an internal mapping so docker can pass on proper delete events now.