Append a deletion button when we handle creation