Handle key deletion