remove and track our own keymaster