Only remove our keys