Ah.  The reason I've never noticed that is the use of 'sudo' there - it removes root's keys, not the logged in user's...