Always remove an alias when we rename the target.

Should fix the dragonegg build bots.