Prune input nodes when removing links too