I think dmesg complained when the interfaces where up. I'll look for the error…
It was this `bonding: bond0: enslaving INTERFACE as an active interface with an up link.` from which I probably assumed that I should bring the interface down. Well, the "down" doesn't seem to have any impact, so should I remove it?