Shifting onto a HABTM should immediately set the ids