Make sure we create / delete SPDs and SADs on secondary node when it changes on primary. Fixes #2303