Add and remove object from associated streams when association modified