Don't intercept set for associations (in creating or loading)