This is a change I already made in Custom Persisters branch.... we discussed about this and it is indeed necessary to be done.
We have a memory hit by doing this, but only on a request that consumes a lot of associations when executing UoW operations, so we should be fine.