Remove unnecessary assignment
Do not dereference non-reference attributes

This allows us to run `Mapper#load_association!` on objects with
attributes that may not be references without having to rely on client
code to decide what has and has not been loaded already.