Fix recursion in Field.load_deferred