Fix recursion in FieldDescriptor.load_deferred