Support owner-class based access
Expose interface to initialize with a reference

- `weak_and_lazy_ref_data_` is now exposed `ref`. It can be used to set
  an optionial hard reference and the loader parameters
- there is a convenience wrapper `defer` which can be used to set only
  the parameters for the loader