Fix Time#change when used with :usec or :nsec options together with offset times

This is a follow-up of #16758 and the branch is based on it.

Fixes #16759.
Doesn't this prevent you from setting `:sec` and `:usec` ?