Remove the disposable from self and the observer when KVO observation is disposed of

Fixes half of #1055