Remove the KVO observer removal because of the self observation issues.