Revert "Only call the update on objects that provide IReferenceable"

This reverts commit f8acb5324614f0a692765e0d34b94415d7cd874a.