Don't call added/removed callbacks, they are not used by default
currently and they cause some problems with threads on some
implementations.