Cancel timer on manager destruction + protect the timeout cb