Agent.on_notification uses get w/default when getting notifications_callback. If unsubscribe is called, and the callback is removed the ioloop still seems to have a chance to receive a message, and try to call the now non-existent callback. Instead, default to the default notification callback