Add notifier as a tracked repo