Fix double notification when delegate is set multiple times