Fix issue with showing notifcations which happened when not active