Correct issue where notification was shown all the time
Make sure we don't overlap fragmets on rotation