Make sure one notification is always foreground