Properly hide the break notification box