Remove the panel when there is no notification