If sidebar is not visible do not toggle visibility.