Always check if we should show the drawer affordance.

The answer is no if we've got a currently active fragment with backstack.