Only show the inventory drawer if the user has picked something up