Don't display inventory selector until something is selected.

otherwise the selection colouring gets in the way of inventory item colouring,
meaning you can't distinguish for example whether or not you've identified the first book in the list of books to read.

From the comment, this actually looks like the intended behaviour anyway?

When you use the arrows to select, the selector appears and works as expected.