Simplify up/down left/right handlers without hasItem in single-select mode, as we don't care about ctrlKey etc there