queue uses ctrl to move the cursor without selecting, and alt to bump selected tracks up or down.
ctrl+arrows and ctrl+space in library work like in the queue.