I did a small analysis on the logging output and it turned out that swapping both conditions saves about 15% requests. Running the tests, though, produces 2k additional requests and each request is ~10 times more time consuming than a single call to `symbol`. Looks like this PR slows down semantic highlighting too much.