This shouldn't take up any more vertical space.  It should be on the same line as the sort text.

So probably have this float left and the sort text float right.