We can send the whole buffer, and eventually I think we do want one canonical token extraction function written in Julia, although I'm not sure if that needs to be part of this PR. There's already something in REPLCompletions.jl, although it might have the same problems with operators.