Remove unused includes of boost lexical_cast

We don't use lexical_cast anywhere, no need to include it.