Remove lexical cast

There seems to be no pressing reason to depend on lexical_cast, a part of boost which is notoriously slow. This removes the dependency.