Generic Conversion & Segmentation for Ranges: A Solution for Unicode - Mathias Gaunard [BoostCon11]
Channel: CppNow
Date: 29/10/2013

https://cppnow.org
---

There has always been much demand for a solution in Boost to deal with Unicode, the industry standard to consistently represent and manipulate text across most of the world's writing systems. In this talk, we present our solution which was initially started during the Google Summer of Code 2009. Based on the concept of Range, it is lightweight, non-intrusive, flexible and generic, and potentially lazy too.

To make the algorithms generic, they were all rewritten, and as such the library does not depend on any existing Unicode solution. The library requires some external data, but albeit the library embeds its own database, there is a clear and stable ABI that can be used to link the library with another database.

The need for a Unicode library has led to another library as a spin-off: Convert, a library that allows to easily convert ranges using N to M transformations or to segment them; be it eagerly or lazily as the ranges are iterated. It also provides facilities to help in the development of SIMD-accelerated transformations. While that library was initially made for Unicode, we show it can be used for a variety of things unrelated to character encoding conversion.
---
Optimized And Managed by Digital Medium Ltd - events.digital-medium.co.uk
events@digital-medium.co.uk
---

*--*

---