Fix annotation loading for char offsets