Include libcharset into both the Timber and Halibut checkouts.
Unfortunately this means people will have to do `cvs co' again to
get this update, but that appears to be the price I pay for being
able to conveniently share a single source base in this way.


git-svn-id: svn://svn.tartarus.org/sgt@4086 cda61777-01e9-0310-a592-d414129be87e
In preparation for using libcharset in Halibut, I've added
PDFDocEncoding to the SBCS list; this is a custom superset of
ISO-8859-1 used in PDF files to store user-visible text that isn't
printed on a page (such as metadata and the document outline).


git-svn-id: svn://svn.tartarus.org/sgt@4087 cda61777-01e9-0310-a592-d414129be87e
Link libcharset into Halibut. (This involved faffing with
CVSROOT/modules, so anyone with a checked-out copy of Halibut will
unfortunately need to do `cvs co' again.)


git-svn-id: svn://svn.tartarus.org/sgt@4088 cda61777-01e9-0310-a592-d414129be87e
Now this is a top-level CVS module, it should have LICENCE and
MODULE files of its own.


git-svn-id: svn://svn.tartarus.org/sgt@4089 cda61777-01e9-0310-a592-d414129be87e
`gcc -Wall' points out some signed/unsigned comparisons. Fixed.


git-svn-id: svn://svn.tartarus.org/sgt@4090 cda61777-01e9-0310-a592-d414129be87e
Fix an oddity in PDFDocEncoding.


git-svn-id: svn://svn.tartarus.org/sgt@4093 cda61777-01e9-0310-a592-d414129be87e
I typed `Win1252' today and libcharset didn't recognise it. Fixed.


git-svn-id: svn://svn.tartarus.org/sgt@4107 cda61777-01e9-0310-a592-d414129be87e
Add charset_from_locale(), a best-effort attempt to return the
libcharset CS_* identifier for the character set indicated by the
active locale. Uses code from Markus Kuhn's website.


git-svn-id: svn://svn.tartarus.org/sgt@4115 cda61777-01e9-0310-a592-d414129be87e
Preferred MIME name for ASCII is "US-ASCII", not "ANSI_X3.4-1968". Oops.


git-svn-id: svn://svn.tartarus.org/sgt@4269 cda61777-01e9-0310-a592-d414129be87e
The COMPOUND_TEXT encoding used by some X applications to transfer
internationalised text in selections is a subset of ISO 2022
containing no base character sets which libcharset doesn't already
support. As such, it isn't too hard to add direct compound text
support into libcharset, so here it is. With any luck I should
eventually be able to integrate this into Unix PuTTY, to deal with
the fact that the useful Xutf8 functions we currently use are
specific to XFree86.


git-svn-id: svn://svn.tartarus.org/sgt@4578 cda61777-01e9-0310-a592-d414129be87e
Fix first two bugs in compound text support: escape sequences were
mis-ordered, and initial charset state failed to specify 8859-1 in GR.


git-svn-id: svn://svn.tartarus.org/sgt@4579 cda61777-01e9-0310-a592-d414129be87e
Cross-testing the libcharset compound text implementation against
Xutf8TextListToTextProperty reveals that the latter supports JIS X
0212 via the escape sequences ESC $ ( D and ESC $ ) D, although this
is not listed in my copy of ctext.ps. It's easy enough to support
it, though, so now we do.


git-svn-id: svn://svn.tartarus.org/sgt@4581 cda61777-01e9-0310-a592-d414129be87e
Couple of fiddly fixes in libcharset.


git-svn-id: svn://svn.tartarus.org/sgt@4701 cda61777-01e9-0310-a592-d414129be87e
Add a `--list-charsets' option to Halibut to enumerate canonical names of known
character sets.

(Also make libcharset `return_in_enum' values saner.)


git-svn-id: svn://svn.tartarus.org/sgt@5341 cda61777-01e9-0310-a592-d414129be87e
Explicitly constify a bunch of static data declarations which were
conceptually const but not declared as such. Halibut is now back to
the practically-speaking-pointless but rather satisfying status of
having no global writable data whatsoever :-)


git-svn-id: svn://svn.tartarus.org/sgt@5476 cda61777-01e9-0310-a592-d414129be87e
I've apparently had this todo-list comment sitting on stormhawk for
nearly a year and not checked it in.


git-svn-id: svn://svn.tartarus.org/sgt@6309 cda61777-01e9-0310-a592-d414129be87e
Bring utf8.c's internal tests up to date in the (somewhat belated)
wake of r3713.


git-svn-id: svn://svn.tartarus.org/sgt@6314 cda61777-01e9-0310-a592-d414129be87e
Substantial overhaul of the UTF-8 decoder.  It now uses 26 bits of state
rather than 32, which might make it possible to use it inside another
decoder.  All the tests still pass.


git-svn-id: svn://svn.tartarus.org/sgt@6315 cda61777-01e9-0310-a592-d414129be87e
TIS-620 is equivalent to ISO 8859-11, so map the MIME name for the former to
the latter.


git-svn-id: svn://svn.tartarus.org/sgt@6316 cda61777-01e9-0310-a592-d414129be87e
Names for ASCII and JIS X 0201 that appear both in the X registry and in
the usual X fonts.


git-svn-id: svn://svn.tartarus.org/sgt@6317 cda61777-01e9-0310-a592-d414129be87e