better error handling
clean up exception handling
add utilities to remove cruft control characters, do re-encoding to non-UTF8 text
fail a little faster (before ingest attempt), better errors