Package: faust-cchardet
cChardetNOTICE: This is a fork of the original project athttps://github.com/PyYoshi/cChardetsince
the original project is no longer maintained.To install:pipinstallfaust-cchardetcChardet is high speed universal character encoding detector. - binding touchardet.Supported Languages/EncodingsInternational (Unicode)UTF-8UTF-16BE / UTF-16LEUTF-32BE / UTF-32LE / X-ISO-10646-UCS-4-34121 /
X-ISO-10646-UCS-4-21431ArabicISO-8859-6WINDOWS-1256BulgarianISO-8859-5WINDOWS-1251ChineseISO-2022-CNBIG5EUC-TWGB18030HZ-GB-2312Croatian:ISO-8859-2ISO-8859-13ISO-8859-16Windows-1250IBM852MAC-CENTRALEUROPECzechWindows-1250ISO-8859-2IBM852MAC-CENTRALEUROPEDanishISO-8859-1ISO-8859-15WINDOWS-1252EnglishASCIIEsperantoISO-8859-3EstonianISO-8859-4ISO-8859-13ISO-8859-13Windows-1252Windows-1257FinnishISO-8859-1ISO-8859-4ISO-8859-9ISO-8859-13ISO-8859-15WINDOWS-1252FrenchISO-8859-1ISO-8859-15WINDOWS-1252GermanISO-8859-1WINDOWS-1252GreekISO-8859-7WINDOWS-1253HebrewISO-8859-8WINDOWS-1255Hungarian:ISO-8859-2WINDOWS-1250Irish GaelicISO-8859-1ISO-8859-9ISO-8859-15WINDOWS-1252ItalianISO-8859-1ISO-8859-3ISO-8859-9ISO-8859-15WINDOWS-1252JapaneseISO-2022-JPSHIFT_JISEUC-JPKoreanISO-2022-KREUC-KR / UHCLithuanianISO-8859-4ISO-8859-10ISO-8859-13LatvianISO-8859-4ISO-8859-10ISO-8859-13MalteseISO-8859-3Polish:ISO-8859-2ISO-8859-13ISO-8859-16Windows-1250IBM852MAC-CENTRALEUROPEPortugueseISO-8859-1ISO-8859-9ISO-8859-15WINDOWS-1252Romanian:ISO-8859-2ISO-8859-16Windows-1250IBM852RussianISO-8859-5KOI8-RWINDOWS-1251MAC-CYRILLICIBM866IBM855SlovakWindows-1250ISO-8859-2IBM852MAC-CENTRALEUROPESloveneISO-8859-2ISO-8859-16Windows-1250IBM852MExample# -*- coding: utf-8 -*-importcchardetaschardetwithopen(r"src/tests/samples/wikipediaJa_One_Thousand_and_One_Nights_SJIS.txt","rb")asf:msg=f.read()result=chardet.detect(msg)print(result)Benchmark$cdsrc/$pipinstallchardet$pythontests/bench.pyResultsCPU: Intel(R) Core(TM) i7-9700K CPU @ 3.60GHzRAM: DDR4-3200 64GBPlatform: Ubuntu 20.04 amd64Python 3.9.0Request (call/s)chardet v3.0.40.46cchardet v2.1.71404.05LICENSESeeCOPYINGfile.ContactIssuesPlatformSupportWindows i686, x86_64Linux i686, x86_64macOS x86_64Do not SupportAnacondapyenvCHANGES2.x.x2.1.7 (2020-10-27)support Python 3.9drop support for Python 3.52.1.6 (2020-03-17)drop support for Python 2.7support Github Actionsupdate dev-dependencies2.1.5 (2019-09-27)update language models (uchardet)add iso8859-2 test but disabled itsupport Python 3.8drop support for Python 3.42.1.4 (2018-09-27)disable LTO because become poor performance2.1.3 (2018-09-26)support Python 3.72.1.2 (2018-09-26)enableLTOfor wheel buildsupdate Cython2.1.1 (2017-07-01)fix that different results with different chuck sizesfix that assignments to nsSMState in nsCodingStateMachine result in unspecified behaviorinclude COPYING in package2.1.0 (2017-05-15)add cchardetect CLI script (#30)@craigds2.0.1 (2017-04-25)fix an issue where UTF-8 with a BOM would not be detected as UTF-8-SIG (fix#28)pass NULL Byte to feed() / detect() (fix#27)2.0.0 (2017-04-06)Improve tests2.0a4 (2017-04-05)Update uchardet repo (Fix buffer overflow)2.0a3 (2017-03-29)Implement UniversalDetector (like chardet)2.0a2 (2017-03-28)Update uchardet repo (Fix memory leak)2.0a1 (2017-03-28)Replaceuchardet-enhancedtouchardetRemove Detector class1.1.3 (2017-02-26)Support AArch641.1.2 (2017-01-08)Support Python 3.61.1.1 (2016-11-05)Use len() function (9e61cb9e96b138b0d18e5f9e013e144202ae4067)Remove detect function in _cchardet.pyx (25b581294fc0ae8f686ac9972c8549666766f695)Support manylinux1 wheel1.1.0 (2016-10-17)Add Detector classImprove unit tests