semvec/pypi-packages huggingface dataset:
signal-spam 0.2
Report an eml file to signal-spam.fr
License: MIT License
Requires Python: >=3.7

# Report to signal-spam.fr

## Install

To install signal-spam CLI, use:

    python -m pip install signal-spam


## Usage

    signal-spam BuyMyDogFood.eml


# Releasing

To push a new version of `signal-spam` on PyPI:

- Bump the `__version__` in `signalspam.py`.
- commit, tag, push commit, push tag.
- `python -m pip install --upgrade build twine`
- `python -m build`
- `python -m twine upload dist/*`
flawunicode 0.1.3
detect flaw or encoding error in unicode text
License: MIT License
Keywords: unicode,detection,annomaly

# flawunicode

Detect unreadable unicode text

Ever encounter any text when crawl text from the internet or inside your raw corpus?

```
srtytyrtyrty
Á¶ÀÌ½ÃÆ¼, ¡®3on3 ÇÁ¸®½ºÅ¸ÀÏ¡¯ 2Á¾ÀÇ ¿¡µð¼Ç ¹øµé Ãâ½Ã
��>+ٽT}$@�������Э����ٗ_���=���e��
```

This is what flawunicode aims to pick these out for you. flawunicode ranks each unicode text and output a score of -1 to 1 which indicates the "completeness" of the unicode text. If the text has a score of lower than 0.4, it is likely this text is not readable by human.

## Usage

```python
import flawunicode
text = "fdsfdxvdhjkf"
flawunicode.detect(text)
>> 0.2727272727272727
flawunicode.detect("Hello World!")
>> 0.6439393939393939
```


## Note

The underlying statistic came from news corpus in [currents api](https://currentsapi.services/en) database. So social network style text maybe rank with low score. You just need to calculate your own frequently used bi-gram characters and it should be fine.