semvec/pypi-packages huggingface dataset:
ekphrasis 0.1.5
Text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction.
License: MIT

Text processing tool, geared towards text from social networks, such as Twitter or Facebook.
The tool performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, 
using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

_ekphrasis_ was developed as part of the text processing pipeline for
_DataStories_ team's submission for _SemEval-2017 Task 4 (English), Sentiment Analysis in Twitter_.

**Documentation and complete examples will be coming soon.**

## Overview

_ekphrasis_ processes text in two steps: 
  1. **Tokenization**. The difficulty in tokenization is to avoid splitting expressions or words that should be kept intact (as one token).
  Although there are some tokenizers geared towards Twitter [1],[2] that recognize the Twitter markup 
  and some basic sentiment expressions or simple emoticons. 
  Our tokenizer offers additional functionality as it is able to identify most emoticons, emojis, expressions such as 
  dates (e.g. 07/11/2011, April 23rd), times (e.g. 4:30pm, 11:00 am), currencies (e.g. \$10, 25mil, 50€), acronyms, censored words (e.g. s**t), 
  words with emphasis (e.g. *very*) and more.
 
  2. **Post-processing**. After the tokenization you can perform an extra postprocessing step, applying modifications on the extracted tokens.
  This is where you can perform spell correction, word normalization and segmentation and decide which tokens to omit, normalize or annotate (surround or replace with special tags).

### Spell Correction
The Spell Corrector extends the functionality of Peter Norvig's spell-corrector.

### Word Segmentation
Word Segmentation that implements the Viterbi algorithm for word segmentation. Based on CH14 from the book Beautiful Data (Segaran and Hammerbacher, 2009)



---
_Ekphrasis_ means expression in Greek (Modern Greek:έκφραση, Ancient Greek:ἔκφρασις). 
 <!--relies on Regular Expression for the text tokenization.-->

#### References

[1] K. Gimpel et al., “Part-of-speech tagging for twitter: Annotation, features, and experiments,” in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers-Volume 2, 2011, pp. 42–47.

[2] C. Potts, “Sentiment Symposium Tutorial: Tokenizing,” Sentiment Symposium Tutorial, 2011. [Online]. Available: http://sentiment.christopherpotts.net/tokenizing.html.
rtrlib 0.1
rtrlib binding
License: MIT

|docs|

=============
rtrlib-python
=============

rtrlib-python is a cffi based python binding for rtrlib_.

.. _rtrlib: https://github.com/rtrlib/rtrlib

Sphinx docs can be found in the docs directory and build with ``make html``.

for usage examples see the tools directory

Features
--------
Features supported so far:

- Prefix validation
- rtr_mgr callbacks



Install Instructions
--------------------

Requirements
''''''''''''
- python 2.7 or python 3
- cffi>=1.4.0
- enum34
- six

and a c compiler at build time.

If you are using virtualenv the Requirements are installed automatically during the install step, otherwise you have to use your platforms package management tool or just run pip install -r requirements.txt.


Download and Installation
'''''''''''''''''''''''''

- ``git clone https://github.com/rtrlib/python-binding.git``
- ``cd python-binding``
- ``python setup.py build``
- ``python setup.py install``


.. |docs| image:: https://readthedocs.org/projects/python-rtrlib/badge/?version=latest
    :target: http://python-rtrlib.readthedocs.io/en/latest/?badge=latest
    :alt: Documentation Status
xillypy 0.1.1
A simple Xillybus interface written in Python
License: MIT
Keywords: xillybus interface development

XillyPy |PyPi| |License|
=========================

A simple Xillybus interface written in Python.
It supports streaming as well as reading/writing bytes to an address/data interface.

Usage
=====
.. code:: python

  import xillypy
  # write 16 (0x10, 0b00010000) to address 2
  xillypy.memory_write('/dev/xillybus_mem', 2, (16,))
  # write some bytes (.encode()) to a streaming interface
  xillypy.stream_write('/dev/xillybus_write', 'this is my data i want to write'.encode())



An example can be found in `benchmark.py <https://github.com/krabo0om/XillyPy/blob/master/benchmark.py>`_.

Compatibility
=============
The code was tested with Python 3.5 and 3.6 on a Linux Host (Ubuntu 16.04).


.. |PyPi| image:: https://img.shields.io/pypi/v/xillypy.svg
    :target: https://pypi.python.org/pypi/xillypy/

.. |License| image:: https://img.shields.io/badge/license-MIT-blue.svg
    :target: https://raw.githubusercontent.com/krabo0om/XillyPy/master/LICENSE