semvec/pypi-packages huggingface dataset:
target-terminusdb 0.1.4
Singer.io target for inserting data in TerminusDB

# target-terminusdb

This is a [Singer](https://singer.io) target that reads JSON-formatted data
following the [Singer spec](https://github.com/singer-io/getting-started/blob/master/SPEC.md).

## To install

`target-terminusdb` can be install via pip with Python >= 3.7:

`python3 -m pip install -U target-terminusdb`

## To use

You can start a project in a directory using conjunction with TerminusDB easily by:

`terminusdb startproject`

This will create the config.json that stores information about the endpoint and database that you are connecting to.

Then you can pipe in data using a Singer.io tap to TerminusDB. For details about how to use a Singer.io tap you can [see here](https://github.com/singer-io/getting-started/blob/master/docs/RUNNING_AND_DEVELOPING.md#running-and-developing-singer-taps-and-targets). For example you have a Python tap like this:

```Python
import singer
import urllib.request
from datetime import datetime, timezone

now = datetime.now(timezone.utc).isoformat("T","milliseconds")
schema = {
    'properties':   {
        'ip': {'type': 'string'},
        'timestamp': {'type': 'string', 'format': 'date-time'},
    },
}

with urllib.request.urlopen('http://icanhazip.com') as response:
    ip = response.read().decode('utf-8').strip()
    singer.write_schema('my_ip', schema, 'timestamp')
    singer.write_records('my_ip', [{'timestamp': now, 'ip': ip}])
```

Then you can use it to put `my_ip` in TerminusDB like this:

`python tap_ip.py | target-terminusdb -c config.json`
ML-Formatter 1.0.1
An easy to use package for parsing media and transforming it for your Machine Learning projects.
Requires Python: >=3.6

ML Formatter
------------

A simple set of scripts that take act as a middle man for media 
intake during  machine learning pipelines. 

Given input arguments, this program aims to produce
the required output format for specific use cases. 

Currently:
 - DeepSpeech

### Usage

```shell
> python -m formatter
```

To view all arguments
```shell
> python -m formatter --help
usage: __main__.py [-h] [-v | -q] [--dont-shuffle] [--train TRAIN] [--test TEST] [--val VAL] [--parser {deepspeech}] [--media_type {wav}]
                   [--transcript_type {txt}] [--media MEDIA] [--transcript TRANSCRIPT] [--output OUTPUT]

Given a set of media, create and output to the required spec of certain ML programs

optional arguments:
  -h, --help            show this help message and exit
  -v, --verbose
  -q, --quiet
  --dont-shuffle        Don't shuffle before splitting into runs
  --train TRAIN         Training part of train/test/val split. Out of 1
  --test TEST           Testing part of train/test/val split. Out of 1
  --val VAL             Validation part of train/test/val split. Out of 1
  --parser {deepspeech}
                        The format you wish to receive as output
  --media_type {wav}    The file extension of media files
  --transcript_type {txt}
                        The file extension of text transcript files
  --media MEDIA         Path to the directory containing media files
  --transcript TRANSCRIPT
                        Path to files containing text transcripts
  --output OUTPUT       Path to directory to use as an output folder
```

Example usage
```shell
> python -m formatter --media ./media --transcript ./transcripts --output ./output --verbose
```
greenws 0.1.0a7
WebSockets for gevent.
Requires Python: >=3.7

**greenws** provides an implementation of websockets (`RFC 6455`_) for the
gevent_ networking library. It is backed by the excellent wsproto_ protocol
implementation.

Documentation
-------------

Available on RTD_.

Usage
-----

Don't. Not yet, at least: there's still a lot of work left to do: passing the
Autobahn compliance tests and a nicer client API are the current priorities.

.. _RFC 6455: https://datatracker.ietf.org/doc/html/rfc6455
.. _gevent: https://gevent.org/
.. _wsproto: https://github.com/python-hyper/wsproto
.. _RTD: https://greenws.rtfd.io/