semvec/pypi-packages huggingface dataset:
multiflow 1.0.4
A Python multithreading library for data processing pipelines, data streaming, etc.
License: MIT
Keywords: multiflow multithreading data processing streaming concurrent futures python

<h1 align="center">multiflow</h1>

[![tests](https://github.com/nyoungstudios/multiflow/actions/workflows/python-test.yml/badge.svg)](https://github.com/nyoungstudios/multiflow/actions/workflows/python-test.yml)
[![codecov](https://codecov.io/gh/nyoungstudios/multiflow/branch/main/graph/badge.svg?token=9M2UZ4WJ36)](https://codecov.io/gh/nyoungstudios/multiflow)
[![Gitpod ready](https://img.shields.io/badge/Gitpod-ready-blue?logo=gitpod)](https://gitpod.io/#https://github.com/nyoungstudios/multiflow)
[![PyPI version shields.io](https://img.shields.io/pypi/v/multiflow.svg)](https://pypi.python.org/project/multiflow/)
[![PyPI license](https://img.shields.io/pypi/l/multiflow.svg)](https://pypi.python.org/project/multiflow/)

## About
`multiflow` is a Python multithreading library for data processing pipelines/workflows, streaming, etc. It extends `concurrent.futures` by allowing the input and output to be generator objects. And, it makes it easy to string together multiple thread pools together to create a multithreaded pipeline.

Additionally, `multiflow` comes with periodic logging, automatic retries, error handling, and argument expansion.

## Why?
The ability to accept an input generator object while yielding an output generator object makes it ideal for concurrently doing multiple jobs where the output of the first job is the input of the second job. This means that it can start doing work on the second job before the first job completes; thus, completing the total work faster.

A great use case for this is streaming data. For example, with `multiflow` and [`smart_open`](https://github.com/RaRe-Technologies/smart_open), you could stream images from S3 and process them in a multithreaded environment before exporting them elsewhere.

## Install
```sh
pip install multiflow
```

## Quickstart
```python
from multiflow import MultithreadedFlow


image_paths = []  # list of images


def transform(image_path):
    # do some work
    return new_path


with MultithreadedFlow() as flow:
    flow.consume(image_paths)  # can accept generator object or iterable item (see examples below for generator)
    flow.add_function(transform)

    for output in flow:
        if output:  # if successful
            print(output)  # new_path
        else:
            e = output.get_exception()

    success = flow.get_successful_job_count()
    failed = flow.get_failed_job_count()

```

## Examples
For a working program using `multiflow`, see this [example](https://github.com/nyoungstudios/multiflow/blob/main/examples/resize/resize.py) which resizes a S3 bucket of images to 50% and saves the resized images locally.

## Documentation
The documentation is still a work in progress, but for the most up to date documentation, please see this [page](https://github.com/nyoungstudios/multiflow/blob/main/docs/thread.md).
pm2case 0.0.7
Convert POSTMAN data to JSON testcases for HttpRunner.
License: MIT
Keywords: postman converter json

# postman2case

[![LICENSE](https://img.shields.io/github/license/HttpRunner/postman2case.svg)](https://github.com/HttpRunner/postman2case/blob/master/LICENSE) [![Build Status](https://travis-ci.org/HttpRunner/postman2case.svg?branch=master)](https://travis-ci.org/HttpRunner/postman2case) [![coveralls](https://coveralls.io/repos/github/HttpRunner/postman2case/badge.svg?branch=master)](https://coveralls.io/github/HttpRunner/postman2case?branch=master)

Convert postman data to yaml testcases for HttpRunner.

## usage

To see ``postman2case`` version:

```shell
$ python main.py -V
0.0.1
```

To see available options, run

```shell
$ python main.py -h
usage: main.py [-h] [-V] [--log-level LOG_LEVEL]
               [postman_testset_file] [output_testset_file]

Convert postman testcases to JSON testcases for HttpRunner.

positional arguments:
  postman_testset_file  Specify postman testset file.
  output_testset_file   Optional. Specify converted JSON testset file.

optional arguments:
  -h, --help            show this help message and exit
  -V, --version         show version
  --log-level LOG_LEVEL
                        Specify logging level, default is INFO.
```

## examples

In most cases, you can run ``postman2case`` like this:

```shell
$ python3 main.py test/test.json output.json
INFO:root:Generate JSON testset successfully: output.json
```

As you see, the first parameter is postman source file path, and the second is converted JSON file path.

The output testset file type is detemined by the suffix of your specified file.

If you only specify postman source file path, the output testset is in JSON format by default and located in the same folder with source file.

```shell
$ python3 main.py test/test.json
INFO:root:Generate JSON testset successfully: test/test.output.json
```

## generated testset

generated JSON testset ``output.json`` shows like this:

```json
[
    {
        "test": {
            "name": "/api/v1/Account/Login",
            "request": {
                "method": "POST",
                "url": "https://httprunner.top/api/v1/Account/Login",
                "headers": {
                    "Content-Type": "application/json"
                },
                "json": {
                    "UserName": "test001",
                    "Pwd": "123",
                    "VerCode": ""
                }
            },
            "validate": []
        }
    }
]
```
gmArrayFilter 1.0.3
A python package to filter SNP array data
License: MIT
Keywords: bioinformatics,NGS,Reseq,SNP

gmArrayFilter: Axiom chip data filter and visualization
========================================================


Usage
-----------

split merged chip file


    $ gmArray filter array-split \
        array.file split.dir --prefix prefix


filter chip data

    $ gmArray filter array-filer-web \
        --array-dir uploads/project/605b06231ac54fdcc821c83f \
        --array-dir public/publicData/array \
        --genome-dir /home/kent/data/gmap/gmapdb/data \
        --out-dir public/score/605b06431ac54fdcc821c845 \
        --array-annotation-dir public/array \
        --options '{"mutant":["mutant"],"wild":["wild"],"mutant_parent":[],"wild_parent":[],"array":"660K","child_max_na":0,"parent_max_na":1,"mutant_gt":"homozygous","wild_gt":"heterozygous","mutant_parent_gt":"homozygous","wild_parent_gt":"homozygous","strict":0,"density_window":1000000,"density_step":500000,"genomes":["CSv1.0","CSv2.0"]}'
sphinx-sqlalchemy 0.1.1
Sphinx extension for documenting SQLAlchemy ORMs
License: MIT
Requires Python: ~=3.7
Keywords: sphinx

# sphinx-sqlalchemy

[![PyPI][pypi-badge]][pypi-link]

Sphinx extension for documenting SQLAlchemy ORMs

[pypi-badge]: https://img.shields.io/pypi/v/sphinx-sqlalchemy.svg
[pypi-link]: https://pypi.org/project/sphinx-sqlalchemy
flexpoolapi-v2 2.2.4.post7
🐍 Pythonic wrapper for Flexpool API v2
License: MIT
Requires Python: >=3.6

# py-flexpoolapi-v2

[![PyPI Latest Release](https://img.shields.io/pypi/v/flexpoolapi-v2.svg)](https://pypi.org/project/flexpoolapi-v2)

Structured Python wrapper for [Flexpool.io](https://flexpool.io/) API v2.

# Installation

Install **py-flexpoolapi-v2**.

## Using pip
```sh
pip3 install flexpoolapi-v2
```

## Build from source
```sh
git clone https://github.com/nekusu/py-flexpoolapi-v2.git
cd py-flexpoolapi-v2
pip3 install -r requirements.txt
sudo make install  # or `sudo python3 setup.py install`
```

# Usage

Quick example:
```python
>>> import flexpoolapi
>>> from flexpoolapi.utils import *

# Coins
>>> coins = flexpoolapi.poolapi.coins()
>>> coins[0].name
'Ethereum'
>>> coins[1].name
'Chia'

# ETH Pool
>>> eth_pool = flexpoolapi.pool("eth")
>>> format_hashrate(eth_pool.hashrate().total, "eth")
'11.2 TH/s'
>>> eth_pool.miner_count()
20600
>>> eth_pool.worker_count()
50987

# XCH Pool
>>> xch_pool = flexpoolapi.pool("xch")
>>> format_hashrate(xch_pool.hashrate().total, "xch")
'207.9 PB'
>>> xch_pool.miner_count()
3530
>>> xch_pool.worker_count()
4933

# ETH Miner
>>> eth_miner = flexpoolapi.miner("eth", eth_pool.top_miners()[0].address)
>>> format_decimals(eth_miner.balance().balance, "eth")
'1.01524 ETH'
>>> format_hashrate(eth_miner.stats().current_effective_hashrate, "eth")
'1.6 TH/s'

# XCH Miner
>>> xch_miner = flexpoolapi.miner("xch", xch_pool.top_miners()[0].address)
>>> format_decimals(xch_miner.balance().balance, "xch")
'0.1692 XCH'
>>> format_hashrate(xch_miner.stats().current_effective_hashrate, "xch")
'2.3 PB'

# Locate Address
>>> flexpoolapi.minerapi.locate_address(eth_pool.top_miners()[0].address)
'eth'
```

For better understanding, I recommend reading the [Flexpool APIv2 documentation](https://www.flexpool.io/docs/api). All variables/functions names were renamed from **camelCase** to **snake_case**.

## Undocumented endpoints added
### **Miner API**

- `/miner/details` (GET)
- `/miner/payoutSettings` (POST)
- `/miner/notificationSettings` (POST)

# License
MIT - Copyright (c) 2020 Flexpool