semvec/pypi-packages huggingface dataset:
zilliqa-etl 1.0.9
Tools for exporting Zilliqa blockchain data to JSON
Requires Python: >=3.6.0,<3.8.0
Keywords: Zilliqa

# Zilliqa ETL CLI

[![Build Status](https://travis-ci.org/blockchain-etl/zilliqa-etl.svg?branch=master)](https://travis-ci.org/blockchain-etl/zilliqa-etl)

Zilliqa ETL CLI lets you convert Zilliqa data into JSON newline-delimited format.

[Full documentation available here](http://zilliqa-etl.readthedocs.io/).

## Quickstart

Install Zilliqa ETL CLI:

```bash
pip3 install zilliqa-etl
```

Export directory service blocks ([Schema](../docs/schema.md), [Reference](../docs/commands.md)):

```bash
> zilliqaetl export_ds_blocks --start-block 1 --end-block 500000 \
--output-dir output --provider-uri https://api.zilliqa.com
```

Find other commands [here](https://zilliqa-etl.readthedocs.io/en/latest/commands/).

For the latest version, check out the repo and call 
```bash
> pip3 install -e . 
> python3 zilliqaetl.py
```

## Useful Links

- [Schema](https://zilliqa-etl.readthedocs.io/en/latest/schema/)
- [Command Reference](https://zilliqa-etl.readthedocs.io/en/latest/commands/)
- [Documentation](https://zilliqa-etl.readthedocs.io/)

## Running Tests

```bash
> pip3 install -e .[dev]
> export ZILLIQAETL_PROVIDER_URI=https://api.zilliqa.com
> pytest -vv
```

### Running Tox Tests

```bash
> pip3 install tox
> tox
```

## Running in Docker

1. Install Docker https://docs.docker.com/install/

2. Build a docker image
        
        > docker build -t zilliqa-etl:latest .
        > docker image ls
        
3. Run a container out of the image

        > docker run -v $HOME/output:/zilliqa-etl/output zilliqa-etl:latest export_ds_blocks -s 1 -e 500000 -o output
ulozto-search 1.0.4
Python package to query uloz.to
Requires Python: >=3.6, <4

# ulozto-search
Search uloz.to for files using Python. It only supports one-page query for now. 

## Install
It's avaiable in [PyPI](https://pypi.org/project/ulozto-search/), so you can use `pip` to install it:

``` sh
python -m pip install ulozto-search
```

## Usage

``` python
import ulozto_search

query = "your_query"
file_type = "documents|videos|images|archives|audios"  # optional
kwargs = {
    "insecure": False           # disables SSL check, optional, default False
    "includeApproximate": False  # also return approximate results
}

# search and return dictionary
ulozto_search.search(query, file_type, **kwargs)

# search and return HTML string
ulozto_search.searchHTML(query, file_type, **kwargs)
```

It can be also used from terminal:

```
$ ulozto-search -h
usage: ulozto-search [-h] [-t {documents,videos,images,archives,audios}] [--insecure] [--show-approximate] query

positional arguments:
  query                 String to query uloz.to

optional arguments:
  -h, --help            show this help message and exit
  -t {documents,videos,images,archives,audios}, --type {documents,videos,images,archives,audios}
                        Filter by file type
  --insecure            Don't verify SSL certificates, not recommended
  --show-approximate     Show approximate results
```

So if you want to download all files found by ulozto-search, enter this to terminal (uses [ulozto-downloader](https://github.com/setnicka/ulozto-downloader)):

``` sh
ulozto-search "your query" | while read in; do ulozto-downloader --auto-captcha $(echo "$in" | cut -d '|' -f2); done
```