semvec/pypi-packages huggingface dataset:
onnx-connx-neowine 0.1.4
ONNX to CONNX converting tool

# ONNX to CONNX Converter
onnx-connx is a tool which converts ONNX to CONNX model. 
And onnx-connx is also a NumPy ONNX Runtime implementation for CONNX.
We don't recommend to use onnx-connx as an ONNX Runtime for NumPy is very (very) slow. 

# For users
## Install onnx-connx via pip
```sh
pip install git+https://github.com/semihlab/onnx-connx
```

## Convert ONNX to CONNX model
```sh
python -m onnx_connx --help        # to get help message
python -m onnx_connx [onnx model]  # to convert onnx to connx
```

# For developers
## Prepare development environments
 * python3
 * onnx               # python package, to run onnx2connx converter
 * protobuf-compiler  # to run bin/dump utility
 * tabulate           # python package, to run test cases
 * pytest-parallel    # python package, to run test cases

```sh
$ sudo apt install python3 python3-pip python3-venv
$ python3 -m pip install --user virtualenv
$ python3 -m venv venv
$ source venv/bin/activate
$ pip install --upgrade pip
$ pip install onnx
```
## Debug installation
```sh
pip install git+file:///[path-to-onnx-connx]
```

## Dump onnx to text
```sh
onnx-connx$ bin/dump [onnx path]  # This utility will dump onnx or pb to text using protoc
```

## Test
## Run test 
```sh
onnx-connx$ make test
```
## Convert all test cases that connx supports
```sh
onnx-connx$ make convert-test [ONNX_HOME=[onnx install dir]] [CONNX_HOME=[connx source dir]] # ONNX_HOME and CONNX_HOME can be omitted
```

## Convert individual test case
```sh
onnx-connx$ bin/convert [onnx test case path] [connx test case path]
```

## Run connx backend
connx backend will compile the ONNX to CONNX and run it using NumPy operators.

```sh
python -m onnx_connx.backend [onnx model] [[input tensor] ...]
```

## Run MNIST example
```sh
onnx-connx$ cd examples
onnx-connx/examples$ ./download.sh
onnx-connx/examples$ cd ..
onnx-connx$ python -m onnx_connx.backend examples/mnist/model.onnx examples/mnist/input_0.pb
```

# Contribution
See [CONTRIBUTING.md](CONTRIBUTING.md)

# License
CONNX is licensed under GPLv3. See [LICENSE](LICENSE)
danphe 0.0.1
Extracting information from the website
Keywords: python,email,phone number,telephone,url,count url


# danphe

Under construction! Give a try at it!

Developed by Ujjawal Shah (c) 2022

## Examples of How To Use Package

Count number of total URL

```python
import danphe

urls = danphe.Getallurls('https://www.bok.com.np/')
total_unique_url = len(urls.uniqueurls())
print(f'total unique urls: {total_unique_url}')
```

Get all urls from which information can be extracted. 
Those webpages which are non-image can only be used to extract information i.e webpages excluding '.pdf', '.jpeg', '.jpg', '.zip', '.png' extension

```python
import danphe

urls = danphe.Getallurls('https://www.bok.com.np/')

#usefulurls() will filter the urls except the ones with '.pdf', '.jpeg', '.jpg', '.zip', '.png' extension
useful_urls = urls.usefulurls()
print(f'useful urls: {useful_urls}')
```

Print all the emails from the website

```python
import danphe

urls = danphe.Getallurls('https://www.bok.com.np/')
email_address = urls.emails()
print(f'emails: {email_address}')
```
s3-to-sftp 1.0.1
S3 to SFTP application / watcher. Feeds from S3 to SQS notifications.
Requires Python: >=3.9,<4.0
Keywords: compose-x,aws,sftp,docker,compose

============
S3 to SFTP
============

Simple application that listens on a SQS Queue and transfers files from S3
to a SFTP Server.

The authentication can be done via username/password or username/private key.
Private key should be stored "as-is" in AWS Secrets Manager.

The container must have an environment variable ``SFTP_TARGET``, that follows the format below.
You can set an enviroment variable for each of the below, using the property name as environment variable name.

The value in environment variables overrides the values otherwise set.

Build
======

You can build the docker image with the following commands

.. code-block::

    docker build . -t s3-to-sftp

Alternatively, using docker-compose

.. code-block::

    docker-compose build

Deploy with ECS Compose-X
===========================

We highly recommend that you store the value for ``SFTP_TARGET`` in AWS Secrets Manager.

Install compose-x
------------------

.. code-block::

    python3 -m venv compose-x
    source compose-x/bin/activate
    pip install pip -U; pip install ecs-composex

Deploy
--------

You might need to update the settings in the aws.yaml file to meet your environment settings.
On start, the connection to the SFTP server is not established, so the deployment won't fail
because of that. However, it requires to have the ``SFTP_TARGET`` details setup in before it
starts listening on the SQS queue jobs.

.. code-block::

    ecs-compose-x up -d templates -f docker-compose.yaml -f aws.yaml -p s3-to-sftp-testing

Monitoring
-----------

In AWS CloudWatch, you will see new metrics in a Namespace called ``S3ToSFTP`` which is going to have
some metrics, here for statistics.

These metrics are published using `EMF`_.

.. _EMF: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch_Embedded_Metric_Format_Specification.html


SFTP_TARGET format
===================

.. code-block::

    {
        "$schema": "http://json-schema.org/draft-07/schema#",
        "id": "sftp-secret-format",
        "type": "object",
        "additionalProperties": false,
        "properties": {
            "host": {
                "type": "string",
                "format": "idn-hostname"
            },
            "port": {
                "type": "number",
                "minimum": 1,
                "maximum": 65535
            },
            "username": {
                "type": "string"
            },
            "password": {
                "type": "string"
            },
            "default_path": {
                "type": "string"
            },
            "private_key": {
                "type": "string"
            },
            "private_key_pass": {
                "type": "string"
            }
        },
        "required": [
            "host",
            "port",
            "username"
        ]
    }