semvec/pypi-packages huggingface dataset:
htmlparsingbs4based 1.1.0
This package extracts/parses information from source HTML.
Requires Python: >=3.8

# HTML Parser

extracts/parses information from source HTML.

# construct a Pypi package

* python3 setup.py sdist bdist_wheel
* twine upload dist/*

# create CLI from dist (if you has .dist file)

* python3 -m pip install /home/yaxiong/html_parsing/dist/htmlparsingbs4based-1.1.0.tar.gz

# install package and CLI

* pip install htmlparsingbs4based
* OR python3 -m pip install htmlparsingbs4based

# run from script

* from htmlparsingbs4based.html_parsing.html_parser_custombs4_script import parse_single_page
* parse_single_page(input_url='https://bryansfuel.on.ca/about/',  path_to_crawled_files='/home/yaxiong/data_crawled_websites/crawled_websites_first_batch', min_length=1,  prefix="")

# run CLI (examples)

* mode_1: eleasticsearch
* PARSE -gpf elasticsearch -i 'http://www.mineracamargo.com/MCA_Investors.html' -esusr readwrite -espw ''

* mode_2: local
* PARSE -gpf local -i 'https://bryansfuel.on.ca/about/' -fo /home/yaxiong/data_crawled_websites/crawled_websites_first_batch
* PARSE -gpf local -i 'http://www.mineracamargo.com/MCA_Investors.html' -fo /home/yaxiong/data_crawled_websites/crawled_websites_first_batch
* PARSE -gpf local -i 'https://www.conpak.com/About-Conpak/' -fo /home/yaxiong/data_crawled_websites/crawled_websites_first_batch

* mode_3: html
* PARSE -gpf html -fi /home/yaxiong/html_parsing/html_example/parsed_html.json
create-tox-app 1.0.2
A wrapper that creates a tox env with the minimal setup for a Python app.

create-tox-app
==============

A small script to set up a tox environment with ``setup.py``,
formatting, linting and tests.

It does this:

::

   $ create-tox-app my_app_name
   $ tree -a my_app_name/
   my_app_name/
   ├── .gitignore
   ├── .pylintrc
   ├── README.md
   ├── my_app_name
   │   ├── __init__.py
   │   ├── __main__.py
   │   └── exit_codes.py
   ├── setup.py
   ├── tests
   │   └── test_app.py
   └── tox.ini

You're ready to call ``tox`` to run tests, format check and linting.
``tox -e format`` would reformat your code.

Installation
------------

::

   pip3 install create-tox-app
django-cidr-allowed-hosts 1.0.3
Django middleware to allow access from specific CIDR ranges

Django CIDR Allowed Hosts
=========================

A Django middleware that allows you to specify a list of allowed hosts
using CIDR notation.

Installation
------------

Install using pip:

::

   pip install django-cidr-allowed-hosts

Add the middleware at the top of your ``MIDDLEWARE`` settings:

.. code:: python

   MIDDLEWARE = [
       'cidr.middleware.CIDRMiddleware',
       ...
   ]

Add the ``CIDR_ALLOWED_HOSTS`` setting to your settings:

.. code:: python

   CIDR_ALLOWED_HOSTS = ["0.0.0.0/0"] # allows any IPv4

And that should be it.

Features
--------

-  ``ALLOWED_HOSTS`` will still work as expected. Since the middleware
   overrides the ``ALLOWED_HOSTS`` setting to ``"*"``, the value
   provided originally to ``ALLOWED_HOSTS`` will be stored in
   ``ORIGINAL_ALLOWED_HOSTS`` and used to check if the request should be
   allowed.
-  If ``CIDR_ALLOWED_HOSTS`` is not set, the middleware will not be
   used.
-  If ``ALLOWED_HOSTS`` contains ``"*"`` and ``CIDR_ALLOWED_HOSTS`` is
   set, the middleware will raise ``MiddlewareNotUsed`` exception.
-  ``CIDR_ALLOWED_HOSTS`` must follow the `CIDR
   notation <https://en.wikipedia.org/wiki/Classless_Inter-Domain_Routing#CIDR_notation>`__.
-  Only IPv4 is supported.

Development
-----------

::

   python3 -m virtualenv venv
   source venv/bin/activate
   pip3 install tox
   tox

Credits
-------

This project was inspired by
`django-allow-cidr <https://github.com/mozmeao/django-allow-cidr>`__