semvec/pypi-packages huggingface dataset:
dragnet 1.1.0
Extract the main article content (and optionally comments) from a web page
License: MIT
Keywords: automatic content extraction,web page dechroming,HTML parsing


Dragnet
=======

Dragnet isn’t interested in the shiny chrome or boilerplate dressing of
a web page. It’s interested in… ‘just the facts.’ The machine learning
models in Dragnet extract the main article content and optionally user
generated comments from a web page. They provide state of the art
performance on variety of test benchmarks.

For more information on our approach check out:

-  The `Dragnet homepage`_
-  Our paper `Content Extraction Using Diverse Feature Sets`_, published
   at WWW in 2013, gives an overview of the machine learning approach.
-  `A comparison`_ of Dragnet and alternate content extraction packages.
-  `This blog post`_ explains the intuition behind the algorithms.

Installing
==========

The build requires numpy, lxml and a new version of Cython, so first make sure
they are installed, then install Dragnet:

.. code::

    pip install numpy
    pip install --upgrade cython
    pip install lxml
    pip install dragnet


GETTING STARTED
===============

Depending on your use case, we provide two separate models to extract
just the main article content or the content and any user generated
comments. Each model implements the ``analyze`` method that takes an
HTML string and returns the content string.

.. code:: python

    import requests
    from dragnet import content_extractor, content_comments_extractor

    # fetch HTML
    url = 'https://moz.com/devblog/dragnet-content-extraction-from-diverse-feature-sets/'
    r = requests.get(url)

    # get main article without comments
    content = content_extractor.analyze(r.content)

    # get article and comments
    content_comments = content_comments_extractor.analyze(r.content)

.. _Dragnet homepage: https://github.com/seomoz/dragnet
.. _Content Extraction Using Diverse Feature Sets: https://github.com/seomoz/dragnet/blob/master/dragnet_www2013.pdf?raw=true
.. _A comparison: https://moz.com/devblog/benchmarking-python-content-extraction-algorithms-dragnet-readability-goose-and-eatiht/
.. _This blog post: https://moz.com/devblog/dragnet-content-extraction-from-diverse-feature-sets/
sshASA 2.0
python3 ssh module for Cisco ASA
License: MIT

python3/python2 SSH module for ssh session management for multivendor network devices (Juniper, Cisco IOS, Cisco ASA, Arista).
This module is entirely based on Netmiko

``sshASA`` provides a ready-to-go ssh module, asking for ``Username``, ``Password`` and ``Enable Password``.
Error handling and promt information are also provided to facilitate the user in case of wrong username or password

All `netmiko <https://pynet.twb-tech.com/blog/automation/netmiko.html>`_ commands are available with this module

Example::

  #!/usr/bin/env python3
  import sys
  from sshASA import sshHost as ssh

  def showVersion(host):
      out = host.send_command("show version")
      print(out)

  showVersion(ssh(sys.argv[1]))

How to run it::

  federico@federico:~/git/github/python/modules/python3 $ python3 importTest.py FIREWALL01
  Username: olivierif
  Password:
  Enable password:
  Session established with Hostname:FIREWALL01 IP:10.10.10.93

  Cisco Adaptive Security Appliance Software Version 9.1(7)23
  Device Manager Version 7.5(2)153
  [...]
sshEOS 2.0
python3 ssh module for Arista EOS
License: MIT

python3/python2 SSH module for session management for multivendor network devices (Juniper, Cisco IOS, Cisco ASA, Arista). Based on Netmiko

``sshEOS`` provides a ready-to-go ssh module, asking for ``Username``, ``Password`` and ``Enable Password``.
Error handling and promt information are also provided to facilitate the user in case of wrong username or password

All `netmiko <https://pynet.twb-tech.com/blog/automation/netmiko.html>`_ commands are available with this module

Example::

  #!/usr/bin/env python3
  import sys
  from sshEOS import sshHost as ssh

  def showVersion(host):
      out = host.send_command("show version")
      print(out)

  showVersion(ssh(sys.argv[1]))

How to run it::

  federico@federico:~/git/github/python/modules/python3 $ python3 importTest.py SWITCH01
  Username: olivierif
  Password:
  Enable password:
  Session established with Hostname:SWITCH01 IP:10.10.10.92

  Arista DCS-7048T-4S-R
  Hardware version:    04.10
  [...]
sshIOS 2.0
ssh module for Cisco IOS
License: MIT

python3/python2 SSH module for session management for multivendor network devices (Juniper, Cisco IOS, Cisco ASA, Arista). Based on Netmiko

``sshIOS`` provides a ready-to-go ssh module, asking for ``Username``, ``Password`` and ``Enable Password``.
Error handling and promt information are also provided to facilitate the user in case of wrong username or password

All `netmiko <https://pynet.twb-tech.com/blog/automation/netmiko.html>`_ commands are available with this module

Example::

  #!/usr/bin/env python3
  import sys
  from sshIOS import sshHost as ssh

  def showVersion(host):
      out = host.send_command("show version")
      print(out)

  showVersion(ssh(sys.argv[1]))

How to run it::

  federico@federico:~/git/github/python/modules/python3 $ python3 importTest.py ios.sw11.lab
  Username: root
  Password:
  Session established with Hostname: Hostname: ios.sw11.lab IP: 192.168.255.50

  Cisco IOS Software, C2600 Software (C2600-ADVIPSERVICESK9-M), Version 12.3(4)T4,  RELEASE SOFTWARE (fc2)
  Technical Support: http://www.cisco.com/techsupport
  Copyright (c) 1986-2004 by Cisco Systems, Inc.
  [...]
sshJUNOS 2.0
ssh module for Juniper OS
License: MIT

python3/python2 SSH module for session management for multivendor network devices (Juniper, Cisco IOS, Cisco ASA, Arista). Based on Netmiko

``sshJUNOS`` provides a ready-to-go ssh module, asking for ``Username``, ``Password`` and ``Enable Password``.
Error handling and promt information are also provided to facilitate the user in case of wrong username or password.

All `netmiko <https://pynet.twb-tech.com/blog/automation/netmiko.html>`_ commands are available with this module

Example::

  #!/usr/bin/env python3
  import sys
  from sshJUNOS import sshHost as ssh

  def showVersion(host):
      out = host.send_command("show version")
      print(out)

  showVersion(ssh(sys.argv[1]))

How to run it::

  federico@federico:~/git/github/python/modules/python3 $ python3 importTest.py srx00.sw11.lab
  Username: root
  Password:
  Session established with Hostname: Hostname: srx00.sw11.lab IP: 192.168.1.1

  Hostname: srx00.sw11.lab
  Model: srx300
  Junos: 15.1X49-D120.3
  JUNOS Software Release [15.1X49-D120.3]
  [...]
do-latency 0.4.0
Digital Ocean latency checker helps to find fastest DO region from your location.
License: MIT
Keywords: digital ocean latency ping connection speed ICMP

Digital Ocean latency checker
=============================

Digital Ocean latency checker helps to find fastest DO region from your location.

INSTALLATION
------------

::

    pip install do-latency

USAGE
-----

.. image:: https://raw.githubusercontent.com/dizballanze/do-latency/master/usage.gif

-  **-h, --help** - show help
-  **--ping-count** - count of ICMP requests for latency check (default: 10)
-  **--file-size {10mb, 100mb}** - size of downloaded file (default: 10mb). 
-  **--udp** - use UDP not ICMP.

**In some linux systems UDP testing does not work, so you should use true ICMP and run `do-latency` from root:**

::

    sudo do-latency


TODO
----

[x]  latency check with ICMP

[x]  download speed measurement

[x]  python 3 support

LICENSE
-------

MIT
deduper 0.0.7
OneFlorida De-duplication Software
License: MIT
Keywords: entity resolution,deduplication,record linkage


OneFL Deduper
------------

OneFlorda Entity Resolution Software (aka Deduper)
<https://github.com/ufbmi/onefl-deduper> is designed to generate hashes of the
specific patient data elements.

Multiple generated hashes are then matched against the registry of "known"
hashes and associated with a Unique Universal Identifier (aka OneFlorida UUID).

The UUID is used to de-duplicate medical records such as
demographics, procedures, diagnoses, vitals, lab results submitted
from different hospital networks.