Saravanan666/pypi-org huggingface dataset:
Package: webscrapingapi
WebScrapingApi Python SDKWebScrapingApi is an API that allows scraping websites while using rotating proxies to prevent bans. This SDK for Python makes the usage of the API easier to implement in any project you have.InstallationRun the following command in the main folder of your project:pip install webscrapingapiAPI KeyTo use the API and the SDK you will need a API Key. You can get one by registering atWebScrapingApiUsageUsing the SDK it's quite easy. You can check out the code from example.py to make things more clear.
An example of a GET call to the API is the following:from webscrapingapi import WebScrapingApiClient

client = WebScrapingApiClient(api_key='YOUR_API_KEY')

response = client.get('https://webscrapingapi.com/', params ={
    # API Parameters
    # Set to 0 (off, default) or 1 (on) depending on whether or not to render JavaScript on the target web page. JavaScript rendering is done by using a browser.
    'render_js': 1,
    # Set datacenter (default) or residential depending on whether proxy type you want to use for your scraping request. Please note that a single residential proxy API request is counted as 25 API requests.
    'proxy_type': 'datacenter',
    # Specify the 2-letter code of the country you would like to use as a proxy geolocation for your scraping API request. Supported countries differ by proxy type, please refer to the Proxy Locations section for details.
    'country': 'us',
    # Set depending on whether or not to use the same proxy address to your request.
    'session': 1,
    # Specify the maximum timeout in milliseconds you would like to use for your scraping API request. In order to force a timeout, you can specify a number such as 1000. This will abort the request after 1000ms and return whatever HTML response was obtained until this point in time.
    'timeout': 10000,
    # Set desktop (default) or mobile or tablet, depending on whether the device type you want to your for your scraping request.
    'device': 'desktop',
    # Specify the option you would like to us as conditional for your scraping API request. Can only be used when the parameter render_js=1 is activated.
    'wait_until': 'domcontentloaded',
    # Some websites may use javascript frameworks that may require a few extra seconds to load their content. This parameters specifies the time in miliseconds to wait for the website. Recommended values are in the interval 5000-10000.
    'wait_for': 0,
}, headers={
    # API Headers
    'authorization': 'bearer test',
    # Specify custom cookies to be passed to the request.
    'cookie': 'test_cookie=abc; cookie_2=def'
})For a better understanding of the parameters, please check outour documentation
Package: web-scraping-bot-template
This package is a template for you
to create your own bot using Python.In order to do that, you don't need to use 
each method each time you create a new bot.
The datas you collect using the 'get_hypertexts_links'
are saved in a folder called 'datas.json'. You are free 
to modify the path or the name, but I do not reccomend 
this method.
Package: webscraping-tools
webscraping_toolsTools to make webscraping easier.Free software: MIT licenseDocumentation:https://webscraping-tools.readthedocs.io.FeaturesTODOCreditsThis package was created withCookiecutterand theaudreyr/cookiecutter-pypackageproject template.History0.1.0 (2019-11-05)First release on PyPI.
Package: webscrapper
Web Scrapper API client for pythonThis is python client library forhttps://scrapper.scurra.space/This module provide 2 functions with same functionality.
get_page and get_page_async for async python.Installationpip install webscrapperExample usage:fromwebscrapper.clientimportget_pageresult=get_page(url,api_key="__YOUR_API_KEY__",use_selenium=True)print(result['html'])
Package: web-screen-annotator
web screen annotatora tool to collect data for element detection in web site screen shots,extract elements from a web site and generates a json file.Installationpip install web_screen_annotatorGet startedHow to extract data from web sites using this lib:importweb_screen_annotator# list of urls of sitesurls=["C:\\Users\\DELL\\Projects\\First Demo\\login.html",]annotator=web_screen_annotator.DataAnnotator(urls,depth=5)annotator.execute(viz=True)
Package: webscreenshotter
webscreenshotterA Python utility that takes a stitched screenshot of a webpage along with individual ones, at any resolutionUsageInstall the package firstpip install webscreenshotterUse the function in your codefrom webscreenshotter import take_screenshot

if __name__ == "__main__":
    take_screenshot (
        "https://en.wikipedia.org/wiki/qr_code",
        width=1280, height=720,
        directory=".screencaps", file_suffix="capture_",
        stitch=True
    )Change the directory and suffix to whatever you want.Inspect the location you set as output directory for screenshotNotes:Stitching happens vertically.Setting different resolutions can result in different style webpages, especially with PWAs and mobile-optimized webpages.LicenseGPLv3 LicenseBy 0x4f (Owais Shaikh)https://pypi.org/project/webscreenshotter/https://github.com/0x4f53/webscreenshotter
Package: webserver
Docker-Webserver (nginx:mainline-alpine)NB!Big change is in progress, consider this analphaproduct!What is it?Simple to use CLI for setting up nginx webserver in Docker Swarm
and adding websites' configs, proxies and static filesTechnology StackDocker Swarmfor orchestrationclickfor CLI scriptsFeaturesRun Highly-Availablenginx:mainline-alpinestackwith attachablenginxnetwork (to use with others containers) ->webserver runUpdate stack imageswithout downtime->webserver updateGenerate HTTPS configfor website with examples ->webserver genconfGet LetsEncrypt SSL certificatefor websitewith one command and no configuration(except DNS A record) ->webserver gentlsGenerate DH paramsfor website ->webserver gendhWork with configuration files:Add configuration filefor website ->webserver conf addGenerate and add config with one command->webserver conf createEdit configuration filefor website ->webserver conf editReload configswithout downtime->webserver conf reloadAdd/Update static filesfor website ->webserver static addROADMAP (v1.0.0)See statsof running stackStopthe stackRestartthe stackROADMAP (v1.x.x)Analyze logs with GoAccessMade by Igor Nehoroshev (https://neigor.me) for his own needs (if You find it useful - great!😎)
Package: web.sh
web.shweb.sh is a cross-platform script (web) and API for launching a browser
(withx-www-browser(Linux, Unix),open(OSX),start(Windows),
orpython-mwebbrowser)Free software: BSD licensePyPI:https://pypi.python.org/pypi/web.shWarehouse:https://warehouse.python.org/project/web.shSource:https://github.com/westurner/web.shContentsweb.shFeaturesInstallationUsageAPIPlatform NotesHistory0.1.1 (2015-06-21)0.1.2 (2015-06-21)0.1.3 (2015-06-21)0.1.4 (2015-06-21)FeaturesOpen the configured default system web browser with one or more
paths or URIsOpen to a relative pathOpen to an absolute pathInstallationInstall theweb(andx-www-browser-) scripts:pipinstallweb.shpipinstall-ehttps://github.com/westurner/web.shUsageThewebscript commandline interface:web.web./index.htmlweb$WORKON_HOME/dotfiles/src/dotfiles/docs/_build/html/index.htmlweblocalhost:8082#  pgs docs/_build/html  # pypi:pgswebhttps://westurner.org/dotfiles/webwesturner.org/dotfilesgithub.com/westurner/dotfiles# !HTTPS!x-www-browser-.web--helpcommandline help:Usage: websh.py [-b|-x|-o|-s] [-v|-q] <url1> [<url_n>]

Open paths or URIS as tabs in the configured system default webbrowser

Options:
  -h, --help           show this help message and exit
  -b, --webbrowser     Open with `python -m webbrowser`
  -x, --x-www-browser  Open with `x-www-browser` (Linux, X)
  -o, --open           Open with `open` (OSX)
  -s, --start          Open with `start` (Windows)
  -v, --verbose
  -q, --quiet
  -t, --testAPIInstances ofwebsh.websh.WebBrowserimplementopen_new_tab()websh.websh.WebBrowser.x_www_browsercallsopen_new_tab()with a list of paths and/or URIsweb <urls>callswebsh.websh.WebBrowser.x_www_browserto open new tabs for each path or URI:urls=(["https://westurner.org/dotfiles/","https://github.com/westurner/dotfiles","https://waffle.io/westurner/dotfiles"])output=list(WebBrowser.x_www_browser(urls))print(output)Platform NotesOSX:web-o./README.rstandweb-b./README.rstopenREADME.rstin the configured editor
(not the configured system browser).Workarounds:Specify the full path to a specific browser application followed
by a quoted URI, for each URI in a newline-delimited listHistory0.1.1 (2015-06-21)DOC: README.rst: links, Features, Usage, APIBLD: setup.py console_script entrypointweb = websh.web:mainBLD: setup.py console_script entrypointx-www-browser-= websh.web:mainBUG,REF: websh.py: logging, logging config [07f9a0f]BUG,CLN,DOC,REF,TST: websh.py: match_domain, :PymodeLintAuto, argv, logging config [4b33395]ENH: websh.py:https://github.com/westurner/dotfiles/blob/master/scripts/web[29c0ca7]BLD,RLS: *, setup.py, __init__.py:cookiecuttergh:audreyr/cookiecutter-pypackage[e288536]0.1.2 (2015-06-21)DOC: README.rst: API docsRLS: setup.py, __init__.py:__version__ = 0.1.2First release on PyPI0.1.3 (2015-06-21)DOC: README.rst, HISTORY.rst: formatting, links, release notes0.1.4 (2015-06-21)RLS: setup.py, __init__.py: __version = ‘0.1.4’ [8e33773]BUG: websh.py: py26, py34 compat [a6ed31a]BLD: tox.ini, .travis.yml: commands = python websh/websh.py -v -t [295abab]DOC: websh.py, README.rst: usage docstrings [d054b43]DOC: README.rst: links [bc1d06c]
Package: websharecli
CLI interface for getting download links for movies and TV shows fromwebshare.cz.Installation$pip3installwebsharecli$websharesample-configCustomizing configurationCustomize config in order to:Activate VIPChange default preferred video qualitySee instructions in config file.$vi~/.config/webshare/config.yamlUsageDownload a single file$websharedownloadmatrix1999>linkmatrix1999:The.Matrix.1999.BluRay.1080p.DTS-HDMA.AC3.x264.dxva-FraMeSToR(CZ,EN).mkv$wget-ilinkDownload an entire seriesUse asterisk (*) symbol to as a 00-99 wildcard.$websharedownloadblackmirrors02e*>linksblackmirrors03e00:BlackMirrorS03E00WhiteChristmasCZtit.mp4blackmirrors03e01:Black.Mirror.S03E01.PROPER.1080p.WEBRip.X264-DEFLATE.mkvblackmirrors03e02:Black.Mirror.S03E02.PROPER.1080p.WEBRip.X264-DEFLATE.mkvblackmirrors03e03:Black.Mirror.S03E03.PROPER.1080p.WEBRip.X264-DEFLATE.mkvblackmirrors03e04:Black.Mirror.S03E04.PROPER.1080p.WEBRip.X264-DEFLATE.mkvblackmirrors03e05:Black.Mirror.S03E05.1080p.WEBRip.X264-DEFLATE.mkvblackmirrors03e06:Black.Mirror.S03E06.1080p.WEBRip.X264-DEFLATE.mkvblackmirrors03e07:NOTFOUNDblackmirrors03e08:NOTFOUNDblackmirrors03e09:NOTFOUNDAbortingafter3failures$wget-ilinksSearch for a file$websharesearchrequiremforadream1.12Gmkv+076s2uj1ir4Requiem.For.A.Dream.Director's.Cut.2000.1080p.BluRay.DTS.x264-DON.mkv
 2.  67K srt +0 5394mr11r1 Requiem.For.A.Dream.Director's.Cut.2000.1080p.BluRay.DTS.x264-DON.srt3.1.7Gmkv+15uR4b05kh2RequiemforaDream2000UnratedDC(1080px26510bitTigole).mkv4.1.4Gmp4+010z3ja4Xq2Requiem.For.A.Dream.DIRECTORS.CUT.2000.1080p.BrRip.x264.YIFY.mp45.71Ksrt+028s39750D3Requiem.For.A.Dream.DIRECTORS.CUT.2000.1080p.BrRip.x264.YIFY.srt6.4.5Gmkv+04Pr5rz6z13Requiem.For.A.Dream.720p.x264.AC3-5.1-DiC.mkv7.700Mmp4+015i6n36R32Requiem.For.A.Dream.DIRECTORS.CUT.2000.720p.BrRip.x264.YIFY.mp48.1.2Gavi+1KRdAgRvv4FRequiemzasen(RequiemForaDream).aviDownload file by id$websharelink76s2uj1ir4>link$wget-ilinkChangelog2.2.1: support terminal colors everywhere2.2.0: handle keyboard interrupt; terminal colors; Python 3.6+ required2.1.0: add -x/–exclude filter and –ignore-vip2.0.2: fix hadling of single search result2.0.1: include missing config.yaml in PyPI package2.0.0: update to new API (send wst in request) - config update needed!1.2.0: add fail-over logic for unavailable links in download command1.1.1: added setuptools dependency, use YAML.safe_load()1.1.0: added filtering by file extension1.0.2: add README.rst to pypi package
Package: web-share-ftp
web_share_ftp - A Simple Flask App to Share Files Over the NetworkThis is a simple flask app / cli tool that serves your current folder to share files from the host to the client browser or upload to host from a client browser.To install on GNU/Linux, Debian / Ubuntu / Linux Mint:sudopython3-mpipinstallweb_share_ftpTo install on Windows:python-mpipinstallweb_share_ftpTo start the server:web_share_ftpserveTo access server from another device, find your local ip by checkingifconfigin GNU/Linux andipconfigin windows.And of course I could usehttp.serverfor serving the files but I somewhat wanted to do it myself.Here's a web UI view of the flask app:
Package: webshareproxy
Webshare Proxy API Python ClientA Python client library for the Webshare Proxy API, providing easy access to various operations like managing proxies, IP authorizations, user profile, notifications, and more.InstallationRecommended installation method is via pip:pip install webshareproxyAlternatively, you can clone the repository and install it manually:git clone https://github.com/heromr/webshareproxy.git
cd webshareproxy
python setup.py installGetting StartedTo get started with the Webshare Proxy API Python client, you'll need an API key from Webshare Proxy. If you don't have one, you can obtain it by signing up on the Webshare Proxy website.Once you have the API key, you can create an instance of theApiClientclass and pass the API key as an argument:fromwebshareproxyimportApiClient# Replace 'YOUR_API_KEY' with your actual API key from Webshare Proxyapi_key="YOUR_API_KEY"# Create an instance of the ApiClient classapi_client=ApiClient(api_key)Available MethodsTheApiClientclass provides several methods to interact with the Webshare Proxy API. Each method corresponds to an API endpoint and performs specific operations. Here are some of the available methods:create_ipCreate a new IP authorization entry.ip_address="123.45.67.89"new_ip_auth=api_client.create_ip(ip_address)print("New IP Authorization ID:",new_ip_auth.id)get_ipGet a list of IP authorization entries.ip_authorizations=api_client.get_ip()forip_authinip_authorizations.get_results:print("IP Address:",ip_auth.ip_address)get_proxy_listGet a list of proxies with optional filters.# Get a list of proxies country code 'US'proxies=api_client.get_proxy_list(country_code_in='US')forproxyinproxies.get_results:print("Proxy Host:",proxy.proxy_address)print("Proxy Port:",proxy.port)print("Proxy Username:",proxy.username)print("Proxy Password:",proxy.password)print("Country Code:",proxy.country_code)print()ContributingContributions are welcome! If you find a bug, have any questions, or want to suggest an improvement, feel free to open an issue or submit a pull request.LicenseThis library is open-source and available under the MIT License. See theLICENSEfile for more details.
Package: webship
Tools to deploy python web application. The build process is run in container
using podman so make sure you have podman properly setup on the build machine.Installpipx install webshipUsageCreate directory to hold the deploy project:-mkdir -p myapp_deployCreatewebship.inito hold configuration about the deploy:-[fetch]
repo = git@github.com:xoxzoeu/myapp.git
clone_args = recursive

[deploy]
path = /app/myapp
hosts =
    127.0.0.1
    127.0.0.2To build the app:-webship fetch
webship build myapp 1.0.1 --docker_image=myappThat will generate the release tarball inbuild/myapp-1.0.1.tar.gz. Before
deploying the release tarball, we can test it first to make sure everything
is working as expected:-webship run build/myapp-1.0.1.tar.gz ".venv/bin/myapp manage runserver 0.0.0.0:8000" --env-file=/home/kamal/python/myapp_deploy/envTo deploy:-webship deploy build/myapp-1.0.1.tar.gzDeploy directory structure is like below:-deploy_path (default to /app/<project_name>)
        releases/
        current --> releases/<project_name>-0.0.1Active release will be/app/<project_name>/currentwhich is a symlink to active version. This
structure will allow multiple apps to be deployed on the same server.
Package: webshoes
webshoesQuickly create a web service supporting both websockets and http.importwebshoesaswsdefcmdAdd(ctx,q):return{'result':int(q.a)+int(q.b)}wsa=ws.WebShoesApp('127.0.0.1',15801,{'verbose':True})wsa.register('cmd','cmd','args','event','reply',{'add':cmdAdd})wsa.start()Table of contentsInstallExamplesReferencesInstall$ pip3 install webshoesExamples# Test functiondefcmdAdd(ctx,q):return{'result':int(q.a)+int(q.b)}# Create the serverimportwebshoesaswswsa=ws.WebShoesApp('127.0.0.1',15801,{'verbose':True})# Register the callback function#             ----------------------------------> The root for http requests#             |      ---------------------------> The variable in websocket request#             |      |                              containing the command name#             |      |      --------------------> The variable in websocket request#             |      |      |                       containing the function arguments#             |      |      |       ------------> The variable in websocket request#             |      |      |       |               containing the event name#             |      |      |       |        ---> Variable in reply to put return data#             |      |      |       |        |wsa.register('cmd','cmd','args','event','reply',{'add':cmdAdd})# Start the serverwsa.start()# Call add function with http requestimportrequestsreply=requests.get('http://127.0.0.1:15801/cmd/add?a=2&b=3')Log(reply.text)# Call the add function with websocketsimportwebsocketsasyncwithwebsockets.connect('ws://127.0.0.1:15801')aswsc:awaitwsc.send(json.dumps({'cmd':'add','args':{'a':2,'b':3}}))reply=awaitwsc.recv()Log(reply)# Stop the serverwsa.stop()ReferencesPythonhttps://www.python.org/piphttps://pip.pypa.io/en/stable/
Package: webshoter
WebShoterThis tool takes screenshots of websites and saves them to a specified output directory in PNG format. It uses a headless browser to render the website and take the screenshot.InstallationBefore using the tool, make sure you have Python 3 installed on your system. You can download Python from the official website:https://www.python.org/downloads/Once you have Python installed, you can install thewebshoterpackage using pip:pipinstallwebshoterOr install manually:1.gitclonehttps://github.com/americo/webshoter2.cdwebshoter3.pythonsetup.pyinstallUsageTo take a screenshot of a single website, use the following command:webshoter-u<url>-o<output_dir>echo"<url>"|webshoter-o<output_dir>To take a screenshot of a list of websites, use the following command:caturls.txt|webshoter-o<output_dir>Replace<url>with the URL of the website you want to take a screenshot of, and<output_dir>with the directory where you want to save the screenshot.To take screenshots of multiple websites at once, you can provide a list of URLs separated by newlines. For example:LicenseThis tool is distributed under the MIT License. See the LICENSE file for more information.
Package: websigning
Seehttps://wiki.mozilla.org/Apps/WebApplicationReceipt/SigningServiceDev and testingCreate a virtualenv of your choosing and activate it:virtualenv websigning
source websigning/bin/activateOr using virtualenvwrapper:mkvirtualenv websigningInstall the dependencies:python setup.py developRun tests:python setup.py nosetestsWhen testing, you may see output along the lines of:“InsecurePlatformWarning: A true SSLContext object is not available.”This seems to be a feature of newer versions of the request module.  This can be solved by installing by running:pip install requests[security]
Package: website-as-app
WebAppRun any website as standalone desktop applicationmasterbranch:Small Python script opening any web page in dedicated window, using embedded QT WebEngine. There are
no visible browser's UI etc, so the that can be useful to turn any website into standalone desktop
application. This is useful if you, as me, would like to have a website run as standalone app,
independently of your main browser which can be beneficial as it gives you separate entry in
window manager or task switcher etc.IMPORTANT:This tool isNOTturning websites into OFFLINE apps! It's about separating
each of your key websites i.e. from each other, or gazzilions of your browser's tabs. But you
still MUST be connected to the Internet for the apps (websites) to work as previously.InstallationUsepipto install the script:$pipinstallwebsite-as-appOnce app is running, please use--helpto see all available options, as i.e. custom icon,
window title etc.Usage$webapp"https://github.com"Available options:webapp-h
usage:webapp[--profilePROFILE][--nameNAME][--iconICON][--zoomZOOM][--no-tray]url

Openanywebsiteinstandalonewindow(likeit'sanapp)positionalarguments:
urlTheURLtoopen

options:
--profilePROFILEProfilename(forcookiesisolationetc).Default:"default"--nameNAME,-nNAMEApplicationname(shownaswindowtitle)--geometryGEOMETRYInitialwindowgeometry(informat"WIDTHxHEIGHT+X+Y")--iconICON,-iICONFullpathtoimagefiletobeusedasappicon
--zoomZOOM,-zZOOMInitialWebBrowserViewzoomfactor.Default:1.0
--no-trayDisablessystemtraysupport(closingwindowterminatesapp)The most important option is--profilewhich allows you to isolate cookies and app settings
per instance. Any instance using the same profile will have access to the same cookies and
settings. This is useful if you want to run multiple instances of the same app, but with
different accounts. By defaultdefaultprofile is used and it's recommended to use different
profile per each app instance.Current limitationsDue to security based limitations of embeddedQWebBrowerViewyou will not be able
to save any file to your local storage nor filesystem.Website's Javascript code cannot write to system clipboard so you migth need to manually
select given portion of the site and copy using function from context menu as any buttons
on the page that is using JS to write to the host's clipboard will not currently work.LicenseWritten and copyrighted ©2023-2024 by Marcin Orlowski <mail (#) marcinorlowski (.) com>ResponseBuilder is open-sourced software licensed under
theMIT license
Package: website-categorization
OverviewThe client library forWebsite Categorization APIin Python language.The minimum Python version is 3.7.Installationpipinstallwebsite-categorizationExamplesFull API documentation availablehereCreate a new clientfromwebsitecategorizationimport*client=Client('Your API key')Make basic requests# Get categories for a domain name.response=client.data('whoisxmlapi.com')print("Responded? "+"Yes"ifresponse.website_respondedelse"No")ifresponse.website_responded:forcatinresponse.categories:print("Cat: "+str(cat.name))Advanced usageExtra request parameters# Specifying minimal level of confidenceresponse=client.data('whoisxmlapi.com',0.75)# Getting raw API response in XMLxml=client.raw_data('whoisxmlapi.com',output_format=Client.XML_FORMAT)Changelog1.1.2 (2023-11-30)Add list categories methodMinimum Python version is now 3.71.1.1 (2023-10-30)Migrate to Website Categorization API v31.0.0 (2021-07-08)First release