Saravanan666/pypi-org huggingface dataset:
Package: waybackeasy
WaybackeasyThe insanely simple way to interface with the WayBackMachine.Installpip install waybackeasyUseimport waybackeasywaybackeasy.get("https://news.ycombinator.com", "27.05.2016")returns html of news.ycombinator.com on the 27th of May, 2016 as recorded by the WB-machine.Dateformatdd.mm.yyyyI'm planning to improve this and add more useful options in the future.ContactFor feedback, bug-reports or feature-requests, write me -joseikowsky@gmail.com
Package: waybacklapse
waybacklapseA tool for creating a timelapse from the Wayback Machine.InstallationThis tool currently has dependencies on external projects and is only
tested on MacOS X.Install Dependenciesbrew install imagemagick
brew install phantomjs
git clone https://github.com/fzaninotto/screenshot-as-a-service.git
cd screenshot-as-a-service
git checkout -t v1.1.0
npm installInstall WAYBACKLAPSE (From PyPi)pip install waybacklapseInstall WAYBACKLAPSE (From Source)git clone https://github.com/kpurdon/waybacklapse.git
cd waybacklapse
python setup.py installRunning The ToolStart the screenshot-as-a-service node appcd screenshot-as-a-service && node appRun waybacklapseFor help:waybacklapse --helpTo run simply enterwaybacklapseat the command line and follow the
prompts.
Package: waybackmachine
Wayback MachineThis project is an envelope for simple fetching of historical versions of page from archive.org API.The page can be used for subsequent webscrapingSetup and usageInstall frompipwithpipinstallwaybackmachineTo fetch the latest version from archive, simply usefetch()function.importwaybackmachineaswmurl="https://en.wikipedia.org/wiki/COVID-19"latest=wm.fetch(url)latest.response# requests.Responselatest.date# capture timelatest.url# urlOptionally you can specify date. The first version after this date is chosen.may2020=wm.fetch(url,date="2020-05-01")BrowsingYou can also iterate archived versions backwards in time.forversioninwm.browse(url):version.response# requests.Responseversion.date# capture timeversion.url# urlThis will iterate the screenshots fromarchive.org.You can specify a custom date range as follows.forversioninwm.browse(url,start='2020-06-30',end='2020-03-01'):passContributionDeveloped byMartin Benes.Join onGitHub.
Package: wayback-machine-saver
Wayback Machine SaverPython tool for archiving web pages through Internet Archive Wayback MachineGetting StartedPrerequisitesPythonpipxInstallationIt's recommended to use tools likepipxto install this command-line tool.pipxinstallwayback-machine-saverUsageSave pagesSave URLs from the input file toInternet Archive - Wayback Machinewayback_machine_saversave-pagesFILENAMEArgumentFILENAME: filename to the file that consists of URLs to savee.g.,https://example.com
https://another-example.comoptions--deliminator TEXT         [default:  "\n"]--error-log-filename TEXT  [default: save-pages-error-log-"timestamp".csv]Get latest archive urlsAfter the URLs have been saved,Internet Archive - Wayback Machinewill snap-shot the page to their database and create a timestamp. You can access the latest one throughhttp://web.archive.org/web/[Your URL]and it will be redirected tohttp://web.archive.org/web/[timestamp]/[Your URL]. This command is used to get the redirected URLs.wayback_machine_saverget-latest-archive-urlsFILENAMEArgumentFILENAME: filename to the file that consists of URLs to retrievede.g.,https://example.com
https://another-example.comoptions--deliminator TEXT         [default: "\n"]--output-filename TEXT     [default: retrieved-urls-"timestamp".csv]]--error-log-filename TEXT  [default: get-url-error-log-"timestamp".csv]ConfigurationWayback Machine Saves supports configurating through environment variable. You can runexport VARIABLE=VALUEbefore running the script to change the behavior.WAYBACK_MACHINE_SAVER_RETRY_TIMEStimes to retry (default: 3)HTTPX_TIMEOUTtimeout for all GET operations (default: 10)ContributingSeeContributingAuthorsWei Leeweilee.rx@gmail.comCreated fromLee-W/cookiecutter-python-templateversion 0.9.0
Package: wayback-news-search
Wayback Machine News Archive Client🚧under construction🚧A simple client library to access the Wayback Machine news archive search.Installationpip install wayback-news-searchBasic UsageCounting matching stories:fromwaybacknews.searchapiimportSearchApiClientimportdatetimeasdtapi=SearchApiClient("mediacloud")api.count("coronavirus",dt.datetime(2022,3,1),dt.datetime(2022,4,1))Paging over all matching results:fromwaybacknews.searchapiimportSearchApiClientimportdatetimeasdtapi=SearchApiClient("mediacloud")forpageinapi.all_articles("coronavirus",dt.datetime(2022,3,1),dt.datetime(2022,4,1)):do_something(page)Dev InstallationInstall the dependencies for dev:pip install -e .[dev]DistributionRunpytestto make sure all the test passUpdate the version number inwaybacknews/__init__.pyMake a brief note in the version history section below about the changesCommit the changesTag the commit with a semantic version number - 'v*..'Push to repo to GitHubRunpython setup.py sdistto create an installation packageRuntwine upload --repository-url https://test.pypi.org/legacy/ dist/*to upload it to PyPI's test platformRuntwine upload dist/*to upload it to PyPIVersion Historyv1.2.1- fix paging bug triggered by no resultsv1.2.0- add support for newexpandedresults, and more integration testingv1.1.0- add newpaged_articlesmethod to allow paging over all resultsv1.0.3- add 30 sec timeout, remove extra params mcproviders library might be addingv1.0.2- fix to article endpointv1.0.1- automatically escape '/' in query strings, test case forurlfield searchv1.0.0- update to public API endpointv0.1.5- simpler return for top termsv0.1.4- better error handlingv0.1.3- allow overriding base api URLv0.1.2- fixarticleendpoint, test case for fetching content (snippet) viaarticle_urlpropertyv0.1.1- more consistent method namesv0.1.0- initial test-only release
Package: waybackprov
Givewaybackprova URL and it will summarize which Internet Archive
collections have archived the URL. This kind of information can sometimes
provide insight about why a particular web resource or set of web resources were
archived from the web.Installpip install waybackprovBasic UsageTo check a particular URL here's how it works:% waybackprov https://twitter.com/EPAScottPruitt
364 https://archive.org/details/focused_crawls
306 https://archive.org/details/edgi_monitor
151 https://archive.org/details/www3.epa.gov
 60 https://archive.org/details/epa.gov4
 47 https://archive.org/details/epa.gov5
...The first column contains the number of crawls for a particular URL, and the
second column contains the URL for the Internet Archive collection that added
it.TimeBy default waybackprov will only look at the current year. If you would like it
to examine a range of years use the--startand--endoptions:% waybackprov --start 2016 --end 2018 https://twitter.com/EPAScottPruittMultiple PagesIf you would like to look at all URLs at a particular URL prefix you can use the--prefixoption:% waybackprov --prefix https://twitter.com/EPAScottPruittThis will use the Internet Archive'sCDX APIto also include URLs that are extensions of the URL you supply, so it would include for example:https://twitter.com/EPAScottPruitt/status/1309839080398339But it can also include things you may not want, such as:https://twitter.com/EPAScottPruitt/status/1309839080398339/media/1To further limit the URLs use the--matchparameter to specify a regular
expression only check particular URLs. Further specifying the URLs you are
interested in is highly recommended since it prevents lots of lookups for CSS,
JavaScript and image files that are components of the resource that was
initially crawled.% waybackprov --prefix --match 'status/\d+$' https://twitter.com/EPAScottPruittCollectionsOne thing to remember when interpreting this data is that collections can
contain other collections. For example theedgi_monitorcollection is a
sub-collection offocused_crawls.If you use the--collapseoption only the most specific collection will be
reported for a given crawl.  So ifcoll1is part ofcoll2which is part ofcoll3, onlycoll1will be reported instead ofcoll1,coll2andcoll3.
This does involve collection metadata lookups at the Internet Archive API, so it
does slow performance significantly.JSON and CSVIf you would rather see the raw data as JSON or CSV use the--formatoption.
When you use either of these formats you will see the metadata for each crawl,
rather than a summary.LogIf you would like to see detailed information about whatwaybackprovis doing
use the--logoption to supply the a file path to log to:% waybackprov --log waybackprov.log https://example.com/TestIf you would like to test it first installpytestand then:pytest test.py
Package: wayback-scraper
wayback_scraperScraping urls from archive.org (Wayback Machine Snapshots)Command-Line InterfaceThe usage information can be printed by running wayback-scraper -h.usage: wayback-scraper [-h] -u URL [-l LIMIT] [-f Start TIMESTAMP]
                   [-t End TIMESTAMP] [-p DIRECTORY] [-n FILENAME] -o
                   Output type

optional arguments:
  -h, --help            show this help message and exit
  -u URL, --url URL     url for the wayback scraper to scrape. [eg:
                        http://www.example.com
  -l LIMIT, --limit LIMIT
                        limit the number of results to scrape
  -f Start TIMESTAMP, --from Start TIMESTAMP
                        start date, format - YYYYmmddHHMMSS. Example : -f 2011
  -t End TIMESTAMP, --to End TIMESTAMP
                        end date, format - YYYYmmddHHMMSS. Example : -t 201205
  -p DIRECTORY, --path DIRECTORY
                        Output file path
  -n FILENAME, --name FILENAME
                        filename for the output data
  -o Output type, --output Output type
                        output typeExamplesThe usage can be perhaps be made more clear with a couple of concrete examples.wayback-scraper -u https://www.archive.org -l 2 -f 2011 -t 2012 -n output-o jsonwhich produces:{
        'archived_urls':
            [
                'url':'http://www.archive.org:80/',
                'date':'1997-01-26',
                'timestamp':'19970126045828'
            ],
            [
                'url':'http://www.archive.org:80/',
                'date':'1997-10-01',
                'timestamp':'19971011050034'
            ]
    }
Package: waybackshot
WaybackShotA simple API to retrieve screenshots of webpages stored on the Wayback Machine.InstallationpipinstallwaybackshotHow to use itA basic example of how to use WaybackShot is the following:fromwaybackshotimportWaybackShotwayback_shot=WaybackShot()wayback_shot.screenshot("https://www.example.com/")This will save the most recent archived version of the websitehttps://www.example.com/in the current folder.For more flexibility, the following parameters can be passed to thescreenshotmethod:url:URL to request screenshot for.date: (optional)Date to request screenshot for in format YYYYMMDD. If not specified, the most recent screenshot will be returned.filename: (optional)Filename to save screenshot as. If not specified, the URL will be used.dir: (optional)Path to save screenshot to. If not specified, the screenshot will be saved to the current working directory.width: (optional)Width of the screenshot. If not specified, the default width of 1920 will be used.overwrite: (optional)If True, the screenshot will be overwritten if it already exists, otherwise it will not be overwritten.include_date: (optional)If True, the screenshot will be saved with the date of the snapshot, otherwise without it.A full example might look like this:fromwaybackshotimportWaybackShotwayback_shot=WaybackShot()wayback_shot.screenshot(url="https://www.example.com/",date="20220520",filename="example-filename",dir="images",width=1920,overwrite=True,include_date=True,)This will safe the screenshot ofhttps://www.example.com/from the closest match to the given date in a folder namedimageswith a width of 1920px. If an image with the same name in the same folder already exists, it wil be overwritten. Further, the filename includes the date of the retrieved snapshot as well as uses the specified filename.DevelopmentIf you wish to contribute to this package, be sure to follow the steps provied.PrerequisitesBefore you can start, you have to install all packages used in this package.pipinstall-rrequirements.txtThis will install the following packages:requestsseleniumwebdriver_managerFurthermore, Python Version 3.9 is needed.
Package: waybar-openweathermap
Waybar weather pluginThis plugin uses theOne Call API from OpenWeatherMap.org.set your APIKEY and geo location in your shellIn your ~/.bashrc add the following definition and place your APIKEY in there# waybar weather settings:
export WAYBAR_WEATHER_APIKEY="<YOUR OpenWeatherMap API KEY>"
export WAYBAR_WEATHER_LAT="44.43"
export WAYBAR_WEATHER_LON="26.02"
export WAYBAR_WEATHER_UNITS="metric"
export WAYBAR_WEATHER_EXCLUDE="minutely,hourly,daily"
Package: waybill
A python commandline tool to run commandline tools that are housed in docker images to make them like binary installsPer present day shipping terms:
A “Waybill” is a non-negotiable document prepared by or on behalf of the carrier at origin. The document shows origin point, destination, route, consignor, consignee, shipment description and amount charged for the transportation service.Waybill takes this concept and applys it to the docker ecosystem and gives you a commandline interface to create, share and use these shell environment shims to run tools contained in docker images, but automates the docker parts to make it so these docker images act like binary distributions.
All you do is define the necessary parameters and a shim will be created that you can use in your shell environment# This is the creation interface for waybills
waybill create “mycustomtool” “docker.sample.com/mycustomtool:latest”# This is an alternative command to create that helps you import waybill yaml definitions so you can share them with others easily
# You could also just share your ~/.waybills directory
waybill load waybills.yaml# For more documentation see
waybill –help# After the waybills have been defined/setup
$(waybill shellinit) # this could be run in .bash_rc or .profile or similar# Now a custom shim should be in place
mycustomtool –version # will run the shim that runs a docker pull and docker run for the predefined image with the given command name and args
Package: waycheck
Waycheck (Python Type Checker)A lightweight Python type checker. Designed with the developer in mind. The Waycheck class is a decorator, which means you can use it by prepending '@' above the function you'd like to type check. No library dependencies under the hood - Pure Python ;)!Installpython-mpip--installwaycheckGetting StartedYou can refer to thedemo.pyfile in this repository or the code block below
to see howWaycheckworks.importwaycheck# Defining the type for each argument@Waycheck(a=int,b=int)defmain(a,b):print('Total: ',a+b)# Defining the default type for ALL arguments@Waycheck(default_type=int)defmain2(a,b):print('Total: ',a+b)if__name__=='__main__':main(5,10)# this will passmain('5',10)# this will failmain2(5,10)# this will passmain2('5',10)# this will failAccepted TypesWaycheck can type check any valid Python Type provided to it, as well as a wildcard type. A wildcard type
is used when an argument can be any value. This is handy when you're doing your own type checking within
your function and would like Waycheck to skip type checking that argument.You can specify a wildcard by using '*'. See an example below:@Waycheck(a='*',b=bool)defmain(a,b):ifb:returnaYou can also pass a tuple of Types, instead of '*' (wildcat). See an example below:@Waycheck(a=(str,int))defmain(a):print('Argument a is: ',a,' - type: ',type(a))ExmaplesRefer todemo.pyfile.FAQQ: My type checking is failling/passing, but I know it shouldn't be. Why is this happening?
A: This happens when you don't specify the correct order of appearance for the Waycheck class.
The order in which the arguments are passed to the function, should be the exact same order you
provide to the Waycheck class. By not doing this, unexpected type checking behavior will occur,
such as passing when it should fail or failing when it should pass.Note: This will occur if the argument all have different expected type values. i.e if all arguments are supposed to be integers, then the order doesn't matter.
Example:# this works as expected@Waycheck(a=int,b=int)defmain(a,b):...# this will fail if all the arguments# are not the same expected type@Waycheck(b=int,a=int)defmain(a,b):...Q: Can I pass my own custom error class?
A: No. The default error given isWaycheckTypeError. You could use a blanket Exeception check (try/except) then throw whatever error you want.Q: I keep getting an IndexError, why?
A: If you're going to type check the function you must provide Waycheck with the expected type for ALL the arguments, not just some of them.ChangelogApril 2022:Initial Release - v0.0.1
Package: wayforpay
wayfropay - WayForPay API wrapper for PythonPython client forWayForPay APIInstallationUsageLicenseInstallationpipinstallwayforpayor add to to your requirements.txtwayforpayand runpipinstall-rrequirements.txtUsageThe tool is under development. Examples will appear here as soon as they are implemented.LicenseThe MIT License (MIT). Please seeLicensefor more information.ContactsFeel free to contact us atEdicasoftorserhii.z@edicasoft.com
Package: waylake-utils
Waylake Utils개요waylake-utils는 Python 애플리케이션을 위한 다양한 유틸리티 모듈을 제공하는 패키지입니다. 현재는 사용자 정의 로깅 설정을 포함하고 있으며, 향후 여러 유용한 기능들이 추가될 예정입니다. 이 패키지를 통해 애플리케이션 개발 과정에서 필요한 여러 기능들을 쉽고 효율적으로 구현할 수 있습니다.주요 기능사용자 정의 로깅: 애플리케이션의 다양한 부분에 일관된 로깅 설정을 적용할 수 있습니다. 로그 파일은 호출하는 스크립트의 위치에 따라 생성됩니다.추후 추가: 향후 다양한 유틸리티 기능들이 추가될 예정입니다. 각 기능은 쉽게 통합하고 사용할 수 있도록 설계됩니다.설치 방법pipinstallwaylake-utilswaylake-utils는 pip을 통해 쉽게 설치할 수 있습니다. 현재 GitHub 레포지토리나 내부 패키지 저장소를 통해 관리되고 있습니다.사용 방법로깅 설정로깅 기능을 import합니다.fromwaylake.utilsimportsetup_logger# orfromwaylakeimportsetup_logger로거를 설정합니다.__file__을 인자로 전달하여 현재 스크립트 위치에 로그 파일을 생성합니다.logger=setup_logger('my_logger_name',__file__)logger=setup_logger(name='logger_name',caller_file=__file__,log_dir='./logs')로그를 기록합니다.logger.debug("This is a debug message")logger.info("This is an info message")logger.warning("This is a warning message")logger.error("This is an error message")logger.critical("This is a critical message")추가 기능 (향후 업데이트 예정)추가되는 기능들에 대한 설명과 사용 방법을 이곳에 기재합니다.
Package: waylay-beta
waylay-betaThis Python SDK helps you to connect with the REST APIs of the Waylay Platform.It provides a selection of services and utilities, focused on supporting our data science users:importing and queryingtimeseriesdata.uploading your ownmachine learning modelsfor usage in theWaylay Rule Engineprovisioning waylayresourcesandresource types.The SDK is optimised for interactive usage inJupyter Notebooks.PrerequisitesThis package requires a python runtime3.7or higher (validated up to3.11).
For datascience purposes you typically want to prepare an anaconda environment:condacreate--namemy_waylay_envpython=3.8
condaactivatemy_waylay_env
condainstalljupyter
pipinstallwaylay-beta
jupyternotebookInstallationpipinstallwaylay-betaBYOML dependenciesIf you want to prepare BYOML models (Enterprise),extradependency configurations are available, that will check or install framework-specific dependencies.Either for a specific runtime:byoml-xgboost-1.0, byoml-sklearn-0.24, byoml-tensorflow-2.4, byoml-custom-1.0, byoml-xgboost-1.3, byoml-pytorch-1.8, byoml-sklearn-0.22, byoml-pytorch-1.4, byoml-tensorflow-2.1, byoml-pytorch-1.5or for the default runtime of one of the supported frameworks:byoml-tensorflow, byoml-custom, byoml-sklearn, byoml-pytorch, byoml-xgboostE.g. to install with sklearn dependencies for byoml:pipinstallwaylay-beta['byoml-sklearn-0.24']orpipinstallwaylay-beta['byoml-sklearn']In some cases (e.g. older framework versions) it might be needed to use the same python version
when serializing models. Check the supported python version with calls such as:>waylay_client.byoml.runtimes.get('byoml-pytorch-1.8'){'framework':'pytorch','framework_version':'1.8','name':'byoml-pytorch-1.8','python_version':'3.7'}QuickstartLogin to the waylay console, and get hold of anAPI key, API secretpair [>Settings>Authentication keys][Enterprise]https://console.waylay.ioCreate an SDK clientfromwaylayimportWaylayConfig,WaylayClientwaylay_client=WaylayClient.from_profile()On first usage, this will prompt for a gateway endpoint,[Enterprise]api.waylay.io (default)and yourAPI key/API secretcredentials.For more details see[Enterprise]https://docs.waylay.ioUsage ExamplesSeedemo notebooksfor the usage examples supported in the current release.
Package: waylonwalker
Waylon Walker cliMy personal business card.pipxrunwaylonwalker# alternatively with dockerdockerrun-it--rmdocker.io/waylonwalker/waylonwalker:latesthttps://github.com/WaylonWalker/waylonwalker-cli/assets/22648375/a534a740-9f54-4788-acc4-96a42ac3d7ba
Package: waymo-open-dataset-tf-2-11-0
# Waymo Open Dataset LibraryThe library is a collection of python and C++ utils (e.g. custom TensorFlow Ops)
to compute quality metrics, to read and pre-process data from the dataset.To learn about the Waymo Open Dataset, current and past challenges visithttps://waymo.com/open. For usage instructions refer tohttps://github.com/waymo-research/waymo-open-dataset
Package: waypaper
WaypaperGUI wallpaper setter for Wayland and Xorg window managers. It works as a frontend for popular wallpaper backends likeswaybg,swww,wallutilsandfeh. You can check ademo on reddit. See details inthe documentation.FeaturesVim keysSupport for GIF animations (withswww)Support for multiple monitors (withswww)Works on both Wayland (withswwworswaybgorwallutils) and Xorg (withfehorwallutils)Restores wallpaper at launch of your WMCaching for fast loadingInstallationYou need to install at least one of the backends and Waypaper, which works as a frontend.1. Install a backendInstall a preferred backend from your package manager:swwworswaybgon Wayland orfehon Xorg orwallutilson both.2. Install WaypaperWaypaper is available as a package in different repositories listed below:On all distributionspipx install waypaperIfpipxis not found, you first need to installpipxfrom your package manager, it's sometimes calledpython-pipx.On Arch-based distributionsyay -S waypaper-gitThewaypaper-gitpackage is available in AUR, thanks tometak. Please upvote to support the project.On NixOSThewaypaperpackage is available thanks to Basil Keeler.Dependenciesswwworswaybgorfehorwallutilsgobject python library (it might be calledpython-gobjectorpython3-giorpython3-gobjectin your package manager.)python-importlib_metadatapython-platformdirsUsagewaypapercommand will run GUI application.OptionsTo restore your wallpaper at launch, addwaypaper --restoreto your startup config.See moredetails on user arguments in the documentation.ConfigurationSeeconfiguration details in the documentation.TroubleshootingSee typical problemsexplained in the documentationContribution and supportFeel free to propose PR and suggest the improvements. I'll highly appreciate help with packaging for various distributions. If you wish to contribute with translation into your language, please see thetranslations.pyfile.I am not a professional developer and work on open-source projects in my free time. If you'd like to support the development, consider donations viabuymeacoffeeor cryptocurrencies:BTCbc1qpkzmutdqfxkce34skt09vll97s5smpa0r2tyzjETH0x6f1Ce9cA181458Fc153a5f7cBF88044736C3b00CBNB0x40f22c372758E35C905458cAF8BB17f51ac133d1LTCltc1qtu33qyv2xlzxda5mmrmk943zpksq8q75tuh85p