Saravanan666/pypi-org huggingface dataset:
Package: download-tiles
download-tilesDownload map tiles and store them in an MBTiles databaseInstallationInstall this tool usingpip:$ pip install download-tilesUsageThis tool downloads tiles from a specifiedTMS (Tile Map Server)server for a specified bounding box and range of zoom levels and stores those tiles in a MBTiles SQLite database. It is a command-line wrapper around theLandezPython libary.Please use this tool responsibly. Consult the usage policies of the tile servers you are interacting with, for example theOpenStreetMap Tile Usage Policy.Running the following will download zoom levels 0-3 of OpenStreetMap, 85 tiles total, and store them in a SQLite database calledworld.mbtiles:download-tiles world.mbtilesYou can customize which tile and zoom levels are downloaded using command options:--zoom-levels=0-3or-z=0-3The different zoom levels to download. Specify a single number, e.g.15, or a range of numbers e.g.0-4. Be careful with this setting as you can easily go over the limits requested by the underlying tile server.--bbox=3.9,-6.3,14.5,10.2or-b=3.9,-6.3,14.5,10.2The bounding box to fetch. Should be specified asmin-lon,min-lat,max-lon,max-lat. You can usebboxfinder.comto find these for different areas.--city=londonor--country=madagascarThese options can be used instead of--bbox. The city or country specified will be looked up using theNominatum APIand used to derive a bounding box.--show-bboxUse this option to output the bounding box that was retrieved for the--cityor--countrywithout downloading any tiles.--name=NameA name for this tile collection, used for thenamefield in themetadatatable. If not specified a UUID will be used, or if you used--cityor--countrythe name will be set to the full name of that place.--attribution="Attribution string"Attribution string to bake into themetadatatable. This will default to© OpenStreetMap contributorsunless you use--tiles-urlto specify an alternative tile server, in which case you should specify a custom attribution string.You can use the--attribution=osmshortcut to specify the© OpenStreetMap contributorsvalue without having to type it out in full.--tiles-url=https://...The tile server URL to use. This should include{z}and{x}and{y}specifiers, and can optionally include{s}for subdomains.The default URL used here is for OpenStreetMap,http://{s}.tile.openstreetmap.org/{z}/{x}/{y}.png--tiles-subdomains=a,b,cA comma-separated list of subdomains to use for the{s}parameter.--verboseUse this option to turn on verbose logging.--cache-dir=/tmp/tilesProvide a directory to cache downloaded tiles between runs. This can be useful if you are worried you might not have used the correct options for the bounding box or zoom levels.DevelopmentTo contribute to this tool, first checkout the code. Then create a new virtual environment:cd download-tiles
python -mvenv venv
source venv/bin/activateOr if you are usingpipenv:pipenv shellNow install the dependencies and tests:pip install -e '.[test]'To run the tests:pytest
Package: download-tools
download_toolsdownload_tools 下载工具库，也包括爬虫的一些工具。安装Requiredpip install requests selenium安装 download_toolspip install download_tools使用下载文件下载文件时，会先检查存储目录是否有同名文件，有就不下载。download_url()默认只使用requests获取，也可以selenium，需要浏览器firefox和Firefox驱动。import download_tools as dt

dt.download_url('https://www.baidu.com', r'F:\test') 

# 修改名称和增加后缀
dt.download_url('https://www.baidu.com', save_dir=r'F:\test', name='baidu',suffix='html')def download_url(url, save_dir, name=None,  suffix=None, 
                headers=None ,  type='get', post_data=None,
                has_selenium='no', selenium_sleep_time=0, headless=True, sleep_time=0):
    """
    通过链接下载文件，文件名存在时不保存。
    Parameters
    ----------
    url : str
        链接
    save_dir : str
        保存的文件夹路径
    name : str
        文件名，默认None为url文件名
    suffix : str
        文件后缀，默认'txt'
    sleep_time : int
        下载一次休眠的秒数，默认0
    has_selenium : str {'both','only','no'}
        'no'不使用selenium, 'both'先requests不行再selenium，'only'只使用selenium
    selenium_sleep_time : int
        使用selenium时，等待页面加载的休眠时间，默认0
    Returns
    -------
    None
    Examples
    --------
    >>> download_url('https://www.baidu.com',r'F:\test') 
    """download_str()适用于已经获取到源代码，直接保存。当name参数为空时，使用当前日期时间做文件名。import download_tools as dt

page_souce = '<p>测试</p>' dt.download_str(page_souce, r'F:\test', name='测试', suffix='html')
dt.download_str(page_souce, save_dir=r'F:\test')headers生成headersimport download_tools as dt

# 随机生成header
dt.Headers().get()
# 随机生成windows平台chrome浏览器headers
dt.Headers(os='win', browser="chrome", headers=True).get()

for i in range(10):
    print(dt.Headers().get())dtools.fake_headers fork fromhttps://pypi.org/project/fake-headers/修改：generate()函数名修改为get()
Package: download-twitter-resources
Download twitter resourcesDownload tweet images and videos. Run threads which has a event loop to download resources asynchronously.pip3 install download-twitter-resourcesusage: download-twitter-resources [-h] [-c CONFIDENTIAL]
                                  [-s {large,medium,small,thumb,orig}]
                                  [--tweet] [--video] [-l LIMIT] [--rts]
                                  [--thread-number THREAD_NUMBER]
                                  resource_id dest

Download all images uploaded by a twitter user you specify

positional arguments:
  resource_id           An ID of a twitter user. Also accept tweet url or
                        tweet id.
  dest                  Specify where to put images

optional arguments:
  -h, --help            show this help message and exit
  -c CONFIDENTIAL, --confidential CONFIDENTIAL
                        a json file containing a key and a secret
  -s {large,medium,small,thumb,orig}, --size {large,medium,small,thumb,orig}
                        specify the size of images
  --tweet               indicate you gived a tweet url or tweet id
  --video               include video
  -l LIMIT, --limit LIMIT
                        the maximum number of tweets to check (most recent
                        first)
  --rts                 save images contained in retweets
  --thread-number THREAD_NUMBER
Package: downloadutil
downloadutilA Python module with common utilities for downloading and extracting archives.Use cases:Download an archive from a URL and the expected SHA256 checksum from the same URL with a ".sha256"
suffix appended. Verify the checksum.Download an archive as above and extract it into a target directory, and still keep the archive in
a special cache directory.Usage as a command-line toolInvoke asdownloadutilorpython3 -m downloadutil.usage: downloadutil [-h] --url URL [--dest-dir-parent DEST_DIR_PARENT] [--cache-dir CACHE_DIR] [--no-cache] [--verify-checksum] [--verbose]

options:
  -h, --help            show this help message and exit
  --url URL             URL to download.
  --dest-dir-parent DEST_DIR_PARENT
                        Parent directory in which to extract the archive
  --cache-dir CACHE_DIR
                        Download cache directory on the locally mounted disk. Must have enough space.
  --no-cache            Do not use a cache directory
  --verify-checksum     In addition to downloading the given URL, also download the SHA256 checksum file from the URL obtained by appending an .sha256 suffix, and verifying the checksum.
  --verbose             Verbose logging
Package: download-water-data
Downloader for theGlobal Surface Waterdata of the Copernicus Programme.It is based on the original downloadWaterData.py.RequirementsThis tool runs on Windows/Mac/Unix and requiresPythonversion 2 or 3.UsageInstall withpipInstall the tool withpython-mpip install download_water_dataRun the tool withpython-mdownload_water_data <arguments>or justdownload_water_data <arguments>if the Python Scripts directory is in your systemPATHDownload without installingDownload thelatestdownload_water_data.pyzfileOpen a terminal or consoleRun the tool withpython download_water_data.pyz <arguments>Tointerrupttool execution pressCtrl+C.ArgumentsPossible tool arguments and options can be listed with the-hoption:$ download_water_data -h

usage: download_water_data [-h] [-v] [-d PATH] [-r {1_0,1_1,1_1_2019,1_3_2020,1_4_2021}] [-a] [-f] [DS ...]

Full Download Script for Global Surface Water Data.

positional arguments:
  DS                    one or more datasets names to download (occurrence,
                        change, seasonality, recurrence, transitions, extent),
                        use the "-a" option to download all the datasets

options:
  -h, --help            show this help message and exit
  -v, --version         show program's version number and exit
  -d PATH, --directory PATH
                        destination directory where to download the data (by
                        default the current working directory is used)
  -r {1_0,1_1,1_1_2019,1_3_2020,1_4_2021}, --revision {1_0,1_1,1_1_2019,1_3_2020,1_4_2021}
                        data revision (default is 1_4_2021)
  -a, --all             download all datasets (default is false)
  -f, --force           rewrite existing files (default is false)ExamplesTo download theoccurrenceandchangedatasets rundownload_water_data occurrence changeTo download all the datasets rundownload_water_data-aTo change the destination directory add the-doptiondownload_water_data-a-d'download/path'
Package: downloadx
DownloadXContent download CLI toolsInstallationpipinstalldownloadxUsing downloadx CLIGet helpdownloadx-hDownload YouTube contentGet helpdownloadxyoutube-hDownload single urldownloadxyoutube--urlhttps://www.youtube.com/watch?v=aWYgotleA2wDownload multiple YouTube urlcreate any file to store the url of the content to be downloaded.
for example, create aurls.txtfilehttps://www.youtube.com/watch?v=aWYgotleA2w
https://www.youtube.com/watch?v=26JMKOsc8c8&t=254s
https://www.youtube.com/watch?v=Wqr-uZInkQ0
https://youtu.be/Nq4Mh_jTubArun the download command by defining the--url-fileargumentdownloadxyoutube--url-fileurls.txtDownload audio onlyBy default download x will download youtube video content. if you want to download audio only, you can add the--audio-onlyargumentdownloadxyoutube--urlhttps://www.youtube.com/watch?v=aWYgotleA2w--audio-onlyDownload file directoryBy default, downloaded files will be stored in the./outputsdirectory, if you want to change the output directory you can add the--outputargument as follows:downloadxyoutube--url-fileurls.txt--output/mydir/location
Package: download-yfinance-data
download_yfinance_dataDownloads Yahoo Finance data with yfinance in Python.UsageIt's best to customize the list of stocks you want to download.  Change the list at the bottom of download_stocks.py.  Then run the file:python download_stocks.py.
You can also download the entire stocklist from NASDAQ, which should take around 15 minutes to download the data, then another few minutes to store in a sqlite db.   To download all stocks, you can do:ipythonimportdownload_stocksasdsds.download_stocklist()List of stocksRetrieved from here:ftp://ftp.nasdaqtrader.com/symboldirectoryNotesCurrently, yfinance is correcting the OHL for dividends by using the same ratio as for the close.  I think this is incorrect, and it should be using the dividends to subtract that amount from the days prior to the dividend.To doAdd other storage mechanisms (arctic db which uses MongoDB, postgresql, etc)Error checking/testing
Package: downmixer
Download Spotify songs easily using YouTube Music. Can be an alternative or replacement tospotDL, however, it isonly a Python library,nota CLI tool. A very simpledownloadcommand is available for convenience only.This project is currently in alpha version.Basic functionality mostly works, but everything else doesn't. Also, no documentation.UsageCommand linedownmixerdownload[spotifyid]Downloads the first matched result for a Spotify song ID.Use as a libraryDownmixer is made to be adapted to your workflow. By default it doesn't provide a large convenience function like spotDL'ssearch()anddownload()methods.Documentation coming soon.Buildinggitclonehttps://github.com/androidWG/downmixercddownmixer
pipenvinstall
pipinstallbuild
Package: down-notifier
Down notifierUsagepython-mdown-notifier<config.json>Example json config in "examples" folder.fromdown_notifierimportChecker,Sitefromdown_notifier.channelimportTelegramChannelchannel=TelegramChannel(name="channel_name",message="{}-{}",token="token",chats=["chat_id_1","chat_id_2"],)site=Site(name="site_name",url="http://example.com",status_code=200,timeout=60,channels=[channel],)checker=Checker([site])checker.start_loop()
Package: downrinth
DownrinthA Python utility to download mods fromModrinth.QuickstartTo download this package:pip install downrinthUsageTo import ModrinthDownfromdownrinthimport*To download mod from ModrinthdownloadMod(modSlug,modloader,gameversion,minecraftdirectory)ExamplefromdownrinthimportdownloadModdownloadMod("sodium","fabric","1.17.1","C:\users\username\appdata\roaming\.minecraft")That downloads Sodium into the mods folder in the Minecraft directory.Upcoming featuresResource Pack downloadsShader downloadsProper mod manager with GUI
Package: downscale
DownscaleTools for downscaling gridded data in xarrayFree software: MIT licenseDocumentation:https://downscale.readthedocs.io.This is a placeholder for a project in an extremely early stage of development.See ourPaper docfor our latest thoughts.FeaturesNone yet!CreditsNone yet!History0.0.1 (2017-08-11)First release on PyPI.
Package: downscale-image
downscale_imageA utility to downscale an image to the desired file size.Relies on an install of ffmpeg to incrementally downscale the image file into a new file.This modules provides the scriptdownscale-image> downscale-image --help
Usage: downscale-image [OPTIONS] FILE_OR_DIRECTORY

  Downscale file_or_directory to desired max-size.

Options:
  --max-size INTEGER RANGE   Max output size (in MB)  [default: 2; x>0]
  --add-to-right-click-menu  (Windows only) Register this program in right
                             click menu for supported file types.
  --help                     Show this message and exit.
Package: downstream-fairness
Downstream FairnessWe implement the algorithm presented inGeometric Repair for Fair Classification at Any Decision Threshold.
The algorithm looks at the scores, labels, and sensitive attribute in a dataset, and determines a set of adjustments.
The original set of adjustments allow one to adjust the prediction probabilities of a binary classifier, and perturb
them (by adding the appropriate adjustment to a prediction probability), so that you can achievedemographic parity.
To achieve other fairness definitions, such as equalized odds and equal opportunity, our algorithm provides alambdavalue. Thislambdavalue is multiplied to each entry of the set of adjustments, and then those can be added to
predictions. Here is a good way to think about it:prediction_probability + adjustment_value # achieves demographic parity

prediction_probability + lambda_val * adjustment_value # achieves some fairness definition attached to the lambda valueQuickstartFirst, please make sure to download our package. You can either do this from this repo via:pip install -e .or you can install it directly viapip:pip install downstream_fairnessTo get started, we recommend just running ourget_bias_mitigator, so you can get a dictionary of lambda values and
an adjustment table. To go more in-depth, we recommend going through our demo notebook.from downstream_fairness.process import get_bias_mitigator

# Gets the adjustment table and lambdas
table, lambdas = get_bias_mitigator(YOUR_DATA, 
                                    sens_col=YOUR_SENSITIVE_ATTRIBUTE_COLUMN_NAME, 
                                    score_col=YOUR_PREDICTION_PROBABILTIY_COLUMN, 
                                    label_col=YOUR_LABEL_COLUMN)
                                    
# Adjusts the prediction probabilities on the fly
adjusted_scores = get_adusted_scores(table, 
                                     DATA_YOU_WANT_ADJUSTED, 
                                     YOUR_SENSITIVE_ATTRIBUTE_COLUMN_NAME,
                                     YOUR_PREDICTION_PROBABILTIY_COLUMN,
                                     lambdas[THE_METRIC_YOU_WANT])
Package: downtool
-*- coding: utf-8downToolspider down tool / made by python任务-2020年2月：伪装头生成					                 --完成多线程下载/守护线程/用于显示当前已完成的下载进度	--完成多线程下载/下载检查（使用额外的线程进行检查）	--未完成
a. 文件类型/路径访问性检查
b. 文件大小检查多线程下载/下载线程							  --完成a. 超时控制
b. 多线程下载一个大文件（完成）生成下载列表，保存下载历史					  --完成下载器界面                                    --未完成
a. 图形化界面
b. 终端进度显示可控制的错误输出							       --完成提供人性化（英语白痴般）的注释	                --我觉得是可以了提供测试方式									  --难以说服自己的完成度提供一个pypi可下载的版本					   --完成进度条										 --完成-提供了进度显示
a. vue
b. 终端IP代理池默认的下载路径+自定义下载路径的方式				--完成大文件断点续传/下载检查						   	 --完成合并任务添加函数								-- 完成大文件 下载速度									-- 完成任务-2020年5月：整理代码+编写文档
Package: downward-ch
[![PyPI version](https://badge.fury.io/py/downward-ch.svg)](https://badge.fury.io/py/downward-ch) [![License: GPL v3](https://img.shields.io/badge/License-GPLv3-blue.svg)](https://www.gnu.org/licenses/gpl-3.0)This is the “unofficial” disctibution of Fast-Downward Planning System (www.fast-downward.org) with Critical Hop patches supported by CriticalHop team.# Usage## Installing:` pip installdownward-ch`## Running:` $fast-downward<options> <domain.pddl> <problem.pddl> `# Developing## Building:` sudo apt install mercurial g++ cmake python3.7 setup.py bdist_wheel `## Publishing:Build the manylinux distributionalternatively, rename platform tag tomanylinux1_x86_64Upload` twine upload dist/* `
Package: downward-mtree
D-MTree (Downward-MTree)This library implements a datastructure very similar to the MTree datastructure in pure python (for more information, seehttps://en.wikipedia.org/wiki/M-tree)The main difference is that the split of a NonLeafNode (inner node) will not propagate to the parent node, but instead
creates a new subtree with the two closest routing objects as descendants.This has the advantage that the covering-radii of the NonLeafNodes have the least overlap.The disadvantage is that if the points are added in an unlucky order, the depth of the tree can grow very fast!Usagedefdistance(p1,p2):returnabs(p1-p2)dmtree=DMTree(distance_measure=distance,leaf_node_capacity=10,inner_node_capacity=5)# inserting 1000 values with equal identifier:foriinrange(1000):dmtree.insert(identifier=i,value=i)# search in radius and order them by distance (ascending):elements=dmtree.find_in_radius(value=50.5,radius=1)# find the 10 nearest neighbours and order them by distance (ascending):# the parameter 'truncate' decides if the results is trimmed to exactly k if there are multiple elements with the same distanceelements=dmtree.knn(value=50.5,k=10,truncate=True)# deleting entriesforidentifierinrange(1000):dmtree.remove(identifier)identifier should be a datatype that can be compared with ==, <=, >=, <, >mtree.knn(value, k, truncate=True) is equal to mtree.knn(value, k, truncate=False)[:k]ParametersParameterDescriptiondistance_measureCustom distance method that fulfills the  triangle inequalityleaf_node_capacityThe number of children a NonLeafNode can hold before it is split (>=2) Default=50inner_node_capacityThe number of objects a LeafNode can hold before it is split  (>=2)  Default=20split_methodThe algorithm that splits overflowing LeafNodes Default='max_distance'Split methodsParameterDescriptionrandomChoose two random elements of the LeafNode as new routing objectsmin_sum_radiiChoose the two elements of the LeafNode that minimizes the sum of the resulting radiimax_distanceChoose the two elements of the LeafNode that maximizes the distance between the routing valuesBest practiceWhen inserting the values, do so in a randomized order, or the resulting tree can very quickly become heavily unbalanced
Package: downwards
downwardsYou want to read a wikipedia page right from your terminal, right? RIGHT?I know because I wanted it.downwardsis downloading the article you want, converts it tomdocand
displays it using your localmanbinary.$ downwards OpenBSD
$ downwards 'Theo de Raadt'
$ downwards 'Python (Programming Langauge)'
$ downwards --help
Usage: downwards [OPTIONS] ARTICLE

  downwards lets you read a wikipedia page on command line as a manpage.

Options:
  -l, --language TEXT  Language for wikipedia
  -s, --stdout         Print to stdout
  --help               Show this message and exit.I found it very helpful to setexport MANWIDTH=80for nicely readable
documents.InstallationInstallationpip3 install downwardsDevelopmentpip3 install --upgrade .BackgroundI wanted to play around with OpenBSDsmandocand learn howmdocworks.
Then I played around with Wikipedia and put both things together.However, once I got a first prototype up and running, I started liking it. It
feels like a "reader"-feature from your browser, but only from your terminal
right at hand.Bugs and Known IssuesThere are always some things in automatically generated mdoc documents that
throw warnings. Since you cannot makemanignoring them, I need to pressctrl+lto reset those warnings.manis really not made to display a wide range of special utf8 characters
(neither on OpenBSD, Linux nor macOS). I've done what I can to strip those
away or replace german umlauts withaefor example.
Package: downy
downyis an open source (MIT) collection of Python functions useful
in web downloads and parallel downloads.
It provides a simple and intuitive API and handles the threads accordingly.Viewsource codeof downy!Some of its awesome features are:Multiple Download SupportFull utilisation of coresIntuitive API for downloadsAnd more to come!downy is developed by an open community. Release
announcements and general discussion take place on ourmailing listandchat.Thesource code,issue trackerandwikiare hosted on GitHub, and all
contributions and feedback are more than welcome.downy works on recent versions of Python and is released under
the MIT license, hence allowing commercial use of the library.fromdowny.downloadimportDownloadDownload(url,filename).download()NoteThe modules are currently under development and might be unstable at any point of time.
Please help us by reporting any bugs you encounter while using downy.
Package: downyt
downyt - Downloading from YouTubeThis project is deprecated!This little tool was written to fill a void
that turned out it wasn’t there. After I foundyoutube-dlI can only
recommend it for completeness and robustness:http://rg3.github.io/youtube-dlIntroductiondownytis a simple commandline tool to make youtube videos available for
offline watching. It takes a youtube video URL or even just the video ID and
download it to your local storage. That’s it! Nothing more, nothing less. It
might not change your life but it’ll probably take the spinner out of your
underground commute…Installationdownytis primarily implemented in Python 3.3. I’m planning on making it work
with Python 2.7 as well but it is currently untested and might now work. All
instructions assume that you have Python 3.3 setup.It’s simple, just get it from PyPI:pip install downytor install the latest version from github:pip install git+https://github.com/tangentlabs/django-fancypages.gitUsageYou can download a video from YouTube by providing it’s URL or video ID. An
example would be:downyt http://www.youtube.com/watch?v=1coLC-MUCJcor:downyt '1coLC-MUCJc'Both command will download the video into the current directory in theMP4format. Alternatively, you can specify the output format and directory like
this:downyt '1coLC-MUCJc' -t webm -o ~/DownloadsIn addition, you can define the default download directory in a config file in
your home directory. Put the following in$HOME/.downyt/config.ymland it
will be used if no output directory is specified:output_dir: /home/username/DownloadsThat’s all there is to know.LicenseThis project is released under the MIT License.Changelog0.1.1Added changelog file to package manifest.0.1.0Initial release of the project.