Saravanan666/pypi-org huggingface dataset:
Package: downgit
DownGit🔴WARNING🔴:There may occur some bugs, if you find any, please report them to me.Description:DownGit is a simple and convenient command-line tool that allows users to download exact folders from GitHub repositories without the need to use the web interface or 3-rd party websites that provide this feature. This program provides access to GitHub repositories through commands, simplifying and speeding up the download process. It also enables users to set their own token to increase the rate limits for API requests to GitHub.Installation:pip install downgitCommands:downgit get
downgit set-token
downgit remove-token
downgit helpget <url> <ignore-files>- The get command allows you to download a GitHub repository by specifying the repository's URL. Optionally, you can specify ignored files, separated by ';'. This feature allows users to choose which files they want to download.Example of use:downgit get https://github.com/Propsi4/emotions-recognition/tree/main/client "src/App.tsx;src/index.tsx"set-token <token>- The set-token command lets you set a personal GitHub token to increase the rate limits for API requests. This is especially useful for users who frequently use this program and want more capabilities for downloading data from GitHub.remove-token- The remove-token command allows you to remove a previously set GitHub token if you no longer wish to use it for API access.help- The help command displays the command menu to familiarize users with the available options and correct command syntax.DownGit is an excellent tool for working with GitHub repositories through the command line, simplifying the download process and making it more efficient.
Package: downhill
DOWNHILLThedownhillpackage provides algorithms for minimizing scalar loss
functions that are defined usingTheano.Several optimization algorithms are included:ADADELTAADAGRADAdamEquilibrated SGDNesterov’s Accelerated GradientRMSPropResilient BackpropagationStochastic Gradient DescentAll algorithms permit the use of regular or Nesterov-style momentum as well.Quick Start: Matrix FactorizationLet’s say you have 100 samples of 1000-dimensional data, and you want to
represent your data as 100 coefficients in a 10-dimensional basis. This is
pretty straightforward to model using Theano: you can use a matrix
multiplication as the data model, a squared-error term for optimization, and a
sparse regularizer to encourage small coefficient values.Once you have constructed an expression for the loss, you can optimize it with a
single call todownhill.minimize:importdownhillimportnumpyasnpimporttheanoimporttheano.tensorasTTFLOAT='df'[theano.config.floatX=='float32']defrand(a,b):returnnp.random.randn(a,b).astype(FLOAT)A,B,K=20,5,3# Set up a matrix factorization problem to optimize.u=theano.shared(rand(A,K),name='u')v=theano.shared(rand(K,B),name='v')z=TT.matrix()err=TT.sqr(z-TT.dot(u,v))loss=err.mean()+abs(u).mean()+(v*v).mean()# Minimize the regularized loss with respect to a data matrix.y=np.dot(rand(A,K),rand(K,B))+rand(A,B)# Monitor during optimization.monitors=(('err',err.mean()),('|u|<0.1',(abs(u)<0.1).mean()),('|v|<0.1',(abs(v)<0.1).mean()))downhill.minimize(loss=loss,train=[y],patience=0,batch_size=A,# Process y as a single batch.max_gradient_norm=1,# Prevent gradient explosion!learning_rate=0.1,monitors=monitors,monitor_gradients=True)# Print out the optimized coefficients u and basis v.print('u =',u.get_value())print('v =',v.get_value())If you prefer to maintain more control over your model during optimization,
downhill provides an iterative optimization interface:opt=downhill.build(algo='rmsprop',loss=loss,monitors=monitors,monitor_gradients=True)formetrics,_inopt.iterate(train=[[y]],patience=0,batch_size=A,max_gradient_norm=1,learning_rate=0.1):print(metrics)If that’s still not enough, you can just plain ask downhill for the updates to
your model variables and do everything else yourself:updates=downhill.build('rmsprop',loss).get_updates(batch_size=A,max_gradient_norm=1,learning_rate=0.1)func=theano.function([z],loss,updates=list(updates))for_inrange(100):print(func(y))# Evaluate func and apply variable updates.More InformationSource:http://github.com/lmjohns3/downhillDocumentation:http://downhill.readthedocs.orgMailing list:https://groups.google.com/forum/#!forum/downhill-users
Package: downleth
Lecture Downloader ETHDownload livestreams, watch livestreams locally (and reliably!)As always, respect the privacy of the people being recorded and do not publicise anything you record without first requesting permission to do so.downleth's main use case is recording livestreamed lectures and having them immediately available, especially if one is unable to attend lectures in a certain timespan.InstallationInstalldownleth:pipinstalldownlethMake sure you haveffmpeginstalled.UsageTo schedule a lecture recording based on a config:downleth--log-levelINFOexecsample-config.jsonFor structuring your configuration file, seesample-config.json. There is also aconfig.schema.jsonJSON schema.Developmentpipenvis used. Use:PIPENV_VENV_IN_PROJECT=1pipenvinstallThevscodetask might help you get started with debugging.TODOAutomatically generate configuration file per semester from myStudies, fetch room numbers, etc. automaticallyAllow spinning up local server to watch lectures without web clientAllow configuring codecs (save storage)Automatically cut breaks somehowAutomatically detect start/end of lecture (might sometimes end a bit later or start a bit earlier)Consider holidaysUse GitHub actions to publish, maybe GitVersion to version itAllow downloading recordings form video.ethz.ch
Package: downlink
downlinkA python library and command line tool for scraping (and
downloading) links on a web page.librarylinkscraper.pyLinkScraper        - class for scraping links from a pagedocument_linkscraper.pyDocumentLinkScraper - subclass of LinkScraperclass for scraping “document links,”
which all end in a given file extension,
such as “.pdf”__init__.pyimports library classes for cleaner importing__main__.pymain()              - entrypoint for command line toolcommand line toolBasic usage:$ downlink “https://www.ct.gov/doh/cwp/view.asp?a=4513&q=530462” outputThe above will download all PDF documents to a folder called
“output” which must exist and be writable.To download files of a different extension, use the –ext option.For more usage details, run downlink –help
Package: download
DownloadA no-frills tool to download files from the web. It will
attempt to be smart about not downloading data that’s
already there, checking to make sure that
there were no errors in fetching data, automatically unzipping the contents
of downloaded zipfiles (if desired), and displaying a progress bar with
statistics.NoteThis draws heavily from theMNE-python_fetch_filefunction._This package doesn’t get a ton of developer attention, but is hopefully well-scoped
enough that it should still be useful! If you’d like to help improve it, fix bugs, etc,
please reach out in the issues!_InstallationEither clone this repository and install with:python setup.py installor, simply install withpip:pip install downloadUsageDownload a file on the web is as easy as:from download import download
path = download(url, file_path)a file calledfile_namewill be downloaded to the folder offile_path.File typesIf your file is a zip file, you can add the flag:path = download(url, file_path, kind="zip")in this case, the file will be downloaded, and then unzipped into the folder
specified byfile_name.Supported formats are‘file’, ‘zip’, ‘tar’, ‘tar.gz’Defaults tofile.Progress barWhether to display a progress bar during file download.
Defaults toTrue:path = download(url, file_path, progressbar=True)ReplaceIfTrueand the URL points to a single file, overwrite the old file if possible.
Defaults toFalse:path = download(url, file_path, replace=False)TimeoutThe URL open timeout in seconds.
Defaults to 10 seconds:path = download(url, file_path, timeout=10)VerboseWhether to print download status to the screen.
Defaults toTrue:path = download(url, file_path, verbose=True)Frequently Asked QuestionsWhy do I occasionally get a “Error file size is…” error?Occasionally, when you try to download a file, the server from
which you are downloading will return that the download is finished,
when it is not.downloadwill check whether the final downloaded
file is the correct size. If not, it will throw this error. In this case,
you should try re-downloading the file.
Package: download_3gpp
A command line utility for downloading standards documents from the 3GPP download site.Contents1Installation2Getting started3Contributions1InstallationUse pip to install the package into your virtual environment:pipinstalldownload_3gpp2Getting started>download_3gpp--helpusage:download_3gpp[-h][--base-urlBASE_URL][--destinationDESTINATION][--relREL][--seriesSERIES][--stdSTD]Acquire3GPPstandardspackagesfromarchiveoptionalarguments:-h,--helpshowthishelpmessageandexit--base-urlBASE_URLBase3GPPdownloadURLtotarget,default"https://www.3gpp.org/ftp/Specs/latest/"--destinationDESTINATIONDestinationdownloaddirectory,default"./"--relREL3GPPreleasenumbertotarget,default"all"--seriesSERIES3GPPseriesnumbertotarget,default"all"--stdSTD3GPPstandardnumbertotarget,default"all"By default, the utility will just download all the latest documents from all the releases in the
3GPP “latest” archive and deposit them in the current directory in the same directory tree as the
download site.For exampledownload_3gppdownloads all the “latest” documents in all releases and all series to the default location of the
current directory.You can download all documents from a specific 3GPP release using the--relargument.download_3gpp--rel16You can download all documents from a 3GPP series across multiple releases using the--seriesargument.download_3gpp--series32Combining the--reland--seriesarguments narrows the filter to that series in the
specified release.download_3gpp--rel16--series32You can also specify the standard numberdownload_3gpp--std104This will download any standard in any series in any release that uses the 104 number; probably a
little too open-ended for most purposes. This is more likely what you want.download_3gpp--series25--std104This will try to acquire that series/std for all releases. If there is any release where that
document didn’t exist then a warning is issued to the console and the download will continue for
any remaining releases.Unfortunately there is not yet a method to specify a subset of releases to download from, or
exclude specified releases from download so you will have to manually download from each release
that you know the document exists in:download_3gpp--rel13--series25--std104download_3gpp--rel16--series25--std1043GPP specifications are “snap-shotted” over time, although many of the snapshots have been archived
such that they are no longer publicly available. If you want to acquire standards from a
historical snapshot (first checking that it has the files available for download that you expect)
then specify the base URL, thus:download_3gpp--base-urlhttps://www.3gpp.org/ftp/Specs/2019-09/3ContributionsContributions are welcome. If you’d like to make a contribution, send me a pull/merge request. The
contribution must assign copyright to me and in return I will acknowledge you as a contributor to
the project in this document (and of course Gitlab history will also reflect your contribution in
commit history).Feature requests are also welcome, but with limited time I may not be able to implement a feature
very promptly. It might be quicker for you to implement it yourself and submit a merge request…
Package: download-accelerator
A python accelerator based on pythonFree software: MIT licenseInstallationpip install download-acceleratorYou can also install the in-development version with:pip install https://github.com/AriaBagheri/python-download-accelerator/archive/master.zipDocumentationhttps://python-download-accelerator.readthedocs.io/DevelopmentTo run the all tests run:toxNote, to combine the coverage data from all the tox environments run:Windowsset PYTEST_ADDOPTS=--cov-append
toxOtherPYTEST_ADDOPTS=--cov-append toxChangelog0.0.1 (2020-06-07)First release on PyPI.
Package: download-aptnotes
Download APTNotesDownload and (optionally) parseAPTNotesquickly and easilyInstallationpipinstalldownload-aptnotesTo enable parsing the downloaded PDFs you need to install the extratika. This
will try to install the Apache Tika Server which depends on Java 7+. Make sure
that you have an adequate version of Java installed before you try to install it
Without this extra, the only output format available ispdf.pipinstalldownload-aptnotes[tika]UsageUsage: download-aptnotes [OPTIONS]

  Download and (optionally) parse APTNotes quickly and easily

Options:
  -f, --format [pdf|sqlite|json|csv]
                                  Output format  [required]
  -o, --output PATH               Output path of file or directory  [required]
  -l, --limit INTEGER             Number of files to download
  -p, --parallel INTEGER          Number of parallell downloads  [default: 10]
  --install-completion            Install completion for the current shell.
  --show-completion               Show completion for the current shell, to
                                  copy it or customize the installation.

  --help                          Show this message and exit.Download all documents, parse them and store them in an SQLite database:download-aptnotes-fsqlite-oaptnotes.sqliteDownload the first 10 documents in the source list, parse them and store
them in an SQLite database:download-aptnotes-fsqlite-oaptnotes.sqlite-l10Download all documents and store them as individual files in a directory:download-aptnotes-fpdf-oaptnotes/ContributingDependencies:Java 7+PoetryClone this repository and install all dependencies:gitclonehttps://github.com/nikstur/download-aptnotes.gitcddownload-aptnotes
poetryinstall
Package: download_canadian_stations
This is a utility to download the current list of active weather stations in Canada.Currently, this downloads information about the Environment Canada weather
stations and produces a CSV file with their details includingLat and LongVarious IDs used to identify the stationThe station nameA link to the historical records for this stationI wrote this utility to produce CSV files for use with Google's "My Maps"
feature.Installation and use# Using pip
pip3 install download-canadian-stations

# If you want to pull from git, assuming you you have Python and pipenv installed
git clone https://github.com/timdaman/canadian-weather-station-downloader.git
cd canadian-weather-station-downloader
pipenv install
pipenv run ./download_stations.pyWhy would I need a map of weather stations in Canada?I do lots of wilderness travel. I sometimes like to analyze recent weather data
for locations I will travel to in order to pack more efficiently and do better
route planning. This is especially useful in the winter where I try to
anticipate lake ice and snow conditions.I find the way Environment Canada shows information about weather stations
painful to use when trying to find the best station to draw data from. By
overlaying the active stations on a map I can more easily determine the best
choice. The url field then makes it easy to jump to the data.Below is a list of maps I have created using output from this scriptDec 2020https://www.google.com/maps/d/u/0/edit?mid=1yIqZFfyOTgg509UNoe03iD_1ht8&usp=sharingNotesThe code assumes yesterday's data is always available. Weather Canada does not produce a list of stations
until the end of the day is PST so this code always uses PST time to identify what day it is.DisclaimersThis is not an officially supported Google product.
Package: download-center
##版本说明：5.2.5: add ua list5.2.6: add table create function5.2.7: add ua list again5.2.8: 添加获取百度cookie的方法5.2.9: 修改百度cookie存储位置5.2.10: add *.txt file5.2.11: baidu cookie storage use sorted set5.2.12: add baidu mb cookie5.2.13: 修复本地中文乱码5.2.14: downloader fail5.2.15: downloader fail5.2.16: pymysql版本写法问题5.2.18: v1.0.0及以上请使用from pymysql.converters import escape_string5.3.0: 使用私有网络 172.17.0.*5.3.1: spider里可以打印当前ip5.3.2: 登录是判断当前ip5.3.3: 添加百度工具包：pc，mb请求头 + 获取真实url新下载中心参数，参考 newDownloadReadme.md 文件使用方法：
config={"param": {"et":13,'cu',url}}
request = SpiderRequest(headers=headers, urls=urls,config = config)
Package: downloadduxiu
About this packageThis downloadduxiu package is used to download books either from duxiu or from chaoxing if the book is accessable in your browsers.It runs on Python 3 platform and rely on requests package, so download and installpython 3andrequestsbefore running following commands.Filesdownloadlib.py–prex=prex :download directory, should be created before command runs.–logifle=logfile :logfile–procnum=1 :means how many threads will work to download pages–yourlink :the link you get from returned email.# prex direction must be created in order to execute this command.
# on linux
./downloadlib.py --logfile=logfile --prex=prex --procnum=n duxiu_url "yourlink"
# on windows
downloadlib.py --logfile=logfile --prex=prex --procnum=n duxiu_url "yourlink"prefaces.py# this script must be run first to prepare the prefaces before any images copyed to current direction.

# on linux
./prefaces.py *.jpg *.png
# on windows
prefaces.py *.jpg *.pnggui.pyDeprecated. Don’t run this script.
Package: downloader
Each Downloader maintains an sqlite3-based disk cache that utilizes zlib
compression. Network requests are only made if the cached version of the
resource has an age larger or equal to the stale_after value provided by the
programmer.Between network requests a throttling interval needs to elapse. This throttling
interval is randomly chosen, but lies within the throttle_bounds defined by the
programmer.HTML resources can be parsed using lxml and in this case an lxml ElementTree is
returned instead of a file object, with the links rewritten to be absolute in
order to facilitate following them. The parsing is done leniently in order to
not fail when invalid HTML is encountered.The programmer can also supply a function that decides whether the server has
banned the client (possibly by examining the returned resource). In this case
an exception will be raised.Downloader’s features make it ideal for writing scrapers, as it can keep its
network footprint small (due to the cache) and irregular (due to the random
throttling interval).To install, simply run:python setup.py installFor documentation, after installing, run:python -m pydoc downloader
Package: downloader-cluster
downloader_cluster==================DESCRIPTION------------ 一个简单的支持多线程，断点续传及分布式的下载器INSTALL-------ubuntu>>>>>>::git clone https://github.com/ShichaoMa/downloader_cluster.gitsudo python setup.py installorsudo pip install downloader-clusterUSAGE>>>>>::ubuntu@dev:~$ downloader -husage: downloader.py [-h] {start,reload} ...positional arguments:{start,reload}start         start download a file.reload        continue downlaod a file.optional arguments:-h, --help      how this help message and exitCommand 'start'usage: downloader.py start [-h] [-s SETTINGS] -u URL [-f FILENAME]Command 'reload'usage: downloader.py reload [-h] [-s SETTINGS] -u URL [-f FILENAME]- demo1::- 普通下载::downloader start -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f  test.tar.gz- 断点续传(服务器需要提供支持)::downloader reload -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f  test.tar.gz- demo2- 分布式下载- 向redis队列中发布下载任务- 实现自定义分布式下载器- 参见: test_.. _test: https://github.com/ShichaoMa/downloader_cluster/blob/master/test/test.py
Package: downloader-exporter
downloader-exporterA prometheus exporter for qBitorrent/Transmission/Deluge. Get metrics from multiple servers and offers them in a prometheus format.How to use itYou can install this exporter with the following command:pip3installdownloader-exporterThen you can run it withdownloader-exporter -c CONFIG_FILE_PATH -p 9000Another option is run it in a docker container.docker run -d -v CONFIG_FILE_PATH:/config/config.yml -e EXPORTER_PORT=9000 -p 9000:9000 leishi1313/downloader-exporterAdd this to your prometheus.yml- job_name: "downloader_exporter"
    static_configs:
        - targets: ['yourdownloaderexporter:port']The exporter is running too slowUse paramsYou can use params to collector metrics from one or more downloaders as you chose, for examplecurl localhost:9000/metrics?name[]=qb1Will only fetch downloader named qb1 in your config.Then you can usemulti-target-exporterto config your prometheus.Use --multiYou can use an options to expose multiple ports for each downloader you're watching. Then the exporter will open a range of ports starting from the one you set, each port for each downloaderWith command linedownloader-exporter -c CONFIG_FILE_PATH -p 9000 --multi trueWith dockerdocker run -d -v CONFIG_FILE_PATH:/config/config.yml -e EXPORTER_PORT=9000 -e USE_MULTI_PORTS=true -p 9000-9010:9000-9010 leishi1313/downloader-exporterConfig fileThe config file is compatible withautoremove-torrents, you can also refer toexample.ymlto see how to write it.GrafanaYou can use the provideddocker-compose.ymlto host your own stack ofGrafana/Prometheus/downloader-exporter.Simplely clone this project, add or editconfig.yml, then start the docker-compose:cpexample.ymlconfig.yml
docker-composeup-dUselocalhost:3000andadmin/adminto access the dashboard.First you will need to add a data source, selectPrometheuswith URLprometheus:9090, Then go and add a new dashboard with ID15006, the dashboard should look like
Package: downloaderlib
downloaderlib - is a small library that makes downloading easier, with this library you can download picture, audio and GitHub code.from downloaderlib import *  -/import the librarydownloader.picture(link, name_dir) -/link - link to picture, name_dir - folder where this picture will be downloadeddownloader.code(link, name_dir) -/ link - link to code, name_dir - folder where this code will be downloadeddownloader.audio(link, name_dir) -/ link - link to audio, name_dir - folder where this audio will be downloadedThe main thing is that at the end of the link there should be the format mp3, md, py, js, etc.