Saravanan666/pypi-org huggingface dataset:
Package: pyspider
pyspider [![Build Status]][Travis CI] [![Coverage Status]][Coverage] [![Try]][Demo]========A Powerful Spider(Web Crawler) System in Python. **[TRY IT NOW!][Demo]**- Write script in Python- Powerful WebUI with script editor, task monitor, project manager and result viewer- [MySQL](https://www.mysql.com/), [MongoDB](https://www.mongodb.org/), [Redis](http://redis.io/), [SQLite](https://www.sqlite.org/), [Elasticsearch](https://www.elastic.co/products/elasticsearch); [PostgreSQL](http://www.postgresql.org/) with [SQLAlchemy](http://www.sqlalchemy.org/) as database backend- [RabbitMQ](http://www.rabbitmq.com/), [Beanstalk](http://kr.github.com/beanstalkd/), [Redis](http://redis.io/) and [Kombu](http://kombu.readthedocs.org/) as message queue- Task priority, retry, periodical, recrawl by age, etc...- Distributed architecture, Crawl Javascript pages, Python 2.{6,7}, 3.{3,4,5,6} support, etc...Tutorial: [http://docs.pyspider.org/en/latest/tutorial/](http://docs.pyspider.org/en/latest/tutorial/)Documentation: [http://docs.pyspider.org/](http://docs.pyspider.org/)Release notes: [https://github.com/binux/pyspider/releases](https://github.com/binux/pyspider/releases)Sample Code-----------```pythonfrom pyspider.libs.base_handler import *class Handler(BaseHandler):crawl_config = {}@every(minutes=24 * 60)def on_start(self):self.crawl('http://scrapy.org/', callback=self.index_page)@config(age=10 * 24 * 60 * 60)def index_page(self, response):for each in response.doc('a[href^="http"]').items():self.crawl(each.attr.href, callback=self.detail_page)def detail_page(self, response):return {"url": response.url,"title": response.doc('title').text(),}```[![Demo][Demo Img]][Demo]Installation------------* `pip install pyspider`* run command `pyspider`, visit [http://localhost:5000/](http://localhost:5000/)**WARNING:** WebUI is open to the public by default, it can be used to execute any command which may harm your system. Please use it in an internal network or [enable `need-auth` for webui](http://docs.pyspider.org/en/latest/Command-Line/#-config).Quickstart: [http://docs.pyspider.org/en/latest/Quickstart/](http://docs.pyspider.org/en/latest/Quickstart/)Contribute----------* Use It* Open [Issue], send PR* [User Group]* [中文问答](http://segmentfault.com/t/pyspider)TODO----### v0.4.0- [ ] a visual scraping interface like [portia](https://github.com/scrapinghub/portia)License-------Licensed under the Apache License, Version 2.0[Build Status]:         https://img.shields.io/travis/binux/pyspider/master.svg?style=flat[Travis CI]:            https://travis-ci.org/binux/pyspider[Coverage Status]:      https://img.shields.io/coveralls/binux/pyspider.svg?branch=master&style=flat[Coverage]:             https://coveralls.io/r/binux/pyspider[Try]:                  https://img.shields.io/badge/try-pyspider-blue.svg?style=flat[Demo]:                 http://demo.pyspider.org/[Demo Img]:             https://github.com/binux/pyspider/blob/master/docs/imgs/demo.png[Issue]:                https://github.com/binux/pyspider/issues[User Group]:           https://groups.google.com/group/pyspider-users
Package: pyspiflash
SPI data flash device drivers (pure Python)SPI flash devices, also known asDataFlashare commonly found in embedded
products, to store firmware, microcode or configuration parameters.PySpiFlashcomes with several pure Python drivers for those flash devices, that
demonstrate use of SPI devices withPyFtdi. It could also be useful to dump
flash contents or recover from a bricked devices.Supported SPI flash devicesVendorAtmelAtmelMacronixSSTWinbondMicronDataFlashAT45AT25MX25LSST25W25QN25QStatusTestedTestedTestedTestedTestedTestedSizes (MiB)2,42,4,82,4,8,162,42,48Read (KiB/s)12781279132964212521315Write (KiB/s)566471263107Erase (KiB/s)6063315006084Notes about performancesReadoperation is synchronous with SPI bus clock: it therefore only depends
on the achievable frequency on the SPI bus, which is bound to the highest
supported frequency of the flash device.Writeoperation depends mostly on the flash device performance, whose upper
limit comes mostly from the maximum write packet size of the device, as the
device needs to be polled for completion after each packet: the shorter the
packet, the higher traffic on the SPI and associated overhead.Eraseoperation depends mostly on the flash device performance, whose fully
depends on the flash device internal technology, as very few and short
packets are exchanged over the SPI bus.Supporting new flash devices of series ‘25’Many flash devices support a common subset to for read/write/erase operations.
Critical differences appear with lock and protection features, and with
security features. An NDA is often required to obtain details about the
advanced security features of these devices.It should be nevertheless quite easy to add support for new flash device
variants:matchmethod in the PyFtdi flash device API should be the first to look
at to detect more compatible flash devices.Supported SPI flash commandsIdentificationThe SPI device driver is automatically selected based on the detected SPI
flash deviceReadRead byte sequences of any size, starting at any location from the SPI
flash deviceWriteWrite arbitrary byte sequences of any size, starting at any location to the
SPI flash deviceEraseErase SPI flash device blocks, whose size depend on the capabilities of the
flash device, typically 4KiB and/or 64KiB.UnlockUnlock any protected flash device sectorsDependenciesPython3.5 or above is required.PyFTDI0.42 or above is required.Note about previous releasesIf you have no choice but using previous releases of Python (including Python
2.x) orPyFTDI, please checkout the latestPySpiFlash0.4.1 which provides
support for these deprecated environmement, but is no longer actively
maintained.PySpiFlashheavily relies onPyFtdimodule to access the SPI flash device.
ThePyFtdiAPI has been changed several times, see the compatibility matrix
below.Thesetup.pyscript should take care of those dependencies.PySpiFlashversionPyFtdiversion0.2.*0.9 .. 0.100.3.*0.11+0.4.*0.13.2+0.5.*0.20.0+0.6.*0.42.0+
Package: pyspikes
Spike EncodersBranchCodecovCIMasterSoon..Spike encoders for Spiking Neural Network.This package consists of two types of spike encoders for spatio-temporal data:Threshold Based Representation (TBR) encoderBens Spiker Algorithm (BSA) encoderDataInstillationExampleContributionIssuesDataThe data given to the encoders are spatio-temporal. Each sample is onecsvfile. In each file, every column is a feature and the rows are time points.For example each file given in theDatafolder had 128 rows and 14 columns, 14 columns are the features and 128 columns are the data points.Instillationpip install pyspikesExamplefromspikesimportencoderfromspikes.utilityimportReadCSVdata=ReadCSV('Data').get_samples()['samples']bsa=encoder.BSA(data)print(bsa.get_spikes())tbr=encoder.TBR(data)print(tbr.get_spikes())ContributionAll contributions are welcome.IssuesIssues can be opened through Github'sIssuestab.
Package: pyspin
A little terminal spinner lib. Heavily inspired bygo-spin.DemoInstall$ pip install pyspinUsagemake a spinner by hand:from__future__importprint_functionimportsysimporttimefrompyspin.spinimportDefault,Spinner# Choose a spin style.spin=Spinner(Default)# Spin it now.foriinrange(50):print(u"\r{0}".format(spin.next()),end="")sys.stdout.flush()time.sleep(0.1)or you can use the decorator pyspin provide:from__future__importprint_functionimporttimefrompyspin.spinimportmake_spin,Default# Choose a spin style and the words when showing the spin.@make_spin(Default,"Downloading...")defdownload_video():time.sleep(10)if__name__=='__main__':print("I'm going to download a video, and it'll cost much time.")download_video()print("Done!")You can have a look at the example code in the example folder. Run it
via:$ python example/example_spin.py
$ python example/usage_example.pyContributeIf you find an interesting spinner, send me a pull request <3If you find a bug or have any suggestions, open an issue.Contributions are always welcome at any time! ✨ 🍰 ✨LicenseMIT.
Package: pyspinner
pyspinner is simple library for parsing text that uses spin-syntax.InstallationTo install pyspinner, simply:$ pip install pyspinneror download the source code and do:$ python setup.py installHow to use it>>>importspinning>>>spinning.unique('The {quick|fast} {brown|gray|red} fox jumped over the lazy dog.')'The quick gray fox jumped over the lazy dog.'Running tests$pythonspinning-tests.py....----------------------------------------------------------------------Ran2testsin0.000sOKFeaturesSupports nested syntax.Supports custom opening, closing and separator characters by using theoverride_paramsfunction.TO-DOAllow optional phrases:The quick{ red|}fox...Allow special characters{,|,}inside text by escaping them.Write more tests
Package: pyspinners
PySpinnersCLI Progress Spinner collectionPySpinners is a collection of progress spinners for CLI applications.InstallationpipinstallpyspinnersUsage# Create new spinner instance# Options 1-30 for different spinner type# True/False shows both progress and spinner or just the spinnerspinner1=NewSpinner(1,False)# Any list or any other iterable can be usedlst=[1,2,3,4,5]fori,iteminenumerate(lst):...dostuff...spinner1.spin(i+1,len(lst))# Call the .spin() function and give as parameters the iteration number and the length of the iterable.LicenseMIT
Package: pySpintax
pySpintax - The simplest Python Spintax spinner!With pySpintax, you can spin your Spintax text with just one line of code.Getting itTo download pySpintax, simply use Pypi via pip.$pipinstallpySpintaxUsing itUsing pySpintax is extremely easy!frompySpintaximportspinspintax="{ Hi! | Hello! | Hey! }"spinned=spin(spintax)print(spinned)You can also change the delimiter of your Spintax text:frompySpintaximportspinspintax="{ Hi! ; Hello! ; Hey! }"spinned=spin(spintax,delimiter=";")print(spinned)pySpintax will strip whitespaces for you, so even if you have multiple whitespaces or none in your Spintax string, pySpintax will return a stripped String.LicenseMIT LicenseCopyright (c) 2019 1dragoshPermission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
Package: pyspla
splasplais an open-source generalized sparse linear algebra framework for mathematical computations with GPUs
acceleration. It provides linear algebra primitives, such as matrices, vectors and scalars, supports wide variety of
operations. It gives an ability to customize underlying values types treatment and parametrise operations using rich
pre-defined functions' set.Package pagehttps://test.pypi.org/project/pysplaSource code:https://github.com/JetBrains-Research/splaContributing:https://github.com/JetBrains-Research/spla/CONTRIBUTING.mdDevelopment:https://github.com/JetBrains-Research/spla/DEVELOPMENT.mdC/C++ API Reference:https://jetbrains-research.github.io/spla/docs-cppBug report:https://github.com/JetBrains-Research/spla/issuesNote: project under heavy development! Not ready for usage.ContributorsEgor Orachyov (Github:@EgorOrachyov)Gleb Marin (Github:@Glebanister)Semyon Grigorev (Github:@gsvgit)Citation@online{spla,
  author = {Orachyov, Egor and Marin, Gleb and Grigorev, Semyon},
  title = {spla: An open-source generalized sparse linear algebra framework for GPU computations},
  year = 2022,
  url = {https://github.com/JetBrains-Research/spla},
  note = {Version 1.0.0}
}LicenseThis project licensed under MIT License. License text can be found in thelicense file.AcknowledgmentsThis is a research project of the Programming Languages and Tools Laboratory at JetBrains-Research. Laboratory
websitelink.
Package: pySplash
pySplashPrerequisitesPython 3.7+UsageChange to an awesome random wallpaperpySplashChange to a random wallpaper by search termpySplashnature,waterChange to an wallpaper from an image url.
I recommend using api calls fromhttps://source.unsplash.comExample:pySplashhttps://source.unsplash.com/1920x1080/daily
Package: pysplashsph
PySplashSPHA Python wrapper for the smoothed particle hydrodynamics plotting library SPLASH.
Currently supports reading many SPH data formats, and useful exact analytic solutions
for specific hydrodynamics problems.PySplashSPH currently does not wrap the SPLASH interpolation routines, however this
is planned for a future release.Building/Installing from sourceInstalling from source requires an installation of Splash. To install:python setup.py installTo build a python wheel:python setup.py bdist_wheelNote that this will automatically build thesplashlibraries and copy them into the correct location (pysplashsph/libs/.), however it will not "audit" or "delocate" the wheel (i.e. copy in and relink any non-standard external libraries that are dependencies).To build a 'fixed' wheel instead, run the scriptbuild-wheels.sh, which will build as well as audit the wheel for you. Fixed wheels are stored inpysplashsph/wheelhouse. You can choose to install directly from a wheel withpip install <wheel-name>.whl.Search pathssetup.pywill search for an installation of Splash in the following directories, in this order:In the current directory, i.e.pysplashsph/
   |--- README.md
   |--- pysplashsph/
   |--- setup.py
     ...
   |--- splash/
   ...
   |--- test/
   |--- wheelhouse/In the parent directory, i.e.splash/
   |--- bin/
   |--- build/
     ...
   |--- pysplashsph/
   ...
   |--- src/In the directory defined by the environment variable$SPLASH_DIRIn$HOME/splash
Package: pysplines
=========
PySplinesPython / Sympy implementation of Uniform rational B-splines.The supposed usage of the PySplines is CAD-style parameter-based shape generation for meshes and shape optimization.The package focuses on:Easy generation of B-splines with given control points and degree,Access to the surface properties in analytical and numerical forms (normals, curvature, displacement fields)Smoothness of the curve and uniformity of the points distribution along the curveFast access to the surface properties, especially when they are called multiple timesSphinx documentation available here:http://petrkungurtsev.me/PySplines__... __:http://petrkungurtsev.me/PySplinesDemosPlease refer to thedemofolder for some use cases.InstallationWith pip:.. code-block:: rstpython -m pip install pysplines
Package: pysplitcue
Pysplitcue - CUE sheet splitter, based on shntool and cuetools libraries.Pysplitcue is a stupid wrapper for theshntoolandcuetoolslibraries.
It splits big audio tracks using informations contained in the associated"CUE"sheet file and can automatically handle files encoded other than
UTF-8 and ASCII encodings without modifying the source files.Note:there are also other alternatives to pysplitcue:deflacueflaconFeaturesSupported input formats: WAV, FLAC, APE, WavPackSupported output formats: FLAC, APE, WAV, WavPack, OGG or MP3Auto-tag is supported only for FLAC, MP3, OGG formatsRequiresPython >=3.6chardet(The Universal Character Encoding Detector)shntool(includes shnsplit)cuetools(includes cuebreakpoints, cueconvert, cueprint, cuetag)Optionalsflaclamevorbis-tools(includes oggenc, oggdec)monkeys-audio(to convert APE audio format, name depends to your O.S.)wavpackUbuntu users can install required and optional dependencies like this:sudo apt install shntool cuetools flac lame vorbis-tools wavpack monkeys-audioUsageFrom Command Linepysplitcue -i IMPUTFILE
             [-h] 
             [--version]  
             [-f {wav, wv, flac, ape, mp3, ogg}] 
             [-o OUTPUTDIR] 
             [-ow {ask,never,always}] 
             [-c]From Python Interpreter>>>frompysplitcue.splitcueimportPySplitCue>>>kwargs={'filename':'/home/user/my_file.cue','outputdir':'/home/user/some_other_dir','suffix':'flac','overwrite':'ask'}>>>split=PySplitCue(**kwargs)>>>split.open_cuefile()>>>split.do_operations()>>>split.cuefile.close()Examplespysplitcue -i 'inputfile.cue'To split and convert several audio formats into the relative individualflacformat audio tracks.pysplitcue -i '/User/music/collection/inputfile.cue' -f wav -o 'my-awesome-tracklist'This command splits the individual audio tracks intowavformat
and saves them in the 'my-awesome-tracklist' folder.Installationpython3 -m pip install pysplitcueLicense and CopyrightCopyright © 2010 - 2022 Gianluca PernigottoAuthor and Developer: Gianluca PernigottoMail:jeanlucperni@gmail.comLicense: GPL3 (see LICENSE file in the docs folder)
Package: pysplitter
Tutorial using the pysplit packagepysplit is a Python package used for splitting large files into smaller chunks.Currently the default chunk size is 100MB. This size was chosen to work around GitHub's upload file size limit.Install the latest version of pysplitterRun the cell below to ensure you have the latest version ofpysplitterinstalled on your machine.# !pip install --upgrade pysplitterImport required packagesimportpysplitteraspyspimportnumpyasnpImport helpful packagesimportsysimportosCreate a numpy array that will exceed 100MB when saved to disk.The numeric values of the data are not important. Random values were used for convenience only.dim=250num=int(dim*dim*dim)x=np.random.normal(size=num).reshape(dim,dim,dim)x.shape(250, 250, 250)Save numpy array to disk and list directory contentsnp.save('x.npy',x)os.listdir()['.ipynb_checkpoints',
 '1-split-unsplit-tutorial.ipynb',
 'x.npy']Display size of file on disksize=os.path.getsize('x.npy')print(f'{size/1e6}MB')125.000128 MBAs many people may know, GitHub will not allow files exceeding 100 MB to be uploaded.Use the commands below to split the original (and too large) file into multiple.splitfiles.Currently the default split size is <=100 MB, but this may become a variable paramter in furture distributions.os.listdir()['.ipynb_checkpoints',
 '1-split-unsplit-tutorial.ipynb',
 'x(unsplit).npy',
 'x.npy']src='x.npy'pysp.split(src)2 file(s) written.Check file size of the two chunks that were just written.os.listdir()['.ipynb_checkpoints',
 '1-split-unsplit-tutorial.ipynb',
 'x(unsplit).npy',
 'x.npy',
 'x0000.npy.split',
 'x0001.npy.split']print(os.path.getsize('x0000.npy.split')/1e6,'MB')100.0 MBprint(os.path.getsize('x0001.npy.split')/1e6,'MB')25.000128 MBAs is clearly shown from the output of the above cells, both chunks are <= 100MB. This means that this data can now pushed  to GitHub as any other file would.Recombine the data chunks back into a single filesearch_pattern='./x*.split'dst='.'pysp.unsplit(search_pattern,dst,validate=True,orig_src=src)File reconstructed without loss: Trueos.listdir()['.ipynb_checkpoints',
 '1-split-unsplit-tutorial.ipynb',
 'x(unsplit).npy',
 'x.npy',
 'x0000.npy.split',
 'x0001.npy.split']x_unsplit=np.load('x(unsplit).npy')x_unsplit.shape(250, 250, 250)Show that the manipulated datax_unsplitis the same as the original datax.np.allclose(x,x_unsplit)True
Package: pysploit
pysploitPython Boilerplate contains all the boilerplate you need to create a Python package.Free software: ISC licenseDocumentation:https://pysploit.readthedocs.org.FeaturesTODOCreditsThis package was created withCookiecutterand theaudreyr/cookiecutter-pypackageproject template.History0.1.0 (2016-05-28)First release on PyPI.
Package: pysplunk
This is a package for internal use only. Use with Python 3.8+.UsageOn command line:$ pip install pysplunkAdd this code to the entryfile:frompysplunkimportsplunksplunk.configure_logger(index="index_name",token="splunk_token",version="1.0.0",env="production",level="DEBUG")To log something:splunk.loginfo(account=account_id,workflowtype="workflow_type",workflowinstance="workflow_instance",msg="message",customfields={"customField1":3})splunk.logdebug(account=account_id,workflowtype="workflow_type",workflowinstance="workflow_instance",msg="message",customfields={"customField1":3})splunk.logwarn(account=account_id,workflowtype="workflow_type",workflowinstance="workflow_instance",msg="message",customfields={"customField1":1,"customField2":"2"})splunk.logerror(account=account_id,workflowtype="workflow_type",workflowinstance="workflow_instance",msg="message",customfields={"customField1":1},evidencia="Exception traceback")Definitionsaccount: An integer representing the ID of the logged account.workflowtype: Some identification for the overall operation, example: “login”.workflowinstance: Some identification for the specific part of the operation, examples “start_login”, “login_error”, “superuser_login”, etcmsg: A desciptive message of the log.customfields: Additional fields, examples: “operation_id”, “user_id”, “product_id”, etc.evidencia: Some string evidence (can be multiline) to attach into the log. This is convenient to add exceptions or API responses.ConfigurationAEROSPIKE_EVIDENCE_URLURL for aerospikeAEROSPIKE_EVIDENCE_TTLTTL for aerospike evidence, default: 2592000 secondsAEROSPIKE_EVIDENCE_TIMEOUTTimetou for sending data to aerospike, default: 0.800 secondsSPLUNK_URLURL for splunkSPLUNK_LOG_FORMATSplunk log format, default is set in splunk.pySPLUNK_LOG_HANDLER_NAMEHandler for splunk log, default: LogRequirementssplunkfowarder is required for this package work.
Package: pyspnego
Python SPNEGO LibraryLibrary to handle SPNEGO (Negotiate, NTLM, Kerberos) and CredSSP authentication. Also includes a packet parser that can
be used to decode raw NTLM/SPNEGO/Kerberos tokens into a human readable format.RequirementsSeeHow to Installfor more detailsCPython 3.8+cryptographysspilib- Windows onlyOptional RequirementsThe following Python libraries can be installed to add extra features that do not come with the base package:python-gssapiandpykrb5for Kerberos authentication on Linuxruamel.yamlfor YAML output support onpyspnego-parseHow to InstallTo install pyspnego with all basic features, runpipinstallpyspnegoKerberos AuthenticationWhile pyspnego supports Kerberos authentication on Linux, it isn't included by default due to its reliance on system
packages to be present.To install these packages, run the below# Debian/Ubuntuapt-getinstallgccpython3-devlibkrb5-dev# Centos/RHELyuminstallgccpython-develkrb5-devel# Fedoradnfinstallgccpython-develkrb5-devel# Arch Linuxpacman-Sgcckrb5Once installed you can install the Python packages withpipinstallpyspnego[kerberos]Kerberos also needs to be configured to talk to the domain but that is outside the scope of this page.How to UseSeethe examples sectionfor examples on how to use the authentication side of the library.Note: While server/acceptor authentication is available for all protocols it is highly recommended you have the system GSSAPI and NTLM system libraries present for acceptor authentication. Pyspnego NTLM acceptor authentication should work but it is not as thoroughly tested as the GSSAPI implementation.CredSSP AuthenticationSince version 0.2.0, pyspnego can be used for CredSSP authentication. While this isn't part of the SPNEGO/Negotiate
protocol it uses common features and code like ASN.1 structures and even Negotiate auth as part of the CredSSP process.
Bothinitiateandacceptusages are supported when specifyingprotocol='credssp'but there are no guarantees the
acceptor is free of any bugs so use with caution.BacklogAdd support for anonymous authenticationSee ifpywinrmwants to use this