Saravanan666/pypi-org huggingface dataset:
Package: scprint
SCPrint (Discontinued)(Simple Colored Print)DISCONTINUATION NOTICEThis project was discontinued on the 12th March 2021. It has now been replaced bycli-essentials. I highly recommend migrating tocli-essentialshowever it is not required. This module will continue to support current python versions for a while (hopefully). However if you are having trouble, make sure your first troubleshooting step is migrating tocli-essentials.DescriptionSCPrint is a Python 3 module aiming to make it simple and easy to use colors in your python projects. This is achieved by overriding the built-in python print function with one supportive of colored outputs, yet retaining the core functionality of the built-in print function, for example: Line Endings:end=, Separators:sep=and Flushed Outputs:flush=. SCPrint is able to replace the built-in print function without creating any problems with your pre-existing programs and scripts.Installation$ python -m pip install scprintUsage# To override the built-in print function use (Recommended):fromscprintimportprintprint("Hello World!",color="Blue",bcolor="White")# The print function will still work normally without colors:print("Hello World!")# You can still use SCPrint as its own fuction (Not Ideal):fromscprintimportprintasnewFunctionnewFunction("Hello World!",color="Red",bcolor="Grey")# To create multicolored (rainbow) text use:fromscprintimportrainbowrainbow("Multicolored Text")Demofromscprintimportdemodemo(showBColor=False)FeaturesControl foreground and background color by settingcolor=,bcolor=respectively.Continue to change the object separator and line ending withsep=andend=| Default =sep=" ",end="\n"Continue to specify a write method withfile=| Default =file=sys.stdoutCreatemulticoloredtextusingscprint.rainbow()Examplesfromscprintimportprintprint("This text is white",color="White")print("This text is Blue with a Yellow Background",color="Blue",bcolor="Yellow1")fromscprintimportprintprint(" Hello ",color="red",bcolor="blue",end="")punctuation="!"print(" World",punctuation," ",color="blue",bcolor="red",sep="")fromscprintimportrainbowrainbow("Multicolored Text!")
Package: scProject
scProjectOverviewTransfer learning for gene expression signatures in Python.DescriptionscProject is a software package that allows biologists to use transfer learning to understand the usage of previously discovered features in genomic datasets. Tools like NNMF allow biologists to find a set of vectors that linearly combine to approximately reconstruct a dataset. These features can have biological meaning as a pathway, cell type, gene program, cell feature, etc.Built on top ofProjectR, scProject leveragesscikit-learn’s andscipy’s regression tools to effectively perform a change of basis with the new basis being the features discovered from NNMF or another previous analysis tool. For example, the values in the first column of the pattern matrix are the coefficients of the features to approximate the first sample in the dataset. This analysis allows the user to see the usage of features from a previously examined dataset and see if those same features are utilized in a new dataset. Usingumap-learnto decrease the dimensionality of the regressed pattern matrix allows the user to visualize the pattern matrix in intuitive and informative ways.InstallationscProject package can be installed by the following code:pipinstallscProjectIt is recommended to install the package and run the code in a virtual environment (venv). Use the code below to create and activate venv:python-mvenvenvsourceenv/bin/activateContentsNameLinkscProject APIhttps://scproject.readthedocs.io/en/master/contents.htmlRegressionhttps://scproject.readthedocs.io/en/master/contents.html#module-scProject.rgVisualizationhttps://scproject.readthedocs.io/en/master/contents.html#module-scProject.vizStatisticshttps://scproject.readthedocs.io/en/master/contents.html#module-scProject.statsUtilitieshttps://scproject.readthedocs.io/en/master/contents.html#module-scProject.matcherFAQI'm getting NumbaDeprecationWarning while importing scProject in Python. What should I do?NumbaDeprecationWarning:The'nopython'keywordargumentwasnotsuppliedtothe'numba.jit'decorator.TheimplicitdefaultvalueforthisargumentiscurrentlyFalse,butitwillbechangedtoTrueinNumba0.59.0.Seehttps://numba.readthedocs.io/en/stable/reference/deprecation.html#deprecation-of-object-mode-fall-back-behaviour-when-using-jitfordetails.@numba.jit()The following error is coming fromumappackage, notscProject. Please ignore this warning message.Additional InformationFor more instructions and guidelines, read thedocumentation.If you would like to leave feedback, please contactcshin12@jhu.eduandgsteinobrien@jhmi.edu.Copyright © 2022-2024 Goff Lab, Stein-O'Brien Lab. All rights reserved.
Package: sc.psc.policy
Table of ContentsPackage Repository SiteOverviewRequirementsInstallationSponsoringCredits0.6 (2012-07-17)0.5 - UnreleasedPackage Repository SiteOverviewThis package installs a Plone Software Center in a clean Plone Site.The main idea is to provide an easy and fast way to create a package repository,
like PyPi or plone.org/downloads, to be used by a company to release its
packages.WarningThis is an early alpha intended to be used internally only.RequirementsPlone >=4.0.x (http://plone.org/products/plone)InstallationTo enable this product,on a buildout based installation:Edit your buildout.cfg and addsc.psc.policyto the list of eggs to install[buildout]
...
eggs =
    sc.psc.policyAfter updating the configuration you need to run the ‘’bin/buildout’’,
which will take care of updating your system.Go to the ‘Site Setup’ page in the Plone interface and click on the
‘Add/Remove Products’ link.Choose the product (check its checkbox) and click the ‘Install’ button.Uninstall – This can be done from the same management screen, but only
if you installed it from the quick installer.Note: You may have to empty your browser cache and save your resource registries
in order to see the effects of the product installation.SponsoringDevelopment of this product was sponsored byTV1and bySerpro.CreditsSimples Consultoria (products at simplesconsultoria dot com dot br) -
ImplementationChangelog0.6 (2012-07-17)Patch collective.psc.blobstorage to deal with blob files [erico_andrei]0.5 - UnreleasedInitial release [erico_andrei]
Package: scpscraper
SCP ScraperA small Python library designed for scraping data from the SCP wiki. Made with AI training (namely NLP models) and dataset collection (for things like categorization of SCPs for external projects) in mind, and has arguments to allow for ease of use in those applications.Below you will find installation instructions, examples of how to use this library, and the ways in which you can utilize it. I hope you find this as useful as I have!Sample CodeInstallationscpscrapercan be installed viapip install. Here's the command I recommend using, so you consistently have the latest version.pip3 install --upgrade scpscraperThe BasicsImporting the Library# Before we begin, we obviously have to import scpscraper.importscpscraperGrabbing an SCP's Name# Let's use 3001 (Red Reality) as an example.name=scpscraper.get_scp_name(3001)print(name)# Outputs "Red Reality"Grabbing as many details as possible about an SCP# Again using 3001 as an exampleinfo=scpscraper.get_scp(3001)print(info)# Outputs a dictionary with the# name, object id, rating, page content by section, etc.The Fun StuffGrabbing an SCP'spage-contentdiv HTMLFor reference, thepage-contentdiv contains what the user actually wrote, without all the extra Wikidot external stuff.# Once again, 3001 is the examplescp=scpscraper.get_single_scp(3001)# Grab the page-content div specificallycontent=scp.find_all('div',id='page-content')print(content)# Outputs "<div id="page-content"> ... </div>"Scraping HTML or information frommultipleSCPs# Grab info on SCPs 000-099scpscraper.scrape_scps(0,100)# Same as above, but only grabbing Keter-class SCPsscpscraper.scrape_scps(0,100,tags=['keter'])# Grab 000-099 in a format that can be used to train AIscpscraper.scrape_scps(0,100,ai_dataset=True)# Scrape the page-content div's HTML from SCP-000 to SCP-099# Only including this as an example, but scrape_scps_html() has# all the same options as scrape_scps().scpscraper.scrape_scps_html(0,100)Google Colaboratory Only UsageBecause of thegoogle.colabmodule included in Google Colaboratory, we can do a few extra things there that we can't otherwise.Mount your Google Drive to the Colaboratory VM# Mounts it to the directory /content/drive/scpscraper.gdrive.mount()Scrape SCP info/HTML and copy to your Google Drive afterwards# Requires your Google Drive to be mounted at the directory /content/drive/scpscraper.scrape_scps(0,100,copy_to_drive=True)scpscraper.scrape_scps_html(0,100,copy_to_drive=True)Copy other files to/from your Google Drive# Requires your Google Drive to be mounted at the directory /content/drive/scpscraper.gdrive.copy_to_drive('example.txt')scpscraper.gdrive.copy_from_drive('example.txt')Planned UpdatesPotential updates in the future to make scraping data from any website easy/viable, allowing for easy mass collection of data.Link to GitHub RepoPlease consider checking it out! You can report issues, request features, contribute to this project, etc. in the GitHub Repo. That is the best way to reach me for issues/feedback relating to this project.https://github.com/JaonHax/scpscraper/
Package: scpup
AramEau - eau-pySCPUP DescriptionLibrary for Super Crystal Pokebros Ultimate Party game. This library contains the SCPUP ABC and related python classesThis library is not meant to be used in other projects other than AramEau's SCPUP and maybe other games made by AramEau.
So, if for any reason you decide to use this library, it is at your own risk. Sorry but the aim of this library is to
acomplish a personal goal.Installpython-mpipinstall-UscpupUsageAny exported member of any module within this package can be accessed from the root scope, for example:fromscpupimportEauSpriteclassSomeSprite(EauSprite):...# orimportscpupclassSomeSprite(scpup.EauSprite):...
Package: scpy
scpy is a command line tool to autosync files and directories to remote servers over ssh. For windows users, there is a program called winscp that can automatically keep a remote directory up to date with a local one. I didn’t find a tool I liked to do this on linux, so I made this one.It follows the usage of the regular scp command with a couple of slight differences.There is no need to supply the -r option for directories. It determines itself whether it’s a directory or notYou can only push files to remote servers, you can’t pull them backThere is no globbing support (yet)Usage Examplesscpy workspace/src username@192.168.1.2:/This will sync the local folder ./workspace/src to /src on 192.168.1.2. It overwrites the src folder on the remote machine.:scpy workspace/src/file1.py workspace/src/file2.py username@192.168.1.2:workspace/src/This will synchronize the 2 local files file1.py and file2.py to /home/username/workspace/src/ on 192.168.1.2:scpy workspace/src/file1.py workspace/src/file2.py username@192.168.1.2:workspace/src/ otherusername@host.com:/opt/This is the same as above but it will sync the same files to both 192.168.1.2 and host.com
Package: scpython
SCPythonA package to fetch data from the SCP Foundation Wiki.ResourceBadgeDocumentationStatusInstallation and UsageThis library can be found withpip.pip install scpythonOnce installed, all requests are handled with aClientobject:fromscpythonimportClientfromconfigimportYOUR_TOKENconn=Client(YOUR_TOKEN)scp173=conn.getScpArticle("SCP-173")print(scp173.page_source)For more information, refer to thedocumentation.CreditThis app uses content from the SCP Foundation, which is licensed by CC-SA 3.0. Here are the link to all its branches:
Package: sc-python-templates
A simple Python project sample structureThis project provides a sample structure for creating python project.InstallationIt is possible to install the tool withpip:pip install sc-python-templatesConfigurationFirst, make sure /var/opt/sc directory exists, if not create this directory and make sure current user has the right
to create files in this directory.You can copydefault.ymlto /var/opt/sc/.sc-python-templates/production.yml to initialize the production configuration.The default configuration file looks like this:dev:
  # whether this program is running is development mode
  dev_mode: FalseLicenseThe script is released under the MIT License.  The MIT License is registered
with and approved by the Open Source Initiative[1].[1]https://opensource.org/licenses/MIT
Package: scqubits
scqubits is an open-source Python library for simulating superconducting qubits. It is
meant to give the user a convenient way to obtain energy spectra of common
superconducting qubits, plot energy levels as a function of external parameters,
calculate matrix elements etc. The library further provides an interface to QuTiP,
making it easy to work with composite Hilbert spaces consisting of coupled
superconducting qubits and harmonic modes. Internally, numerics within scqubits is
carried out with the help of Numpy and Scipy; plotting capabilities rely on
Matplotlib.If scqubits is helpful to you in your research, please support its continued
development and maintenance. Use of scqubits in research publications is
appropriately acknowledged by citing:Peter Groszkowski and Jens Koch, ‘scqubits:  a Python package for superconducting qubits’,
Quantum 5, 583 (2021).https://quantum-journal.org/papers/q-2021-11-17-583/
Package: scquill
scquillApproximate any single cell data set, saving >99% of memory and runtime.Approximating a single cell data setimportscquillq=scquill.Compressor(filename='myscdata.h5ad',output_filename='myapprox.h5',celltype_column="cell_annotation",)q()Exploring an approximationTo load an approximation:import scquill

app = scquill.ApproxAnnData(
    filename='myapprox.h5',
)To show a neighborhood plot:scquill.pl.neighborhoodplot(app, ['gene1', 'gene2', 'gene3'])To show embeddings of cell neighborhoods, similar to single-cell UMAPs:scquill.pl.embedding(app, ['gene1', 'gene2', 'gene3'])MORE TO COMEAuthorsFabio Zanini @fabilab
Package: scrab
scrab - Fuzzy content scraperFast and easy to use content scraper for topic-centred web pages, e.g. blog posts, news and wikis.The tool uses heuristics to extract main content and ignores surrounding noise. No processing rules. No XPath. No configuration.InstallingpipinstallscrabUsagescrabhttps://blog.postStore extracted content to a file:scrabhttps://blog.post>content.txtToDo ListSupport<main>tagAdd support for listsAdd support for scriptsAdd support for markdown output formatDownload and save referenced imagesExtract and embed linksDevelopment# Lint with flake8flake8.--count--select=E9,F63,F7,F82--show-source--statistics
flake8.--count--exit-zero--max-complexity=10--max-line-length=127--statistics# Check with mypymypy./scrab
mypy./tests# Run testspytestPublish to PyPI:rm-rfdist/*
pythonsetup.pysdistbdist_wheel
twineuploaddist/*LicenseThis project is licensed under theMIT License.
Package: scrab-img-from-ligthshot
Scrab Img(images) From LightShotWhat Is It?If you open this linkhttps://prnt.sc/image/4fdgjb, you can see an image of someone user of lightshot.
You can change lasts 6 symbols in the link, and you'll see another image:https://prnt.sc/image/afsghb,
but changing it manually is uncomfortable. To automatic this uncomfortable process, I created this project.Script will download certain count(that you indicate) of imagesInstallingPoetryYou have to have installed poetry 1.4 or higher.Spawn virtual environment:poetry shellInstall requirementspoetry installPyPiYou have to have installed python 3.7 or higher.Create virtual environment:python3 -m venv envThen activate(launch) virtual environment:Linux:source env/bin/activatepip3 install scrab-img-from-ligthshotSourceClone repository:git clone git@github.com:Transparency010101/scrab-img-from-ligthshot.gitcd scrab-img-from-ligthshot/Create virtual environment:python3 -m venv envThen activate(launch) virtual environment:Linux:source env/bin/activatepython3 setup.py installIf occurred permision denied error:sudo python3 setup.py installUsagePyPi or Source:silf -hPoetry:poetry run silf -hWhen program finished, open the project's folderimg/, and there will be images.NotesIdea for the project I gotthere4:30.I'm developing this project only for my practise, maybe there is fools ideas,
controversial points regarding the development, not serious thing, attitude towards whole developmentP.S. Не бейте за англиский.
Package: scrachy
ScrachyScrachy was primarily developed to provide a flexible cache storage backend forScrapythat stores its data in a relational database usingSQLAlchemy.
However, it now has several other additional features including middleware for using Selenium to download requests.
It also comes with a downloader middleware that will optionally ignore requests that are already in the cache.InstallYou can install the latest version from git:>pip install git+https://bitbucket.org/reidswanson/scrachy.gitor from PyPI:>pip install scrachyDocumentationA brief guide to minimally using the cache storage engine and the Selenium backend are given below.
For other configuration options and features please see the full documentation onRead the Docs.Storage BackendTo (minimally) use the storage backend you simply need to enable caching by adding the following to yoursettings.pyfile:# Enable cachingHTTPCACHE_ENABLED=True# Set the storage backend to the one provided by Scrachy.HTTPCACHE_STORAGE='scrachy.middleware.httpcache.AlchemyCacheStorage'# One of the supported SqlAlchemy dialectsSCRACHY_DB_DIALECT='<database-dialect>'# The name of the driver (that must be installed as an extra) and used.SCRACHY_DB_DRIVER='<database-driver>'# Options for connecting to the databaseSCRACHY_DB_HOST='<database-hostname>'SCRACHY_DB_PORT='<database-port>'SCRACHY_DB_SCHEMA=<database-schema>SCRACHY_DB_DATABASE='<database-name>'SCRACHY_DB_USERNAME='<username>'# Note, do not store this value in the settings file. Use an environment# variable or python-dotenv.SCRACHY_DB_PASSWORD='<password>'# A dictionary of other connection argumentsSCRACHY_DB_CONNECT_ARGS={}# there may be a conflict with the compression middleware. If you encounter# errors either disable it or move it after the caching middleware.DOWNLOADER_MIDDLEWARES={...'scrapy.downloadermiddlewares.http.compression.HttpCompressionMiddleware':None,}SeleniumThere are two Selenium middleware classes provided by Scrachy.
To use them, first add one of them to theDOWNLOADER_MIDDLEWARESDOWNLOADER_MIDDLEWARES={...'scrachy.middleware.selenium.SeleniumMiddleware':800,# or AsyncSeleniumMiddleware...}Then in your spider parsing code use aSeleniumRequestinstead of ascrapy.http.Request.LicenseScrachy is released using the GNU Lesser General Public License.
See theLICENSEfile for more details.
Files that are adapted or use code from other sources are indicated either at the top of the file or at the location of the code snippet.
Some of these files were adapted from code released under a 3-clause BSD license.
Those files should indicate the original copyright in a comment at the top of the file.
See theBSD_LICENSEfile for details of this license.
Package: scrahub-sdk
Scrahub SDK for Python中文| EnglishThe SDK for Python contains two parts:CLI ToolUtility ToolsCLI ToolThe CLI Tool is mainly designed for those who are more comfortable using command line tools to interact with Scrahub.The installation of the CLI Tool is simple:pipinstallscrahub-sdkThen, you can use thescrahubcommand in the command prompt to action with Scrahub.Check the help document below, or you can refer tothe official documentation (Chinese).scrahub --helpUtility ToolsUtility tools mainly provide somehelpermethods to make it easier for you to integrate your spiders into Scrahub, e.g. saving results.Below are integration methods of Scrapy and general Python spiders with Scrahub.⚠️Note: make sure you have already installedscrahub-sdkusing pip.Scrapy IntegrationInsettings.pyin your Scrapy project, find the variable namedITEM_PIPELINES(adictvariable). Add content below.ITEM_PIPELINES={'scrahub.pipelines.ScrahubMongoPipeline':888,}Then, start the Scrapy spider. After it's done, you should be able to see scraped results inTask Detail -> ResultGeneral Python Spider IntegrationPlease add below content to your spider files to save results.# import result saving methodfromscrahubimportsave_item# this is a result record, must be dict typeresult={'name':'scrahub'}# call result saving methodsave_item(result)Then, start the spider. After it's done, you should be able to see scraped results inTask Detail -> Result
Package: scraid
Scraidscraid is a Python library that provides advanced utilities for Scrapy, including an advanced features and utilities.InstallationYou can install scraid from PyPI:pipinstallscraidUsageHere's a basic example of how to use the AdvancedRequest class:fromscraid.advanced_requestimportadvancedRequestrequest=AdvancedRequest('http://example.com')print(request.headers['User-Agent'])# prints the random User-AgentLicenseMITContributingPull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.TODOAdd more scrapy most common utilities (middlewares, pipelines, etc.)Add more advanced request featuresAdd more documentation
Package: scralenium
ScraleniumProject name is ascraleniumthat allowsuse selenium webdriver with scrapyto do scrape web data from dynamic web pages.  The name is actually really clever, if you didn't notice it isscrapy+selenium=scralenium.  Genius right? :)PrerequisitesBefore you begin, ensure you have met the following requirements:You have installed the latest version ofpython 3You are familiar with the scrapy frameworkYou are familiar with seleniumYou have a webdriver installed/availableRequirements:scrapyseleniumInstallingTo installscralenium, follow these steps:gitclonehttps://github.com/alexpdev/scralenium.gitcdscralenium
pipinstall.From PyPipipinstallscraleniumLicenseThis project uses the following license:Apache 2.0.UsageUsingscraleniumis really simple.In your scrappy settings set theSELENIUM_DRIVER_NAMEandSELENIUM_DRIVER_EXECUTABLEfields.scraleniumcurrently supports
chrome SELENIUM_DRIVER_NAME field. If the webdriver executable is already
onpaththen it can be omitted. You also need to enable theScraleniumDownloaderMiddlewarein theDOWNLOADER_MIDDLEWARESfeed.fromshutilimportwhichSELENIUM_DRIVER_EXECUTABLE=which("chromedriver")SELENIUM_DRIVER_NAME="chrome"DOWNLOADER_MIDDLEWARES={"scralenium.ScraleniumDownloaderMiddleware":950}Once you have added the settings to thesettings.pyfile or in the
spider'scustom_settingsattribute all that is needed is to useScraleniumRequestwhen yielding from thestart_requestsmethod or
from your parse callback methods. Thepauseargument can be used to set
the webdrivers implicit wait value.  And theresponseargument in the
parse callback methods gives you full access to the normal scrapy response
as well as all the features of the webdriver.importscrapyfromscraleniumimportScraleniumRequestfromselenium.webdriver.common.byimportByfromselenium.webdriver.common.keysimportKeysclassMySpider(scrapy.Spider):"""Example of using scrapy.Spider with ScraleniumRequest"""...defstart_requests(self):forurlinself.start_urls:yieldScreleniumRequest(url,callback=self.parse,pause=4)defparse(self,response):html=response.texttitle=response.xpath("//title/text()").get()element=response.find_element(By.ID,"submit-button")element.send_keys(Keys.Return)next_page=response.xpath("//a[@class='next-page-link']/@href").get()next_url=response.urljoin(next_page)yieldScraleniumRequest(next_url,callback=self.parse,pause=4)yield{"title":title}I have added some additional features but am behind on documenting them.TODO[x] add features[] document them