Saravanan666/pypi-org huggingface dataset:
Package: crash-ipdb
crash-ipdbDebug Python crashes conveniently: Whenever a Python code crashes, theipdb(IPython debugger) debugger will be triggered. And thepdbcommands can be used to debug your crash.UsageFirst install it with:pipinstallcrash-ipdbThen importcrash_ipdbin your Python and run your code as usual (./example.py):importcrash_ipdb# just import crash_ipdb in your Python code## simple example of source code to be debugged ##x=1y=0print(x/y)# When you see '----> 7 print(x/y)', this will mean you have entered the ipdb, stopping at this lineYou will find you have entered into ipdb and can use thepdb commandsto debug your code:Traceback(mostrecentcalllast):File"example.py",line7,in<module>print(x/y)# When you see '----> 7 print(x/y)', this will mean you have entered the ipdb, stopping at this lineZeroDivisionError:divisionbyzero

>/home/ukp/kwang/crash-ipdb/crash-ipdb/example.py(7)<module>()3## simple example of source code to be debugged ##4x=15y=06---->7print(x/y)# When you see '----> 7 print(x/y)', this will mean you have entered the ipdb, stopping at this lineReferencexcodebuild/crash_on_ipy.py
Package: crash-test-multipass
CrashtestDescriptionRequirementsInstallationUsageContributingDescriptionCrashtest is a command-line tool to create aMultipassinstance and transfer a project to test
to the newly created instance.RequirementsPython 3MultipassInstallation$pip3install--upgradecrash-test-multipassNOTE: After installing crash-test-multipass with pip if you have not added ~/.local/bin (macOS/Linux) to $PATH you will
be asked to do so with a warning that should look like this:WARNING: The script crash-test-multipass is installed in '/home/ubuntu/.local/bin' which is not on PATH.Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.UsageCreate a new instance and transfer a project$crashtest--instance-nameINSTANCE_NAME--projectPROJECTCreate a new instance, transfer a project and install the dependenciesNOTE: To install npm package dependencies, the latest stable version ofnvmwill be
installed in the new multipass instance, which will install the latest LTS version of Node.$crashtest--instance-nameINSTANCE_NAME--projectPROJECT--install-dependenciesExecute a custom scriptThe script is executed in the home folder$crashtest--instance-nameINSTANCE_NAME--projectPROJECT--scriptSCRIPTDelete the instance after finishing to test$crashtest--instance-nameINSTANCE_NAME--projectPROJECT--deleteContributingIf you would like to contribute to this project just create a pull request which I will try to review as soon as
possible.
Package: crate
A Python client library forCrateDB.This library:Implements the PythonDB API 2.0specification.Includes support forSQLAlchemyin form of anSQLAlchemy dialect.InstallationThe CrateDB Python client is available as packagecrateonPyPI.To install the most recent driver version, including the SQLAlchemy dialect
extension, run:$ pip install "crate[sqlalchemy]" --upgradeDocumentation and helpCrateDB Python Client documentationCrateDB reference documentationDeveloper documentationContributingOthersupport channelsContributingThe CrateDB Python client library is an open source project, and ismanaged on
GitHub. We appreciate contributions of any kind.
Package: crate-anon
PurposeCreate and use de-identified databases for research.Anonymises relational databases.Extracts and de-identifies text from associated binary files.Performs some specific preprocessing tasks; e.g.preprocesses some specific databases (e.g. Servelec RiO EMR);drafts a “data dictionary” for anonymisation, with special knowledge of
some databases (e.g. TPP SystmOne);fetches some word lists, e.g. forenames/surnames/eponyms.Provides tools to link databases, including via Bayesian personal identity
matching, in identifiable or de-identified fashion.Provides a natural language processing (NLP) pipeline, including built-in
NLP, support for external tools, and client/server support for the Natural
Language Processing Request Protocol (NLPRP).Web app forquerying the anonymised database;providing a de-identification API;managing a consent-to-contact process.DocumentationSeehttps://crateanon.readthedocs.ioSourcesPython package:https://pypi.org/project/crate-anon/Source code:https://github.com/ucam-department-of-psychiatry/crateLicenceCopyright (C) 2015, University of Cambridge, Department of Psychiatry.
Created by Rudolf Cardinal (rnc1001@cam.ac.uk).Licensed under the GNU GPL v3+: see LICENSE file.Some third-party libraries have slightly different licences;
see the documentation.
Package: cratedb-toolkit
CrateDB Toolkit»Documentation|Changelog|Community Forum|PyPI|Issues|Source code|License|CrateDBAboutThis software package includes a range of modules and subsystems to work
with CrateDB and CrateDB Cloud efficiently.You can use CrateDB Toolkit to run data I/O procedures and automation tasks
of different kinds around CrateDB and CrateDB Cloud. It can be used both as
a standalone program, and as a library.It aims forDWIM-like usefulness andUX, and provides CLI and HTTP
interfaces, and others.StatusPlease note that thecratedb-toolkitpackage contains alpha-, beta- and
incubation-quality code, and as such, is considered to be a work in progress.
Contributions of all kinds are much welcome, in order to make it more solid,
and to add features.Breaking changes should be expected until a 1.0 release, so version pinning is
strongly recommended, especially when you use it as a library.InstallInstall package.pipinstall--upgradecratedb-toolkitVerify installation.cratedb-toolkit--versionRun with Docker.dockerrun--rm"ghcr.io/crate-workbench/cratedb-toolkit"cratedb-toolkit--versionDevelopmentFor installing a development sandbox, please refer to thedevelopment sandbox
documentation.
Package: crate-docs-theme
AboutASphinxtheme for theCrate documentation.Note: This theme is tightly integrated into the Crate.io website and is
not intended for general use.For making changes to the theme, see thedeveloper docs.PreviewThe demo/preview project is rendered and published tohttps://crate-docs-theme.readthedocs.io/.Using the themePrerequisitesThe documentation can include UML diagrams which will be rendered usingsphinxcontrib-plantuml. In order to satisfy its requirements, run:# On Linux
apt-get install plantuml

# On macOS
brew install plantumlInstallationThe Crate docs theme is available as a package onPyPI. However, there is no
need to install it yourself. Crate projects that use the theme should install
it automatically.ConfigurationThe Crate.io documentation is composed of multiple separate documentation
projects, seamlessly interlinked via the Crate docs theme.To use the theme, add this line to your Sphinxconf.pyfile:from crate.theme.rtd.conf.foo import *Here, replacefoowith the appropriate module for your documentation
project.ContributingThis project is primarily maintained byCrate.io, but we welcome community
contributions!See thedeveloper docsand thecontribution docsfor more information.HelpLooking for more help?Check out oursupport channels
Package: crateman
Crateman - Crate Manager.Is a high level build system focused solely on resolving build dependencies between projects.
In other words, it's like a package manager, but for developers.FeaturesSimple, TOML-based configuration files supportBuilds dependencies by executing arbitrary shell commands, making it universal across programming languages.Finds critical mistakes in dependency graph: circular dependencies, version requirements, e.t.c.Every major piece of functionality (such as config parsing, dependency resolving or building) can be used as separate Python module.Does builds in parallel whenever possible.HistoryWhen I was getting into Rust programming, I quickly realised that I am in huge need for a build dependency-only system. Cargo wasn't satisfying for me at all: it is a build-system - package manager - downloader - publisher at the same time, which is weird. It also hadn't needed features for my case (building dependencies only, or executing arbitrary scripts).Then I tried building Rust project with a Makefile. It was pretty convenient for one freestanding project, very universal, but dependency management was clunky, I would find myself writing a lot of repetitiveness to make my project depend on other.Then I tried searching for a build system focused only on dependencies. Didn't find one, and decided to implement one myself. Thus, crateman was born. And that's why it's called 'crateman', because Rust calls its packages crates.Luckily, crateman is not Rust-only. It is universal! It can be used with any language, and any project due to ability to execute arbitrary shell commands.
Package: crate-peewee
Crate driver forpeewee, a small, expressive ORM.Most basic operations work. Support for special Crate features like fulltext
search or object and array fields is still a work in progress.For a full documentation take a look at thepeewee documentation.UsageUse peewee with Crate:from peewee import Model, CharField
from crate.peewee import CrateDatabase
from uuid import uuid4

db = CrateDatabase()
db.connect()

def gen_key():
    return str(uuid4())

class User(Model):
    id = CharField(null=True, default=gen_key, primary_key=True)
    name = CharField(null=True)
    class Meta:
        database = db

db.create_tables([User], safe=True)
arthur = User.create(name='Arthur')
db.execute_sql('refresh table user')

print([u for u in User.select(User.name).tuples()])
Package: craterslab
# Craters Morphology Analysis ToolA library to simplify the analysis of crater data from depth maps.## InstallationCraterslab requires Python 3.10+ for functioning. Make sure you have a compliant version of [python](https://www.python.org/downloads/) installed in your system.### Installing craterslab from pypi using pip (Recommended)Craterslab is also available from pypi. You can install it by running:```$ pip install craterslab```We strongly encourage users using this method to create a [virtual environment](https://packaging.python.org/en/latest/guides/installing-using-pip-and-virtual-environments/) before installing the library.### Installing craterslab from the repository using poetryMake sure you have [poetry](https://python-poetry.org/docs/) in your system and then run:```$ git clone https://github.com/gvieralopez/craterslab.git$ cd craterslab$ poetry install$ poetry shell```These will create and activate an isolated virtual environment with craterslab installed on it.## UsageYou can find some examples on how to use the library in this repository:```$ git clone https://github.com/gvieralopez/craterslab.git$ cd craterslab/examples```Before executing any example, you will need to download data from actual craters using the provided scripts:```$ python download_data.py```Then, you can execute any given example as:```$ python example1.py```See [software documentation](https://craterslab.readthedocs.io/en/latest/) for more details.
Package: crate-smartnow
A Python client library forCrateDB.This library:Implements the PythonDB API 2.0specificationIncludes support forSQLAlchemy(>= 1.0.0)PrerequisitesRecent versions of this library requirePython 3(>= 3.4) to run.Use version0.21.xif you are running Python 2.7/3.3 or version0.14.xif you are running Python 2.6.InstallationThe CrateDB Python client is available as apippackage.To install, run:$ pip install crateTo update, run:$ pip install -U crateIf you use Python 2.7 or 3.3 with a recent version ofpip, it will install
only version0.21.xby default, because newer versions of this package are
not compatible with Python 2.7/3.3 any more.ContributingThis project is primarily maintained byCrate.io, but we welcome community
contributions!See thedeveloper docsand thecontribution docsfor more information.HelpLooking for more help?Read theproject docsCheck out oursupport channels
Package: cratesmirror
CratesMirrorAboutDownload all crates oncrates.ioRequirementPython >= 2.7.9requestsGitPythonAt least 4G free disk space for hosting local cratesInstallation# pip install cratesmirrorUsage$cratesmirror-husage:cratesmirror[-h][-iINDEX][-wCRATES][-dDBPATH][-fLOGFILE][-cCHECKDB][-v]optionalarguments:-h,--helpshowthishelpmessageandexit-i,--indexINDEXregistryindexdirectory(default:/srv/git/index)-w,--cratesCRATEScratesdirectory(default:/srv/www/crates)-d,--dbpathDBPATHdatabasefilepath(default:None)-f,--logfileLOGFILElogfilepath(default:None)-c,--checkdbCHECKDBcheckdatabaseformissingcrates(default:False)-v,--verboseAvailableenvironmentvariables:HTTP_PROXY,HTTPS_PROXY,CRATES_DL,CRATES_APIExamples:# Download all crates only$cratesmirror-d/var/lib/crates/crates.db-f/var/log/crates/debug.log# Find out missing crates, then update the repository$cratesmirror--checkdb-d/var/lib/crates/crates.db-f/var/log/crates/debug.log# Update repo and commit custom settings$CRATES_DL='https://crates.mirrors.ustc.edu.cn/api/v1/crates'\cratesmirror-d/var/lib/crates/crates.db-f/var/log/crates/debug.log# Using proxy$HTTPS_PROXY='https://127.0.0.1:8081'\cratesmirror-d/var/lib/crates/crates.db-f/var/log/crates/debug.logOr use it in scriptfromcratesmirrorimportCratesMirrorindexdir='/srv/git/index'cratesdir='/srv/www/crates'config={'dl':'https://crates.mirrors.ustc.edu.cn/api/v1/crates','api':'https://crates.io'}# By default, it will be saved at os.getcwd()/crates.dbdbpath='/var/lib/cratesmirror/crates.db'withCratesMirror(indexdir,cratesdir,config=config,dbpath=dbpath)asmirror:mirror.update_repo()# with proxyproxies={"http":"http://10.10.1.10:3128","https":"http://10.10.1.10:1080",}withCratesMirror(indexdir,cratesdir,config=config,proxy=proxies,dbpath=dbpath)asmirror:mirror.update_repo()NoteBy default, the script will:assume that registry index directory is located at/srv/git/index, and crates are saved at/srv/www/cratessave downloaded crate as<CratesDir>/{name}/{name}-{version}.cratesave the database file atos.getcwd()/crates.dbIf the environment variableCRATES_DLorCRATES_APIis set, its value will be saved at<IndexDir>/config.jsonand the changes will be committed automatically.After the first run, all you need to do is to run this script periodically using crontab-like tools or systemd.timers to sync with upstream.ChangeLog1.1.3BugfixPick up all new crates in the modified index file, not only the latest1.1.2BugfixReplace None with default value in<RegistryDir>/config.json1.1.1MiscellaneousAdd changelog1.1.0ImprovementAlways download crates using multithreading1.0.4FeatureAdd -c/–checkdb option, enable users to check database for missing crates1.0.3ImprovementWhen <CratesDir> is empty, download all crates in a multithreaded way1.0.2Naive crawler
Package: cratex
vidstream📦 dfsd
👨‍💻🛠️🔥⌛🏃📦Python bindings for the Qt cross platform application \ntoolkit thank you !Under construction! Not ready for use yet! Currently experimenting and planning!
Developed by Florian Dedov from NeuralNine (c) 2020Examples of How To Use (Buggy Alpha Version)https://docs.github.com/en/get-started/writing-on-github/getting-started-with-writing-and-formatting-on-github/basic-writing-and-formatting-syntax// To call guiodccallCLI# or ( odc.CLI ) ==> To call CLIodccallgui# or ( odc.gui ) ==> To call GUIodccallweb# or ( odc.web ) ==> To call WEBsearch<input><button>search</button></input>fromvidstreamimportStreamingServerserver=StreamingServer('127.0.0.1',9999)server.start_server()# Other Codeserver.stop_server()#--> When You Are Done// Creating A Clientodccallgui#-> odc.guifromvidstreamimportCameraClientfromvidstreamimportVideoClientfromvidstreamimportScreenShareClient# Choose Oneclient1=CameraClient('127.0.0.1',9999)client2=VideoClient('127.0.0.1',9999,'video.mp4')client3=ScreenShareClient('127.0.0.1',9999)client1.start_stream()client2.start_stream()client3.start_stream()Check out:https://www.youtube.com/c/NeuralNinemarkdown_code_exec
Execute Python code in Markdown files and captures the outputCopyright 2022 Sebastiaan MathôtCommand-line usage
usage: markdown_code_exec.py [-h] [-i INPUT] [-o OUTPUT]optional arguments: -h, --help show this help message and exit -i INPUT, --input INPUT input markdown file -o OUTPUT, --output OUTPUT output markdown fileFunction reference
markdown_code_exec.parse_text(md)Takes a str containing markdown text, finds code blocks in the markdown, executes these code blocks and captures the output, and then embeds the captured output in the markdown.Parameters
md: str : The input markdown string
Returns
str The compiled markdown stringmarkdown_code_exec.parse_file(src, dst)Takes a markdown input file, executes code blocks while capturing output and writes the result to a new output file.src: str The full path to the input file dst: str The full path to the output fileLicense
GNU General Public License 3
Package: cratt
cratt·A CLI for creating React App with TypeScript and TailwindCSS. It comes already configured with ESLint, Prettier, and Husky. Also, It can automatically push the project to Github, add relevant tags and description, and deploy it to Github Pages.PrerequisitesYou need to havePythonandGitHub CLIinstalled on your machine.InstallationFirst of all, install the package usingpip:pipinstallcrattThen, run the command to create a new project:cranew-app
Package: crawlabpy
Crawlab Python SDK基本用法fromcrawlabpy.utilsimportnotify_target,save_file,PART_CONTENT_TYPEimg=requests.get(url=img_url).contentimg_name=hashlib.md5(img).hexdigest()+'.jpg'save_file(img_name,img)result={'body':body,'body_cn':'','body_en':body,'covering':img_name_list,'downdate':down_date,# 爬虫时间'id':news_id,'languageid':'10001','languagename':'英语','pagedate':down_date,'partid':'3',# 板块号'partname':'对外关系,国际关系',# 板块名'resource':img_name_list,'sectionid':'','sectionname':'缅甸','siteid':'153','sitename':'缅甸新闻网','title':news_title[0],'title_cn':'','title_en':news_title[0],'url':news_url,'viewcount':'','writer':''}save_item(result)notify_target(PART_CONTENT_TYPE,result,img_name_list)开始开发开发环境初始化gitclonehttps://github.com/gditsec/crawlabpy.gitcdcrawlerpy

makedevsourcevenv/bin/activate

python-mpipinstall-rrequirements.txt构建代码makebuild发布代码makerelease
Package: crawlab-sdk
Crawlab SDK for Python中文| EnglishThe SDK for Python contains two parts:CLI ToolUtility ToolsCLI ToolThe CLI Tool is mainly designed for those who are more comfortable using command line tools to interact with Crawlab.The installation of the CLI Tool is simple:pipinstallcrawlab-sdkThen, you can use thecrawlabcommand in the command prompt to action with Crawlab.Check the help document below, or you can refer tothe official documentation (Chinese).crawlab --helpUtility ToolsUtility tools mainly provide somehelpermethods to make it easier for you to integrate your spiders into Crawlab, e.g. saving results.Below are integration methods of Scrapy and general Python spiders with Crawlab.⚠️Note: make sure you have already installedcrawlab-sdkusing pip.Scrapy IntegrationInsettings.pyin your Scrapy project, find the variable namedITEM_PIPELINES(adictvariable). Add content below.ITEM_PIPELINES={'crawlab.pipelines.CrawlabMongoPipeline':888,}Then, start the Scrapy spider. After it's done, you should be able to see scraped results inTask Detail -> ResultGeneral Python Spider IntegrationPlease add below content to your spider files to save results.# import result saving methodfromcrawlabimportsave_item# this is a result record, must be dict typeresult={'name':'crawlab'}# call result saving methodsave_item(result)Then, start the spider. After it's done, you should be able to see scraped results inTask Detail -> Result
Package: crawler
Web scraping framework based on py3 asyncio & aiohttp libraries.Usage ExampleimportrefromitertoolsimportislicefromcrawlerimportCrawler,RequestRE_TITLE=re.compile(r'<title>([^<]+)</title>',re.S|re.I)classTestCrawler(Crawler):deftask_generator(self):forhostinislice(open('var/domains.txt'),100):host=host.strip()ifhost:yieldRequest('http://%s/'%host,tag='page')defhandler_page(self,req,res):print('Result of request to{}'.format(req.url))try:title=RE_TITLE.search(res.body).group(1)exceptAttributeError:title='N/A'print('Title:{}'.format(title))bot=TestCrawler(concurrency=10)bot.run()InstallationpipinstallcrawlerDependenciesPython>=3.4aiohttp
Package: crawlerdetect
About CrawlerDetectThis is a Python wrapper forCrawlerDetect- the web crawler detection library
It helps to detect  bots/crawlers/spiders via the user agent and other HTTP-headers. Currently able to detect > 1,000's of bots/spiders/crawlers.InstallationRunpip install crawlerdetectUsageVariant 1fromcrawlerdetectimportCrawlerDetectcrawler_detect=CrawlerDetect()crawler_detect.isCrawler('Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)')# true if crawler user agent detectedVariant 2fromcrawlerdetectimportCrawlerDetectcrawler_detect=CrawlerDetect(user_agent='Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html)')crawler_detect.isCrawler()# true if crawler user agent detectedVariant 3fromcrawlerdetectimportCrawlerDetectcrawler_detect=CrawlerDetect(headers={'DOCUMENT_ROOT':'/home/test/public_html','GATEWAY_INTERFACE':'CGI/1.1','HTTP_ACCEPT':'*/*','HTTP_ACCEPT_ENCODING':'gzip, deflate','HTTP_CACHE_CONTROL':'no-cache','HTTP_CONNECTION':'Keep-Alive','HTTP_FROM':'googlebot(at)googlebot.com','HTTP_HOST':'www.test.com','HTTP_PRAGMA':'no-cache','HTTP_USER_AGENT':'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1500.71 Safari/537.36','PATH':'/bin:/usr/bin','QUERY_STRING':'order=closingDate','REDIRECT_STATUS':'200','REMOTE_ADDR':'127.0.0.1','REMOTE_PORT':'3360','REQUEST_METHOD':'GET','REQUEST_URI':'/?test=testing','SCRIPT_FILENAME':'/home/test/public_html/index.php','SCRIPT_NAME':'/index.php','SERVER_ADDR':'127.0.0.1','SERVER_ADMIN':'webmaster@test.com','SERVER_NAME':'www.test.com','SERVER_PORT':'80','SERVER_PROTOCOL':'HTTP/1.1','SERVER_SIGNATURE':'','SERVER_SOFTWARE':'Apache','UNIQUE_ID':'Vx6MENRxerBUSDEQgFLAAAAAS','PHP_SELF':'/index.php','REQUEST_TIME_FLOAT':1461619728.0705,'REQUEST_TIME':1461619728})crawler_detect.isCrawler()# true if crawler user agent detectedOutput the name of the bot that matched (if any)fromcrawlerdetectimportCrawlerDetectcrawler_detect=CrawlerDetect()crawler_detect.isCrawler('Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)')# true if crawler user agent detectedcrawler_detect.getMatches()# SosospiderContributingIf you find a bot/spider/crawler user agent that CrawlerDetect fails to detect, please submit a pull request with the regex pattern added to the array inproviders/crawlers.pyand add the failing user agent totests/crawlers.txt.Failing that, just create an issue with the user agent you have found, and we'll take it from there :)ES6 LibraryTo use this library with NodeJS or any ES6 application based, check outes6-crawler-detect..NET LibraryTo use this library in a .net standard (including .net core) based project, check outNetCrawlerDetect.Nette ExtensionTo use this library with the Nette framework, checkoutNetteCrawlerDetect.Ruby GemTo use this library with Ruby on Rails or any Ruby-based application, check outcrawler_detectgem.Parts of this class are based on the brilliantMobileDetect