Saravanan666/pypi-org huggingface dataset:
Package: the-crawler
The CrawlerWeb crawling utility for downloading files from web pages.InstallationFrom PyPIThis assumes you havePython 3.10+installed andpip3is on
your path:~$pip3installthe-crawler
...
~$the-crawler-h
usage:the-crawler[-h][--recurse][--output-directoryOUTPUT_DIRECTORY][--extensionsEXTENSIONS[EXTENSIONS...]][--max-workersMAX_WORKERS]base_url

Crawlsgivenurlforcontent

positionalarguments:base_url

options:-h,--helpshowthishelpmessageandexit--recurse,-r--output-directoryOUTPUT_DIRECTORY,-oOUTPUT_DIRECTORY--extensionsEXTENSIONS[EXTENSIONS...],-eEXTENSIONS[EXTENSIONS...]--max-workersMAX_WORKERSFrom SourceThis assumes you havegit,Python
3.10+, andpoetryinstalled
already.~$gitclonegit@gitlab.com:woodforsheep/the-crawler.git
...
~$cdthe-crawler
the-crawler$poetryinstall
...
the-crawler$poetryrunthe-crawler-h
usage:the-crawler[-h][--quiet][--verbose][--collect-only][--force-collection][--recurse][--output-directoryOUTPUT_DIRECTORY][--extensions[EXTENSIONS]][--max-workersMAX_WORKERS]base_url

Crawlsgivenurlforcontent

positionalarguments:base_url

options:-h,--helpshowthishelpmessageandexit--quietChangestheconsoleloglevelfromINFOtoWARNING;defersto--verbose--verboseChangestheconsoleloglevelfromINFOtoDEBUG;takesprecedenceover--quiet--collect-onlyStopsaftercollectinglinkstobedownloaded;usefulforcheckingthecachebeforecontinuing--force-collectionForcesrecollectionoflinks,evenifthecachefileispresent--recurse,-rIfspecified,willfollowlinkstochildpagesandsearchthemforcontent--output-directoryOUTPUT_DIRECTORY,-oOUTPUT_DIRECTORYThelocationtostorethedownloadedcontent;mustalreadyexist--extensions[EXTENSIONS],-e[EXTENSIONS]Ifspecified,willrestrictthetypesoffilesdownloadedtothosematchingtheextensionsprovided;case-insensitive--max-workersMAX_WORKERSThemaximumnumberofparalleldownloadstosupport;defaultstoos.cpu_count()
Package: thecrypt
project_titleproject_descriptionExplore the docs »View Demo·Report Bug·Request FeatureTable of ContentsAbout The ProjectBuilt WithGetting StartedPrerequisitesInstallationUsageRoadmapContributingLicenseContactAcknowledgmentsAbout The ProjectHere's a blank template to get started: To avoid retyping too much info. Do a search and replace with your text editor for the following:carterfaceysmith,Crypt,twitter_handle,linkedin_username,email_client,email,project_title,project_description(back to top)Built WithPython(back to top)Getting StartedThis is an example of how you may give instructions on setting up your project locally.
To get a local copy up and running follow these simple example steps.PrerequisitesThis is an example of how to list things you need to use the software and how to install them.npmnpminstallnpm@latest-gInstallationGet a free API Key athttps://example.comClone the repogitclonehttps://github.com/carterfaceysmith/Crypt.gitInstall NPM packagesnpminstallEnter your API inconfig.jsconstAPI_KEY='ENTER YOUR API';(back to top)UsageUse this space to show useful examples of how a project can be used. Additional screenshots, code examples and demos work well in this space. You may also link to more resources.(back to top)RoadmapFeature 1Feature 2Feature 3Nested FeatureSee theopen issuesfor a full list of proposed features (and known issues).(back to top)ContributingContributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make aregreatly appreciated.If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement".
Don't forget to give the project a star! Thanks again!Fork the ProjectCreate your Feature Branch (git checkout -b feature/AmazingFeature)Commit your Changes (git commit -m 'Add some AmazingFeature')Push to the Branch (git push origin feature/AmazingFeature)Open a Pull Request(back to top)LicenseDistributed under the MIT License. SeeLICENSE.txtfor more information.(back to top)ContactYour Name -Email-email@email_client.comProject Link:https://github.com/carterfaceysmith/Crypt(back to top)Acknowledgments(back to top)Godspeed.
Package: thecurator
The Curator helps you define pipelines for transforming dirty data into consumable databases.UsagefromthecuratorimportCurator# Paths to files describing different tablestable_descriptions=['patient.yml','lab.yml']curator=Curator(sqlalchemy_engine,table_descriptions)# Transform a pandas DataFrame according to the descriptionscurator.transform_df('patient',patient_df)# Transform a dictionary array according to the descriptionscurator.transform_dicts('patient',patient_dicts)# Transform and insert a dictionary array according to the descriptionscurator.insert_dicts('lab',lab_dicts)See the tests for more examples. More coming soon…DevelopmentInstall development requirementspip install -r dev-requirements.txtMake changesRun the testspytest testsSee the Makefile for other useful commands
Package: thecut-durationfield
Welcome to thecut-durationfieldThis app provides a custom Django model field,RelativeDeltaField, and
related form fields and widgets.RelativeDeltaFieldstores time durations
usingISO 8601representations, and returnsdateutil.relativedeltaobjects which may be used directly withdatetime.datetimeobjects.This project was inspired by packages such asdjango-durationfield. However,
this project focuses on:providing a database-agnostic, standards-compliant way of storing the
durations in the database (usingISO 8601).returningdateutil.relativedeltaobjects that can be used to perform
calculations ondatetime.datetimeobjects.Note thatdjango-durationfieldprovides the ability to filter querysets
based on the relative size of the stored duration, which is not possible with
this project. I.e., you can’t use__ltand__gtetc., when filtering
by fields provided by this project.DocumentationThe full documentation is athttps://thecut-durationfield.readthedocs.org.QuickstartInstallthecut-durationfieldusing the installation instructions found in the documentation.Model fieldfromdjango.dbimportmodelsfromdatetimeimportdatetimefromthecut.durationfield.modelsimportRelativeDeltaFieldclassMyModel(models.Model):duration=RelativeDeltaField(blank=True,null=True)my_instance=MyModel(duration='P7D')datetime(2014,1,1)+my_instance.duration# datetime(2014, 1, 8, 0, 0)Form fieldTwo form fields are provided:RelativeDeltaChoiceFieldandRelativeDeltaTextInput:fromdjangoimportformsfromthecut.durationfield.modelsimportRelativeDeltaChoiceFieldDURATIONS=[('','Never'),('P7D','One week'),('P1M','One month'),]classMyForm(forms.ModelForm):duration=RelativeDeltaChoiceField(choices=DURATIONS)or, if you’d prefer to type in the (ISO 8601compliant) value manually:fromdjangoimportformsfromthecut.durationfield.formsimportRelativeDeltaTextInputclassMyForm(forms.ModelForm):duration=RelativeDeltaTextInput()CreditsSeeAUTHORS.rst.History2.0.3 (2016-08-15)Removed cross-document links from README.rst as it breaks pypi.Small fix to project’s setup file.2.0.2 (2016-08-15)Documentation updates.2.0.1 (2016-08-15)Documentation fixes.Testing fixes.2.0 (2016-08-15)Added support for Django 1.10.Removed support for Django < 1.8.Restructured test suite.Restructured documentation.1.0.8 (2015-08-26)Improved handling of seconds and milliseconds.1.0.8 (2015-08-26)Improved handling of seconds and milliseconds.1.0.7 (2015-03-17)Added Python 3 support.1.0.6 (2014-07-28)Fix an issue which caused an emptyrelativedeltato be returned for a
database NULL value.Gettoxup and running.Update package for public release.1.0.5 (2014-03-19)Removedistributefrominstall_requires.1.0.4 (2013-12-17)Fixed an issue with Postgres’s fixed-length 64 character field.1.0.3 (2013-09-28)Minor code cleanup.1.0.2 (20132-08-08)Add a Select widget for friendlier form input.1.0.1 (2013-07-25)Fixes to south introspection rules.1.0 (2013-07-25)First useful release with base model and form fields.0.1 (2013-06-10)Initial release, mostly useless.
Package: thecut-emailfield
thecut-emailfieldA Django email field which validates by checking for an MX record on the domain.DocumentationThe full documentation is athttps://thecut-emailfield.readthedocs.org.QuickstartInstallthecut-emailfieldusing the installation instructions found in the project documentation.An examplemodels.py:# -*- coding: utf-8 -*-
from __future__ import absolute_import, unicode_literals
from django.db import models
from thecut.emailfield.models import EmailField


class EmailModel(models.Model):

    email = EmailField()An exampleforms.py:# -*- coding: utf-8 -*-
from __future__ import absolute_import, unicode_literals
from django import forms
from thecut.emailfield.forms import EmailField


class EmailForm(forms.Form):

    email = EmailField()CreditsSeeAUTHORS.rst.History1.0.2 (2016-08-16)Documentation bug fixes.1.0.1 (2016-08-16)Documentation bug fixes.1.0 (2016-08-16)Testing improvementsDocumentation improvements.0.4 (2016-06-28)Redesigned testing environment.Added basic documentation.0.3 (2016-06-28)Stop automated testing for Django 1.5 and Django 1.6.Improved code coverage exception list.Improved code coverage reporting with Travis.Removed pre-Django 1.5 email validation code.0.2.4 (2016-03-11)Configured code coverage exceptions.Unicode packaging fix (version.py).0.2.3 (2015-11-23)Configured continuous integration via Travis.Configured code coverage tracking via codecov.0.2.2 (2015-11-23)Added unit tests.Added basic unit test environment (withtox).Accounted fordnspythonincompatibility with Python 3.0.2.1 (2015-01-13)AddedLICENSE,README.etc0.2 (2014-09-18)Added Python 3 packging support.Added extra validation of email addresses in Django 1.40.1 (2014-06-17)First release.
Package: thecypher
Welcome to the Cypher. Blog post [here](https://tmthyjames.github.io/tools/Cypher/)=======================Easily get music lyricsTo install, use `pip`:`pip install thecypher`Example:```python>>> import thecypher as cy>>> coasts = cy.get_lyrics('coasts')>>> coasts[0]{'album': 'Coasts (2016)','artist': 'coasts','genre': 'Indie_Pop','id': 0,'lyric': 'We fell in love','song': 'Oceans','year': '2016'}```Convert it to a pandas DataFrame like so:```python>>> import pandas as pd>>> coasts_df = pd.DataFrame(coasts)>>> coasts_df.head()```<table border="1" class="dataframe"><thead><tr style="text-align: right"><th></th><th>album</th><th>artist</th><th>genre</th><th>id</th><th>lyric</th><th>song</th><th>year</th></tr></thead><tbody><tr><th>0</th><td>Coasts (2016)</td><td>coasts</td><td>Indie_Pop</td><td>0</td><td>We fell in love</td><td>Oceans</td><td>2016</td></tr><tr><th>1</th><td>Coasts (2016)</td><td>coasts</td><td>Indie_Pop</td><td>1</td><td>Right by the ocean</td><td>Oceans</td><td>2016</td></tr><tr><th>2</th><td>Coasts (2016)</td><td>coasts</td><td>Indie_Pop</td><td>2</td><td>Made all our plans</td><td>Oceans</td><td>2016</td></tr><tr><th>3</th><td>Coasts (2016)</td><td>coasts</td><td>Indie_Pop</td><td>3</td><td>Down on the sand</td><td>Oceans</td><td>2016</td></tr><tr><th>4</th><td>Coasts (2016)</td><td>coasts</td><td>Indie_Pop</td><td>4</td><td>And from the tips of your fingers</td><td>Oceans</td><td>2016</td></tr></tbody></table>
Package: thedevilseye
An osint tool that uses Ahmia.fi to get Tor hidden services and descriptions that match with the users query.InstallationGithubpip install git+https://github.com/rly0nheart/thedevilseyePyPIpip install thedevilseyeUsagethedevilseye --helpusage: thedevilseye [-h] [-c COUNT] [-d] query

thedevilseye — by Richard Mwewa | https://about.me/rly0nheart

positional arguments:
  query                 search query

optional arguments:
  -h, --help            show this help message and exit
  -c COUNT, --count COUNT
                        number of results to return (default 10)
  -d, --debug           enable debug mode

thedevilseye is an osint tool that uses Ahmia.fi to get Tor hidden services and descriptions that match with the user's query.
Package: thedicomsort
dicomsortA project to provide custom sorting and renaming of dicom filesDescriptionGiven DICOM files in a random folder structure, this program copies all into a user-defined folder hierarchy, creating folders as necessary and changing DICOM file names to be more meaningful.The user can define the target folder structure and file naming by using a string consisting of concatenated tag names (like 'PatientName'), underscores and slashes.
The last part of the string (as separated by slashes) denotes the naming convention for the file parts.An Example: a target string of
'Modality/PatientName_PatientID'
means that all DICOM images are arranged in a base folder and named by PatientName_PatientID,
followed by an underscore and a unique number for every file that falls into the same category (and is not the same..?)dicomsort returns with a count for both DICOM files organized and non-DICOM (or invalid DICOM) files skipped.
It aborts with an error if it is to overwrite any existing file.Installationpipinstallthedicomsort%dicomsort--help
dicomsort[options...]sourceDirtargetDir/<patterns>where[options...]canbe:[-z,--compressTargets]-createa.zipfileinthetargetdirectory[-d,--deleteSource]-removesourcefiles/directoriesaftersorting[-f,--forceDelete]-removesourcewithoutconfirmation[-k,--keepGoing]-reportbutignoreduplicatetargetfiles[-v,--verbose]-printdiagnosticswhileprocessing[-s,--symlink]-createasymlinktodicomfilesinsourceDirinsteadofcopyingthem[-t,--test]-runthebuiltinselftest(requiresinternet)[-u,--unsafe]-donotreplaceunsafecharacterswith'_'inthepath[--help]-printthismessagewheresourceDirisdirectorytobescannedor""(nullstring)toreadfilelistfromstdinwheretargetDir/<patterns...>isastringdefiningtheoutputfileanddirectorynamesbasedonthedicomtagsinthefile.

Ifpatternsarenotspecified,thefollowingdefaultisused:%PatientName-%Modality%StudyID-%StudyDescription-%StudyDate/%SeriesNumber_%SeriesDescription-%InstanceNumber.dcm

Example1:dicomsortdatasorted/%PatientName/%StudyDate/%SeriesDescription-%InstanceNumber.dcmcouldcreateafolderstructurelike:sorted/JohnDoe/2013-40-18/FLAIR-2.dcm

Example2:findDicomSourceDir/|grep"IMA$"|dicomsort-s""DicomTargetDirwouldscanDicomSourceDirforfilepathnamesendinginIMAandcreateanoutputdirectoryDicomTargetDir.Thefolderstructurewillbecreatedusingthedefaultpatternwithsymboliclinkstothesourcedicomdatafiles.
Package: the-directory-scanner
The Directory ScannerThe Directory Scanner is a Python library designed to simplify the process of scanning directory structures and generating a comprehensive list of files and folders. It provides a convenient way to recursively traverse directories, ignoring specific files and folders specified by the user.Features:Recursively scan directories and subdirectories to generate a structured list of files and folders.Exclude specific files and folders from the scan using an ignore list.Supports customization of the output format to suit different needs.Usage:Install the library using pip:pip install the-directory-scannerImport thescan_directoryfunction from the library and use it to scan a directory:fromthe_directory_scannerimportscan_directoryscan_result=scan_directory(directory=".",output_file_name="directory_structure.txt",ignored_items=('.git','.idea','venv','__pycache__',))Access the generated directory structure in the output file (directory_structure.txtin this example) to view the results.If you wish to modify the structure, importprettify_structurefunction and provide the path to generated file:fromthe_directory_scannerimportscan_directory,prettify_structurescan_result=scan_directory(directory=".",output_file_name="directory_structure.txt",ignored_items=('.git','.idea','venv','__pycache__',))prettify_structure(output_file=scan_result,spaces_to_trim=4,lines_to_trim=1)Output exampledirectory_structure.txt:directory_structure.txt
LICENSE.rst
README.md
setup.py
usage.py
directory_scanner/
    directory_structure.txt
    main.py
    __init__.pyAbout:The Directory Scanner library aims to simplify directory scanning tasks by providing a flexible and easy-to-use interface. Whether you need to generate a directory structure for documentation, analysis, or any other purpose, this library offers a convenient solution.Links:GitHub RepositoryPyPI Package
Package: thedom
thedom is a collection of python objects that enable developers to
generate and interact with web apps server side. It encourages object
oriented website development, and code reuse by seperating each DOM
element into its own object, and then allowing inheritance and child
elements to come together to form new elements not defined in the
standard DOM.write this:from thedom import Layout, Document, Buttons

page = Document.Document()
layout = page.addChildElement(Layout.Center()).addChildElement(Layout.Horizontal())
layout += Buttons.Button(text="Use thedom.", **{'class':'MainAction'})
layout += Buttons.Button(text="Enjoy writing less code.", **{'class':'DeleteAction'})
layout += Buttons.Button(text="100% Python.")

print page.toHTML(formatted=True)get this:<!DOCTYPE html>
<html>
    <head>
    <title>
    </title>
    <meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
    </meta>
    </head>
    <body>
        <div class="WCenter">
            <div class="WOuter">
                <div class="WInner">
                    <div class="WClear">
                        <input class="WBlock WLeft MainAction" type="button" value="Use thedom." />
                        <input class="WBlock WLeft DeleteAction" type="button" value="Enjoy writing less code." />
                        <input class="WBlock WLeft" type="button" value="100% Python." />
                    </div>
                </div>
            </div>
        </div>
    </body>
</html>Installing thedomInstalling thedom is as simple as:pip install thedomor if you prefereasy_install thedomThanks and I hope you find thedom useful!~Timothy Crosley
Package: theeasytype
An assertion lib fortheto assert basic type.tested on 2.7, 3.2, 3.3APIintfloatstrdictlisttuplesetUsagefromtheimportexpectimporttheeasytypeexpect.use(theeasytype)expect(1).to.be.intexpect(1.1).to.be.floatexpect("").to.be.strexpect({}).to.be.dictexpect([]).to.be.listexpect(()).to.be.tupleexpect(set()).to.be.set
Package: theethugubon
Link:https://www.youtube.com/shorts/Z5f6FnICJQ8PyPi:https://pypi.org/project/theethugubon/วิธีติดตั้งเปิด CMD / Terminalpipinstalltheethugubonวิธีใช้งานแพ็คเพจนี้เปิด IDLE ขึ้นมาแล้วพิมพ์…fromtheethugubonimportTheeThugUbonthee=TheeThugUbon()#ประกาศชื่อclassthee.show_name()#แสดงชื่อพี่ตี๋thee.about()#เล่าประวัติพี่ตี๋thee.show_art()#โชว์วาดภาพพี่ตี๋thee.turner()#เล่าเรื่องราวพัฒนาโดย: AnnerezFB: Arucha Khematharonon
Package: thefactory
TheFactoryThis is the thefactory module. It contains factory config and google config files.Install the module via going to this directory andpip install thefactoryActually what we're currently doing is:
rsync -avx /opt/development/thefactory_module/thefactory /opt/thefactory_venv/lib/python3.9/site-packages/ --deleteCall it viafrom thefactory import config
or
import thefactory.config as config
from thefactory import google_configv4
or
import thefactory.google_configv4 as gconfWonder of wonders.Spark up the venv
source /opt/thefactory_venv/bin/activate
Navigate to thefactory_module directory
pip install .BUT WAIT THERE'S MOREpip install --editable .symlinks the code to the place, so you NEVER have to install the changes again.  Just restart the python process.
Package: thefilewatch
the file watchcapable to watch multi files at the same time.base on pyinotifyeasy to useinstall$ pip install thefilewatchhow to useimportsysfromthefilewatch.file_watchimportBaseWatchHandler,FileWatchclassPrintHandler(BaseWatchHandler):defprocess(self,content):print('getting content ',content)if__name__=='__main__':iflen(sys.argv)<2:print('need watch files')exit(1)else:file_list=sys.argv[1:]watcher=FileWatch(file_list,PrintHandler())watcher.start()start watching files$ python -m thefilewatch.file_watch a.txt b.txtexamplessee more specific examples in handler
Package: theflow
Pipeline development framework, easy to experiment and compare different pipelines, quick to deploy to workflow orchestration toolsMost of the current workflow orchestrators focus on executing the already-developed pipelines in production. This library focuses on thepipeline development process. It aims to make it easy to develop pipeline, and once the user reaches a good pipeline, it aims to make it easy to export to other production-grade workflow orchestrators. Notable features:Manage pipeline experiment: store pipeline run outputs, compare pipelines & visualize.Support pipeline as code: allow complex customization.Support pipeline as configuration - suitable for plug-and-play when pipeline is more stable.Fast pipeline execution, auto-cache & run from cache when necessary.Allow version control of artifacts with git-lfs/dvc/god...Export pipeline to compatible workflow orchestration tools (e.g. Argo workflow, Airflow, Kubeflow...).InstallpipinstalltheflowQuick start(A code walk-through of this session is stored inexamples/10-minutes-quick-start.ipynb. You can run it with Google Colab (TODO - attach the link).)Pipeline can be defined as code. You initialize all the ops inself.initializeand route them inself.run.fromtheflowimportFunction# Define some operations used inside the pipeline# Operation 1: normal class-based Python objectclassIncrementBy(Function):x:intdefrun(self,y):returnself.x+y# Operation 2: normal Python functiondefdecrement_by_5(x):returnx-5# Declare flowclassMathFlow(Function):increment:Functiondecrement:Functiondefrun(self,x):# Route the operations in the flowy=self.increment(x)y=self.decrement(y)y=self.increment(y)returnyflow=MathFlow(increment=IncrementBy(x=10),decrement=decrement_by_5)You run the pipeline by directly calling it. The output is the same object returned byself.run.output=flow(x=5)print(f"{output=},{type(output)=}")# output=5, type(output)=intYou can investigate pipeline's last run through thelast_runproperty.flow.last_run.id()# id of the last runflow.last_run.logs()# list all information of each step# [TODO] flow.last_run.visualize(path="vis.png")   # export the graph in `vis.png` fileFuture featuresArguments managementCachecache by runs, organized by root task, allow reproduciblespecify the filesthe keys are likelru_cache, takes in the original input key, specify
the cache, but the cache should be file-backed, for run-after-run execution.cli command to manipulate cacheCompare pipeline in a result folderDynamically create reproducible configSupport pipeline branching and mergingSupport single process or multi-processing pipeline runningCan synchronize changes in the workflow, allowing logs from different run to be compatible with each otherCompare different runsSame cache directoryCompare evaluation result based on kwargsCLI List runsCLI Delete unnecessary runsAdd coverage, pre-commit, CI...LicenseMIT License.
Package: theforensicator
TheForensicatorSchool project for forensic investigationsFree software: MITDocumentation:https://ValekoZ.github.io/TheForensicator/FeaturesRead a EWF fileExtract MBR from NTFS partitionsResolve paths of files from NTFS partitionsExtract files from NTFS partitionsExtract list of files from NFTS partitons using yaml file as a listCreditsThis package was created with theppwtool. For more information, please visit theproject page.
Package: thefs
python file system better assertionAn assertion lib fortheto assert file system stuff.APIbasename(dir). assert basename of a path.dirname(dir). assert dirname of a path.extname(file). assert file extensionpath. assert path existsfile. assert it a filedir. assert it a dirmount. assert it a mount pointabsolute_path. assert it an absolute pathreadable. assert readable.writable. assert writable.executableassert executableUsage:fromtheimporttheimportthefsthe.use(thefs)the("/a/b/c.md").should.have.basename("c.md")the("/a/b/c.md").should.have.dirname("/a/b")the("/a/b/c.md").should.have.extname("/a/b")the("/a/b/c.md").should.be.a.paththe("/a/b/c.md").should.be.a.filethe("/a/b/c.md").should.be.a.dirthe("/a/b/c.md").should.be.a.linkthe("/a/b/c.md").should.be.a.mountthe("/a/b/c.md").should.be.an.absolute_paththe("/a/b/c.md").should.be.readablethe("/a/b/c.md").should.be.writablethe("/a/b/c.md").should.be.executable