Saravanan666/pypi-org huggingface dataset:
Package: atk
🐍atk🐋🌴(Automation)-(Terminal)-(Kubernetes)🎣Automate the administration of docker and kubernetes⚓支持 Python3.8 版本的atk，正在开发中……Simple to install</code></pre>
</li>
</ol>
<p>pipinstallatk</p>
<pre><code>first step实例化Agility_Docker()，如果您没有安装docker，那么将会报错。fromatkimport*docker=Agility_Docker()Check the container查询容器query()查询镜像query(self_object_='images')docker.query()docker.query(self_object_='images')Run the container运行容器run()docker.run(docker.run(images_name='centos',vessel_name='centos1'))Query the network card查询网卡query_network()docker.query_network(formatting=True)Modify image tag（label）修改镜像标签tag()docker.tag(old_name='centos',new_name='centos2')更多使用说明：atk-GitHub-tutorial当前版本：version-0.1.3.8b
Package: atk-dinesh-project
project_name: atk-dinesh-project
short_description: This short description needs to be edited by dinesh
tags: []
category: tech
long_description: >
This is the long descripption to be edited by dinesh
Created on Fri 19 Jan 2024 12:32:28 PM IST
Built with poetryTODO: Fix the followingPurposeHere three line description about how to use this code, the context.InstallationHow do we use install the code, library or whatever. What prereqs are neededHow to use itHow do I use it? Examples, if needed.Related informationReferences etc if needed.
Package: atkit
atkitprovides tools, enabled for all python processes (viausercustomize.py). At the moment, these include:A cli tool to completely enable/disableatkit.A cli tool to “sandbox” any python module (requires write access), so that edits can be cleanly and safely done, even to standard library modules.An exception hook that logs all exceptions and drops you into your preferred debugger (pdb by default).A flexible, yet dead-simple logging wrapper that knows about context (filenames, function names, line numbers, etc.)All of this is highly configurable. Components may be disabled, piece-wise.
Package: atk-training-dinesh-wf-basic
project_name: atk-training-dinesh-wf-basic
short_description: This short description needs to be edited by dinesh
tags: []
category: tech
long_description: >
This is the long descripption to be edited by dinesh
Created on Fri 02 Feb 2024 09:22:06 PM IST
Built with poetryTODO: Fix the followingPurposeHere three line description about how to use this code, the context.InstallationHow do we use install the code, library or whatever. What prereqs are neededHow to use itHow do I use it? Examples, if needed.Related informationReferences etc if needed.
Package: atk-training-dinesh-wf-dynamic
project_name: atk-training-dinesh-wf-dynamic
short_description: This short description needs to be edited by dinesh
tags: []
category: tech
long_description: >
This is the long descripption to be edited by dinesh
Created on Sat 03 Feb 2024 01:16:00 AM IST
Built with poetryTODO: Fix the followingPurposeHere three line description about how to use this code, the context.InstallationHow do we use install the code, library or whatever. What prereqs are neededHow to use itHow do I use it? Examples, if needed.Related informationReferences etc if needed.
Package: atk-training-dinesh-wf-dynamic-loader
project_name: atk-training-dinesh-wf-dynamic-loader
short_description: This short description needs to be edited by dinesh
tags: []
category: tech
long_description: >
This is the long descripption to be edited by dinesh
Created on Sun 04 Feb 2024 12:36:30 AM IST
Built with poetryTODO: Fix the followingPurposeHere three line description about how to use this code, the context.InstallationHow do we use install the code, library or whatever. What prereqs are neededHow to use itHow do I use it? Examples, if needed.Related informationReferences etc if needed.
Package: atk-training-dinesh-wf-dynamic-streaming
project_name: atk-training-dinesh-wf-dynamic-streaming
short_description: This short description needs to be edited by dinesh
tags: []
category: tech
long_description: >
This is the long descripption to be edited by dinesh
Created on Sat 03 Feb 2024 08:29:17 PM IST
Built with poetryTODO: Fix the followingPurposeHere three line description about how to use this code, the context.InstallationHow do we use install the code, library or whatever. What prereqs are neededHow to use itHow do I use it? Examples, if needed.Related informationReferences etc if needed.
Package: atk-training-dinesh-wf-stream
project_name: atk-training-dinesh-wf-stream
short_description: This short description needs to be edited by dinesh
tags: []
category: tech
long_description: >
This is the long descripption to be edited by dinesh
Created on Sat 03 Feb 2024 05:27:31 PM IST
Built with poetryTODO: Fix the followingPurposeHere three line description about how to use this code, the context.InstallationHow do we use install the code, library or whatever. What prereqs are neededHow to use itHow do I use it? Examples, if needed.Related informationReferences etc if needed.
Package: atk-training-nitesh-psq
a Very simple Persistant queue service using sqlite3How to intialize the queue using  the package (to instialize the db)pip install atk_training_nitesh_psq
from atk_training_nitesh_psq.sqlite_ import SQLITE
queue=SQLITE('db_name')

# if someone is directly jumping to producer queue is automaticallt initializedHow to run intialize the queue using commandqueue --db-name db_nameHow to initialize the producer using the package---> Given one has installed the package
from atk_training_nitesh_psq.producer import producer_
producer_("queue.db")How to initialize the producer using the commandproducer "queue.db"How to initialize the consumer using the packagefrom atk_training_nitesh_psq.consumer import cons

cons('queue.db')How to initailize the consumer using the commandconsumer "queue.db" or empty
(automatically initializes to queue.db)Need to implement a manager schuduled to push pending tasks to queue back to procesing and a ops manager
Package: atk-training-rin-chatlink
Gets all links from a given Google Space and stores them in a text file.UsageTo install the package, runpip install atk-training-rin-chatlinkThe command can be used by running the following in a terminal.atk-training-rin-chatlink path/to/config.yamlEnsure your config.yaml has the following fields:space:name of space to get links fromsave_to:folder/to/save/url.txt/to/If downloaded from GitHub, add yourclient_secrets.jsonfile fromGoogle Cloud Consoletoatk_training_rin_chatlink. Make sure it has the following scopes enabled:.../auth/chat.spaces.readonly.../auth/chat.messages.readonly
Package: atk-training-rin-q-basic
AssignmentDesign a system with producer and a consumer.Producer produces some entities independent of consumerConsumer consumes the entities, producing new entities.Clickherefor usage/commands.SolutionHere, let the job be a string of length 10.Using async and await, functions can be turned into coroutines to be passed to aexecute_functioncommand.graph TD;
    A["PersistentQInterface"]-- child class ---B["Producer(s)"];
    A-- child class ---C["Consumer(s)"]
    B-- submit jobs -->D["PersistentQSQlite"]
    D-- process jobs -->CSystemConsists of abstract class (ABC)PersistentQInterface, childrenProducer,ConsumerandCleaner.Also consists of classPersistentQSQLitethat performs SQL queries on a database from Python.On being called,Producergenerates a file name (and file), and submits this file name as a job.PersistentQSQLiteadds this name to a queue/SQL database. Occurs every5secondsConsumerreads this queue and processes them, generating a new file with the processed content. Occurs every7-15seconds.If afterntries a file is not able to be processed byConsumer, it gets renamed with a.failedextension.Cleanerchecks for .failed files every30seconds and deletes them.Wait times for Producers, Consumers and Cleaners are independent amongst themselves and each other.Usageatk-training-rin-q-basic--helpTo run the web app, tryatk-training-rin-q-basicweb-appThe program will open inlocalhost:8000.producerandconsumerwill be running in the background -- any logs/output produced (primarily by consumer) will be visible in the terminal.NOTE: All files produced will be in the CURRENT DIRECTORY BY DEFAULT. To set your custom path, modify the path in config.yaml.Setting up your own configParameters can be customised by giving the command path to a config.yaml file.The parameters along with their default values are as follows. If any parameter is missing from the file, the default value will be used.consumer:n_time:3600n_tries:3general:primary_path:current/directoryn_prod:1n_cons:1n_time: Seconds a consumer is allowed to spend on one job before skippingn_tries: Number of time a consumer is allowed to try a job (in case of errors) before skippingprimary_path: Path where files are createdn_prod: Number of producersn_cons: Number of consumers
Package: atlantic-server
AtlanticThis program is the sever side of the Atlantic app. It gives you a restful api.Installation on debian 10 (or ubuntu 20.04) for productionThe recommended way to install it is to use a virtual environment.Install packageapt install -y pipx apache2 libapache2-mod-wsgi-py3 mariadb-server python3-dev libmariadb-dev libmariadbclient-dev build-essentialCreate and configure databasemysql -u root -p
CREATE DATABASE atlantic CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci;
CREATE USER 'aristide'@'localhost' IDENTIFIED BY 'password';
GRANT ALL PRIVILEGES ON atlantic . * TO 'aristide'@'localhost';
FLUSH PRIVILEGES;
quit;Create a user and log itadduser aristide
su - aristideInstall atlantic_serverpipx install atlantic_serverIn the user home directory, create a conf.py filenano ~/conf.pyand paste following parameters (with adjust):SECRET_KEY = "enter here a lot of randoms letters and numbers here"
DEBUG = True
DATABASES = {
    "default": {
        "ENGINE": "django.db.backends.mysql",
        "NAME": "aristide",
        "USER": "atlantic",
        "PASSWORD": "password",
    }
}
MEDIA_ROOT = "/home/aristide/www/media/"Configure Django appatlantic_server makemigrations com atl smd 
atlantic_server migrate
atlantic_server collectstatic
atlantic_server createsuperuserConfigure Apache2Return to root userexitCreate a new filenano /etc/apache2/site-available/atlantic.confPaste following parameters (with adjust):<VirtualHost *:80>
    ServerName url.for.your.site
    ErrorLog ${APACHE_LOG_DIR}/error.log
    CustomLog ${APACHE_LOG_DIR}/access.log combined
    DocumentRoot /home/aristide/www/vue/
    <Directory /home/aristide/.local/pipx/venvs/atlantic-server/lib/python3.7/site-packages/atlantic_server>
        <Files wsgi.py>
            Require all granted
        </Files>
    </Directory>
    WSGIPassAuthorization On
    WSGIDaemonProcess aristide python-home=/home/aristide/.local/pipx/venvs/atlantic-server python-path=/home/aristide
    WSGIProcessGroup aristide
    WSGIScriptAlias /admin /home/aristide/.local/pipx/venvs/atlantic-server/lib/python3.7/site-packages/atlantic_server/wsgi.py/admin
    WSGIScriptAlias /api /home/aristide/.local/pipx/venvs/atlantic-server/lib/python3.7/site-packages/atlantic_server/wsgi.py/api
    <Directory /home/aristide/www/>
            Require all granted
    </Directory>
    Alias /media/ /home/aristide/www/media/
    Alias /static/ /home/aristide/www/static/
</VirtualHost>The DocumentRoot directory is the place where you upload the atlantic_client side.Save and close fileEnabled site for apachea2dissite *
a2ensite atlantic
systemctl reload apache2It is recommended to secure the access of your site with a certificate...
Package: atlantis
AtlantisAtlantisis a Python library for simplifying programming with Python for data science.InstallationYou can just use pip to install Atlantis:pip install atlantisModulescollectionshelps with working with collections.coloursimplifies using colours.ds (datascience)provides tools for:data wrangling,validation,tuning,sampling,evaluation,clustering, andparallel processing of machine learning models.functionsmanages higher order functions.hashsimplifies and standardizes hashing.textmakes working with texts and strings easy.timeprovides methods for interacting with time and date as well asprogress barscollectionsThis module of the packageatlantishelps with working with collections.flattenfromatlantis.collectionsimportflattenflatten([1,2,[3,4,[5,6],7],8])returns:[1, 2, 3, 4, 5, 6, 7, 8]ListThis class inherits from Python's list class but implements a few
additional functionalities.fromatlantis.collectionsimportListl=List(1,2,3,4,2,[1,2],[1,2])Flattening:l.flatten()>>>List:[1,2,3,4,2,1,2,1,2]Finding duplicates:l.get_duplicates()>>>List:[2,List:[1,2]]Note:thelistelements of aListautomatically get converted toLists, recursively.ds(Data Science)This module provides data science tools for:data wrangling,validation,tuning,sampling,evaluation,clustering, andparallel processing of machine learning models.KMeansClusteringI have used theKMeansclass from bothsklearnand that ofpysparkand was frustrated
by two problems: (a) even though the two classes do exactly the same thing their interfaces
are vastly different and (b) some of the simplest operations are very hard to do with
both classes. I solved this problem by creating my ownKMeansclass that is a wrapper
aroung both of those classes and uses the appropriate one automatically without
complicating it for the data scientist programmer.Usagefromatlantis.ds.clusteringimportKMeanskmeans=KMeans(n_clusters=3,n_jobs=10)kmeans.fit(X=X)predictions=kmeans.predict(X=X)transformed_x=kmeans.transform(X=X)Clustering OptimizationUsagefromatlantis.ds.clusteringimportClusteringOptimizerclustering_optimizer=ClusteringOptimizer(min_k=2,max_k=16,n_jobs=10)clustering_optimizer.fit(X=X)print(f'best number of clusters:{clustering_optimizer.optimal_number_of_clusters}')
Package: atlantisbot-api
AtlantisBot API (Django App)This is a Django App made to create an API that interfaces withAtlantisBot's Database.SetupInstall the app# Or 'pip install atlantisbot-api'poetryaddatlantisbot-apiAdd"atlantisbot_api"to yourINSTALLED_APPS(insettings.py):INSTALLED_APPS=[...'atlantisbot_api'](Optional, Discord Oauth) Setup Discord Oauth settings and API keys in yoursettings.py(sensitive configuration)DISCORD_OAUTH2_CLIENT_ID='CLIENT_ID'DISCORD_OAUTH2_CLIENT_SECRET='CLIENT_SECRET'DISCORD_OAUTH2_REDIRECT_URI='https://your-website-callback-url.com'DISCORD_API_BASE_URL='https://discord.com/api/v6'DISCORD_AUTHORIZATION_BASE_URL=DISCORD_API_BASE_URL+'/oauth2/authorize'DISCORD_TOKEN_URL=DISCORD_API_BASE_URL+'/oauth2/token'if'http://'inDISCORD_OAUTH2_REDIRECT_URI:os.environ['OAUTHLIB_INSECURE_TRANSPORT']='true'Include API paths in your projecturls.py:path('atlantisbot/',include('atlantisbot_api.urls'))Runpython manage.py migrateto create theatlantisbotmodels.Your API paths should now be running at the following routes:# Database API Routes/atlantisbot/api/# Discord API Oauth routes/atlantisbot/api/oauth/user/
/atlantisbot/api/oauth/authorize/DocsManagement Commandspython manage.py clear_secretsantaClears receiving and giving_to fields on every Secret Santa entrypython manage.py roll_secretsantaMake pairs for Secret Santa
Package: atlantpayments-sdk
Atlant payments payment page SDKThis is a set of libraries in the Python language to ease integration of your service
with the Atlant payments Payment Page.Please note that for correct SDK operating you must have at least Python 3.5.Payment flowInstallationInstall with pippipinstallatlantpayments-sdkGet URL for paymentfrompayment_page_sdk.gateimportGatefrompayment_page_sdk.paymentimportPaymentgate=Gate('secret')payment=Payment('402')payment.payment_id='some payment id'payment.payment_amount=1001payment.payment_currency='USD'payment_url=gate.get_purchase_payment_page_url(payment)payment_urlhere is the signed URL.Handle callback from Atlant paymentsYou'll need to autoload this code in order to handle notifications:frompayment_page_sdk.gateimportGategate=Gate('secret')callback=gate.handle_callback(data)datais the JSON data received from payment system;callbackis the Callback object describing properties received from payment system;callbackimplements these methods:callback.get_payment_status()Get payment status.callback.get_payment()Get all payment data.callback.get_payment_id()Get payment ID in your system.
Package: atlasapprox
Python interface to cell atlas approximationsCell atlases such as Tabula Muris and Tabula Sapiens are multi-organ single cell omics data sets describing entire organisms. A cell atlas approximation is a lossy and lightweight compression of a cell atlas that can be streamed via the internet.This project enables biologists, doctors, and data scientist to quickly find answers for questions such as:What is the expression of a specific gene in human lung?What are the marker genes of a specific cell type in mouse pancreas?What fraction of cells (of a specific type) express a gene of interest?In addition to this interface, these questions can be asked in R or in a language agnostic manner using the REST API. See the documentation for more info.Documentation:https://atlasapprox.readthedocs.io/en/latest/python/index.htmlDevelopment:https://github.com/fabilab/cell_atlas_approximations_API
Package: atlasbroker
Atlas Broker for Kubernetes Service CatalogCode documentation (sphinx)DockerThe docker folder provides everything to create an image that will serve Service Catalog requests in Kubernetes.Atlasbroker moduleInstallationThis package is available for Python 3.5+.pip3installatlasbrokerOr install the development version from github:pip3installgit+https://github.com/mickybart/python-atlasbroker.gitPrerequisiteExamples in this README are using the secret.json file to inject Atlas and Mongo credentials.
Of course you can use any other solution provided by your infrastructure.# Secrets structure#secrets={"mongo":{"uri":"","db":"","timeoutms":5000,"collection":""},"atlas":{"user":"","password":"","group":""}}Quick startfromatlasbroker.brokerimportBrokerfromatlasbroker.configimportConfigsecrets=Config.load_json("secret.json")config=Config(secrets["atlas"],secrets["mongo"])Broker(config).run()Custom ConfigThe class Config is the main way to customize the broker. All important functions like
generate credentials, database name, permissions of the database user, UUID, etc are exposed on this class.Please read the Code documentation for more details.fromatlasbroker.brokerimportBrokerfromatlasbroker.configimportConfigsecrets=Config.load_json("secret.json")classCustomConfig(Config):PARAMETER_NAMESPACE="ns"defgenerate_binding_username(self,binding):returnbinding.binding_id+'-rw'defgenerate_instance_dbname(self,instance):returninstance.parameters[self.PARAMETER_NAMESPACE]config=CustomConfig(secrets["atlas"],secrets["mongo"])Broker(config).run()Error TypesExceptionsErrClusterNotFoundCluster not foundErrClusterConfigCluster configuration not foundErrStorageMongoConnectionThe storage is not able to communicate with MongoDBErrStorageTypeUnsupportedType unsupportedErrStorageRemoveInstanceFailed to remove the instanceErrStorageRemoveBindingFailed to remove the bindingErrStorageStoreFailed to store the instance or bindingErrStorageFindInstanceFailed to find the instanceErrPlanUnsupportedPlan not supportedInternal NotesCode documentation (sphinx)Bugs or IssuesPlease report bugs, issues or feature requests toGithub
Issues
Package: atlasclient
Apache Atlas Client in PythonApache Atlas client in Python.
Only compatible with Apache Atlas REST APIv2.Free software: Apache Software License 2.0Documentation:https://atlasclient.readthedocs.io.Get started>>> from atlasclient.client import Atlas
>>> client = Atlas('<atlas.host>', port=21000, username='admin', password='admin')
>>> client.entity_guid(<guid>).status
>>> params = {'typeName': 'DataSet', 'attrName': 'name', 'attrValue': 'data', 'offset': '1', 'limit':'10'}
>>> search_results = client.search_attribute(**params)
>>> for s in search_results:
...    for e in s.entities:
...         print(e.name)
...         print(e.guid)FeaturesLazy loading: requests are only performed when data are required and not yet availableResource object relationships: REST API from sub-resources are done transparently for the user, for instance the user does not have to know that it needs to trigger a different REST request for getting the classifications of a specific entity.TODO featuresallow multiprocessingCreditsThis package was created withCookiecutterand theaudreyr/cookiecutter-pypackageproject template.History1.0.0 (2019-08-10)Adds the helper functions to parse the qualified nameUpdates the version to 1.x to get some confidence from community as the module is pretty stable now0.1.8 (2019-08-08)Add support for Atlas’ Admin Metrics REST API0.1.7 (2019-07-08)Add support for Atlas’ DSL Saved Search (#81)Fixes list lookups for searching0.1.6 (2019-04-26)Call of DependentClass inflate (#79)0.1.5 (2019-04-24)Add support for Post type Basic Search (#76)0.1.4 (2019-04-16)fixes (BasicSearch, when no result in _data, etc)0.1.3 (2019-04-05)HTTP AuthBasic search inflaterelationshipAttributes0.1.2 (2018-03-27)Bug fixesResponse is returned after entity creation (easier to figure out the guid)0.1.1 (2018-03-07)Bug fixesMost of the resources have been implemented (except RelationshipREST)Basic authentication (only the Basic token is sent on the network)0.1.0 (2018-01-09)First push.
Package: atlas-consortia-clt
Command-Line TransferCommand-Line Transfer (CLT) is a command-line interface (CLI) used to download multiple files and directories from the Globus file transfer service. The CLT initiates a transfer from a Globus endpoint to theGlobus Connect Personalapplication. CLT provideshubmap-cltandsennet-cltcommand-line interfaces for HuBMAP and SenNet, respectively.UsageCLT provideshubmap-cltandsennet-cltcommand-line interfaces. The following documentation uses<consortium>-cltin examples. Please replace<consortium>withhubmaporsennet.Usage documentation can also be found by running the following command:<consortium>-clt -hLoginA one-time login is required for any download session. For non-public data, you must log in with your HuBMAP or SenNet account. For publicly available data, you can log in with any account accepted by the login form (Google and ORCID). Log in can be initiated using the following command:<consortium>-clt loginLogoutLogout can be used to log out the current user.<consortium>-clt logoutTransferA data transfer and download can be initiated using the transfer command and a manifest file. You must be logged in to use the transfer command.<consortium>-clt transfer <PATH/TO/MANIFEST/FILE>An optional destination argument can be specified. The destination is the directory on the user's computer where data will be downloaded. The directory will be created if it doesn't exist. The destination argument is relative to the user's home directory (~). For example,--destination Desktop/<consortium>-datacorresponds to an absolute path of~/Desktop/<consortium>-data. The default destination directory is~/<consortium>-downloads.<consortium>-clt transfer <PATH/TO/MANIFEST/FILE> --destination <PATH/TO/DESTINATION/DIRECTORY>WhoamiWhoami can be used to display the information of the currently logged in user.<consortium>-clt whoamiAdditional DocumentationAdditional documentation can be found at theHuBMAPandSenNetdocumentation pages.DevelopmentAsrc/atlas_consortia_clt/common/app.cfgconfiguration file is required to build the CLT. An exampleapp.cfg.examplefile is located in thesrc/atlas_consortia_clt/commondirectory. Replace the values inapp.cfg.exampleand rename the file toapp.cfg.When contributing to the CLT, run the following commands in the root directory to install the editable package.python3 -m pip install --upgrade pip setuptools
python3 -m pip install -e .Building and PublishingInstall thebuildpackage and build the project by running the following commands in the root directory. These commands should generate adistdirectory.python3 -m pip install --upgrade build
python3 -m buildInstall thetwinepackage and upload the build files to PyPI by running the following commands. The second command will prompt for a PyPI username and password.python3 -m pip install --upgrade twine
python3 -m twine upload dist/*See thePython Documentationfor more detailed instructions on building and publishing.