Saravanan666/pypi-org huggingface dataset:
Package: dtool-create
Installationpipinstalldtool-createWarningIn order to be able to install theryamel.yamldependency you may need to run:pip install -U pip setuptools wheelSeehttp://yaml.readthedocs.io/en/latest/install.htmlfor more details.UsageCreate a proto dataset:dtool create my_datasetAdd some data to to the dataset:cp *.csv my_dataset/dataAdd descriptive metadata to the dataset:dtool readme interative my_datasetConvert the proto dataset to a dataset by freezing it:dtool freeze my_datasetSee thedtool documentationfor more detail.Configuring the descriptive metadata templateIt is possible to configure the required metadata prompted for by thedtool readme interactivecommand. The default template is thedtool_create/templates/README.yml.One may want to create a custom YAML file specifying the required metadata
that will be prompted for. This can be achieved by setting theDTOOL_README_TEMPLATE_FPATHenvironment variable, e.g.:export DTOOL_README_TEMPLATE_FPATH=~/dtool_readme.ymlAlternatively, one can add theDTOOL_README_TEMPLATE_FPATHkey to the~/.config/dtool/dtool.jsonfile.  For example,{"DTOOL_README_TEMPLATE_FPATH":"/Users/olssont/dtool_readme.yml"}If the~/.config/dtool/dtool.jsonfile does not exist one may need to
create it.Configuring the user’s full name and email for the descriptive metadataWhen running thedtool interactive readmethe default name and email
address areYour Nameandyou@example.com.  These defaults can be
configured by setting theDTOOL_USER_FULL_NAMEDTOOL_USER_EMAILenvironment variables.export DTOOL_USER_FULL_NAME="Care A. Bout-Data"
export DTOOL_USER_EMAIL=researcher@famous.uni.ac.ukAlternatively, one can add theDTOOL_USER_FULL_NAMEandDTOOL_USER_EMAILkeys to the~/.config/dtool/dtool.jsonfile.  For
example,{"DTOOL_USER_FULL_NAME":"Care A. Bout-Data","DTOOL_USER_EMAIL":"researcher@famous.uni.ac.uk"}If the~/.config/dtool/dtool.jsonfile does not exist one may need to
create it.Related packagesdtoolcoredtool-clidtool-configdtool-info
Package: dtool-ecs
GitHub:https://github.com/jic-dtool/dtool-ecsPyPI:https://pypi.python.org/pypi/dtool-ecsFree software: MIT LicenseFeaturesCopy datasets to and from ECS S3 object storageList all the datasets in a ECS S3 bucketCreate datasets directly in ECS S3InstallationTo install the dtool-ecs package:pip install dtool-ecsConfigurationCreate the file.config/dtool/dtool.jsonand add the ECS account details
using the format below:{
   "DTOOL_ECS_ENDPOINT_<BUCKET NAME>": "<ENDPOINT URL HERE>",
   "DTOOL_ECS_ACCESS_KEY_<BUCKET NAME>": "<USER NAME HERE>",
   "DTOOL_ECS_SECRET_ACCESS_KEY_<BUCKET NAME>": "<KEY HERE>"
}For example:{
   "DTOOL_ECS_ENDPOINT_my-bucket": "http://blueberry.famous.uni.ac.uk",
   "DTOOL_ECS_ACCESS_KEY_ID_my-bucket": "olssont",
   "DTOOL_ECS_SECRET_ACCESS_KEY_my-bucket": "some-secret-token"
}See thedtool documentationfor more detail.Related packagesdtoolcoredtool-httpdtool-s3dtool-azuredtool-irods
Package: dtool-gui-tk
GitHub:https://github.com/jic-dtool/dtool-gui-tkPyPI:https://pypi.python.org/pypi/dtool-gui-tkFree software: MIT LicenseFeaturesList datasetsView dataset metadataCreate new datasetsInstallationThis package requires Python3, i.e. it is not compatible with Python2.pip install dtool-gui-tkUsageTo start the application run the command:dtool-tkWhen the application starts for the first time the user will be asked to
specify a directory to use as the “local base URI directory”. This is the
location where the application will look for existing datasets and save new
datasets to. The local base URI directory can be set and updated using the
“Edit >> Edit preferences…” dialogue.Existing datasets are displayed on the left hand side of the main window.
Information about a selected dataset is available on the right hand side
of the main window.The main window of the dtool-tk GUIWhen creating a new dataset one has to specify the name and the input directory
from where the data files will be copied. One also needs to specify the
metadata schema to use to describe the metadata.Metadata schemas are described using a subset of theJSON schemasyntax. The dtool-tk application comes with one
basic schema built in:{"type":"object","properties":{"description":{"type":"string"}},"required":["description"]}More metadata schemas can be added by creating approprate JSON files in the
user’s~/.config/dtool/metadata_schemasdirectory. Below is an example
of a more complex metadata schema:{"type":"object","properties":{"description":{"type":"string","minLength":3,"maxLenth":80},"age":{"type":"integer","exclusiveMinimum":0},"allowed":{"type":"boolean"},"celcius":{"type":"number","exclusiveMinimum":-273.15},"continent":{"type":"string","enum":["Africa","Antarctica","Asia","Europe","North America","South America"]}},"required":["description"]}The “New dataset” window of dtool-tk, using a more “complex” metadata
schema. The optional metadata items “age” and “allowed” have been
selected. Feedback is provided if the metadata entered does not conform to
the specification in the schema as in the case of having an “age” less than
or equal to 0.ShortcutsDescriptionWindows/LinuxMac OSXCreate new datasetCtrl+NCmd+NEdit metadataCtrl+MCmd+MEdit tagsCtrl+TCmd+TEdit preferencesCtrl+PCmd+,QuitCtrl+QCmd+Q
Package: dtool-http
GitHub:https://github.com/jic-dtool/dtool-httpFree software: MIT LicenseFeaturesPublish dtool datasets by making them accessible via HTTP(S)Interact with dtool datasets over HTTP(S)Copy a dataset over HTTP(S)InstallationTo install the dtool-http package.cddtool-httppythonsetup.pyinstallUsageTo publish a dataset hosted in Amazon S3 or Microsoft Azure Storage use thedtool_publish_datasetcommand line utility:$ dtool_publish_dataset azure://jicinformatics/c58038a4-3a54-425e-9087-144d0733387f
Dataset accessible at: https://jicinformatics.blob.core.windows.net/c58038a4-3a54-425e-9087-144d0733387fTo show the descriptive metadata of the published dataset:$ dtool readme show https://jicinformatics.blob.core.windows.net/c58038a4-3a54-425e-9087-144d0733387f
---
description: Enterobacteria phage lambda, complete genome
creation_date: 2018-02-06
accession: NC_001416.1
link: https://www.ncbi.nlm.nih.gov/nuccore/NC_001416.1
reference: |
  Nucleotide [Internet]. Bethesda (MD):
  National Library of Medicine (US),
  National Center for Biotechnology Information; [1988] - .
  Accession No. NC_001416.1, Enterobacteria phage lambda, complete genome
  [cited 2018 Feb 06]
  Available from: https://www.ncbi.nlm.nih.gov/nuccore/NC_001416.1To copy the dataset to local disk:$ dtool copy https://jicinformatics.blob.core.windows.net/c58038a4-3a54-425e-9087-144d0733387f ~/my_datasets
Dataset copied to:
file:///Users/olssont/my_datasets/lamda-phage-genomeServing a directory of datasets over HTTPThere is a simple utility for serving datasets in a directory over HTTP calleddtool_serve_direcotry. This is mainly useful for testing purposes.Usage:$ dtool_serve_directory ~/my_datasetsThe default port used is 8081. To show the descriptive metadata in the README
one can use dtool:$ dtool readme show http://localhost:8081/lamda-phage-genome
---
description: Enterobacteria phage lambda, complete genome
creation_date: 2018-02-06
accession: NC_001416.1
link: https://www.ncbi.nlm.nih.gov/nuccore/NC_001416.1
reference: |
  Nucleotide [Internet]. Bethesda (MD):
  National Library of Medicine (US),
  National Center for Biotechnology Information; [1988] - .
  Accession No. NC_001416.1, Enterobacteria phage lambda, complete genome
  [cited 2018 Feb 06]
  Available from: https://www.ncbi.nlm.nih.gov/nuccore/NC_001416.1Related packagesdtoolcoredtool-clidtool-infodtool-s3dtool-azure
Package: dtool-ibeis
Data tools forIBEIS.Currently in proof of concept mode (and wont be developed further).Contains the SQLDatabaseController powering the IBEIS APIContains a preliminary dependency cache# Goals of this projectAllow for small pieces code and algorithms to be easilly integrated into a
large scale cache / pipeline structure.Each computation function should be fairly self contained, stateless, and
re-usable by other projects that do not wish to conform to the rules set by
this structure.Repos relevant to the ibeis project:https://github.com/Erotemic/plottool_ibeishttps://github.com/Erotemic/guitool_ibeishttps://github.com/Erotemic/dtool_ibeishttps://github.com/Erotemic/vtool_ibeishttps://github.com/Erotemic/vtool_ibeis_exthttps://github.com/Erotemic/pyflann_ibeishttps://github.com/Erotemic/pyhesaffhttps://github.com/Erotemic/utoolhttps://github.com/Erotemic/ibeis
Package: dtool-irods
GitHub:https://github.com/jic-dtool/dtool-irodsPyPI:https://pypi.python.org/pypi/dtool-irodsFree software: MIT LicenseFeaturesCopy datasets to and from iRODSList all the datasets in an iRODS zoneCreate datasets directly in iRODSInstallationTo install the dtool-irods package.pipinstalldtool-irodsUsageTo copy a dataset from local disk (my-dataset) to an iRODS zone
(/data_raw) one can use the command below.dtool copy ./my-dataset /data_raw irodsTo list all the datasets in an iRODS zone one can use the command below.dtool ls /data_raw irodsSee thedtool documentationfor more detail.Related packagesdtoolcoredtool-clidtool-symlink
Package: dtool_lookup_client
Dtool plugin for interacting with dtool lookup serverInstallationTo install the dtool_lookup_client package.pipinstalldtool_lookup_clientThis plugin depends on having adtool-lookup-serverto talk to.Looking up datasets by UUIDTo lookup URIs from a dataset UUID:dtool lookup UUIDSearchingTo list all registered datasets:dtool searchFull text search for the word “EMS”:dtool search EMSTo list all datasets created by userolssontusing the mongo query language:dtool search -m '{"creator_username": "olssont"}'
Package: dtool-lookup-server-plugin-scaffolding
GitHub:https://github.com/IMTEK-Simulation/dtool-lookup-server-plugin-scaffoldingPyPI:https://pypi.python.org/pypi/dtool-lookup-server-plugin-scaffoldingFree software: MIT LicenseFeaturesTemplate for dtool-lookup-server plugin developments.Introductiondtoolis a command line tool for packaging
data and metadata into a dataset. A dtool dataset manages data and metadata
without the need for a central database.However, if one has to manage more than a hundred datasets it can be helpful
to have the datasets’ metadata stored in a central server to enable one to
quickly find datasets of interest.Thedtool-lookup-serverprovides a web API for registering datasets’ metadata
and provides functionality to lookup, list and search for datasets.This scaffolding serves as a template fordtool-lookup-serverplugin
developments.InstallationInstall the dtool lookup server dependency graph plugin:$ pip install dtool-lookup-server-plugin-scaffolding
Package: dtool-lookup-server-retrieve-plugin-mongo
Retrieve plugin for dtool-lookup-server using mongodbTo install the dtool-lookup-server-retrieve-plugin-mongo package.cddtool-lookup-server-retrieve-plugin-mongopythonsetup.pyinstallTo configure the connection to the mongo database.exportRETRIEVE_MONGO_URI="mongodb://localhost:27017/"exportRETRIEVE_MONGO_DB="dtool_lookup_server"exportRETRIEVE_MONGO_COLLECTION="datasets"TestingTesting requires a minimaldtool-lookup-serverinstallation including a
functional search plugin, i.e.pipinstalldtool-lookup-serverpipinstalldtool-lookup-server-search-plugin-mongoRun tests from within repository root withpytest.
Package: dtool-lookup-server-search-plugin-mongo
Search plugin for dtool-lookup-server using mongodbTo install the dtool-lookup-server-search-plugin-mongo package.cddtool-lookup-server-search-plugin-mongopythonsetup.pyinstallTo configure the connection to the mongo database.exportSEARCH_MONGO_URI="mongodb://localhost:27017/"exportSEARCH_MONGO_DB="dtool_lookup_server"exportSEARCH_MONGO_COLLECTION="datasets"TestingTesting requires a minimaldtool-lookup-serverinstallation including a
functional retrieve plugin, i.e.pipinstalldtool-lookup-serverpipinstalldtool-lookup-server-retrieve-plugin-mongoRun tests from within repository root withpytest.
Package: dtools
Dtools PackageDtoolspackage provide a wrapper object around relativedelta to manage date and datetime stringsInstallation :pipinstalldtoolsExamples :Example 1:>>>fromdtoolsimportDate>>>Date('2017-06-04').relativedelta(days=2)'2017-06-06'>>>type(Date('2017-06-04').relativedelta(days=2))<class'str'>Example 2:>>>fromdtoolsimportDate>>>Date('2017-06-04').relativedelta(month=2,day=3)'2017-02-03'>>>Date('2017-06-04').relativedelta(last_day=True)'2017-06-30'>>>Date('2017-06-04').relativedelta(months=4,last_day=True)'2017-10-31'Example 3:>>>fromdtoolsimportDate>>>Date('2017-06-04').relativedelta(hour=12)>>>'2017-06-04'>>>Date('2017-06-04').relativedelta(hour=12,rtype='datetime')>>>'2017-06-04 12:00:00'Example 4:>>>fromdtoolsimportDate>>>Date('2017-06-04 04:30:00').relativedelta(days=4,hour=12)>>>'2017-06-08 12:30:00'>>>Date('2017-06-04 04:30:00').relativedelta(days=4,hour=12,rtype='date')>>>'2017-06-08'LicenceThis software is made available under the LGPL v3 license.Bug TrackerPlease, feel free to report bugs or suggestions in theBug Tracker!Credits:Mohamed Cherkaoui <http://mohamedcherkaoui.com>News2.0.0Release date: 04-Jun-2017First stable version
Package: dtool-smb
GitHub:https://github.com/IMTEK-Simulation/dtool-smbPyPI:https://pypi.python.org/pypi/dtool-smbFree software: MIT LicenseFeaturesCopy datasets to and from SMB storageList all the datasets in an SMB shareCreate datasets directly to an SMB shareInstallationTo install the dtool-smb package:pip install dtool-smbConfigurationThen create the file.config/dtool/dtool.jsonand add the SMB account using the format below:```
{
  "DTOOL_SMB_USERNAME_jicinformatics": "<username>",
  "DTOOL_SMB_PASSWORD_jicinformatics": "<password>",
  "DTOOL_SMB_SERVER_NAME_jicinformatics": "<server-name>",
  "DTOOL_SMB_SERVER_PORT_jicinformatics": <server-port>,
  "DTOOL_SMB_DOMAIN_jicinformatics": "<smb-domain>",
  "DTOOL_SMB_SERVICE_NAME_jicinformatics": "<smb-share>",
  "DTOOL_SMB_PATH_jicinformatics": "<path-within-share>"
}
```Note that <server-port> is typically 445. The name of the ‘share’ is specified through theDTOOL_SMB_SERVICE_NAME_*key.UsageTo copy a dataset from local disk (my-dataset) to an SMB storage account
(jicinformatics) one can use the command below:dtool cp ./my-dataset smb://jicinformatics/To list all the datasets in an SMB share one can use the command below:dtool ls smb://jicinformatics/See thedtool documentationfor more detail.Related packagesdtoolcoredtool-httpdtool-s3dtool-irodsdtool-ecsdtool-azure
Package: dtool-symlink
Add ability to create dataset where data directory is a symlink.Installing this package provides the dtool command line client with a storage
broker namedsymlink. This is useful if one wants to mark up files in a
directory as a dataset without having to re-organise their structure on disk.
For example if one wants to mark up some Next Generation Sequencing data that
has arrived on an external hard disk as a dataset before copying the resulting
dataset to some other form of storage.If one wants to make use of thedtool_symlink.storagebroker.SymLinkStorageBrokerclass programatically one
needs to set an attribute calledsymlink_pathon theSymLinkStorageBrokerinstance with the path to the directory to be linked
before calling thecreate_structuremethod. For example:from dtool_symlink.storagebroker import SymLinkStorageBroker

symlink_storage_broker = SymLinkStorageBroker("/path/to/dataset")
symlink_storage_broker.symlink_path = "/mnt/my_data/"
symlink_storage_broker.create_structure()InstallationTo install the dtool-symlink package.cddtool-symlinkpythonsetup.pyinstall
Package: dtool-tag
Installation$ pip install dtool-tagExample usageGet a dataset to play with:$ LOCAL_DS_URI=$(dtool cp -q http://bit.ly/Ecoli-ref-genome .)Add a couple of  tags:$ dtool tag set $LOCAL_DS_URI e.coli
$ dtool tag set $LOCAL_DS_URI genomeList the dataset tags:$ dtool tag ls $LOCAL_DS_URI
e.coli
genomeDelete a tag:$ dtool tag delete $LOCAL_DS_URI genomeFor more information see thedtool documentation.Related packagesdtoolcoredtool-clidtool-createdtool-overlaydtool-annotation
Package: dtopt
When using thedoctestmodule it is often
convenient to use the ELLIPSIS option, which allows you to use...as a
wildcard.  But you either have to setup the test runner to use this option, or
you must put#doctest: +ELLIPSISoneveryexample that uses this feature.dtoptlets you enable this option globally from within a doctest, by doing:>>> from dtopt import ELLIPSIS(The optionsNORMALIZE_WHITESPACEandCOMPAREare also available)You can install this fromthe subversion repositorywitheasy_installdtopt==dev.
Package: dtorch
DTorchA direct link to the package :hereDTorch is a package made by a student at Epitech to improve his understanding ofpytorchand better his knowledge of ia.
It is built on top ofnumpywhich is a scientific framework for math between matrices.This project run on cpu but still have decent computation time making it usable for model building, optimization and saving/loading.The tensors created can work with numpy but remember that the gradients willnot be calculatedif the operation are not in the range of control of the library. Therefore, a usage of the packages methods on the tensors if preferable.Cudasupport may appear in the future and similarly for the dkldnn library that seems to be an excellent when working on CPU.A directadvantageof using dtorch is it's lightness. The package is currently close to 14 Ko and is fast to load in any project while the use of torch often lead to a slow start.More about DTorchThe package is organised in the following manner :ModuleDescriptiondtorchthe base module where other are regroupedfunctionnala gather of all the functions that can be used on jtensorsjtensorsa simple module containing the JTensors declarationlossloss classes for model implementationnna neural network layer system and its multiple layers (see doc for more details).einopsa basic reproduction of some einops library methods that support autogradoptimA library contaning the optimizers that can be used on the networks parameters.dtorchvisionA lib containing visual datasets and models (pretrained too)dtorchtextA lib containing textual datasets and models (pretrained too)About AutogradThe implementation in this library may not be the most effective computationnaly but the goal was to make it simple and make it work effectively by relying on numpy matrices operations for computation speed concerns.
Package: dtox
.. raw:: html<div align="center">.. raw:: html</div>Intro-----**Detox** is an open source software library for machine learningsecurity. It contains tools for adversarial example generation andprovides a framework for building new types of attack methods.Currently in the dev stage.Attacks-------Available attack algorithms implemented in Detox:-  Fast Gradient Methods (FGM/FGSM)```Tutorial`` </tutorial/source/fgsm.ipynb>`__-  Basic Iterative```Tutorial`` </tutorial/source/basic_iterative.ipynb>`__-  Momentum Iterative```Tutorial`` </tutorial/source/momentum_iterative.ipynb>`__-  DeepFool-  Universal Adversarial Perturbation (UAP)-  Jacobian-based Saliency Map Approach (JSMA)-  One Pixel Attack-  LBFGS-  Carlini Wagner L2-  Carlini Wagner L-inf-  Feature Adversaries-  Boundary Attack-  Elastic Net-  Natural Adversarial Examples (NAE)The Team~~~~~~~~Detox is a community driven project. The project was initiated bymachine learning security team @ `KakaoBrain <kakaobrain.com>`__... |license| image:: https://img.shields.io/github/license/mashape/apistatus.svg
Package: dtppy
Data Transfer Protocol for PythonCross-platform networking interfaces for Python.Data Transfer ProtocolThe Data Transfer Protocol (DTP) is a larger project to make ergonomic network programming available in any language.
See the full projecthere.InstallationInstall the package:$python-mpipinstalldtppyCreating a serverA server can be built using theServerimplementation:fromdtppyimportServer# Called when data is received from a clientdefreceive(client_id,data):# Send back the length of the strings.send(len(data),client_id)# Called when a client connectsdefconnect(client_id):print(f"Client with ID{client_id}connected")# Called when a client disconnectsdefdisconnect(client_id):print(f"Client with ID{client_id}disconnected")# Create a server that receives strings and returns the length of each strings=Server(on_receive=receive,on_connect=connect,on_disconnect=disconnect)s.start("127.0.0.1",29275)Creating a clientA client can be built using theClientimplementation:fromdtppyimportClientmessage="Hello, server!"# Called when data is received from the serverdefreceive(data):# Validate the responseprint(f"Received response from server:{data}")assertdata==len(message)# Called when the client is disconnected from the serverdefdisconnected():print("Unexpectedly disconnected from server")# Create a client that sends a message to the server and receives the length of the messagec=Client(on_receive=receive,on_disconnected=disconnected)# Send the message to the serverc.send(message)SecurityInformation security comes included. Every message sent over a network interface is encrypted with AES-256. Key
exchanges are performed using a 512-bit RSA key-pair.
Package: dtptcpy
dtptcPy介绍数据交换中心 Data transportation center软件架构软件架构说明安装教程xxxxxxxxxxxx使用说明xxxxxxxxxxxx参与贡献Fork 本仓库新建 Feat_xxx 分支提交代码新建 Pull Request特技使用 Readme_XXX.md 来支持不同的语言，例如 Readme_en.md, Readme_zh.mdGitee 官方博客blog.gitee.com你可以https://gitee.com/explore这个地址来了解 Gitee 上的优秀开源项目GVP全称是 Gitee 最有价值开源项目，是综合评定出的优秀开源项目Gitee 官方提供的使用手册https://gitee.com/helpGitee 封面人物是一档用来展示 Gitee 会员风采的栏目https://gitee.com/gitee-stars/