Saravanan666/pypi-org huggingface dataset:
Package: idem-posix
Grains, execution modules, and state modules common to all posix systemsAboutidem-posixhelps executing commands on a posix systemidem.idem-posix source codeidem-posix documentationWhat is POP?This project is built withpop, a Python-based
implementation ofPlugin Oriented Programming (POP). POP seeks to bring
together concepts and wisdom from the history of computing in new ways to solve
modern computing problems.For more information:Intro to Plugin Oriented Programming (POP)pop-awesomepop-createWhat is Idem?This project is built withidem, an idempotent,
imperatively executed, declarative programming language written in Python. This project extends
idem!For more information:Idem Project WebsiteIdem Project docs portalInstallationInstall with pip:pip install idem-posixDevelopment InstallationClone theidem-posixrepo and install with pip:git clone https://gitlab.com/vmware/idem/idem-posix idem_posix
pip install -e idem_posixExecutionAfter installation the Idem Posix Provider execution and state modules will be accessible to the pophub.
In order to use them we need to set up our credentials.Example of using cmd.run state in SLS:# Execute "ls -l" commandmy_state_name:cmd.run:cmd:ls -lcwd:/shell:Falseenv:ENV_VAR_1:ENV_VAL_1ENV_VAR_2:ENV_VAL_2timeout:100render_pipe:kwargs:Example of using cmd.run with Idem CLI:idemexeccmd.run"shell command --with-flags"cwd=/homerender_pipe=jsontimeout=10
Package: idempotent-sequence
A set of Python classes to declare an idempotent sequence of commands –
a sequence that can be run repeatedly and on success will produce
the same side effects no matter how many times you invoke it.This is useful when you have a sequence of commands each of which can
fail and you want to keep rerunning the sequence until it succeeds, yet
you don’t want to run previously completed parts again.See examples underidemseq/examples.$ pip install idempotent-sequence

$ set IDEMSEQ_SEQUENCE_ID=/tmp/example02.db
$ export IDEMSEQ_SEQUENCE_ID
$ set IDEMSEQ_LOG_LEVEL=debug
$ export IDEMSEQ_LOG_LEVEL

$ idemseq idemseq.examples.example02:example

$ idemseq idemseq.examples.example02:example list
$ idemseq idemseq.examples.example02:example run --dry-run
$ idemseq idemseq.examples.example02:example run
$ idemseq idemseq.examples.example02:example reset all
Package: idem-random
An Idem plugin that provides randomness.AboutIdem Random provides us with logical states like random password,
random integer, random string which can be used in conjunction with
other idem plugins. This plugin in itself doesn’t interact with the
any cloud provider.An example use-case where this plugin can be used is -
AWS RDS database instance needs a password when its created.
We can use AWS’s RDS state along with Idem random password state
in order to generate a random password at runtime and help create
the RDS instance.Random IDThe resource random_id generates random numbers that are intended to be used as unique identifiers for other resources.
This resource does use a cryptographic random number generator in order to minimize the chance of collisions, making the
results of this resource when a 16-byte identifier is requested of equivalent uniqueness to a type-4 UUID.What is POP?This project is built withpop, a Python-based
implementation ofPlugin Oriented Programming (POP). POP seeks to bring
together concepts and wisdom from the history of computing in new ways to solve
modern computing problems.For more information:Intro to Plugin Oriented Programming (POP)pop-awesomepop-createGetting StartedPrerequisitesPython 3.8+git(if installing from source, or contributing to the project)InstallationNoteIf wanting to contribute to the project, and setup your local development
environment, see theCONTRIBUTING.rstdocument in the source repository
for this project.If wanting to useidem-random, you can do so by either
installing from PyPI or from source.Install from PyPIIf package is available via PyPI, include the directions.pipinstallidem-randomInstall from source# clone repogitclonegit@gitlab.com/vmware/idem/idem-random.gitcdidem-random# Setup venvpython3-mvenv.venvsource.venv/bin/activatepipinstall-e.RoadmapReference theopen issuesfor a list of
proposed features (and known issues).AcknowledgementsImg Shieldsfor making repository badges easy.
Package: idem-resources-validation
Resources schemas validation plugin tool.Aboutidem-resources-validationperforms different validations on the IDEM plugins’ schemas usingidem.idem-resources-validation source code:What is POP?This project is built withpop, a Python-based
implementation ofPlugin Oriented Programming (POP). POP seeks to bring
together concepts and wisdom from the history of computing in new ways to solve
modern computing problems.For more information:Intro to Plugin Oriented Programming (POP)pop-awesomepop-createWhat is Idem?This project is built withidem, an idempotent,
imperatively executed, declarative programming language written in Python. This project extends
idem!For more information:Idem Project WebsiteIdem Project docs portalGetting StartedPrerequisitesPython 3.7+git(if installing from source, or contributing to the project)InstallationNoteIf wanting to contribute to the project, and setup your local development
environment, see theCONTRIBUTING.rstdocument in the source repository
for this project.If wanting to useidem-resources-validation, you can do so by either
installing from PyPI or from source.Install from PyPIpipinstallidem-resources-validationInstall from sourceClone theidem-resources-validationrepository.gitclonegit@gitlab.com:vmware/idem/idem-resources-validation.gitcdidem-resources-validationCreate a virtual environment, and then activate it:python3-mvenv.venvsource.venv/bin/activateInstall idem-resources-validation and other base requirements:pip3install-e.pip3install-rrequirements/base.txtInstall the following packages in order to run the tests:pip3install-rrequirements/py3.10/tests.txtNOTE:Change py3.10 if needed with your  Python version. There is support for py3.8, py3.9, py3.10 and py3.11.SetupAfter installation the validations execution module will be accessible to the pophub.
You can provide your custom config file with the specific plugin properties.
Plugin config properties file can be found in the idem-resources-validation repo under tests/plugins dir.exportPLUGIN_CONFIG_FILE=./tests/plugins/idem-aws-example.jsonidemexecresources_validator.schema.checkers.validate_schema
Package: idem-salt
InstallationInstalling this package via pip will copy the idem state and execution
modules to the proper locations in /srv/salt:pip install idem-salt --global-option install_scriptsYou can also install to a custom location:pip install idem-salt --global-option install_scripts --global-option="--install-dir=/srv/file/root"StatesCreate a salt state that references idem sls files or sources directly:state_name:
    idem.state:
        - idem.sls
        - sls_sourceExecution ModulesIdem execution modules can be called directly from the command line:salt '*' idem.exec test.ping
Package: idem-solaris
Grains, execution modules, and state modules common to all solaris systemsINSTALLATIONInstall idem-solaris directly from pip:pip install idem-solarisDEVELOPMENT INSTALLATIONClone theidem_solarisrepo and install with pip:git clone https://gitlab.com/saltstack/pop/idem-solaris.git idem_solaris
pip install -e idem_solarisEXECUTIONAfter installation thegrainscommand should now be availableTESTINGinstallrequirements-test.txtwith pip and run pytest:pip install -r idem_solaris/requirements-test.txt
pytest idem_solaris/testsVERTICAL APP-MERGINGInstructions for extending pop-solaris into an OS-specific pop projectInstall pop:pip install --upgrade popCreate a new directory for the project:mkdir pop_{specific_solaris}
cd pop_{specific_solaris_os}Usepop-seedto generate the structure of a project that extendsgrainsandidem:pop-seed -t v pop_{specific_solaris_os} -d grains exec states“-t v” specifies that this is a vertically app-merged project“-d grains exec states” says that we want to implement the dynamic names of “grains”, “exec”, and “states”Add “idem_solaris” to the requirements.txt:echo "idem_solaris @ git+https://gitlab.com/saltstack/pop/idem_solaris.git" >> requirements.txtAnd that’s it!  Go to town making grains, execution modules, and state modules specific to your specific solaris-based platform.
Follow the conventions you see in idem_solaris.For information about running idem states and execution modules check outhttps://idem.readthedocs.io
Package: idem-sources
Generic sls-source plugins for idemAboutThis project provides generic sls-sources for idem.
sls-sources can be used to collectparamsdata orstatedefinitions.What is POP?This project is built withpop, a Python-based
implementation ofPlugin Oriented Programming (POP). POP seeks to bring
together concepts and wisdom from the history of computing in new ways to solve
modern computing problems.For more information:Intro to Plugin Oriented Programming (POP)pop-awesomepop-createGetting StartedPrerequisitesPython 3.6+git(if installing from source, or contributing to the project)InstallationNoteIf wanting to contribute to the project, and setup your local development
environment, see theCONTRIBUTING.rstdocument in the source repository
for this project.If wanting to useidem-sources, you can do so by either
installing from PyPI or from source.Install from PyPIpipinstallidem-sourcesInstall from source# clone repogitclonegit@gitlab.com/vmware/idem/idem-sources.gitcdidem-sources# Setup venvpython3-mvenv.venvsource.venv/bin/activatepipinstall-e.UsageSLS sources are directory trees, archives, and remote stores that contain sls files.
SLS and param sources can come from many different places.
The plugins that can be used to process SLS sources are in idem/idem/sls.The format for an sls sources is:<protocol>://<resource>The format for authenticated sls sources is:<protocol_plugin>://<acct_profile>@<resource>The named acct profile associated with the protocol_plugin provider will have it’s values passed toctx.acctof the appropriate “cache” function.File sources that have a mimetype, such as zip files, will be unarchived before further processing.This is an example of an idem config file that specifiessls_sourcesandparam_sources:idem:sls_sources:-file://path/to/sls_tree-file://path/to/sls_source.zip-git://github.com/my_user/my_project.git-git+http://github.com/my_user/my_project.git-git+https://github.com/my_user/my_project.gitparam_sources:-file://path/to/sls_tree-file://path/to/sls_source.zip-git://github.com/my_user/my_project.git-git+http://github.com/my_user/my_project.git-git+https://github.com/my_user/my_project.gitsls_sourcesandparam_sourcescan also be specified from the CLI.$idemstatemy.sls.ref\--sls-sources\"file://path/to/sls_tree"\"file://path/to/sls_source.zip"\"git://github.com/my_user/my_project.git"\"git+http://github.com/my_user/my_project.git""git+https://github.com/my_user/my_project.git"--param-sources\"file://path/to/sls_tree"\"file://path/to/sls_source.zip"\"git://github.com/my_user/my_project.git""git+http://github.com/my_user/my_project.git""git+https://github.com/my_user/my_project.git"RoadmapReference theopen issuesfor a list of
proposed features (and known issues).AcknowledgementsImg Shieldsfor making repository badges easy.
Package: idem-tls
The Idem TLS providerAboutAn Idem plugin to work with TLS keys and certificates.The plugin fetches TLS certificate information for use with other Idem plugins, such asidem-aws, when creating resources that expose TLS services.What is POP?This project is built withpop, a Python-based implementation ofPlugin Oriented Programming (POP). POP seeks to bring together concepts and wisdom from the history of computing in new ways to solve modern computing problems.For more information:Intro to Plugin Oriented Programming (POP)pop-awesomepop-createGetting StartedPrerequisitesPython 3.8+git(if installing from source or contributing to the project)To contribute to the project and set up your local development environment, seeCONTRIBUTING.rstin the source repository for this project.InstallationYou can installidem-tlswith the Python package installer (PyPI) or from source.Install from PyPIpipinstallidem-tlsInstall from Source# clone repogitclonegit@<your-project-path>/idem-tls.gitcdidem-tls# Setup venvpython3-mvenv.venvsource.venv/bin/activatepipinstall-e.UsageSetupAfter installation,idem-tlsexecution and state modules are accessible to the pophub.For more information:Intro to Plugin Oriented Programming (POP)pop hubTo set the TLS method thatidem-tlsuses, configure it in your credentials.yaml file.Credentials foridem-tlsare optional. If you don’t configure a TLS method, the plugin uses TLSv1 by default.credentials.yaml:tls:default:method:TLSv1_2For more about Idem credentials files, including recommended steps for encryption and environment variables, seeAuthenticating with IdemYou are now ready to use idem-tls.Exec ModuleAn SLS file specifies the desired state of a resource. You can run an exec module within an SLS file using theexec.runstate, where the exec module returns a new state that can be referenced with argument binding.Theidem-tlsplugin exec module supports TLS certificategetandlistoperations.tls.certificate.getReturn the root CA certificate for a given URL.tls.certificate.listReturn the certificate chain for a given URL.Syntax:[Idem-state-name]:exec.run:-path:tls.certificate.get-kwargs:url:'string'Example:unmanaged-tls_certificate:exec.run:-path:tls.certificate.get-kwargs:url:https://oidc.eks.us-east-2.amazonaws.com/id/sampleoidc.eks.us-east-2.amazonaws.com/id/sample:aws.iam.open_id_connect_provider.present:name:oidc.eks.us-east-2.amazonaws.com/id/sampleresource_id:oidc.eks.us-east-2.amazonaws.com/id/sampleurl:https://oidc.eks.us-east-2.amazonaws.com/id/sampleclient_id_list:-sample_clientthumbprint_list:-${exec:unmanaged-tls_certificate:sha1_fingerprint}tags:-Key:tag-key-1Value:tag-value-1-Key:tag-key-2Value:tag-value-2Idem command line example:idemexecexec.tls.certificate.listurl=https://oidc.eks.us-east-2.amazonaws.com/id/sampleCurrent Supported Resource Statestlscertificate
Package: idem-vault
AboutVault Cloud Provider for Idemidem-vault source codeidem-vault documentationWhat is Idem?This project is built withidem, an idempotent,
imperatively executed, declarative programming language written in Python. This project extends
idem!For more information:Idem Project WebsiteIdem Project docs portalGetting StartedPrerequisitesPython 3.8+git(if installing from source, or contributing to the project)InstallationNoteIf wanting to contribute to the project, and setup your local development
environment, see theCONTRIBUTING.rstdocument in the source repository
for this project.You can installidem-vaulteither  from PyPI or from source.Install from PyPIpipinstall"idem-vault"Install from sourceClone theidem-vaultrepository and install with pip.# clone repogitclonegit@<your-project-path>/idem-vault.gitcdidem-vault# Setup venvpython3-mvenv.venvsource.venv/bin/activatepipinstall-eidem-vaultSetupAfter installation vault idem provider execution and state modules will be accessible to the pophub.
In order to use them we need to set up our credentials.Create a new file calledcredentials.yamland populate it with profiles.
Thedefaultprofile will be used automatically byidemunless you specify one with–acct-profile=profile_nameon the cli.credentials.yamlvault:default:address:https://vault.example.com:8200token:my_tokenversion:v1Now encrypt the credentials file and add the encryption key and encrypted file path to the ENVIRONMENT.idemencryptcredentials.yamloutput:-A9ZkiCSOjWYG_lbGmmkVh4jKLFDyOFH4e4S1HNtNwI=Add these to your environment:exportACCT_KEY="-A9ZkiCSOjWYG_lbGmmkVh4jKLFDyOFH4e4S1HNtNwI="exportACCT_FILE=$PWD/credentials.yaml.fernetYou are ready to useidem-vault!State ExampleExample of using vault state in SLS:my_state.sls:ensure_sample_exists:vault.sample.present:-name:a_sample_name-description:Managed by IdemCreate sample state:idemstatemy_state.slsDelete sample state:idemstatemy_state.sls--invert
Package: idem-virtualbox
IDEM_VIRTUALBOX# VirtualBox Provider for IdemINSTALLATIONThe virtualbox idem provider can be installed via pip:pip install idem-virtualboxINSTALLATION FOR DEVELOPMENT1. Clone theidem_provider_virtualboxrepository and install with pip:pip install -r requirements.txt2. Runpip install -e <path to provider>from your project’s root directoryYou are now fully set up to begin developing additional functionality for this provider.EXECUTIONAfter installation the Azure Resource Manager Idem Provider execution and state modules will be accessible to the hub.The following example uses a virtualbox state module to ensure the existence of vm:VM exists:
  vbox.present:
    - name: instance_nameUse the command line to run virtualbox specific execution modules:idem exec vbox.list
Package: idem-vmware-alb
Aboutavilb Cloud Provider for Idemidem_vmware_alb source codeidem_vmware_alb documentationWhat is Idem?This project is built withidem, an idempotent,
imperatively executed, declarative programming language written in Python. This project extends
idem!For more information:Idem Project WebsiteIdem Project docs portalGetting StartedPrerequisitesPython 3.8+git(if installing from source, or contributing to the project)InstallationNoteIf wanting to contribute to the project, and setup your local development
environment, see theCONTRIBUTING.rstdocument in the source repository
for this project.You can installidem_vmware_albeither  from PyPI or from source.Install from PyPIpipinstall"idem_vmware_alb"Install from sourceClone theidem_vmware_albrepository and install with pip.# clone repogitclonegit@<your-project-path>/idem_vmware_alb.gitcdidem_vmware_alb# Setup venvpython3-mvenv.venvsource.venv/bin/activatepipinstall-eidem_vmware_albSetupAfter installation avilb idem provider execution and state modules will be accessible to the pophub.
In order to use them we need to set up our credentials.Create a new file calledcredentials.yamland populate it with profiles.
Thedefaultprofile will be used automatically byidemunless you specify one with–acct-profile=profile_nameon the cli.credentials.yamlavilb:default:username:my_userpassword:my_good_passwordendpoint_url:https://console.avilb.com/apiNow encrypt the credentials file and add the encryption key and encrypted file path to the ENVIRONMENT.idemencryptcredentials.yamloutput:-A9ZkiCSOjWYG_lbGmmkVh4jKLFDyOFH4e4S1HNtNwI=Add these to your environment:exportACCT_KEY="-A9ZkiCSOjWYG_lbGmmkVh4jKLFDyOFH4e4S1HNtNwI="exportACCT_FILE=$PWD/credentials.yaml.fernetYou are ready to useidem_vmware_alb!State ExampleExample of using avilb state in SLS:my_state.sls:ensure_sample_exists:avilb.sample.present:-name:a_sample_name-description:Managed by IdemCreate sample state:idemstatemy_state.slsDelete sample state:idemstatemy_state.sls--invert
Package: idem-vultr
IDEM_VULTRVultr Cloud Provider for IdemINSTALLATIONThe vultr idem provider can be installed via pip:pip install idem-vultrINSTALLATION FOR DEVELOPMENT1. Clone theidem_provider_vultrrepository and install with pip:pip install -r requirements.txt2. Runpip install -e <path to provider>from your project’s root directoryYou are now fully set up to begin developing additional functionality for this provider.EXECUTIONAfter installation the Vultr Idem Provider execution and state modules will be accessible to the hub.To authenticate, first create a profile set up like so:vultr:
    default:
        api_key: XXXXXXXXXXXXXXXXXXXX
        location: New Jerseyencrypt this file using theacctplugin:acct acct_profile.ymlIt will create a file called acct_profile.yml.fernet and give you a key for decrypting it.
Put these in the appropriate environment variables:export ACCT_FILE="vultr.yml.fernet"
export ACCT_key="gAAAAAAbjlkjsdkj_lkjlkfsjoj023h_jiosajdf="You can now safely delete the plaintext file containing your api key.
idem knows how to get the credentials it needs.The following example uses an vultr state module to ensure the existence of a resource group:VM exists:
  vultr.server.vm.present:
    - name: instance_name
    - vps_plan: 16384 MB RAM,320 GB SSD,5.00 TB BW
    - os: Ubuntu 20.04 x64Use the command line to run vultr specific execution modules:idem exec vultr.list full=True
Package: idem-windows
Grains, execution modules, and state modules common to all windows systemsINSTALLATIONClone theidem-windowsrepo and install with pip:git clone https://gitlab.com/saltstack/pop/idem-windows.git
pip install -e idem-windowsEXECUTIONAfter installation thegrainscommand should now be availableTESTINGinstallrequirements-test.txtwith pip and run pytest:pip install -r idem_windows\requirements-test.txt
pytest idem_windows\testsVERTICAL APP-MERGINGInstructions for extending idem-windows into another POP project:Install pop:pip install --upgrade popCreate a new directory for the project:mkdir idem_{windows_project_name}
cd idem_{windows_project_name}Usepop-seedto generate the structure of a project that extendsgrains,idem, andstates:pop-seed -t v pop_{specific_windows_system} -d grains exec states“-t v” specifies that this is a vertically app-merged project“-d grains exec states” says that we want to implement the dynamic names of “grains”, “exec”, and “states”Add “idem-windows” to the requirements.txt:echo "idem-windows" >> requirements.txtAnd that’s it!  Go to town making your own unique grains, execution modules, and state modules.
Your new project automatically has access to everything inidem_windowsthrough thehub.
Follow the conventions you see in idem_windows.For information about running idem states and execution modules check outhttps://idem.readthedocs.ioTo read about the hub and learn about POP readhttps://pop.readthedocs.io
Package: idena
This is Python wrapper for Idene Node.Highly inspired byWeb3.pyandcookiecutter-pypackage.InstallationIdena.py can be installed usingpipas follows:$pipinstallidenaFor the development, clone the repository then:$poetryinstallUsing IdenaThis library depends on a connection to an Idena node and there are 2 ways to configure them.Callingclient.init>>>fromidenaimportclient>>>client.init('http://localhost:9009/','api-key')Setting environment variablesSetIDENA_RPC_NODEandIDENA_API_KEYenvars:$exportIDENA_RPC_NODE=http://localhost:9009/$exportIDENA_API_KEY=api-keyGetting Blockchain Info>>>client.blockchain.get_last_block()Block(coinbase='0xbe854231db69ab042073b7ff8309ae3ee265a40f',hash='0xa88e6ab305d7ee311ad2de35338cdbf7e664d860709e5a53f0307baeeaa6f968',parentHash='0xe324a208892241e0294e5a6334965660375dda7a3ad8d8a42a5f3f2ef2857a22',height=2159398,timestamp=1606904853,root='0xd874709bdd4c6fcd95e2e531cc07a4ce42ab23334dfd12ceb45350535b36664c',identityRoot='0x9f3661f19e13d4860f2f2f1610abbbaf86abc8adf1a2781b371189e683745a97',ipfsCid=None,transactions=None,flags=['OfflinePropose'],isEmpty=False,offlineAddress='0x0df427ad7e1906ab4fcc5fd31118932256f5dc7a')
Package: idendrogram
idendrogramidendrogram helps you create nicer, interactive visualizations of hierarchical clustering trees (a.k.a. dendrograms) from clustering outputs generated by your preferred hierarchical clustering library (SciPy, Scikit-learn or HDBSCAN) in your preferred python visualization library (Altair, Plotly or Matplotlib)It also supports bi-directional Streamlit integration via a custom D3-powered component.InstallationTo use the main package:pip install idendrogramTo use the bi-directional Streamlit component:pip install idendrogram idendrogram-streamlit-componentBasic usageimportidendrogramimportscipy.cluster.hierarchyasschfromidendrogram.targets.altairimportto_altair#cluster the datalinkage_matrix=sch.linkage(data['data'],method='single',metric='euclidean')threshold=0.8flat_clusters=sch.fcluster(linkage_matrix,t=threshold,criterion='distance')#wrap clustering outputs / parameters into a containercl_data=idendrogram.ClusteringData(linkage_matrix=linkage_matrix,cluster_assignments=flat_clusters)#pass to idendrogram and visualizeidd=idendrogram.idendrogram()idd.set_cluster_info(cl_data)dendrogram=idd.create_dendrogram(truncate_mode='level',p=10)to_altair(dendrogram=dendrogram,height=200,width=629)For more, see docs athttps://kamicollo.github.io/idendrogram/