Saravanan666/pypi-org huggingface dataset:
Package: cloudmesh-google
Cloudmesh Google Providerssee cloudmesh.cmd5https://github.com/cloudmesh/cloudmesh.cmd5IntroductionCloudmesh-google provider offers various cloud engineering operations via command line.
cloudmesh-google storage module provides following options via command line usingcms storage:create dirputgetlistdeleteAlso following options are available via command line usingcms google:json_to_yaml (adds json file information to yaml)yaml_to_json (creates a json file from yaml entry)list_bucketcreate_bucketblob_metadatarename_blobcopy_blob_btw_bucketsInstallationRefer installation of cloudmesh-google:https://cloudmesh.github.io/cloudmesh-manual/accounts/google/google.html#instaltion-of-cloudmesh-google-providersReferencesGoogle account creationhttps://cloudmesh.github.io/cloudmesh-manual/accounts/google.htmlSpecificationsgoogle-cloud-storagejson{
      "type": "service_account",
      "project_id": "imposing-coast-257700",
      "private_key_id": "xxxxxxxx....",
      "private_key": "-----BEGIN PRIVATE KEY-----\nxxxxxxxxxx\n-----END PRIVATE KEY-----\n",
      "client_email": "user@imposing-coast-257700.iam.gserviceaccount.com",
      "client_id": "12345678...",
      "auth_uri": "https://accounts.google.com/o/oauth2/auth",
      "token_uri": "https://oauth2.googleapis.com/token",
      "auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
      "client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/" \
                              "user%40imposing-coast-257700.iam.gserviceaccount.com"
    }API ReferenceUsing API through Google API Python Client:from googleapiclient.discovery import build

compute = build('compute', 'v1', developerKey=apiToken) #Multiple API versions, I assume v1 is the one we want to use

instances = compute.instances() #Holds operations for working with specific instances
instances.list() #List available instances
instances.delete(project, zone, instance) # Delete specific instance
#Etc.API reference:http://googleapis.github.io/google-api-python-client/docs/dyn/compute_v1.html
Package: cloudmesh-gui
Cloudmesh Configuration with a GUIsee cloudmesh.cmd5https://github.com/cloudmesh/cloudmesh.cmd5This component allows you to edit the cloudmesh.yaml file via a simple
GUI form.The manual page isgui activate
  gui profile
  gui cloud CLOUD [--show]
  gui edit KEY [--show]If you use --show the passwords are shown in the form otherwise they are
blended out with a *For cloudmesh to work you need to editthe profileactivate the cloud you like to useand add things such as usernames, passwords and other parametersNext we provide some examples to achive these tasks and include a
screenshot:cmsguiprofilecmsguiactivatecmsguieditcloud.chameleon.credentialsorcmsguicloudchameleonIn case you like to edit all parameters for a compute cloud you can usecmsguieditcloud.chameleon
Package: cloudmesh-jupyter
Documentationsee cloudmesh.cmd5https://github.com/cloudmesh/cloudmesh.cmd5$pipinstallcloudmesh-jupyter$cmshelpjupytercms jupyter

  Usage:
        jupyter start USER HOST PORT [DIR]
        jupyter tunnel USER HOST PORT
        jupyter stop USER HOST
        jupyter open PORT

  This command can start a jupyter notebook on a remote machine and
  use it in your browser.

  Arguments:
     USER   The username on the remote machine
     HOST   The hostname of the remote machine
     PORT   The port of the remote machine
     DIR    The directory where the notebooks are located

  Description:

    Step 1: Setting up a .bash_profile file

     If you have your python venv set up you need to add it to the
     .bash_profile on your remote machine. A possible
     profile file could look as follows:

        if [ -f ~/.bash_aliases ]; then
             . ~/.bash_aliases
         fi

         export PATH=$HOME/ENV3/bin:$PATH
         source $HOME/ENV3/bin/activate

    Step 2: Start the remote notebook server in a terminal

        Note: After the start you will not be able to use that terminal

        cms jupyter start USER HOST PORT

        Thsi command will aslo establich an SSH tunel and open in
        the web browser jupyter lab
Package: cloudmesh-multipass
Documentationsee cloudmesh.cmd5https://github.com/cloudmesh/cloudmesh.cmd5InstalationNote:cloudmesh-installermust be called within the cm directory.you must run in a python3 venvmkdircmcdcm
pipinstallcloudmesh-installer
cloudmesh-installergitclonemultipass
cloudmesh-installerinstallmultipass
cmshelpcmshelpmultipassYou can modify cloudmesh-multipass in its directory.
Package: cloudmesh-oracle
Documentationsee cloudmesh.cloudhttps://github.com/cloudmesh/cloudmesh-cmd5Oracle Compute Cloud interfaceWe provide the Oracle Cloud Compute interfacesGetting an AccountTBDOracle Cloud Python interfaceCloudmesh ConfigAdd the following entry to you cloudmesh.yaml file:cloudmesh:
  compute:
    oracle:
      cm:
        active: true
        heading: ORACLE
        host: cloud.oracle.com
        label: oracle
        kind: oracle
        version: TBD
        service: compute
      default:
        image: ami-0f65671a86f061fcd
        size: t2.micro
      credentials:
        user : TBD
        fingerprint : TBD
        key_file : ~/.oci/oci_api_key.pem
        pass_phrase : TBD
        tenancy : TBD
        compartment_id : TBD
        region : us-ashburn-1TBD. describe how we use cloudmesh configdesign an entryIn prg you useconfig = Config["cloudmesh.cloud.oracle"]to get oracle configuration from cloudmesh.yamlList Flavorspoint to example prg examples/flavors.py
use cloidmesh.yamlList Imagespoint to example prg examples/images.py
use cloidmesh.yamlList VMspoint to example prg examples/vms.py
use cloidmesh.yamlBoot VMspoint to example prg examples/boot.py
use cloidmesh.yamlNaturally you nee to deal with keys and secgroups also...Referenceshttps://oracle-cloud-infrastructure-python-sdk.readthedocs.io/en/latest/https://oracle-cloud-infrastructure-python-sdk.readthedocs.io/en/latest/api/core/client/oci.core.ComputeClient.htmlhttps://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/pythonsdk.htmhttps://github.com/oracle/oci-python-sdkhttps://github.com/oracle/oci-python-sdk/blob/master/examples/launch_instance_example.pyhttps://github.com/cloudmesh-community/fa19-516-162/blob/master/project/report.md
Package: cloudmesh-pearl
DocumentationThis command will help you to interact with pearl from a remote machine easily and allow you to develop jupyter
notebooks locally on your computer that you then execute on pearl.The implementation is based on cloudmesh and allows convenient execution either from the cloudmesh shell or a terminal.INstalation on your local ComputerTo use the command you have to install it with pip in python3 virtualenv on your local computer.If you do not have a venv you can create one on Linux with$python3-mvenv~/ENV3
$source~/ENV3/bin/activatepipinstallcloudmesh-pearl-Uand on Windows with$python-mvenv~/ENV3
$\ENV3\Script\activatepipinstallcloudmesh-pearl-UTest out if the install was successful withcms helpInstallation on PearlAfter your first logi with regular ssh please execute the following commandsmodule load Python/3.7.4-GCCcore-8.3.0
python --version
python -m venv ENV3
source ~/ENV3/bin/activate
pip install jupyterlab
pip install pip -U
pip install matplotlibThis will create a python3 venv in the directory ~/ENV3Now, please replace the .bashrc and .bash_profile files on perl with the following content:# .bashrc and .bash_profile

# Source global definitions
if [ -f /etc/bashrc ]; then
	. /etc/bashrc
fi

# Uncomment the following line if you don't like systemctl's auto-paging feature:
export SYSTEMD_PAGER=

# User specific aliases and functions

source /etc/profile
module load Python/3.7.4-GCCcore-8.3.0

source ~/ENV3/bin/activate

PATH=$HOME/.local/bin:$HOME/bin:$PATHUsing notebooks on your local computerManual PageYou can see the manual page withcms pearl helpSet up the pearl userTo simplify the setup, you will activate your username (we assuume your key is in~/.ssh/id_rsa)cms pearl user pearl????where ??? needs to be replaced with the username number you got from the adminitsrtaorNext we want to test if you can login withcms pearl sshRunning notebooksIf this works, pleas log out and we can now test a notebook.For simplicity we place all notebooks in the directory ~/notebooks on your local machinePlease copy the Simple notebook fromhttps://raw.githubusercontent.com/cloudmesh/cloudmesh-pearl/main/example/Simple.ipynbinto the folder ~/notebooksNext, execute it withcd ~/pearl
cms pearl notebook Simple.ipynb --forceThis script will do several thingsIt will create a batch script for executing the notebook in the batch queuing systemIt will copy the notbook and the script via an rsync command to pearlIt will submit the batch script and print information about the processNow the script is executed.YOu can check the status in the queue withcms pearl queueIf you do not see your job anymore in it, it is already completed.To fetch the results you can do this withcms pearl sync getThis fetches the entire content of the notebooks directory that is stored on pearl.The output of the notebook not only creates a log file under the slurm job id, but also creates a new notebook
that you can view on your local computer when you open the fileSimple-output.ipynbOpen it in jupyter-labPlease note that the contents of these files are overwritten and if you want to save them you
have to place them into a backup directory.
Package: cloudmesh-piazza
Piazza provides a free Q&A platform that is often used in class
settings. It is superior to other systems, but has at this time one
major flaw. There is no official mechanism to access piazza through
python or an API. Thus we have started a small project that simplifies
access for us.This is a prototype and needs many improvements. If you like to work
with us let us know your improvements via pull requests and we add
them. At present this is hosted at gitlab, but we may move soon to github.Setup from Developmentgit clonegit@gitlab.com:cloudmesh/piazza.gitorgit clonehttps://gitlab.com/cloudmesh/piazza.gitThencd piazza
python setup.py install
piazzaSetupPlace a .piazza file in the directory where you like to do that piazza
analysis. It is a yaml file of the following formatpiazza:email: <PUT YOUR EMAIL YOU USE IN PIAZZA HERE>
password: <PUT YOUR PASSWORD THAT YOU USE IN PIAZZA HERE>
id: <PUT THE ID OF THE PIAZZA PROJECT HERE, NOT YET SUPPORTD CHANGE FOR NOW IN CODE>UsageDownload all main post (not responses) from a folder where d1 is the
folder namepiazza list d1This will create a file called d1.json. Next print the post in htmlpiazza convert d1 –htmlThis will produce a file called d1.html. Next view it with your
browser, on OSX you can say simplyopen d1.htmlTODOLots of things have to be done.[ ] update the format to eiminate non ascii characters[ ] replace user ids with names[ ] add user management[ ] consider using piazza_api[ ] statistics for posts[ ] integrate responses with flag[ ] export to latex[ ] implement find/search
Package: cloudmesh-rivanna
Documentationsee cloudmesh.cmd5https://github.com/cloudmesh/cloudmesh.cmd5Jupyter on rivanna# cms vpn connect
local>
  cms rivanna a100
a100>
  # source your ENV3
  pip install pip -U
  pip install jupyterlab 
  pip install jupyterrivanna>
  pip install pip -U
  pip install jupyterlab
  pip install notebookManual PageCommand rivanna
===============

::

  Usage:
        rivanna storage info DIRECTORY [--info]
        rivanna login [--sbatch=SBATCH] [--host=HOST] [KEY] [--debug]
        rivanna slurm info
        rivanna slurm [--sbatch=SBATCH] [--host=HOST] [KEY] [--debug]
        rivanna tutorial [KEYWORD]
        rivanna vpn on
        rivanna vpn off
        rivanna vpn info
        rivanna vpn status
        rivanna ticket
        rivanna image build DEFFILE
        rivanna jupyter --port=PORT

  This command simplifys access to rivanna.

  Arguments:
      DIRECTORY  a location of a directory on rivanna

  Options:
      -f      specify the file

  Description:

    rivanna storage info DIRECTORY [--info]
        A command that can be executed remotely and obtains information about the storage associated
        with a directory on rivanna

    rivanna login [--allocation=ALLOCATION] [--gres=GRES] [--cores=CORES] [--host=HOST] [--constraint=CONSTRAINT] [--reservation=RESERVATION] [--time=TIME]
        A command that logs into from your current computer into an interactive node on rivanna
        with a given GPU. Values for GPU are

        a100 or a100-80 -- uses a A100 with 80GB
        a100-40 -- uses a A100 with 40GB
        a100-localscratch  -- uses a A100 with 80GB and access to localscratch

        others to be added from rivannas hardware description

    rivanna tutorial apptainer
        shows the rivanna apptainer documentation on the UVA website

    rivanna tutorial hpc
        shows the general rivanna hpc information on infomall.org

    rivanna tutorial pod
        shows the general rivanna pod information on infomall.org

    rivanna tutorial globus
        shows the general rivanna globus information on infomall.org

    rivanna tutorial rclone
        shows the general rivanna rclone information on infomall.org

    rivanna vpn on
        switches the vpn on

    rivanna vpn off
        switches the vpn off

    rivanna vpn info
        prints the information about the current connection to the
        internet. INformation includes

          "ip": "128.143.1.11",
          "hostname": "vpn-user-1-11.itc.virginia.edu",
          "city": "Charlottesville",
          "region": "Virginia",
          "country": "US",
          "loc": "38.0293,-78.4767",
          "org": "AS225 University of Virginia",
          "postal": "22902",
          "timezone": "America/New_York",
          "readme": "https://ipinfo.io/missingauth"

    rivanna vpn status
        prints True if vpn is enabled, False if not


  Installation:

    pip install cloudmesh-rivana
    cms help
Package: cloudmesh-ssh
Cloudmesh Command sshManual PageCommand ssh
===========

::

    Usage:
        ssh config list [--output=OUTPUT]
        ssh config add NAME IP [USER] [KEY]
        ssh config delete NAME

    Arguments:
      NAME        Name or ip of the machine to log in
      list        Lists the machines that are registered and
                  the commands to login to them
      PARAMETERS  Register te resource and add the given
                  parameters to the ssh config file.  if the
                  resource exists, it will be overwritten. The
                  information will be written in /.ssh/config
      USER        The username for the ssh resource
      KEY         The location of the public keye used for
                  authentication to the host

    Options:
       --output=OUTPUT   the format in which this list is given
                         formats includes cat, table, json, yaml,
                         dict. If cat is used, it is just printed as
                         is. [default: table]

    Description:
        ssh config list
            lists the hostsnames that are present in the ~/.ssh/config file

        ssh config add NAME IP [USER] [KEY]
            registers a host i ~/.ssh/config file
            Parameters are attribute=value pairs

        ssh config delete NAME
            deletes the named host from the ssh config file

    Examples:

         ssh config add blue 192.168.1.245 gregor

             Adds the following to the !/.ssh/config file

             Host blue
                  HostName 192.168.1.245
                  User gergor
                  IdentityFile ~/.ssh/id_rsa.pub
Package: cloudmesh-storage
Cloudmesh Storage ModuleNote: Do not modify the shield, once we release the storage module they will workRequirementsPlease note that several packages are available which are pointed to
in the installation documentation.LinksDocumentationhttps://cloudmesh.github.io/cloudmesh-manualCodehttps://github.com/cloudmesh/cloudmesh-storageInstalation Instructionshttps://github.com/cloudmesh/cloudmesh-installerAn dynamically extensible CMD based command shell. For en extensive
documentation please seehttps://github.com/cloudmesh-community/book/blob/master/vonLaszewski-cloud.epub?raw=truewhere we also document how to use pyenv.InstallationSeehttps://github.com/cloudmesh/cloudmesh-installer
Package: cloudmesh-sys
Cloudmesh SysCloudmesh sys is a command that allows the generation of new plugin
commands to cmd5. For more details we like you to look at thecloudmesh.cmd5manual and thecloudmesh.manualpages athttps://github.com/cloudmesh/cloudmesh.cmd5https://cloudmesh.github.io/cloudmesh-manualAcknowledgmentsContinued work was in part funded by the NSF
CyberTraining: CIC: CyberTraining for Students and Technologies
from Generation Z with the awadrd numbers 1829704 and 2200409.
Package: cloudmesh_vagrant
Virtualbox provides a vonvenient way to manage virtual machines on a
local computer. Graphical user interfaces, a commandline client, but
also vagrant exist to access them. However we noticed that we often
only need a very small subset to start a vm and to tear it
down. Remembering the interfaces is difficult. Previously we developed
a cloudmesh_client that has an easy to remember interface. We leverage
from this experience and introduce a very easy to remember commandline
client. At the same time we also allow a simpl python API to manage
virtual machines on virtualbox. We use vagrant internally. However
vagrants focus on directories and Vagrantfiles in a bit inconvenient
also fo us, so we provided wrappers and utelize the design of vagrant
to our advantage while only exposing the needed functionality.Manual PageUsage:
  cm-vbox version [--format=FORMAT]
  cm-vbox image list [--format=FORMAT]
  cm-vbox image find NAME
  cm-vbox image add NAME
  cm-vbox vm list [--format=FORMAT] [-v]
  cm-vbox vm delete NAME
  cm-vbox vm config NAME
  cm-vbox vm ip NAME [--all]
  cm-vbox create NAME ([--memory=MEMORY]
                       [--image=IMAGE]
                       [--script=SCRIPT] | list)
  cm-vbox vm boot NAME ([--memory=MEMORY]
                        [--image=IMAGE]
                        [--port=PORT]
                        [--script=SCRIPT] | list)
  cm-vbox vm ssh NAME [-e COMMAND]
  cm-vbox -h | --helpSource Codegithub.com/cloudmesh/vagrantPrerequisitsMake sure you have the python development libraries and pip installedUbuntusudo apt-get install python-dev
sudo apt-get install python-pipInastall from pippip install cloudmesh_vagrantInstall from githubmkdir cloudmesh
cd cloudmesh
git clone https://github.com/cloudmesh/vagrant
cd vagrant
python setup.py installExamplesListing vmsList the vms:cm-vbox vm listnamestateidproviderdirectoryw12
w1running
running47347b4
db913ddvirtualbox
virtualbox~/w12
~/w1Listing imagesList the images:cm-vbox image listnameproviderdateubuntu/trusty64virtualbox20160406.0.0Booting vmsStart a vm while taking an ubuntu image as default:cm-vbox vm boot w12LoginTo login into a vm you can use the ssh command followed by the VM:cm-vbox vm ssh w12where w12 is the name of the vm.Executing a commandTo just execute a command, use:cm-vbox vm ssh w12 -e unameDestroy a vmDeletes the specified vm:cm-vbox vm delete w12Create a VagrantfileCreates a Vagrantfile in ./w12/Vagrantfile:cm-vbox create w12Destroy the directory of the vmAssume you like to destroy also the directory with all information about the previously
run vm you can simple delete it with rm:cm-vbox vm delete w12
rm -r w12Please not that wen you delet the directory the list command will automatically remove
it from the available vms. Hoewver before you delete it is advisable to destroy the vm
so you do not have the vm any longer running.
Package: cloudmitigator-semantic
CloudMitigator SemanticAllows you to manage versioning and releases using git tags as the source of truth. No more manual bumping
of version files. CloudMitigator Semantic allows the user to control releases via commit messages. All the rest is handled for you.
Just use trigger words listed below, and if a word is detected, a release will be automatically completed. Incrementing the specified number.Major release:Major:major:Minor release:Minor:minor:Patch release:Patch:patch:Trigger words can also be modified through the inclusion of a semantic.yml.major:
  - "major:"
  - "breaking:"

minor:
  - "minor:"

patch:
  - "patch:"Installation:Runpip install cloudmitigator_semanticThis will install a script calledsemanticUsage:Runsemantic --helpfor a list of commands that can be run.semantic versionwill return the latest git tag version if it has been changed, or the current git tag version if unchanged.v0.0.1semantic changedwill return a boolean on whether or not the version has been incremented.FalseRequirements:Must run command within a directory that has git initialized.If no version tag is specified then a default of v0.0.0 will be given. Make sure to tag your repo if you wish to start at a different seed number.This module is only compatible with 'v' tagging. This means '0.0.0' will not be recognized where 'v0.0.1' will be.This is meant to be run as part of a github action. Please see the sample implementation for an example.
Package: cloudml
A set of tools that allow building a classifier on the cloud.It consists of three components:Import handler: a utility module which is responsible for feeding the trainer and the predictor with data.Trainer: which receives data from the import handler and trains a classifier to produce a classification model.Predictor: which uses a model produced by the trainer in order to predict the class of incoming requests.The Latest VersionDetails of the latest version can be found on the CloudML project GitHub page:https://github.com/odeskdataproducts/cloudml.DocumentationThe documentation availablehere.InstallationPlease see the documentation page called install. The platform specific notes also could be found in this page.LicensingPlease see the file called LICENSE.
Package: cloudml-hypertune
Helper Functions for CloudML Engine Hypertune Services.PrerequisitesGoogle CloudML EngineOverview.Google CloudML EngineHyperparameter Tuning
Overview.InstallationInstall viapip:pip install cloudml-hypertuneUsageimporthypertunehpt=hypertune.HyperTune()hpt.report_hyperparameter_tuning_metric(hyperparameter_metric_tag='my_metric_tag',metric_value=0.987,global_step=1000)By default, the metric entries will be stored to/tmp/hypertune/outout.metricin json format:{"global_step": "1000", "my_metric_tag": "0.987", "timestamp": 1525851440.123456, "trial": "0"}LicensingApache 2.0
Package: cloudmon
# CloudMonCloudMon is a monitoring orchestrator for clouds. Cloudmon integrates directly an IaaS plataform (currently works with Apache CloudStack and AWS EC2) with a monitoring plataform (Zabbix).On the fly, CloudMon will:create, delete or change status of zabbix hosts (each host corresponds to an IaaS VM) and even update its configurations (templates, hostgroups, macros…) replicating the changes (created/removed/stopped) ocurred within the VMs.Read VMs [resource tags](Tags.md) and take different actions based on its values.Associate zabbix hosts to predefined templates or hostgroups.Simultaneously monitor multiple Cloud regions (different or same IaaS).CloudMon works as a Python Daemon that retrieves IaaS data through CloudStack API, AWS EC2 API and/or its event queues, processing that data and taking the proper action in Zabbix through the Zabbix API.CloudMon requires a Zabbix Agent installed to ensure proper functionality.CloudMon has been tested and used in CentOS environments and Python 2.7.## Getting StartedRead the [documentation](https://cloudmon.readthedocs.io)Recommended to create a python virtualenv for CloudMon.Install viapip install cloudmon.Edit yourcloudmon.conffile for your needs. See [Configuration](Configuration.md).Create and edit one or more [managers](Managers.md).Edit /etc/init.d/cloudmon if needed.Run CloudMon with:cloudmonor/etc/init.d/cloudmon start | stop | restart. See [Usage](Usage.md).## Success StoriesCloudMon has been successfully used by Globo.com to monitor its Cloud Infrastructure.# Changelog
All notable changes to this project will be documented in this file.The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).