Saravanan666/pypi-org huggingface dataset:
Package: bucketman
bucketmanA terminal application for exploring and interacting (coming soon) with S3 buckets.Installation$pipinstallbucketman
$bucketman--helpAuthenticationbucketman uses the boto3 library for interacting with your S3 buckets. Thus it supports the same ways ofproviding your credentials.Additionally you can pass your access and secret key using the--access-key-idand--secret-access-keyparameters as well as providing a custom endpoint URL with--endpoint-urlfor non-AWS S3 buckets.Featuresbrowse through S3 bucketsswitch between S3 bucketsbrowse through local directoriesdelete S3 objectsupload files to S3download files from S3Planned featurescopy files from one S3 bucket to anothermove/rename S3 objectsset ACL and metadata of S3 objectsview file contentsupport S3 bucket paginationFileDrop support for uploading filessafe mode disabling all destructive actions
Package: bucket-pull
bucket-pullSmall CLI command to download a bucket directory locally.Aims to simulategsutil cp -rwhen copying from a bucket to local path.# download whole bucket to a local dir
bucket-pull gs://mybucketname ./mybucketname

# download a directory and all it's content to a local dir
bucket-pull gs://mybucketname/mydir ./Get itpip install bucket-pullhttps://pypi.org/project/bucket-pull/Run it# as cli 
$ bucket-pull gs://mybucketname ./mybucketname

# as a module
$ python -m bucket_pull gs://mybucketname ./mybucketnameAuth & PermissionsThe utility makes use of the Google SDK and usesClient-Provided AuthenticationTo run with exported SA key, you can make use of the GOOGLE_APPLICATION_CREDENTIALS environmental variableGOOGLE_APPLICATION_CREDENTIALS=/path/to/sa-credentials.json  bucket-pull gs://bucket/mydir /tmp/some/pathThe account you are connecting with will need at leaststorage.buckets.geton the bucket, which can be granted with theroles/storage.legacyBucketReader.gsutil iam ch serviceAccount:SERVICEACCOUNT@PROJECT.iam.gserviceaccount.com:legacyBucketReader  gs://bucketSome noteable differencesgsutil seems to have this somewhat weird behaviour when the destination path doesn't exist$ gsutil cp -r  gs://smoss-tech-test-bucket/mydir/ ./doesnotexist/actually/
$ echo $?
0
$ ls ./doesnotexist
ls: cannot access './doesnotexist': No such file or directoryIt will not create the destination path (not that weird)but it won't complain either and end exits with 0.Here bucket-pull diverge and throws an error instead.Notes on multi-processingWith the-mflag we can enable multi-processing.Herebucket-pullhas opted for using thethreading.So, nottrueparalellism and we only ever make use of one CPU.However, since we are mostly IO bound (disk and network) there isstill some gain to be had by using multiple threads waiting for IO."very" scientific comparison:# with multithreading
time ./bucket-pull.py gs://smoss-tech-test-bucket/mydir /tmp/ -m
...
Downloading to /tmp/mydir/32mb.file
Downloading to /tmp/mydir/128mb.file
Downloading to /tmp/mydir/64mb.file
Downloading to /tmp/mydir/a/1.txt
Downloading to /tmp/mydir/a/b/2.txt
./bucket-pull.py gs://smoss-tech-test-bucket/mydir /tmp/ -m  5.86s user 5.24s system 22% cpu 50.149 total

# single thread
time ./bucket-pull.py gs://smoss-tech-test-bucket/mydir /tmp/ 
...
Downloading to /tmp/mydir/128mb.file
Downloading to /tmp/mydir/32mb.file
Downloading to /tmp/mydir/64mb.file
Downloading to /tmp/mydir/a/1.txt
Downloading to /tmp/mydir/a/b/2.txt
./bucket-pull.py gs://smoss-tech-test-bucket/mydir /tmp/  4.80s user 4.38s system 12% cpu 1:13.83 total
Package: bucketshunter
BucketsHunter ☁️🪣BucketsHunter is an opensource tool to find Open Buckets, Misconfigured Permissions and dump bucket's contents.InstallationFrom source:gitclonehttps://github.com/DanielAzulayy/BucketsHunter.gitcdBucketsHunter
python3-mpipinstall-rrequirements.txt
python3-mBucketsHunterFeatures ⚡️Scans all buckets permissions & finds misconfigurationsFast multi threaded scanningUI friendly - supports JSON scan results to a local folderBuckets Regions supportCloud Providers Support ️️ ☁️AWSAzureGCPDigitalOcean (soon)Linode (soon)Alibaba Cloud (soon)Wasabi (soon)ContributingPull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.Please make sure to update tests as appropriate.AuthorsDaniel Azulay -danielazulayyLicenseMIT
Package: bucketstore
bucketstoreis a very simple Amazon S3 client, written in Python. It
aims to be much more straight-forward to use than boto3, and specializes
only in Amazon S3, ignoring the rest of the AWS ecosystem.FeaturesTreats S3 Buckets as Key/Value stores.Automatic support forAWS_ACCESS_KEY_ID,AWS_SECRET_ACCESS_KEY,
andAWS_DEFAULT_REGIONenvironment variables.Easily make keys (or entire buckets) publically accessable.Easily get the public URL for a given key.Generates temporary URLs for a given key.Use S3 in a pythonic way!UsageInstallationpipinstallbucketstoreGet (or create) a bucket, easily:importbucketstore# Create the bucket if it doesn't exist.bucket=bucketstore.get('bucketstore-playground',create=True)Treat the bucket like a key/value store:>>>bucket<S3Bucket name='bucketstore-playground'># get/set using array syntax>>>bucket['foo']='bar'>>>bucket['foo']bar# get/set using methods>>>bucket.set('foo2','bar2')>>>bucket.get('foo2')bar2# list keys>>>bucket.list()[u'foo', u'foo2']# all keys>>>bucket.all()[<S3Key name=u'foo' bucket='bucketstore-playground'>, <S3Key name=u'foo2' bucket='bucketstore-playground'>]# check if a key exists in the bucket>>>'foo'inbucketTrue# delete keys in the bucket>>>delbucket['foo2']{}Interact with S3 keys:>>>bucket.key('foo')<S3Key bucket='bucketstore-playground' name=u'foo'>>>>foo=_>>>foo.set('new value')# Generate a temporary share URL.>>>foo.temp_url(duration=1200)u'https://bucketstore-playground.s3.amazonaws.com/foo?AWSAccessKeyId=AKIAI2RVFNXIW7WS66QQ&Expires=1485493909&Signature=L3gD9avwQZQO1i11dIJXUiZ7Nx8%3D'# Make key publically accessable.>>>foo.make_public()>>>foo.url'https://s3.amazonaws.com/bucketstore-playground/foo'# Get / set metadata for key.>>>foo.meta={'foo':'bar'}>>>foo.meta{'foo': 'bar}# Rename key to 'foo3'.>>>foo.rename('foo3')# Delete the key.>>>foo.delete()# Create a key with a content type>>>foo=bucket.key('foo.html')>>>foo.set('<h1>bar</h1>',content_type='text/html')# upload to key>>>bucket.key('test.py').upload('/tmp/test.py')# or upload with a file-like object! (make sure it's open in binary mode)>>>withopen('/tmp/test.py','rb')asfile:>>>bucket.key('test.py').upload(file)# download to file>>>bucket.key('test.py').download('/tmp/test.py')# or download to a file-like object! (make sure it's open in binary mode)>>>withopen('/tmp/test.py','wb')asfile:>>>bucket.key('test.py').download(file)# size of key>>>bucket.key('test.py').size()>>>len(bucket.key('test.py'))15Other methods includebucketstore.login(access_key_id, secret_access_key),bucketstore.list(), andbucketstore.get(bucket_name, create=False).TestsTests are run throughTox.# Run tests against all environments.$tox# Run against a specific version.$tox-epy310# Run with pytest arguments.$tox----pdb✨🍰✨
Package: buckeye
This package is for iterating through theBuckeye Corpusannotations in Python. It
uses the annotation timestamps to cross-reference the .words, .phones, and
.log files, and can be used to extract sound clips from the .wav files. It is
tested to work with Python 2.7 and 3.6.UsageThere is a short guide to using the package in theQuickstartnotebook, and the docstrings inbuckeye.py,containers.py, andutterance.pyhave more detail.InstallationThe package can be installed from PyPI with pip with this command:pip install buckeyeThe latest version can also be installed from GitHub with pip with this
command:pip install git+http://github.com/scjs/buckeye.gitYou can also copy thebuckeyesubdirectory into your working
directory, or put it in your Python path.TestsTo run the tests, runnosetestsfrom the root directory, orpython setup.py testto install the test dependencies first.ReferencesPitt, M.A., Dilley, L., Johnson, K., Kiesling, S., Raymond, W., Hume, E.
and Fosler-Lussier, E. (2007) Buckeye Corpus of Conversational Speech
(2nd release) [www.buckeyecorpus.osu.edu] Columbus, OH: Department of
Psychology, Ohio State University (Distributor).
Package: buckle-up
buckle-up by m4rkwA python toolbox for writing macOS sandbox profiles.installationpip3 install buckle-upmonitor all sandbox eventsbu -p allmonitor sandbox events for specific processesbu -p 'Slack,Slack Helper'write denied actions to a sandbox profile filebu -p 'Slack,Slack Helper' -o slack.sbknown issuesdeny events are de-duped but written verbatim from the system log into the
output sandbox profile. this means that all file references are entered as
"literal" and other actions such as signals will not be in a valid format so
some manual tidying will be necessary.
Package: buck.pprint
Python’s standard library contains a pretty print module (pprint), but it’s
output is in a very odd style.  This project is a fairly straightforward fork
which aim to create output suitable for use in python code with standard
formatting.I copied both pprint.py and test_pprint.py from the cpython (2.6) code base,
and made the minimal changes to make things work, and all the tests pass. The
result should be equally reliable as the stdlib pprint library.>>> example_obj = {1:2, 3:4, 'range':range(3)}
>>> example_obj['range'].append(range(5))
>>> example_obj['range'].append(range(20))>>> import buck.pprint
>>> buck.pprint.pprint(example_obj)
{
    1: 2,
    3: 4,
    'range': [
        0,
        1,
        2,
        [0, 1, 2, 3, 4],
        [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19],
    ],
}This is how I’d format this object in my own code. Below is the formatting that
the standard pprint gives. I believe you’ll agree that it’s not a style you’ve
ever seen in real python code.>>> import pprint
>>> pprint.pprint(example_obj)
{1: 2,
 3: 4,
 'range': [0,
           1,
           2,
           [0, 1, 2, 3, 4],
           [0,
            1,
            2,
            3,
            4,
            5,
            6,
            7,
            8,
            9,
            10,
            11,
            12,
            13,
            14,
            15,
            16,
            17,
            18,
            19]]}History0.02013-03-28 – Initial release.
Package: buckshot
Thebuckshotlibrary contains multiprocessing functions designed to help
developers create distributed applications quickly.InstallationThe easiest way to installbuckshotis viapip:$ pip install buckshotUsageCurrently, there are two ways of leveragingbuckshotto distribute work
across processes: the@distributedecorator andwithdistributed(...)context manager.The following example shows how we can distibute the work of calculating
many harmonic sum values across processes.Serial Approachimport fractions

def harmonic_sum(x):
    F = fractions.Fraction
    return sum(F(1, d) for d in xrange(1, x + 1))

for value in range(1, 100):
    result = harmonic_sum(value)
    print resultUsing@distributeimport fractions

from buckshot import distribute

@distribute(processes=4)
def harmonic_sum(x):
    F = fractions.Fraction
    return sum(F(1, d) for d in xrange(1, x + 1))

for result in harmonic_sum(range(1, 100)):  # Pass in values list.
    print resultUsingwithdistributed(...)import fractions

from buckshot import distributed

def harmonic_sum(x):
    F = fractions.Fraction
    return sum(F(1, d) for d in xrange(1, x + 1))

with distributed(harmonic_sum, processes=4) as distributed_harmonic_sum:
    for result in distributed_harmonic_sum(range(1, 100)):
        print resultAll processes are destroyed when inputs are exhausted and/or the context is exited.Known IssuesFunction inputs must be picklable.Function outputs must be picklable.If a child process is killed externally,buckshotwill block forever waiting
for results.This usesos.fork()under the hood, so there is a risk of rapidly exhausting
memory.LICENSERead the LICENSE file for details.
Package: buckup
buckupCreate S3 bucket, policy and user with one command. After creation it is ready
to use on your project.FeaturesCreate bucketEnableversioningSetCORSCreate user and generate access key pair and give it permissions to the
bucket.Set policy to enables3:GetObjectpermission on every object in your bucket to the public.DependenciesPython 3boto3InstallationPyPI (pip)python3-mpipinstallbuckupArch User RepositoryBuckupcan be found on AUR.cd/tmpgitclonehttps://aur.archlinux.org/buckup.gitcdbuckupmakepkg-siHomebrewBuckup can be installed from Torchbox’sHomebrew tap.brewtaptorchbox/tapbrewinstallbuckupDevelopment buildYou can easily install buckup inside a virtual environment and work on it
there, e.g.gitclonegit@github.com:torchbox/buckup.gitcdbuckuppython3-mvenvvenvsourcevenv/bin/activatepipinstall-e.buckupUsageFirst you need an AWS account. You need programmatic access key to use it
with buckup.If you haveAWS CLIinstalled,
you can save your credentials withaws configure; oryou can setAWS_ACCESS_KEY_IDandAWS_SECRET_ACCESS_KEYenvironment variable containing your credentials.Readboto3 documentationfor more detail.If you want to restrict your access only to essential credentials to use
buckup, please set them to:iam:ListAccountAliases(not required to use)s3:PutBucketPolicys3:CreateBucketiam:GetUseriam:CreateUsers3:PutBucketCORSs3:PutBucketVersioningiam:CreateAccessKeyAfter you set that up, you can typebuckupand that should open the
prompt.If you want to specify other than the default region, please use--regionflag withbuckup, e.g.buckup--regioneu-west-2.After you answer all the questions you should obtain your bucket details
that are ready to use in your application.
Package: bucky-covid
Bucky ModelDocumentationDeveloper GuideThe Bucky model is a spatial SEIR model for simulating COVID-19 at the county level.Getting StartedRequirementsThe Bucky model currently supports Linux and OSX and includes GPU support for accelerated modeling and processing.gitmust be installed and in your PATH.GPU support requires a cupy-compatible CUDA installation. See theCuPy docsfor details.InstallationStandard installation:pipinstallbucky-covidChoose a working directoryBucky will produce multiple folders for historical data and outputs. It's recommended to put these in their own directory, for example~/buckyBUCKY_DIR=~/bucky
mkdir$BUCKY_DIRcd$BUCKY_DIRConfigurationThe default configuration for bucky is locatedhere. Currently, you can locally modify these options by creating abucky.ymlinBUCKY_DIRthat will override any of the default options specified in it.TODO this is WIP and does not work yet:To use a customized configuration you first need to make a local copy of the bucky configuration. In your working directory:buckycfginstall-localDownload Input DataTo download the required input data to thedata_dirspecified in the configuration files (default is$(pwd)/data:buckydatasyncRunning the ModelTo run the model with default settings and produce standard outputs.buckyrunEquivalently, one can the following command (to provide cli configuration to each part of the process)buckyrunmodel
buckyrunpostprocess
buckyvizplotCLI optionsEachbuckycommand has options that can be detailed with the--helpflag. e.g.$ bucky run model --help

Usage: bucky run model [OPTIONS]

  `bucky run model`, run the model itself, dumping raw monte
  carlo output to raw_output_dir.

Options:
  -d INTEGER         Number of days to project forward
                     [default: 30]
  -s INTEGER         Global PRNG seed  [default: 42]
  -n INTEGER         Number of Monte Carlo iterations  [default:
                     100]
  --runid TEXT       UUID name of current run  [default:
                     2022-06-04__08_00_03]
  --start-date TEXT  Start date for the simulation. (YYYY-MM-DD)
  --help             Show this message and exit.Further CLI documentation is available in thedocumentation.
Package: bud
bud===author: Peter HoffmannOverview--------bud runs stuff for youInstallation / Usage--------------------To install use pip:$ pip install budOr clone the repo:$ git clone https://github.com/hoffmann/bud.git$ python setup.py installContributing------------TBDExample-------TBDTODO-----Logginghttp://stackoverflow.com/questions/4984428/python-subprocess-get-childrens-output-to-file-and-terminalAllow configuration in budfile:config:include:- ~/bud.ymllog: ~/logs/bud/Usage#run predefined taskbud [taskname]# use bud.yml configuration instead of global ~/.bud.ymlbud -c bud.yml [taskname]# run oneshot taskbud -r 'ls -hla'Bud Configuration-----------------vars:key: valuekey2: value2
Package: buddy
Opinionated tools to manage your AWS infrastructure.Manage your cloudformation stacksCloudformation stacks are described bystack filesYAML formatSpecify which Cloudformationtemplateto useSpecify the parameters to use when creating/updating stacksExamples:$bstacklist...$cat.aws/production.yamlname:helloworldtemplate:service.yaml$catservice.yamlAWSTemplateFormatVersion:2010-09-09Description:HandleServiceResources:...$bstackcreate.aws/production.yaml$bstackeventshelloworld# or bstack events .aws/production.yaml$bstackresourceshelloworld$bstackupdate.aws/production.yaml$bstackdeletehelloworldManage your services and tasks on ECSAlpha: in development. Currently only implement deploy action for
continuous deployment on ECS.$cat.aws/cluster.yamltargets:production:cluster:productionservice:service-Service-1234567890JVMtask:helloworldenvironment:productiontasks:helloworld:containers:-http-app-celeryenvironments:production:SECRET_KEY:s3cr3tDATABASE_URL:postgis://user:pass@host/nameREDIS_URL:redis://host:6379containers:http:properties:memory:100cpu:100portMappings:-containerPort:80hostPort:0# 0 = dynamic portlinks:['app']command:['nginx','-g','daemon off;']app:properties:memory:200cpu:200environment:[SECRET_KEY,DATABASE_URL,REDIS_URL]celery:properties:memory:150cpu:100command:['celery','-A','helloworld','worker','-B','-l','info']environment:[DATABASE_URL,REDIS_URL]$bclusterdeploy.aws/cluster.yamlproductionregistry/myapp:latesta1b2c3d4Definition:[{'command':['nginx','-g','daemon off;'],'cpu':100,...]RegistertaskRegisteredtask:arn:aws:ecs:us-east-1:000000000000:task-definition/helloworld:123Deploying...Wait:deploymentinprogressarn:aws:ecs:us-east-1:000000000000:task-definition/helloworld:123-PRIMARY-running:0arn:aws:ecs:us-east-1:000000000000:task-definition/helloworld:122-ACTIVE-running:2Wait:deploymentinprogressarn:aws:ecs:us-east-1:000000000000:task-definition/helloworld:123-PRIMARY-running:0arn:aws:ecs:us-east-1:000000000000:task-definition/helloworld:122-ACTIVE-running:2Wait:deploymentinprogressarn:aws:ecs:us-east-1:000000000000:task-definition/helloworld:123-PRIMARY-running:2arn:aws:ecs:us-east-1:000000000000:task-definition/helloworld:122-ACTIVE-running:0Finalstate:...SuccessDevelopmentRunning tests$gitclonegit@github.com:pior/buddy.git...$mkvirtualenvbuddy-ppython3...$pipinstall-U-rrequirements-test.txt...$pipinstall-e....$pytest
Package: buddy-config
buddy_configDecoupled and lazy library to get settings from an environment variables.MotivationEnvironment variables are the most common way to configure projects, based on Docker, hosted on clouds, e.t.c. In the end, it is a secure and simple way. So grab variables from an environment is the only feature of the package.The first issue that becomes obvious at the simplest approach for getting environment variables is attempting to get the environment variables too early. For example, an app is initialized by tests, and you need different values for the settings at different tests. But if the values obtained in this way:init.pyimport os

VAR_A = os.environ['VAR_A']module_a.pyfrom . import *

def a():
    b(VAR_A)test.pyfrom . import module_a

class Test(unittest.TestCase):
    @mock.patch('os', 'environ', {"VAR_A": 1})
    def test_a(self, env):
        ...The values are already loaded to the memory. Therefore mock will not work. And the saddest part that this issue is not solved in most of the advanced configuration libraries. So this is the first issue solved here by Buddy Config.Installationpip install buddy_configGetting startedBuddy Config aims to be as declarative as possible.import buddy_config


class MyConf(metaclass=buddy_config.Config):
    NAME_OF_A_SETTING_A = "NAME_OF_AN_ENVIRONMENT_VARIABLE_A", strThis is a minimum of declaration that you need to have a setting. Let's pale it out. The name of a class attribute is the name of the setting, exactly how you suppose to call it. A string at position 0 of the following tuple is a name of an environment variable that you will retrieve from the environment. And the type class at position 1 of the tuple is the type value after it is retrieved from the environment. Both values are required.To use the config, you need to instantiate it:my_conf = MyConfig()The value is not going to be retrieved until you actually get the attribute from the
config.print(my_config.NAME_OF_A_SETTING_A)Also it is not cached.os.environ["NAME_OF_AN_ENVIRONMENT_VARIABLE_A"] = "3"
print(my_config.NAME_OF_A_SETTING_A)Defaults are flexible and could be different per instance of the config.my_conf_a = MyConfig(NAME_OF_A_SETTING_A=1)
my_conf_b = MyConfig(NAME_OF_A_SETTING_A=2)

print(my_conf_a.NAME_OF_A_SETTING_A)
print(my_conf_b.NAME_OF_A_SETTING_A)Moreover, you can add pre-processing of retrieved values.class MyConf(metaclass=Config):
    NAME_OF_A_SETTING_C = "NAME_OF_AN_ENVIRONMENT_VARIABLE_C", int, lambda x: x ** 2The optional items of the tuple are pre-processors. A pre-processor is a callable that must return a value of int, float, string, or bytes value.If you need to create a combined setting using values from environment variables, no problem, buddy config can do that:class MyConf(metaclass=Config):
    NAME_OF_A_SETTING_A = "NAME_OF_AN_ENVIRONMENT_VARIABLE_A", str
    NAME_OF_A_SETTING_B = "NAME_OF_AN_ENVIRONMENT_VARIABLE_B", int
    COMBINED_SETTING = (
        lambda self: int(self.NAME_OF_A_SETTING_A) + self.NAME_OF_A_SETTING_B
    )
Package: buddymojoAPI
READMEThis is an simple API of the websitecn.buddymojo.com.Command Line UsageProgram itself can be run on the command line window.If your running on linux,pythonwon't work since this API is written in python 3. Trypython3instead.Single ModeSend message(s) to a single target. Type:python BuddyMojoAPI.py -s -T [target] -t [times] -n [name] [-l]-lwill show the url of the targetMultiple ModeSend messages to multiple target. Type:python BuddyMojoAPI.py -m -r [start] [end] -n [name]Thestartandendis the userQuizId range.Examplespython BuddyMojoAPI.py -s -T 296688 -t 3 -n hi -lWill have the result like this:The top 3 is the result.