Saravanan666/pypi-org huggingface dataset:
Package: s2stac
s2stacEasily access many Sentinel-2 safe folders from a convenient xarray DataArray.PurposeThe purpose of this library is to create on-the-fly STAC from a list Sentinel-2 products in the form of SAFE folders and provide a xarray DataArray to easily access the main Sentinel-2 bands and more!Accessible information includes:all bands from the IMG_DATA folder (B01, B02, ..., B11)all viewing/sun zenith/azimuth angles.all detector footprints (for each band)ECMWF data (msl, tco3, ...)How it workss2stac uses the stackstac library internally to interogate a static STAC database created on the fly with pystac.
The database can be persisted so the user does not need to build it everytime.InstallationThis library requires Python 3.10 or higher.This library also requires the eccodes library (version 2.16.0) to be able to parse the GRIB ECMWF DataArray containing the meteorological data associated with each tile.
You can install it on Ubuntu with the following command:sudoapt-getinstalllibeccodes-devOn MacOs you will need to do:brewinstalleccodesNow you can simply install s2stac with:pipinstalls2stacOn MacOs you will also need to installecmfwlibs:pipinstallecmwflibsUsageIt is very easy to load some SAFE folders into a DataArray.
Here we import 5 SAFE folders of imagery taken over the south of Finland.frompathlibimportPathfroms2stacimportstacifysafe_folders=list(Path("/path/to/your/safe/folders").glob("*.SAFE"))stack=stacify(safe_folders)stackTo preview the result, you can use the preview function from the s2stac module:froms2stacimportpreviewpreview(stack)This preview function only displays a small collage of bands B04, B03 and B02 (RGB).Many other bands are available, here are a few more:From there, you can use all the convenient methods offered by xarray to manipulate DataArrays.stack.sel(band=["B02","B08","B11"]).loc[:,:,::4,::4].mean("time").plot.imshow(col="band")ExtraA few extra more options have been added to s2stac that are not considered to be part of the expected functionnalities.One of them is the ability to retrieve DEM (digital elevation models) data fromUSGS(United States Geological Survey).TheSRTMasset can be downloaded by specifying in thestacifyfunction the intent to download such imagery as well as username and password.Here's a small demo of it in action, using imagery taken over Guadeloupe:froms2stacimportstacify,previewfrompathlibimportPathimportmatplotlib.pyplotaspltsafe_folders=list(Path("/path/to/safe/folders").glob("*.SAFE"))[:2]usgs_username="<your USGS username>"usgs_password="<your USGS password>"stack=stacify(safe_folders,include_aux_data=False,include_ecmwf=False,include_footprint=False,include_mtd_tl=False,include_qi_data=False,include_srtm=True,usgs_password=usgs_password,usgs_username=usgs_username,catalog_folder=Path("./out"),)fig,ax=plt.subplots(1,2)stack.sel(band="srtm").mean("time").plot.imshow(ax=ax[0])(stack.sel(band=["B04","B03","B02"]).loc[:,:,::4,::4].mean("time")/10_000).plot.imshow(ax=ax[1])ax[0].set_aspect("equal")ax[1].set_aspect("equal")LicenseMITAuthorPierre Louvart -plouvart@argans.euCreditgjoseph92, the creator ofhttps://stackstac.readthedocs.io/en/latest/
Package: s2stools
DocumentationDocumentation on readthedocs:https://s2stools.readthedocs.ioInstalls2stools is available on PyPI and can be installed with pip:pip install s2stoolsFeaturesdata handling: combine different init dates, realtime forecasts, hindcasts, control and perturbed forecastsinto onexr.Datasetby introducing dimensionsreftime,hc_year,leadtimesimultaneous useleadtimeandvalidtimeclimatology and deseasonalizationfind events in forecasts and create compositesand more…AcknowledgmentsJonas Spaeth is supported by the Transregional Collaborative Research Center “Waves to Weather” (W2W; SFB/TRR165).
Package: s2t2-game-utils
Rock Paper Scissors Gameplay Logic (Python)InstallationInstall the package using one of the following commands, as desired:# from PyPI (recommended):pipinstalls2t2-game-utils# from PyPI Test server:pipinstall-ihttps://test.pypi.org/simple/s2t2-game-utils# from GitHub source (HTTPS version):pipinstallgit+https://github.com/s2t2/game-utils-py.git# from GitHub source (SSH version):pipinstallgit+ssh://git@github.com/s2t2/game-utils-py.git# from local source (after downloading the repo):pipinstall-epath/to/game-utils-py/Usagefromgame_utils.rock_paper_scissorsimport*print(WELCOME_MESSAGE)#> Hi. Welcome to my Rock-Paper-Scissors game!determine_winner("rock","paper")#> "paper"ContributingReleasingLicense
Package: s2terminal-lex-rank-summarizer
LexRank SummarizerThis is a CLI tool that uses LexRank to translate sentences in 3 lines.UsageDocker$ docker run --rm s2terminal/lex-rank-summarizer \
  'メロスは激怒した。必ず、かの邪智暴虐の王を除かなければならぬ と決意した。メロスには政治がわからぬ。メロスは、村の牧人である。笛を吹き、羊と遊んで暮して来た。けれども邪悪に対しては、人一倍に敏感であっ た。きょう未明メロスは村を出発し、野を越え山越え、十里はなれた此のシラクスの市にやって来た。メロスには父も、母も無い。女房も無い。十六の、 内気な妹と二人暮しだ。この妹は、村の或る律気な一牧人を、近々、花婿として迎える事になっていた。結婚式も間近かなのである。メロスは、それゆえ 、花嫁の衣裳やら祝宴の御馳走やらを買いに、はるばる市にやって来たのだ。先ず、その品々を買い集め、それから都の大路をぶらぶら歩いた。'メロスは激怒した。
メロスは、村の牧人である。
きょう未明メロスは村を出発し、野を越え山越え、十里はなれた此のシラクスの市にやって来た。Python$ pip install s2terminal-lex-rank-summarizer
$ lex-rank-summarizer \
  'メロスは激怒した。必ず、かの邪智暴虐の王を除かなければならぬ と決意した。メロスには政治がわからぬ。メロスは、村の牧人である。笛を吹き、羊と遊んで暮して来た。けれども邪悪に対しては、人一倍に敏感であっ た。きょう未明メロスは村を出発し、野を越え山越え、十里はなれた此のシラクスの市にやって来た。メロスには父も、母も無い。女房も無い。十六の、 内気な妹と二人暮しだ。この妹は、村の或る律気な一牧人を、近々、花婿として迎える事になっていた。結婚式も間近かなのである。メロスは、それゆえ 、花嫁の衣裳やら祝宴の御馳走やらを買いに、はるばる市にやって来たのだ。先ず、その品々を買い集め、それから都の大路をぶらぶら歩いた。'Development$ docker-compose upand useVS Code Remote Container$ docker-compose exec app poetry run lex-rank-summarizer 'おはよう。こんにちは。こんばんは。'Testing$ docker-compose exec app poetry run pytestLicenseMITReferencesPython: LexRankで日本語の記事を要約する - け日記図書カード：走れメロス
Package: s2v-extractor
s2v-extractor#you get "abc234d4" from this 2344 as number#memory and age are column of datafrme which has values like 16GB and you want 16 as number it will return dataframe withconverted valuesimport pandas as pdfrom test import s2vdf=pd.read_csv('test_data.csv')obj=s2v(df,["Memory","Age"])print(obj.extract())
Package: s2w
Spoken English To Written English Conversion system (s2wconversion)This repository contain library which convert spoken english like "Triple A" to written English like AAA or "Double A" to AA.To use this library you have to simply install it using pip and write from conversion import conversion (See demo.py)InstallationDependenciess2wconversion requires:Python (>= 3.5)NumPy (>= 1.11.0)speech_recognitionUser installationIf you already have a working installation of numpy and speech_recognition, the easiest way to install s2wconversion is using pippip install s2wConversionconversion directory contain converion.py file which have spoken to written funtion as per above rulesrun demo.py file to see how to convert trascript paragraph such as "I worked at Triple a" to "I worked at AAA". After run demo.py it    says "Say Something" then spoke anything you want then by using google speech recognition services it trascript paragraph spoken with abbrevations conversion rules.conversion rulesconversion rules directory contain rules.md file and rules.py file.In rules.md file i explained about adding some grammer rules such as Part of speech in a paragraph or decontracted phrasesrules.py file contain some of these rules implementedWe convert transcript speech into tokens then after apply nltk pos_tagg to detect pos for words and implement some rules
(See rules.md)How to useClone or download this repository.run demo.py file to see how it works.after run demo.py it ask some input "Say Something".then it converts speech into written text usin Google Speech Recognition Services, having rules like "Triple A" is "AAA" etcSee conversion rule\rules.py file to checkout more rules like punctuations or different pos tags.Future implementations and contributionsThis repo always open for open source contributions.We can add some more pos tagging rules and implement it to our library.Also we can use deep learning pos tagging for get better accuracy and add more grammer rules.Can add some more abbrevations such as we can add rules for "AAAA", "AAAAA" etc.I think of quad a, pent a etc.LICENSEGNU General Public License v3.0 (gplv3)
Package: s3200
s3200A Python3 package for controlling the Fröling heating system with S3200 lambdatronic control over the maintenance interface.State: BetaImplemented: Reading and writing all values.
Not Implemented: force_mode and set_time_slotCode Example:froms3200.objimportS3200()s=S3200("/dev/ttyS0")temperature=s.get_value('boiler_1_temperature')print('Temperature:{0}'.format(str(temperature)))status=s.get_status()print('Status:{0}'.format(status))Output:Temperature: 42.5
  Status: STÖRUNG
Package: s3a
Semi-Supervised Semantic Annotator (S3A)DescriptionA highly adaptable tool for both visualizing and generating semantic annotations for generic images.Most software solutions for semantic (pixel-level) labeling are designed for low-resolution (<10MB) images with fewer than 10 components of interest. Violating either constraint (e.g. using a high-res image or annotating ~1000 components) incur detrimental performance impacts. S3A is designed to combat both these deficiencies. With images up to 150 MB and 2000 components, the tool remains interactive.A more detailed overview can be found in the project wikihere.InstallationThe easiest method for installings3ais viapipafter cloning the repository, or directly from pypi:gitclonehttps://gitlab.com/ficsresearch/s3a
pipinstall-e./s3a# Or from pypi using "pip install s3a"Note that a version of OpenCV and Qt binding are required for S3A to work. These can be installed for you with the "full" option:pipinstall-e./s3a[full]# Or "pip install s3a[full]"Running the AppRunning the app is as easy as callings3aas a module or using a provided entry point:python-ms3aOr, equivalently:s3a-guiFrom here, projects can be created to host groups of related images, or images can be annotated in the default project. Both options are available through theFilemenu.Detailed Feature ListMore information about the capabilities of this tool are outlined in theproject wiki.Please NoteS3A's programmatic API is still largely under development. It still needs refinement to allow for consistent naming schemes, removing vestigial elements, confirming private vs. public-facing elements, and a few other line items. However, the graphical interface should be minimally affected by these alterations.Thus, while the GUI entry point should be consistently useful, be aware of these developments when using the scripting portion of S3A in great detail.LicenseThis tool is free for personal and commercial use (except the limits imposed by the selected Qt binding). If you publish something based on results obtained through this app, please cite the following papers:Jessurun, N., Paradis, O., Roberts, A., & Asadizanjani, N. (2020). Component Detection and Evaluation Framework (CDEF): A Semantic Annotation Tool. Microscopy and Microanalysis, 1-5. doi:10.1017/S1431927620018243
Package: s3ac
s3acA small IPython extension that auto-completes S3 URIS.To install:pip install s3ac$ipython
Python3.9.13(main,Jun92022,00:00:00)Type'copyright','credits'or'license'formoreinformation
IPython8.4.0--AnenhancedInteractivePython.Type'?'forhelp.

In[1]:%load_exts3ac

In[2]:froms3acimports3

In[3]:s3("<hit tab>To use, start an expression withs3(", hit tab, see buckets.
After selecting a bucket and hitting tab,s3 ("my_bucket/will complete prefixes up to the next slash and objects with that prefix.For example, tabbing afters3("my_bucket1/dmight suggest:my_bucket1/diary.txt
my_bucket1/dir1/
my_bucket1/dir2/
my_bucket1/dungeons_and_dragons.csvThe s3 function will return a URI (for example,"s3://my_bucket/dir1/dir2/file.txt").Depends only on boto3 and requires an AWS credentials file in ~/.aws.
Package: s3access
APIS3Access:s3 = S3Access()s3.selectExposesS3 Selectin a usable manner.s3.lss3.ls_pathS3Path:p = S3Path("s3://bucket/key/part=value")p.with_params(foo=7, bar=29)👉s3://other/key/part=value/foo=7/bar=29Appends or replaces the key/value pairs in order as given.p.with_params(foo=7, part='else', bar=29)👉s3://other/key/part=else/foo=7/bar=29If a partition is already mentioned in the path, it is
replaced with the value.p.with_bucket('other')👉s3://other/key/part=valueReplaces the bucket name of the S3 url.p.with_key('path')👉s3://bucket/pathReplaces the prefix/key/path component of this S3 url.
Package: s3adapter
S3AdapterA AWS S3 Python Adapter to Readn, Write and Check existence of files in S3 Buckets.
Current version use adapter to read/write a dataframe as csv in bucketInstallationYou can install My Package using pip:pipinstalls3adapterUsageSet defatut AWS Account Environment vars (AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, AWS_DEFAULT_REGION) or calls3adapter.init_cloud()methodWrite your code like it to write an Dataframe to your bucketfromfileadapters.s3adapterimports3adapterimportpandasaspdbucket_name=<your-bucket># Creating a DataFrame from a dictionarydata={'Name':['Alice','Bob','Charlie'],'Age':[25,30,22],'City':['New York','San Francisco','Los Angeles']}df=pd.DataFrame(data)# Initialize Adapter with Bucket Name and option to validate if cloud credentials is configureds3=s3adapter(bucket_name,validade_aws=True)# Write dataframe as CSVs3.write_dataframe_as_csv(df,file_path)
Package: s3ala
s3alaA basic CLI-based aggregator to extract some very basic metrics from ALB logs stored in an S3 bucket[!NOTE]
Work in progress. This README serves as a rough design specInstallationpipinstalls3alaUsageTo use the pre-configured AWS profile to extract metrics of ALB logs in the bucket "bucket" under "prefix/" in the time range [2024-01-01T00:00:00, 2024-01-02T00:00:00)AWS_PROFILE=my-aws-profiles3alabucketprefix/2024-01-01T00:00:002024-01-02T00:00:00
Package: s3_analyst
# S3 analyst[![pypi shield](https://img.shields.io/pypi/v/s3_analyst.svg)](https://pypi.python.org/pypi/s3_analyst)[![Build Status](https://travis-ci.org/Tofull/devops-coding-challenge.svg?branch=master)](https://travis-ci.org/Tofull/devops-coding-challenge)[![Documentation Status](https://readthedocs.org/projects/devops-coding-challenge/badge/?version=latest)](http://devops-coding-challenge.readthedocs.io/en/latest/?badge=latest)[![Updates](https://pyup.io/repos/github/Tofull/devops-coding-challenge/shield.svg)](https://pyup.io/repos/github/Tofull/devops-coding-challenge/)[![Python 3](https://pyup.io/repos/github/Tofull/devops-coding-challenge/python-3-shield.svg)](https://pyup.io/repos/github/Tofull/devops-coding-challenge/)An AWS S3 storage analysis tool.- Free software: GNU General Public License v3- Documentation: [http://devops-coding-challenge.readthedocs.io](http://devops-coding-challenge.readthedocs.io).## Features* TODO## CreditsThis package was created with Cookiecutter _and the `audreyr/cookiecutter-pypackage`_ project template.[Cookiecutter](https://github.com/audreyr/cookiecutter)[audreyr/cookiecutter-pypackage](https://github.com/audreyr/cookiecutter-pypackage)# History0.3.2 (2017-10-11)------------------* Configure setup.py to launch the tool with `coveos3tool`.0.3.0 (2017-10-11)------------------* CI with travis (aws credentials).* First release on PyPI.0.2.0 (2017-10-11)------------------* query s3 bucket metadata is available.* filter s3 bucket metadata is available.* regex are available.* export s3 bucket metadata is available.* select unit to display s3 bucket metadata is available.* a CLI is available.0.1.0 (2017-09-10)------------------* First release on github.
Package: s3autocp
s3autocps3autocpis a Python script designed to automate the process of copying local directories to Amazon S3 with appropriate Content-Type headers and optional compression. This script is especially useful for deploying static assets, applying suitable MIME types, and ensuring efficient transfer and storage with Brotli and Gzip compression.FeaturesContent-Type Guessing:Automatically determines the Content-Type for files based on their extensions.Compression:Compresses eligible files using Brotli and Gzip for optimized storage and transfer.S3 Upload:Efficiently uploads files to a specified S3 bucket, setting appropriate headers like Cache-Control.Command-Line Interface:Easy-to-use CLI for specifying source directory and destination S3 URL.RequirementsPython 3.9boto3librarybrotlilibraryAWS credentials configured (typically via environment variables or AWS CLI)InstallationMake sure you have Python 3 installed. Then, install the required dependencies:pipinstalls3autocpDevelopmentpipinstallboto3brotliUsages3autocp [-c/--compress] <source_directory> <destination_s3_url>-c/--compress: Enable compression for appropriate file types<source_directory>: The local directory you wish to copy to S3.<destination_s3_url>: The S3 URL where files will be uploaded, in the formats3://bucket-name/path.Examples3autocp ./my-local-dir s3://my-bucket/my-pathThis command will copy all files from./my-local-dirto the S3 bucketmy-bucketunder themy-pathdirectory.How It WorksThe script scans the source directory recursively for files.Determines the MIME type for each file.If you are using the-c/--compress-flag, compresses eligible files using Brotli and Gzip.Uploads files to the specified S3 bucket with appropriate Content-Type and Cache-Control headers.ContributingContributions, issues, and feature requests are welcome. Feel free to checkissues pageif you want to contribute.LicenseDistributed under the Apache License. SeeLICENSEfor more information.
Package: s3-backup-rotate
Backup your files to Amazon Web Services in a way that slowly forgets! I’ve learned that this way is refered to as the [‘Grandfather, father, son’](http://en.wikipedia.org/wiki/Backup_rotation_scheme#Grandfather-father-son) strategy.This script copies a file to Amazon S3 and rotates it.The filename will have a date stamp added before the first . in the filename.Do notadd a timestamp yourself, this will cause the script to treat the file as a unique file and the rotation won’t work!Rotation works as follows:
- Keep files from the last X days
- After that, keep Y files spaced at least a week apart
- After that, keep Z files spaced at least 30 days apart## Installationpip install s3-backup-rotate## UsageExport the following environment variables:
-export AWS_ACCESS_KEY_ID=yourkeyidhere-export AWS_SECRET_ACCESS_KEY=yoursecretkeyYou can also use one of the other methods supported by boto.upload_rotate.py bucket prefix file.Seepython upload_rotate.py -hfor more info.## Development### Buidling Pypi packagepython setup.py sdist
twine upload dist/s3-backup-rotate-
Package: s3blobsync
S3BlobSyncS3BlobSyncprovides a seamless way to operate between two of the major cloud platforms: AWS S3 and Azure Blob Storage. With a focus on data transfer and synchronization, this tool simplifies cloud operations, making it easier for developers and administrators to manage their resources across different platforms.FeaturesData Download: Easily download data from Azure or AWS S3.Data Transfer: Transfer data seamlessly from AWS S3 to Azure Blob.InstallationInstall S3BlobSync easily via pip:pipinstalls3blobsyncConfigurationCreate a.envfile for AWS and Azure credentials, referencing.env.example.Command-Line Entry PointsPost-installation, the following command-line tools are available:Sync Data:s3blobsyncList S3 Bucket Contents:list_s3Download from AWS S3:download_s3Download from Azure Blob Storage:download_blobUsage examples:s3blobsync--env_file<path_to_env_file>
list_s3--env_file<path_to_env_file>
download_s3--patterns'foo*.gz,bar*.gz'--env_file<path_to_env_file>
download_blob--patterns'foo*.gz,bar*.gz'--env_file<path_to_env_file>DependenciesThese dependencies are automatically installed with pip:boto3azure-storage-blobtqdmpython-dotenvUsing S3BlobSync in ScriptsAfter installing via pip, S3BlobSync can be used as a library in your Python scripts:Syncing Data from AWS S3 to Azure Blob Storagefroms3blobsyncimports3blobsyncs3blobsync(env_file='path_to_your_env_file')Downloading Data from AWS S3froms3blobsyncimportdownload_s3download_s3(patterns=['foo*.gz','bar*.gz'],env_file='path_to_your_env_file')Downloading Data from Azure Blob Storagefroms3blobsyncimportdownload_blobdownload_blob(patterns=['foo*.gz','bar*.gz'],env_file='path_to_your_env_file')Listing Contents of S3 Bucketfroms3blobsyncimportlist_s3list_s3(env_file='path_to_your_env_file')Alternative Installation and UsageFor a more manual approach, clone the GitHub repository and install the dependencies. When running scripts directly, use the module execution method to avoid relative import issues:python3-ms3blobsync.s3blobsync--env_file<path_to_env_file>
python3-ms3blobsync.download_s3--patterns'foo*.gz,bar*.gz'--env_file<path_to_env_file>
python3-ms3blobsync.download_blob--patterns'foo*.gz,bar*.gz'--env_file<path_to_env_file>
python3-ms3blobsync.list_s3--env_file<path_to_env_file>Advanced UsagePattern Filtering: Apply--patternsfor file name filtering (comma-separated).Custom Environment File: Use--env_fileto specify a custom.envfile (defaults to '.env').ContributingContributions are welcome. Please open an issue first for significant changes.LicenseS3BlobSync is under theMIT License.
Package: s3browser
## S3 Browser [![Build Status](https://travis-ci.org/andrewgross/s3browser.svg?branch=master)](https://travis-ci.org/andrewgross/s3browser) [![Coverage Status](https://coveralls.io/repos/github/andrewgross/s3browser/badge.svg?branch=master)](https://coveralls.io/github/andrewgross/s3browser?branch=master)S3Browser is a tool to help you browse your S3 Buckets like a local filesystem.  It features `cd`, `ls`, and `pwd` for now, with some added bonuses around showing rollups for directory sizes and the most recently modified file.  For now it is read only, though if you want any features feel free to suggest them.### Installation```pip install s3browser```### UsageYou can pass access keys to `s3browser` directly, or just let it pick them up from your environment.  It uses `boto` under the hood so you can use an existing configurations for that.```usage: s3browser [-h] [--access-key-id ACCESS_KEY_ID][--secret-access-key SECRET_ACCESS_KEY]Run S3Browseroptional arguments:-h, --help            show this help message and exit--access-key-id ACCESS_KEY_IDAWS_ACCESS_KEY_ID used by Boto--secret-access-key SECRET_ACCESS_KEYAWS_SECRET_ACCESS_KEY used by Boto```Once you are in the CLI, it will automatically load a list of all of your available S3 buckets.  You can use the `help` command to get detailed information for each of the commands.### Gotchas`s3browser` is written in Python, so it is not the most efficient.  For really large buckets be prepared to wait a while for it to complete.  S3 requires us to page through all the files to retrieve them, and currently that is done serially in chunks of 1000.  Additionally, the internal representation of each S3 Key is ~800 Bytes, once you use `refresh` on a bucket with millions of keys, expect some memory pressure.I have successfully browsed ~15mm keys on my dev machine with 16GB of RAM, of which python used ~12GB.  If key retrieval speed or memory usage are big issues for you, feel free to open a ticket and we can spend the time to find better ways to implement the internal structures so they are more compact!
Package: s3-browser
S3 BrowserA small, interactive tool to browse s3 like a regular directory structureWritten in python.FeaturesTab completionFamiliar interface for unix users (cd,ls,file,pwd, etc.)Bookmarking (bookmark add,bookmark ls...)Inspect key metadata (file) or contents (cat)Download or upload individual keys to/from local files (putorget)Maintains command historyLazy-loading and caching of paths (no scanning entire buckets on start up)Installationpip install s3_browserAnd then run withs3-browser.Example usageDevelopmentRunning testsInstall the project into your virtualenv in development mode:pipinstall-e.Then install the test requirements:pipinstall-rrequirements_test.txtand finally run./build.shto run the full build.