Saravanan666/pypi-org huggingface dataset:
Package: elastic-tools
ElasticTools - high-speed utilities for ElasticSearch data manipulationsElasticToolsis a python package developed as a handy utility for cases when it comes tostreaming,manipulationorprocessingof any sort of data stored (or prone to be stored) within ElasticSearch.The key features are:Highly performant. Written purely in python with a dense usage of concurrency thanks to AsyncIO.Intuitive. Though almost every commandline argument has a detailed explanation ofwhatis it andwhywe need it, one can intuitively answer those questions.InstallationCreate and activate a virtual environmentpython3-mvenvvenvsourcevenv/bin/activateInstall the package usingpippipinstallelastic-toolsUsage1. Dump Elasticsearch indexelasticdump--elastic_address<ES_ADDRESS>--index<INDEX_NAME>--output_dir<TARGET_DIRECTORY>--chunk_size<CHUNK_SIZE>Example call:elasticdump--elastic_addresslocalhost:9200--indexproducts--output_dir./dump/--chunk_size5002. Restore Elasticsearch indexelasticload--elastic_address<ES_ADDRESS>--index<INDEX_NAME>--input_dir<DIR_WITH_DUMPED_DATA>--chunk_size<CHUNK_SIZE>--connection_pool_size<PARALLEL_CONNECTIONS_COUNT>--mode<MODE>Example call:elasticload--elastic_addresslocalhost:9200--indexproducts--input_dir./dump/--chunk_size1000Based on the situation you may want to loadonly dataorboth data and settings. For this purposesmodeargument is very helpful. Runmongo2elastic -hfor more info.3. Stream data from MongoDB to Elasticsearchmongo2elastic--mongo_address<MONGO_ADDRESS>--mongo_db<MONGO_DATABASE_NAME>--mongo_collection<MONGO_COLLECTION_NAME>--elastic_address<ES_ADDRESS>--elastic_index<ES_INDEX_NAME>--batch_size<BATCH_SIZE>--connection_pool_size<CONNECTION_POOL_SIZE>--mode<MODE>Example call:mongo2elastic--mongo_addresslocalhost:27017--mongo_dbstore--mongo_collectionproducts--elastic_addresslocalhost:9200--elastic_indexproducts--batch_size500--connection_pool_size5--modedefaultBased on the situation you may want to streamonly data,only updatesorboth. For this purposesmodeargument is very helpful. Runmongo2elastic -hfor more info.
Package: elastic-transport
elastic-transport-pythonTransport classes and utilities shared among Python Elastic client librariesThis library was lifted fromelasticsearch-pyand then transformed to be used across all Elastic services
rather than only Elasticsearch.Installing from PyPI$ python -m pip install elastic-transportVersioning follows the major and minor version of the Elastic Stack version and
the patch number is incremented for bug fixes within a minor release.                      |DocumentationDocumentation including an API reference is available onRead the Docs.Licenseelastic-transport-pythonis available under the Apache-2.0 license.
For more details seeLICENSE.
Package: elasticutils
Deprecated January 5th, 2015This project is no longer being maintained. Last release is
ElasticUtils 0.10.2. You should consider switching toelasticsearch-dsl-py.READMEElasticUtils is a convenient Django QuerySet-like API for querying
Elasticsearch.Project detailsCode:https://github.com/mozilla/elasticutilsDocumentation:http://elasticutils.rtfd.orgIssue tracker:https://github.com/mozilla/elasticutils/issuesIRC:#elasticutilson irc.mozilla.orgLicense:BSD 3-clause; see LICENSE fileOur unit tests are run by Travis CI every time we commit to the
master branch.Quick installLatest released version:$ pip install elasticutilsRun the dev version (which is master tip):$ pip install elasticutils==devThat corresponds withhttp://github.com/mozilla/elasticutils/tarball/master#egg=elasticutils-dev.Quick startSeehttps://elasticutils.readthedocs.org/for the quick start.
Package: elastic-workplace-search
A first-party Python client forElastic Workplace Search.ContentsGetting startedUsageFAQContributeLicenseGetting started 🐣Supports Python 2.7 and Python 3.3+.Depends onfuturesandrequests.Installed withpip <http://pypi.python.org/pypi/pip>:$python-mpipinstallelastic_workplace_searchYou can also download and install the project source:$pythonsetup.pyinstallUsageCreating a new Clientfromelastic_workplace_searchimportClientauthorization_token='authorization token'client=Client(authorization_token)Retrieve your access token and a content source key after creating your content source.Change API endpointclient=Client(authorization_token,"https://your-server.example.com/api/ws/v1")Custom Source DocumentsDocument API features are found in theclient.documentsmodule.Indexing DocumentsIndexing a document into a custom content source:content_source_key='content source key'documents=[{'id':'1234','url':'https://github.com/elastic/workplace-search-python','title':'Elastic Workplace Search Official Python Client','body':'A descriptive body, with document contents and metadata'}]client.documents.index_documents(content_source_key,documents)Deleting DocumentsDeleting a document from a custom content source:content_source_key='content source key'ids=['1234']client.documents.delete_documents(content_source_key,ids)PermissionsPermissions API features are found in theclient.permissionsmodule.Listing all permissionscontent_source_key='content source key'client.permissions.list_all_permissions(content_source_key)Listing all permissions with pagingcontent_source_key='content source key'client.permissions.list_all_permissions(content_source_key,size=20,current=2)Retrieve a User's permissionscontent_source_key='content source key'user='enterprise_search'client.permissions.get_user_permissions(content_source_key,user)Add permissions to a Usercontent_source_key='content source key'user='enterprise_search'permissions=['permission1']client.permissions.add_user_permissions(content_source_key,'enterprise_search',{'permissions':permissions})Update a User's permissionscontent_source_key='content source key'user='enterprise_search'permissions=['permission2']client.permissions.update_user_permissions(content_source_key,'enterprise_search',{'permissions':permissions})Remove permissions from a Usercontent_source_key='content source key'user='enterprise_search'permissions=['permission2']client.permissions.remove_user_permissions(content_source_key,'enterprise_search',{'permissions':permissions})FAQ 🔮Where do I report issues with the client?If something is not working as expected, please open anissue.Contribute 🚀We welcome contributors to the project. Before you begin, a couple notes...Before opening a pull request, please create an issue todiscuss the scope of your proposal.Please write simple code and concise documentation, when appropriate.License 📗Apache 2.0©ElasticThank you to all thecontributors!
Package: elasticwrapper
elasticwrapperElasticsearch offers (major) API-versioned packages for its Python SDK, calledelasticsearch2,elasticsearch5and so on.
This wrapper connects to the given URL, retrieves the major version and imports the versioned
module according to that.Usage examples:fromelasticwrapperimportelasticsearches=elasticsearch.Elasticsearch()res=es.search(index="*",body={})This will connect to the defaulthttp://localhost:9200/URL.Customizing the wrapperYou can override defaults in the following ways:With environment variablesYou can set the Elasticsearch URL with the following environment variable:ELASTICWRAPPER_URL=http://localhost:9200python-c"from elasticwrapper import elasticsearch; print(elasticsearch)"And the connect timeout with:ELASTICWRAPPER_TIMEOUT(specified in seconds)ThroughbuiltinsThe URL can be set from code as well, either by setting the above environment variable (before)
the import, or by through thebuiltinsmodule:# anywhere in the code before the `elasticwrapper` importimportbuiltinsbuiltins.elasticwrapper_url="http://localhost:9200"builtins.elasticwrapper_timeout=30# anywhere in the code after variables has been set up in `builtins`fromelasticwrapperimportelasticsearchCaveatsElasticwrapper (currently) does nothing more than selecting the right (major)elasticsearchmodule to be imported and imports it underelasticwrapper.elasticsearch.Be aware, thatelasticsearchmight be incompatible with your Elasticsearch cluster even in the
same major version (like7.x).
Also,elasticwrappercurrently does nothing to provide API compatibility, so different SDK versions
might (and will) need different syntax.
Package: elasticwriter
Using to insert/update ES documentTo build and upload to pypi, run two commandspython setup.py bdist_wheelpython -m twine upload dist/How to usecreate es connectionimport elasticwriter
from elasticwriter.elasticwriter import *

es = get_es([
    "http://username:password@es-host"
])create index if not exsited with mapping and settingmapping = {
           "_doc": { 
               "properties": {
                   "name": {
                        "type": "text",
                   },
               }
            }
        }

    index_name = 'tuan-test'
    create_index_if_not_existed(es, index_name, mapping)handle with dataframetest_df = spark.createDataFrame([(1, 'tuan', 30), (2, 'tank', 27)], ['es_id', 'name', 'age'])

push_df_to_index(es, index_name, test_df, 'overwrite')handle with list dictionarytest_list = [
    {'es_id': 3, 'name': 'tuyet', 'age': 25}
]
push_list_dict_to_index(es, index_name, test_list, 'overwrite')
Package: elastix-napari
elastix-napariThenapariplugin forelastix, a toolbox for rigid and nonrigid registration of images, based onitk-elastix.For a demo video seeyoutubechannel.
For tutorials on how to use elastix, see ourJupyter notebooks.To find parameters that work well with specific datasets, see theelastix Model Zoo.InstallationYou can installelastix-napariviapip:pip install elastix-napariContributingContributions are very welcome. Tests can be run withtox, please ensure
the coverage at least stays the same before you submit a pull request.LicenseDistributed under the terms of theApache Software License 2.0license,
"elastix-napari" is free and open source softwareIssuesIf you encounter any problems, pleasefile an issuealong with a detailed description.
Package: elastos-adenine
Python-gRPC-clientThis repository contains the python client library to interact withElastos Smart Web Service.PrerequisitesFirst, install Python3:brew install python3 // On Mac
sudo apt-get install python3 // On UbuntuNormally, pip comes with python3 if you're downloading the latest version (or any version above 3.4). If that is not the case, install pip by running the following:curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py
python3 get-pip.pyInstall virtualenv:pip3 install virtualenvInstructions on how to run from official pypiSetup virtualenv:virtualenv -p `which python3` venv;
source venv/bin/activate;Install dependencies:pip3 install -r requirements.txt;Setup environment variables and update variables if needed:cp .env.example .env;Run sample.pypython3 sample.pyInstructions on how to build and run locallyClone the repositorygit clone https://github.com/cyber-republic/python-grpc-adenine.git
cd python-grpc-adenineSetup virtualenv:virtualenv -p `which python3` venv;
source venv/bin/activate;Install dependencies:pip3 install -r requirements.txt;Setup environment variables and update variables if needed:cp .env.example .env;Run sample.py:python3 sample.pyHow to package up the client librarySetup virtualenv:virtualenv -p `which python3` venv;
source venv/bin/activate;Install dependencies:pip3 install -r requirements.txt;Update setup.py if needed(eg. version number should be modified each time it's pushed to the pypi repo) and get the package readyrm -rf dist/*;
python3 setup.py sdist bdist_wheelPush to pypi repo:For testing purposes, do the following:python3 -m twine upload --repository-url https://test.pypi.org/legacy/ dist/*For production, do the following:python3 -m twine upload dist/*Unit TestingRequires pytest version 5.3.5. Included as part of requirements.txtIf pytest is not installed. Run the following command:pip install pytest==5.4.1To run the pytest:./test.sh
Package: elaugment
elaugmentelaugment is a Python package for reproducable data-augmentations. In difference to most other libraries random parameters for transformations are drawn seperate from the transformations. This makes it very easy apply the same transformations to several images. An example where this behaviour is useful is semantic segmentation, when you need to modify the input and the mask in the same way.This library is currently in it's early stages so interfaces may break and some operations are slow.InstallationClone this repositoryRunpip install elaugmentExamples & UsageSee/examplesfor an comprehensive overview.ContributeTransformations are easy to integrate into elaugment, so just create pull-requests when you feel like it!
Package: elblog2dict
ELBLOG2DICTDescriptionThis module converts Amazon ELB traffic logs into a python dictionary format.Installationpipinstallelblog2dictUsagefromelblog2dictimportparserimportgzipfile_path='log1.log.gz'withgzip.open(file_path,'rb')asf:data=f.read()extracted_data=parser.parse(data)fordatainextracted_data:print(data)Output{"type":"http","timestamp":"2023-06-19T01:24:36.560391Z","elb":"app/crawling-ALB/df7b42c830cab31c","client_ip":"185.254.196.173","clent_port":"55646","target_ip":"172.31.1.83","target_port":"80","request_processing_time":"0.012","target_processing_time":"0.001","response_processing_time":"0.000","elb_status_code":"404","target_status_code":"404","received_bytes":"231","sent_bytes":"3828","request_method":"GET","url":"http://15.165.214.35:80/.env","http_version":"HTTP/1.1","user_agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.129 Safari/537.36","ssl_cipher":"-","ssl_protocol":"-","target_group_arn":"arn:aws:elasticloadbalancing:ap-northeast-2:375350317796:targetgroup/crawling-TG/02bacd9ef5e3c0ab","trace_id":"Root=1-648fae54-2521fdf43f8d31f87fc9061b","domain_name":"-","chosen_cert_arn":"-","matched_rule_priority":"0","request_creation_time":"2023-06-19T01:24:36.547000Z","actions_executed":"waf,forward","redirect_url":"-","error_reason":"-","target_port_list":"172.31.1.83:80","target_status_code_list":"404","classification":"-","classification_reason":"-"}LicenseMIT LicensePermission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Package: elb-log-tools
ELB Log ToolsTools for processing logs from AWS Elastic Load BalancerInstallation$ pip install elb-log-toolsUsageSpecifying the log bucket nameThere are two options:Set theELB_LOG_BUCKETenvironment variable, orPass the bucket name toelb-logsusing the-bor--bucketargument.$ elb-logs -b my-log-bucketPrint ELB logs to stdout$ elb-logs | head -n 1
2019-11-06T23:00:47.799875Z production-pymcore-webserver 84.10.79.236:55801 172.16.11.238:80 0.000049 1.922708 0.000054 200 200 0 230454 "GET https://www.pymetrics.com:443/results/downloads/traits/ HTTP/1.1" "Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.103 Safari/537.36" ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2Filter ELB logsFiltering currently only outputs the PATH component of the log file.# Only output redirects
$ elb-logs | elb-filter --include-statuses 301 302 | head -n 1
/logout/Aggregate request counts based on pattern matchingelb-patterncountsmatches URL paths against a list of regex patterns, and
outputs the counts of requests matching the patterns in CSV format.# patterns.txt has all the URL patterns we want included in the report

$ elb-logs | elb-filter -f 404 | elb-patterncounts --patternfile patterns.txt --all
Path,Hits
/api3/apps/applications/,66762
/api3/games/games/,42192
/api/game/submission/,35418
/api2/games/list/,33487
/api2/accounts/config/,19251
/health/,18891ExamplesGet most common requests for static files that 404:$ elb-logs | elb-filter -i 404 | grep static | head -n 50 | uniq -c | sort -bgr
Package: elbow
💪 ElbowElbow is a lightweight and scalable library for getting diverse data out of specialized formats and into common tabular data formats for downstream analytics.ExampleExtract image metadata and pixel values from all JPEG image files under the current directory and save as aParquetdataset.importnumpyasnpimportpandasaspdfromPILimportImagefromelbow.buildersimportbuild_parquetdefextract_image(path:str):img=Image.open(path)width,height=img.sizepixel_values=np.asarray(img)return{"path":path,"width":width,"height":height,"pixel_values":pixel_values,}build_parquet(source="**/*.jpg",extract=extract_image,output="images.pqds/",workers=8,)df=pd.read_parquet("images.pqds")For a complete example, seehere.Installationpip install elbowThe current development version can be installed withpip install git+https://github.com/cmi-dair/elbow.gitRelated projectsThere are many other high quality projects for extracting, loading, and transforming data. Some alternative projects focused on somewhat different use cases are:AirByteMeltanoSingerMageOrchestStreamz🤗 DatasetsContributingWe welcome contributions of any kind! If you'd like to contribute, please feel free to start a conversation in ourissues.
Package: elcano
ElcanoCurrently under initial development, do not use.This Python 3 library is a visual dataset explorer that can be used to analyse the main properties of a dataset. It is named afterJuan Sebastián Elcano, the explorer who completed the first circumnavigation of the Earth.Some of the main features of this library are:Wide format support: The formats ARFF, BSI, CSV, DAT, DATA, JSON, LIBSVM, M, NAMES, XRFF and their gzipped versions can be used.Comprehensive analysis features: many analysis tools are available to study the dataset, giving access to well-known toolboxes such as scikit-learn, keras and pandas.Pipeline storage and sharing: the pipelines created can be saved locally and uploaded to the pipeline cloud.Simple-yet-powerful interface: when a dataset is loaded, a web platform is deployed locally to analyse the datasets visually. Every pipeline can be exported as a script to avoid losing the grip on the process.Install and usageInstalling and using this library is as simple as:$pipinstallelcano
Successfullyinstalledelcano-0.1
$elcanodataset.csvA complete reference will be added as the development of this library advances.Changesv0.0.Released on May 24, 2020.Initial package upload.
Package: elcrawlsdk
SDK for PythonThe SDK for Python contains two parts:CLI ToolUtility ToolsCLI ToolThe CLI Tool is mainly designed for those who are more comfortable using command line tools.The installation of the CLI Tool is:pip install elcrawlsdkThen, you can use theelcrawlcommand in the command prompt.  elcrawl --helpUtility ToolsUtility tools mainly provide somehelpermethods to make it easier for you to integrate your spiders into platform, e.g. saving results.Scrapy IntegrationInsettings.pyin your Scrapy project, find the variable namedITEM_PIPELINES(adictvariable). Add content below.ITEM_PIPELINES={'elcrawl.pipelines.ElcrawlMongoPipeline':888,}Then, start the Scrapy spider. After it's done, you should be able to see scraped results inTask Detail -> ResultGeneral Python Spider IntegrationPlease add below content to your spider files to save results.# import result saving methodfromelcrawlimportsave_item# this is a result record, must be dict typeresult={'name':'elcrawl'}# call result saving methodsave_item(result)Then, start the spider. After it's done, you should be able to see scraped results inTask Detail -> Result
Package: el-decko-backend-mpris
El Decko MPRIS-BackendAn El Decko backend to control media applications via the MPRIS2 dbus interface.First runUpon running El Decko the first time with this backend installed it will create an empty default config to connect to
your local OBS Studio instance at:$XDG_CONFIG/eldecko/backend/mpris.json.Please update the generated default credentials with the actual port and password of what is shown inside your OBS
Studio Websocket Settings.Use this backendIn order to use this backend you need to supply thestreamdeck.jsongenerated
byEl Decko Corewith the followingkey_config:{
    "STREAM_DECK_SERIAL_NUMBER": {
        "brightness": 30,
        "key_config": {
            "0": {
            "backend": "edb_mpris",
            "event": "PLAY",
            "event_parameters": {"player":"rhythmbox"},
            "image_idle": null,
            "image_pressed": null
            }
        }
    }
}This will configure the very first key (0) to use this plugin (edb_mpris) and bind the eventPLAYto it.
If theevent_parametersare kept empty"event_parameters": {}the respective event will be send to all available
MPRIS2 clients.Ifevent_parameterscontains"player":"<some_mpris_player_name"it will only send the MPRIS event to all players
matchingplayer.Supported MPRIS2 controlsPlayPlay/PauseNextPreviousAdditional controlsMuteUnmuteToggle MuteRequirementsPythonPython >= 3.8pympris
dbus-pythoncmakedbus-1-develglib2-develpython3**-devel