Saravanan666/pypi-org huggingface dataset:
Package: wordlistools
wordlistoolsWordlistools is a collection of tools to play with wordlists. This tool was built with offensive security in mind,
to help bruteforcing, filtering wordlists to crack passwords, building
wordlists for fuzzing, etc.
This project is still under development.FeaturesCan be used as command lines or as a python libraryCan be used with stdin redirection|Easily extensible, you can add your own plugins on your home directory~/.koalak/wordlistools/pluginsInstallpip3installwordlistoolsDemonstrationNote: This demonstration is an old version of wordlistools,
but the principe remains the same.Using policy subcommandYou can filter your wordlist based on a policy, the policy follow the following format[base_policy][lenght_policy].
The base policy can have the following rules:a: word must contain at least one lower case letterA: word must contain at least one upper case letter1: word must contain at least one digit@: word must contain at least one special characterlength rule have an operator (==, !=, <=, >=, <, >) followed by its length. Example if we want
to have passwords that have at least one lowercase, at least one upper case, at least one special
character and its length is at least 10 characters longpolicy 'aA@>=10'. Do not forget
to quote your arguments.Add a toolYou can easily add your own tools in wordlistools. Create a python file in~/koalak/wordlistools/plugins/and subclassBasePlugin, wordlistools will automatically execute your script and register your plugin.You have to define the following attributesname(str): the name of your plugin (must be unique)description(str): description of what your will plugin do, it will be displayed in the help CLIImplement the following abstract methods:init_parser(): to configure the CLI arguments by using the standard library argparse, useself.add_argumentwhich is a wrapper for the original argparse method.run: implement here the logic of your plugin, take any things as parameters and must return an iterator of stringscmd(args): must call theself.runmethod based on theargsarguments of argparsePlugin Template# path of this file: ~/koalak/wordlistools/plugins/myplugins.pyimportitertoolsfromwordlistoolsimportBaseToolclassMyTool(BaseTool):name="myplugin"description="Do nothing, return the same list"definit_parser(self):self.add_argument("wordlists",help="wordlist to return",nargs="+",stdin=True)defcmd(cls,args):returncls.run(*args.wordlists)defrun(cls,*wordlists):wordlists=cls.normalize_wordlists(wordlists)foreinitertools.chain(*wordlists):yieldeIf you want your plugins to handle stdin wordlists you have to addstdin=Trueinadd_argument.
Package: wordlists
wordlistsUtilities to download word lists in Python.Usagefromwordlistsimportupdate_lists,read_words# Update the word lists from the webupdate_lists()# Get the words from a listwords=read_words("dwyl_alpha")# Filter words which are 27 characterswords=[wforwinwordsiflen(w)==27]# Print the wordsprint(words)# ['electroencephalographically', 'hydroxydesoxycorticosterone', 'microspectrophotometrically']
Package: wordmarker
WordMarkerWord文档生成器。安装WordMarker在PyPI上发布，可以从那里安装：pipinstallwordmarker-ihttps://pypi.org/simple国内用户建议直接下载进行安装。文档资料你可以从wordmarker.readthedocs.io获取文档。你也可以从wordmarker.rtfd.io获取文档。保持联系你可以在Github上，反馈漏洞，提出建议，查看源码。其他问题，请使用E-mail :chensixiang1234@gmail.com。
Package: wordmatrix
Licensed under the Apache License, Version 2.0 (the “License”);
you may not use this file except in compliance with the License.
You may obtain a copy of the License athttp://www.apache.org/licenses/LICENSE-2.0Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an “AS IS” BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.Description: UNKNOWN
Platform: UNKNOWN
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Natural Language :: English
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 2.6
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3.3
Classifier: Programming Language :: Python :: 3.4
Classifier: Programming Language :: Python :: 3.5
Package: word-mover-distance
Word Mover's DistanceIn this package you will find the implementation of Word Mover's Distance for a generic Word Embeddings model.I largely reused code available in thegensimlibrary, in particular thewmdistancefunction, making it more general so that it can be used with other Word Embeddings models, such asGloVe.You can find a real-world usage of this package in mynews summariser repository, where I use Word Mover's distance for finding the most similar sentences in a given news article.How to installThe preferred way to install this package is throughpip:pipinstallword-mover-distanceOn Mac and Linux it works like a charm. On Windows, however, it is highly likely you will experience some issues: this is due topyemd, which needs some C++ dependencies during build time. A quick way to solve this issue is to install "Build Tools for Visual Studio 2019" following this procedure:Go to the following page and download "Build Tools for Visual Studio 2019"https://visualstudio.microsoft.com/downloads/#build-tools-for-visual-studio-2019Double click on the .exe file once finished and select to install C++ build toolsCheck that among the suggested packages to install it is also selected "Windows 10 SDK" (the newest version is fine) as this is the critical dependencyOnce the installation has finished reopen your PowerShell/Command Prompt and retry to install the library with the original pip instructionIf storage/connectivity speed is critical for your usecase and/or you would like to know more about the issue have a look atthis Stack Overflow discussion.Basic usageImport the library:fromword_mover_distanceimportmodelInitialise a Word Embedding objectYou can pass the path where the model is stored:my_model=model.WordEmbedding(model_fn="/path/where/my/model/is/stored.txt")or you can pass the model itself, previously loaded (assuming your model is a dictionary, whose keys are the various words and its values the vector representation of the various words):my_model=model.WordEmbedding(model=my_word_embedding_model)Compute Word Mover's distances1='Obama speaks to the media in Chicago'.lower().split()s2='The president spoke to the press in Chicago'.lower().split()wmdistance=my_model.wmdistance(s1,s2)1.8119693993679309Remember that thewmdistance(s1, s2)method expects twoList[str]as input!
Package: word-neo4j
Word Neo4jWord Neo4j contains modules relating to word components of Neo4j Cypher queries’Free software: MIT licenseDocumentation:https://word-neo4j.readthedocs.io.FeaturesTODOCreditsThis package was created withCookiecutterand theaudreyr/cookiecutter-pypackageproject template.History0.1.0 (2019-01-27)First release on PyPI.
Package: word-piece-tokenizer
A Lightweight Word Piece TokenizerThis library is an implementation of a modified version ofHuggingface's Bert Tokenizerin pure python.Table of ContentsUsageInstallingExampleRunning TestsMaking it LightweightOptional FeaturesUnused FeaturesMatching AlgorithmThe TrieUsageInstallingInstall and update usingpippipinstallword-piece-tokenizerExamplefromword_piece_tokenizerimportWordPieceTokenizertokenizer=WordPieceTokenizer()ids=tokenizer.tokenize('reading a storybook!')# [101, 3752, 1037, 2466, 8654, 999, 102]tokens=tokenizer.convert_ids_to_tokens(ids)# ['[CLS]', 'reading', 'a', 'story', '##book', '!', '[SEP]']tokenizer.convert_tokens_to_string(tokens)# '[CLS] reading a storybook ! [SEP]'Running TestsTest the tokenizer against hugging's face implementation:pipinstalltransformers
pythontests/tokenizer_test.pyMaking It LightweightTo make the tokenizer more lightweight and versatile for usage such as embedded systems and browsers, the tokenizer has been stripped of optional and unused features.Optional FeaturesThe following features has been enabled by default instead of being configurable:CategoryFeatureTokenizer- The tokenizer utilises the pre-trainedbert-based-uncasedvocab list.- Basic tokenization is performed before word piece tokenizationText Cleaning- Chinese characters are padded with whitespace- Characters are converted to lowercase- Input string is stripped of accentUnused FeaturesThe following features has been removed from the tokenizer:pad_token,mask_token, and special tokensAbility to add new tokens to the tokenizerAbility to never split certain strings (never_split)Unused functions such asbuild_inputs_with_special_tokens,get_special_tokens_mask,get_vocab,save_vocabulary, and more...Matching AlgorithmThe tokenizer'slongest substring token matchingalgorithm is implemented using atrieinstead ofgreedy longest-match-firstThe TrieThe originalTrieclass has been modified to adapt to the modifiedlongest substring token matchingalgorithm.Instead of asplitfunction that seperates the input string into substrings, the new trie implements agetLongestMatchTokenfunction that returns thetoken value(int)of the longest substring match, and theremaining unmatched substring(str)
Package: wordplay
# Wordplay[![Build Status](https://travis-ci.org/enioluwa23/wordplay.svg?branch=master)](https://travis-ci.org/enioluwa23/wordplay) [![PyPI version](https://img.shields.io/pypi/v/wordplay.svg)](https://pypi.org/project/wordplay/) [![Supported versions](https://img.shields.io/pypi/wheel/wordplay.svg)](https://pypi.org/project/wordplay/) [![PyPI version](https://img.shields.io/pypi/pyversions/wordplay.svg)](https://pypi.org/project/wordplay/)Python package for word searching utilities.Using a convenient API, you can filter a set of strings with detailed criteria. There are also more scrabble-like features such as getting all anagrams of a word.## Install```bashpip install wordplay```## BackgroundI initially built this as an algorithm solely to help my endeavors in word games such as Scrabble. It was useful for finding word combinations in every type of situation. However, I realized it could be used for many other purposes, such as filtering email addresses, phone numbers and any set of data really. So I decided to decouple the API from my personal use.## UsageWords are stored in a `Dictionary` object. Initialize the dictionary with a [`set`](https://docs.python.org/2/library/stdtypes.html#set) of strings (there are no restrictions on what the string can contain) or `Dictionary()` with no arguments to use the word set sourced from [here](https://github.com/dwyl/english-words). In the future, I will amass a couple of word lists and make them options for initializing the dictionary.If you do want restrictions on the string, see the documentation for the [`Utils`](https://enioluwa23.github.io/wordplay/api/utils/) module. For complex query parameters, you can use a `Criteria` object. The class uses the builder pattern, making it easy to construct search parameters.Here is a an example file:```pythonfrom __future__ import print_functionfrom wordplay.dictionary import Dictionaryfrom wordplay.criteria import Criteriadef main():dictionary = Dictionary()result = dictionary.get_words_with_any_letters('diction', 6)print(result)# ['diotic', 'dition', 'indico', 'indict', 'nidiot', 'odinic']result = dictionary.get_words_with_any_letters('pox')print(result)# ['o', 'op', 'ox', 'p', 'po', 'pox', 'x']result = dictionary.get_anagrams('aekst')print(result)# ['keats', 'skate', 'skeat', 'stake', 'steak', 'takes', 'teaks']print('car' in dictionary)  # Dictionary is directly iterable# Truecriteria = Criteria()criteria.begins_with('c').ends_with('s').contains('or')criteria.contains_at(('o', 2), ('r', 4)).size_is(10)result = dictionary.get_words(criteria)print(result)# ['corrosives', 'correlates', 'corrugates']if __name__ == '__main__':main()```For further example usage see the [Documentation](https://enioluwa23.github.io/wordplay/).To run tests, use `pytest`.## Documentation[API Reference](https://enioluwa23.github.io/wordplay/)## License[Apache Software License](https://github.com/enioluwa23/wordplay/blob/master/LICENSE)
Package: wordplex
WordPlexTheWordPlexclass is a Python utility designed to generate and manipulate words. It provides methods
for handling consonants, vowels, numbers and alphabet.Examplepython-mwordplex-f"Porsche-99#"Porsche-990Porsche-991Porsche-992Porsche-993Porsche-994Porsche-995Porsche-996Porsche-997Porsche-998Porsche-999RequirementsPython^3.8InstallationpipinstallwordplexUsagefromwordpleximportWordPlex# Initialize the classwordplex=WordPlex()# Example method usage (adjust according to actual methods)result=wordplex.generate('CV')print(result)FeaturesConsonants and Vowels Handling: Provides lists of consonants and vowels for various processing needs.ContributingContributions to theWordPlexclass are welcome. Please fork the repository, make your changes, and submit a
pull request for review.LicenseMIT
Package: wordpredict
wordpredictThis is a library that predicts words for ambiguous input.InstallationpipinstallwordpredictHow to usecodeimportpandasaspdfromwordpredictimportWordPredictcorpus=pd.read_csv("./unigram_freq.csv",header=0,keep_default_na=False,).valueswp=WordPredict(corpus[:,0],corpus[:,1])print("start user input")input=["e","f","g","h"]print(wp.update(input))input=["e","f","g","h"]print(wp.update(input))input=["i","j","k","l"]print(wp.update(input))print("reset user input")wp.reset()input=["e","f","g","h"]print(wp.update(input))input=["m","n","o","p"]print(wp.update(input))outputstart user input
['for', 'e', 'from', 'he', 'has', 'have']
['he', 'get', 'here', 'her', 'help', 'few']
['help', 'held', 'felt', 'hell', 'hello', 'helps']
reset user input
['for', 'e', 'from', 'he', 'has', 'have']
['for', 'home', 'go', 'how', 'good', 'end']corpuse.g.,https://www.kaggle.com/datasets/rtatman/english-word-frequencyexecution time%%timeitimportpandasaspdfromwordpredictimportWordPredictcorpus=pd.read_csv("./unigram_freq.csv",header=0,keep_default_na=False,).valueswp=WordPredict(corpus[:,0],corpus[:,1])1.42 s ± 83.7 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)%%timeitinput=["e","f","g","h"]wp.update(input)input=["e","f","g","h"]wp.update(input)input=["i","j","k","l"]wp.update(input)8.34 ms ± 315 µs per loop (mean ± std. dev. of 7 runs, 100 loops each)noteautocomple was implemented with reference tohttps://doi.org/10.1145/3173574.3173755
Package: wordpress2markdown
Wordpress To Markdown=====================This is a script to convert wordpress.com style html (including sourcecode) into github flavour markdown.Script Usage============usage: Wordpress2Markdown [-h] [-f] wordpress_htmlThis script converts wordpress.com html into markdown syntax.positional arguments:wordpress_htmloptional arguments:-h, --help      show this help message and exit-f, --file      Read the Wordpress.com html from a fileHow it works============This passes over the text several times, converting a differentconstruction on each pass.Passes------1. &lt;h[1,2,3,4,5,6]> tags -> #, ##, ###, ####, #####, ###### pairs2. &lt;a href="url">title</a> -> \[title](url)3. [sourcecode language="lang"] -> ```lang4. [/sourcecode] -> ```5. &lt;!-- --> comments deleted, mainly due to &lt;!--more--> tags.Note converting [sourcecode] tags currently ignores any option but language.Unimplemented features:------------------------ ordered/unordered lists- images
Package: wordpress2zinnia
Wordpress2zinnia is package allowing you to migrate from WordPress to
Zinnia.InstallationInstall the package on your system:$ pip install wordpress2zinniaRegister the'zinnia_wordpress'in yourINSTALLED_APPS.Importing from WordpressOnce you have the XML file of your export, you simply have to do this.$ python manage.py wp2zinnia path/to/your/wordpress-export.xmlThis command will associate the post’s authors to User and
import the tags, categories, post and comments.For the options execute this.$ python manage.py help wp2zinniahttp://codex.wordpress.org/Tools_Export_SubPanelFrom Zinnia to WordPressWe also provides a command for exporting your Zinnia blog to WordPress in
the case you want to migrate on it.Simply execute this command:$ python manage.py zinnia2wp > export.xmlOnce you have the XML export, you can import it into your WordPress site.http://codex.wordpress.org/Importing_Content
Package: wordpress-backup-data
This Python script is made for doing a complete backup of your WordPress
blog’s data. It does exactly the same thing that the WordPress’ export
feature.InstallationWith pip (recommanded)pip install wordpress-backup-dataFrom sourcesgit clone https://github.com/SkypLabs/wordpress-backup-data.git
cd wordpress-backup-data
python setup.py installHow tousage: wp-backup-data [-h] [-u USER] [-p PASSWORD] [-P] [-O] [-a ADDRESS]
                      [-d DIRECTORY] [--http] [--https]
                      [--ignore-certificate] [-v]

Do a backup of your WordPress data

optional arguments:
  -h, --help            show this help message and exit
  -u USER, --user USER  username to use
  -p PASSWORD, --password PASSWORD
                        password to use
  -P, --prompt-for-password
                        prompt for password to use
  -O, --prompt-for-otp  prompt for Yubikey OTP to use
  -a ADDRESS, --address ADDRESS
                        root address of the WordPress blog (examples:
                        'blog.example.net' or '192.168.20.53')
  -d DIRECTORY, --directory DIRECTORY
                        directory where the backup file will be stored
  --http                use HTTP as protocol
  --https               use HTTPS as protocol (default)
  --ignore-certificate  ignore invalid certificates
  -v, --version         show program's version number and exit

Example: ./wp-backup-data -a blog.example.net -u user -PYubikey OTP supportIf you have secured your WordPress blog with theYubikey OTP
plugin, the-Ooption is made for you ! By this way, you will be prompted to enter your
OTP.With Dockerdocker run --rm -it -v <local path>:/backups docker.io/skyplabs/wordpress-backup-datalocal pathrefers to the folder on your host system where the backup
file will be stored.If you want to store the backup file in your current directory :docker run --rm -it -v $(pwd):/backups docker.io/skyplabs/wordpress-backup-dataAnd if you want to specify someoptions:docker run --rm -it -v $(pwd):/backups docker.io/skyplabs/wordpress-backup-data -d /backups <options>LicenseGPL version 3
Package: wordpress-oauth
Python REST API wrapper for WP-API/OAuth1Usageimport wordpress_oauth
api = wordpress_oauth.Wordpress("~/.config/pywordpress_oauth/config.yml")
image_path = "images/icon.png"
result = api.upload_image(image_path)This library asks auth setting on initial startup.Installationpip install wordpress_oauthRequirementsWP REST API - OAuth 1.0a ServerCompatibilityLicenceAuthorswordpress_oauth was written byfx-kirin.
Package: wordpress-py-client
DescriptionA WordPress client written in PythonUsagevar blog = new WordPress(config);blog.getPosts();
blog.getPost();SupportSeehttp://developer.wordpress.com/docs/apiBuildingsetup.pyis used to package up the plugin, install and distribute.make installinstalls the plugin as a package on your systemmake testruns the tests.make cleancleans.make releasepackages and uploads the plugin to [PyPI](http://pypi.python.org/pypi) for distribution.
Package: wordpress-recommender
Wordpress articles recommender app using PythonAn application to recommend articles from a Wordpress blog based on user's query using semantic searchPre-requisites:Adjust the below environment variables before running any of the below steps if required:DATA_LOC: Location where all the application data will be stored. By default, it is stored in adatafolder in the current directory. This folder will be created if it does not exist during creation.HuggingFace key (free) to use their inference endpoints to generate embeddings using Sentence Transformer models. Export the key to an environment variable calledHF_KEYbefore creating or querying the index as shown in the steps below.Override the default HuggingFace embeddings model by specifying the name in the environment variableHF_EMBEDDINGS_MODEL_NAME. If not provided, thesentence-transformers/all-MiniLM-l6-v2model is used to generate embeddings.How to use the CLI after installing the package from PyPI:Download content:wordpress-recommender download-content "https://learnwoo.com/post-sitemap1.xml"Build index using the downloaded content:wordpress-recommender generate-index "https://learnwoo.com/post-sitemap1.xml"Query index built in previous step:wordpress-recommender query-index "https://learnwoo.com/post-sitemap1.xml" --query "How are the AI regulations different in different parts of the world?"Release notes:0.1.1Initial release0.1.2Allow client to override the default HuggingFace inference API embeddings model via the environment variableHF_EMBEDDINGS_MODEL_NAMEAllow client to rebuild index by providing the option--rebuild_indexin the CLIBreaking changeReturn final output as a sorted pandas dataframe with all original columns present along with a new column for the score e.g.cosine_distanceorcosine_similarityAllow client to override the number of results returned by passing an optional--topparameter with an integer value0.1.3Minor updates to docsAdd testsAdd GitHub Actions to publish package
Package: wordpress-rss-archiver
wordpress-rss-archiverWordPress.com/Automattic.com charges you US$38,000 tohost your blog for 100 yearsand automatically submit your site to the Internet Archive?Well, We can do it for free... (the latter part at least, lol)Installationpipinstallwordpress-rss-archiverUsagewordpress-rss-archiver<feed_url>--ia-s3<access_key:secret_key>NOTE: register an Internet Archive account and get your access key and secret key fromhttps://archive.org/account/s3.php
Package: wordpresstools
Python WordPress ToolA collection of tools for managing WordPress installationsPhpVariableExtractorExtractorClass to extract variables from a PHP file as key value pairs in a Python dict.Install$ pip install wordpresstoolsUsage(example-env) utegrad@COMPUTER:/mnt/d/sources/wpcreds$ ipython
Python 3.6.8 (default, Jan 14 2019, 11:02:34)
Type 'copyright', 'credits' or 'license' for more information
IPython 7.7.0 -- An enhanced Interactive Python. Type '?' for help.

In [1]: from wptools.PhpVariableExtractor import Extractor

In [2]: php_vars = Extractor.extract('wp-config.php')

In [3]: print(php_vars['DB_HOST'])
10.10.0.44
Package: wordpress-to-puput
Import your Wordpress blog data into Puput.UsageInstall wordpress-to-puput package and its dependenciespip install wordpress-to-puputAddwordpress2puputto yourINSTALLED_APPSinsettings.pyfile.Run the management command:python manage.py wp2puput path_to_wordpress_export.xmlYou can optionally pass the slug and the title of the blog to the importer:python manage.py wp2puput path_to_wordpress_export.xml --slug=blog --title="Puput blog"