Saravanan666/pypi-org huggingface dataset:
Package: wikitoexcel
WikiToExcelUse is trivial as shown below:from wikitoexcel import wikiToExcel
w2e = wikiToExcel(infile="./wikitbl.txt")
# print the html representation of wiki markup
print w2e.getHTML()
# save excel file to out.xlsx
w2e.saveExcel(fileName="out.xlsx")Options are:wikiToExcel(wikiContent=<wikistr>, infile=<wikiTextFile>)Featureswikitoexcel can capture:Font styling: bold, underline, strikethroughCell styling: foreground color, background colorSupports merged cellsSheet name is captured as caption of the wiki tableMultiline cell contents are styled with ‘wrap’ in excelspan and div elements are converted to their inner text representationHyperLinks are addressed in a way that the hyperlink and display text are presented side by side. This facilitates round-trip between exceltowiki and wikitoexcel. Such as:http://yahoo.comYahoo!Support for saving intermediate html representationwikitoexcel currently cannot capture anything more complex than the above list.
Features such as a font styling within a paragraph is not captured.NotesIf implementing this as a web.py call:You can construct a simple HTML form post with a textarea (below assumes textarea name is ‘wikitoexcel’)Add the following classclasswikitoexcel():defPOST(self):formdata=web.input()w2e=wikiToExcel(wikiContent=formdata['wikitoexcel'])sbuf=StringIO.StringIO()w2e.saveExcel(fileObj=sbuf)web.header('Content-type','application/vnd.openxmlformats-officedocument.spreadsheetml.sheet')returnsbuf.getvalue()Release Notes: 0.1.7Minor update to handling empty cells or with &nbsp;. And some cleanupRelease Notes: 0.1.6Bug found and fixed for creating a worksheet.Release Notes: 0.1.5Clean up of setup.py and minor changesRelease Notes: 0.1.4Added option to output in inline format using double pipe separator notation vs line by line format.Set the package level variable: wikitoexcel.INLINE_FMT=True (default)To allow multiline text, a BR tag is replaced for each return characterRelease Notes: 0.1.3Added license file
Rewrote parser to retain wikimarkup within cells. This allows an excel user to passthrough wiki markup.Release Notes: 0.1.2Packaging was not following best practice of examples within the package.Release Notes: 0.1.1Initial Release
Package: wikitools
A Python package for interacting with a MediaWiki wiki using the MediaWiki API.
Designed for MediaWiki version 1.20 and higher, should work on 1.13+.
The edit-API must be enabled on the site to use editing features.
Please report any bugs to the tracker on Github.If you are using the development alpha version of MediaWiki (as Wikipedia does), you should consider using the development version of wikitools, which can be downloaded via Github from the project homepage link.Note that due to developer time constraints, only the most recent release and
the Git version are supported and receive bugfix releases. For major bugs
affecting old versions, a patch may be released.The simplejson package is required for Python < 2.6 and the poster package is
required for file upload support (both are available on pypi).The 1.3 release fixes several bugs and adds support for MediaWiki’s new token retrieval and query continuation method. See the changelog for more details.Files are signed with the author’s public key:0E07BEA4.Changes since last release:CHANGELOG.
Package: wiki-tools
WikiToolsDescriptionWikiFillerWikiFiller generates and fills templates of Wikipedia with ease. It does all the stuff behind the scenes using selenium and other modules so you don't have to.### WikiFinder
WikiFinder finds other isomers of molecular formula based on compound name and directly. Atoms changes is also available for given molecular formula. (It isn't much use of normal wiki editing)Installationpip install wiki-toolspython3 setup.py installUsageWikiFillderusage: WikiFiller [-h] [-c | -d] [-n NAME] [-o OUTPUT]

optional arguments:
  -h, --help            show this help message and exit
  -c, --chembox         Generates chembox
  -d, --drugbox         Generates drugbox
  -n NAME, --name NAME  Enter pubchem compound name from pubchem url
  -o OUTPUT, --output OUTPUT
                        Enter output filename### WikiFinder
```
usage: WikiFinder [-h] [-m MOLECULAR_FORMULA | -n NAME] [-c [CHANGE ...]]
                  [-o OUTPUT]optional arguments:
-h, --help            show this help message and exit
-m MOLECULAR_FORMULA, --molecular-formula MOLECULAR_FORMULA
Outputs list of chemicals from molecular formula
-n NAME, --name NAME  Ouputs list of chemicals matching compound molecular
formula from name
-c [CHANGE ...], --change [CHANGE ...]
Enter atom change of compound using spaces. '+'
increases atom while '_' decreases. Eg -c '_C1' '+H3'
-o OUTPUT, --output OUTPUT
Enter output filename## Example
### WikiFiller
1. Generate and fill chembox template of Ascorbic acid taken from (https://pubchem.ncbi.nlm.nih.gov/compound/Ascorbic-acid). The output is automatically copied to system clipboard
* ```WikiFiller -c -n 'Ascorbic-acid'```
2. Generate and fill drugbox template of Salvinorin A taken from (https://pubchem.ncbi.nlm.nih.gov/compound/Salvinorin-A) and generates output.
* ```WikiFiller -d -n 'Salvinorin-A' -o SalvinorinDraft```
<hr>
### WikiFinder
Later.

## Limitations
1. Might fetch wrong data or sometimes no data.
2. WikiFinder is in developmental stage
Package: wikitrad
wikitradInstallationwikitradis available onPyPI:pip install wikitradUsageLanguage codes refer to the language codes used by wikipedia:enforen.wikipedia.org,frforfr.wikipedia.org, etc.Without specifying the source languagewikitrad "word to translate" target_language_codespecifying the source languagewikitrad source_language_code "word to translate" target_language_code
Package: wikivector
wikivectorTools for encoding Wikipedia articles as vectors.InstallationTo get the latest stable version:pipinstallwikivectorTo get the development version:pipinstallgit+git://github.com/mortonne/wikivectorExporting Wikipedia textFirst, runWikiExtractoron a Wikipedia dump. This will generate a directory with many
subdirectories and text files within each subdirectory. Next, build
a header file with a list of all articles in the extracted text data:wiki_headerwiki_dirwherewiki_diris the path to the output fromWikiExtractor.
This will create a CSV file calledheader.csvwith the title of each
article and the file in which it can be found.To extract specific articles, write a CSV file with two columns: "item"
and "title". The "title" for each item must exactly match an article
title in the Wikipedia dump. We refer to this file as themap_file.If you are working with an older Wikipedia dump, it can be difficult to
find the correct titles for article pages, as page titles may have changed
between the archive and the current online version of Wikipedia. To help
identify mismatches between the map file and the Wikipedia dump, you can
run:wiki_check_mapheader_filemap_fileto display any items whose article is not found in the header file. You
can then use the Bash utilitygrepto search the header file for correct
titles for each missing item.When your map file is ready, extract the text for each item:export_articlesheader_filemap_fileoutput_dirwheremap_fileis the CSV file with your items, andoutput_diris
where you want to save text files with each item's article. Check the
output carefully to ensure that you have the correct text for each item
and that XML tags have been stripped out.Universal Sentence EncoderOnce articles have been exported, you can calculate a vector embedding
for each item using the Universal Sentence Encoder.embed_articlesmap_filetext_dirh5_fileThis reads a map file specifying an item pool (only the "item" field is
used) and outputs vectors in an hdf5 file. To read the vectors, in
Python:fromwikivectorimportvectorvectors,items=vector.load_vectors(h5_file)CitationIf you use wikivector, please cite the following paper:Morton, NW*, Zippi, EL*, Noh, S, Preston, AR. In press.
Semantic knowledge of famous people and places is represented in hippocampus and distinct cortical networks.
Journal of Neuroscience. *authors contributed equally
Package: wikiwall
wikiwallis a CLI that downloads a random image from Wikiart’s Hi-Res page and sets it as your desktop background in macOS.FeaturesEasily customize your desktop with new hi-res artwork from the command line.Update your wallpaper periodically with your favorite scheduler.RequirementsPython 3.6 or highermacOSInstallation$ pip3 install wikiwallIf you want, set your wallpaper to change every night with launchd:$ git clone https://github.com/kylepw/wikiwall.git && cd wikiwall
$ sed -i.bak -e "s|WIKIWALL|$(which wikiwall)|g" wikiwall.plist
$ cp wikiwall.plist ~/Library/LaunchAgents
$ launchctl load ~/Library/LaunchAgents/wikiwall.plistUsage$ wikiwall --help
Usage: wikiwall [OPTIONS] COMMAND [ARGS]...

  Set desktop background in macOS to random WikiArt image.

Options:
  --dest TEXT      Download images to specified destination.
  --limit INTEGER  Number of files to keep in download directory. Set to -1
                   for no limit. Default is 10.
  --debug          Show debugging messages.
  --help           Show this message and exit.

Commands:
  show  Show previous downloads in Finder.TodoSet wallpaper on a desktop not currently being viewed.Add support for other operating systems.Provide preview of image before setting as background.LicenseMIT License
Package: wikiweb
WikiWebEver wonder if there’s a better way to play the link game? Well here you go! Your personal Wikipedia crawler.Free software: MIT licenseDocumentation:https://wikiweb.readthedocs.io.FeaturesTODOCreditsThis package was created withCookiecutterand theaudreyr/cookiecutter-pypackageproject template.History0.1.0 (2018-06-28)First release on PyPI.
Package: wikiwho-pickle
wikiwho_picklescript and dependencies to open a wikiwho pickle independent of the API infraestructureInstallpip install git+git://github.com/gesiscss/wikiwho_pickle.git@masteror, add this line to therequirements.txtfile:git+git://github.com/gesiscss/wikiwho_pickle.git@master#egg=wikiwho_pickleand executepip install -r requirements.txtExampleSee theexample.pyfile.
Package: wikiwho-wrapper
wikiwho_wrapperA light/simple Python wrapper for theWikiWho API.TheWikiWho APIprovides the first editor (author) of Wikipedia words (tokens). It also provides the history of each of the tokens, i.e. in which revisions (and which editors) was the token (re)inserted or removed. The API is based on theWikiWho algorithm(~95% acc.).Find full information and how to cite this work inapi.wikiwho.net.InstallationRequires python >= 3.6pip install wikiwho_wrapperHow to use it?First, you need an instance of the WikiWho.from wikiwho_wrapper import WikiWho
ww = WikiWho() # or WikiWho(USERNAME, PASSWORD)You can either use api with the JSON (raw format from api.wikiwho.net)response = ww.api.all_content("Bioglass")Or you can use the dataview to obtain a pandas DataFrame representation of the datadataView = ww.dv.all_content("Bioglass")Note that all the methods, and classes can receive parameters. All the parameters of the API are currently supported. For now, you can check them directly in thecode.TutorialThe Github repository of the tutorial is availablehere.
Package: wikiwords
This Python module can be used to quickly retrieve absolute word frequency
for English language, as used in Wikipedia articles as of year 2012.Author: Paweł Foremski <pjf@iitis.pl>, IITiS PANhttp://www.iitis.plUsage>>> import wikiwords
>>> wikiwords.freq("monty")
6.348454761413523e-06
>>> wikiwords.occ("python")
18972
>>> wikiwords.freq("no such word", lambda x: 1./len(x))
0.08333333333333333Installation$ sudo pip install wikiwords
Package: wikiWrapper
wikiWrapperAboutwikiWrapper is a basic python module designed to make working with the mediawiki action API easier.UsageJust place wikiWrapper.py in your working directory and import it into your program. It will be available on PyPi soon.Creating a search:importwikiWrapperquery=wikiWrapper.SearchQuery("Penguin")SearchQuery parameters:def __init__(self, search_q, host="wikipedia", srnamespace=0, srlimit=10, sroffset=0, srqiprofile="classic", _format="json")search_q: This should be a string containing the search you are enacting. It is the only mandatory parameterhost: This should be a string. It chooses which member of the WikiMedia foundation you wish to make the search to. The default value of this parameter is "wikipedia". Accepted values are("wikipedia", "wikibooks", "wikidata")srnamespace: This should be an integer or a string. It chooses which namespace on the wikimedia pages you wish to execute your search on. For all namespaces, use"*". The default value of this parameter is0.srlimit: This should be an integer or a string. The amount of pages to return from a search. The default value of this parameter is10.sroffset: This should be an integer or a string. Shifts results forward by specified amount. The default value of this parameter is0srqiprofile: This should be a string. Chooses the algorithm used by the MediaWiki API to find your search results. The default value of this parameter is"classic". Accepted values are("classic", "classic_noboostlinks", "empty", "wsum_inclinks", "wsum_inclinks_pv", "popular_inclinks_pv", "popular_inclinks", "engine_autoselect")_format: The format you want your data back in. Default value is"json"Methodsquery.search():
Returns raw HTTP request from the wikipedia page.query.content_summary():
Returns the content summary of the search_q parameter's wiki page.
Package: wiki-xmlrpc-extensions
Toolset for doing xmlrpc requests using a MoinMoin wikiIt simplifies some common tasks:ListPages: lists pages from a wiki.ReceiveFiles: downloads files from a wiki pageSendFiles: uploads files to a wiki page and if the page does not exists it create a wiki page in wiki format using the AttachFile macro.ForkWikiContent: Forks all content of the wiki a user can access by sending it to another wiki installation.For further informations seehttps://utils.icg.kfa-juelich.de/docs/wiki-xmlrpc-extensions
Package: wiko
Wiko, the Wiki CompilerBy David Garcia and Pau ArumiDescriptionWe do not recommended to use Wiko in new projects.
This is a quite deprecated zombie project from 2007.
It is kept alive because it is still being used to generate some websites pending to be migrated to modern static generators.WiKo is a very simple but powerful python script
which takes files withwikicontent in a given directory
and either builds aweb, aLaTeX articleor ablog.
It is very recommended to use it in tandem
with a collaborative versioning systems
in order to publish on commit.Main benefits of using WiKo are:An easy and readable wiki like format that generates LaTeX and HTML indistinctlyYou can use your favourite text editor instead web forms to edit contentYou don't need to reformat content to reuse it from the web to a LaTeX article or to a blog.You can change the look of your entire site by changing common headers, side bars, footers and styling in a pair of files which are content independent. And still it is an static web site.You can put your web site or your article under a versioning system (cvs, svn...) for collaborative elaboration and having a published version that updates on commit.UsageExamplesScreenshotsThe original Sourceforge projectInstallationpipinstallwikoSystem dependenciespython-bibtex: Optional. For nicer HTML bibliography.mimetex: Optional. Alternative to avoid relying on external services for formulae in HTML output.FeaturesCommon formattingText formating:'''bold''',''italics''...Hypertext and anchoring:[[http://lalala.com links]]and the likeLists and enumerationsTable of content generation for HTML pagesLaTeX constructs supported on both formats: figures, formulae, bibliography, footnotes...Automatic recompilation of some image formats (dia->eps/png, dot->eps/png, eps->pdf...)User definable paragraphs typesUseful constructs for elaboration such as to-do notes and reviewers notesGallery generationBloggingThe blog mode takes the wiki files as blog entries and
combines and distributes them in different pages and RSS's
according to attributes you can define for each entry
such as publication date, author, tags...a front page with newer entries,RSSfile with the last entriesfiltered pages with entries by the same author or with a given tag,graphical import tool from Blogger and Wordpressobjects for the sidebar with archived entries and tags listAuthorsThis script has been developed mainly by ''David Garcia Garzon'' and ''Pau Arumi Albo''.
They developed the script for their own personal use
on their webs, scientific articles and even their thesis.
See at theWiKo examples page.
Package: wikt-cli
wikt-cliInstallationFrom pypi:pip install wikt-cliFrom source: clone this repo, runpython setup.py bdist_wheel,Usagewikt <word>Example outputThe output ofEtymology:
    From meta-, back-formed from metaphysics.

    Definitions:
        (adjective) meta (comparative more meta, superlative most meta) (informal)
        Self-referential; structured analogously, but at a higher level.

Etymology:
    From Latin mēta.

    Definitions:
        (noun) meta (plural metas) Boundary marker. Either of the conical columns at
        each end of a Roman circus.

Etymology:
    Clipping of metagame.

    Definitions:
        (noun) meta (plural metas) (video games) Metagame; the most effective tactics
        and strategies used in a competitive video game.

        (adjective) meta (comparative more meta, superlative most meta) (video games)
        Prominent in the metagame; effective and frequently used in competitive
        gameplay.

Etymology:
    Clipping of metaoidioplasty.

    Definitions:
        (noun) meta (plural metas) (informal) Metoidioplasty.ContributingUsinggit.sr.ht, you don't need an account to contribute! Send "issues" as normal emails (remember to use plaintext, not HTML), and "pull/merge requests" as a patch (seegit-send-email.
Package: wiktionary-de-parser
wiktionary-de-parserA Python module to extract data from German Wiktionary XML files (for Python 3.11+).FeaturesExtractsIPA transcriptions,hyphenation,language,part of speechinformation (basic),genusandflexion tablesof a word.Yields per entry, not per page (a page can have multiple entries/ words can have different meanings)Installationpip install wiktionary-de-parserOr withPoetry:poetry add wiktionary-de-parserUsageLoading the XML dump filefromwiktionary_de_parserimportWiktionaryParserfromwiktionary_de_parser.dump_processorimportWiktionaryDump# To download the dump file, specify the directory where the# dump file should be stored.dump=WiktionaryDump(dump_dir_path="directory-of-dump-file")# This will download "dewiktionary-latest-pages-articles-multistream.xml.bz2" to# the directory specified in `dump_dir_path`.dump.download_dump()# Alternatively you can specify a different dump file to download.dump=WiktionaryDump(dump_dir_path="directory-of-dump-file",dump_download_url="url-to-dump-file.xml.bz2",)dump.download_dump()# If you already have the dump file locally, specify the path to the file.dump=WiktionaryDump(dump_file_path="path-to-dump-file.xml.bz2")dump.download_dump()Parsing the dump filefrompprintimportpprintfromwiktionary_de_parserimportWiktionaryParser# ... (see above)parser=WiktionaryParser()forpageindump.pages():# Skip redirectsifpage.redirect_to:continueifpage.name=="Abend":# Parse all entries for "Abend"forentryinparser.entries_from_page(page):results=parser.parse_entry(entry)pprint(results)breakOutputAll page entries for "Abend":ParsedWiktionaryPageEntry(name="Abend",hyphenation=["Abend"],flexion={"Genus":"m","Nominativ Singular":"Abend","Nominativ Plural":"Abende","Genitiv Singular":"Abends","Genitiv Plural":"Abende","Dativ Singular":"Abend","Dativ Plural":"Abenden","Akkusativ Singular":"Abend","Akkusativ Plural":"Abende",},ipa=["ˈaːbn̩t","ˈaːbm̩t"],language=Language(lang="Deutsch",lang_code="de"),lemma=Lemma(lemma="Abend",inflected=False),pos={"Substantiv":[]},rhymes=["aːbn̩t"],)ParsedWiktionaryPageEntry(name="Abend",hyphenation=["Abend"],flexion=None,ipa=["ˈaːbn̩t"],language=Language(lang="Deutsch",lang_code="de"),lemma=Lemma(lemma="Abend",inflected=False),pos={"Substantiv":["Nachname"]},rhymes=["aːbn̩t"],)ParsedWiktionaryPageEntry(name="Abend",hyphenation=["Abend"],flexion=None,ipa=["ˈaːbn̩t","ˈaːbm̩t"],language=Language(lang="Deutsch",lang_code="de"),lemma=Lemma(lemma="Abend",inflected=False),pos={"Substantiv":["Toponym"]},rhymes=["aːbn̩t"],)DevelopmentThis project usesPoetry.InstallPoetry.Clone this repositoryRunpoetry installinside of the project folder to install dependencies.There is anotebook.ipynbto test the parser.Runpoetry run pytestto run tests.LicenseMIT© Gregor Weichbrodt
Package: wiktionaryparser
Wiktionary ParserA python project which parses word content from Wiktionary in an easy to use JSON format.
Right now, it parses etymologies, definitions, pronunciations, examples, audio links and related words.JSON structure[{"pronunciations":{"text":["pronunciation text"],"audio":["pronunciation audio"]},"definitions":[{"relatedWords":[{"relationshipType":"word relationship type","words":["list of related words"]}],"text":["list of definitions"],"partOfSpeech":"part of speech","examples":["list of examples"]}],"etymology":"etymology text",}]InstallationUsing piprunpip install wiktionaryparserFrom SourceClone the repo or download the zipcdto the folderrunpip install -r "requirements.txt"UsageImport the WiktionaryParser class.Initialize an object and use thefetch("word", "language")method.The default language is English, it can be changed using theset_default_language method.Include/exclude parts of speech to be parsed usinginclude_part_of_speech(part_of_speech)andexclude_part_of_speech(part_of_speech)Include/exclude relations to be parsed usinginclude_relation(relation)andexclude_relation(relation)Examples>>>fromwiktionaryparserimportWiktionaryParser>>>parser=WiktionaryParser()>>>word=parser.fetch('test')>>>another_word=parser.fetch('test','french')>>>parser.set_default_language('french')>>>parser.exclude_part_of_speech('noun')>>>parser.include_relation('alternative forms')Requirementsrequests==2.7.0beautifulsoup4==4.4.0ContributionsIf you want to add features/improvement or report issues, feel free to send a pull request!
Package: wiktionaryparser-ml
Wiktionary ParserA python project which parses word content from Wiktionary in an easy to use JSON format.
Right now, it parses etymologies, definitions, pronunciations, examples, audio links and related words.JSON structure[{"pronunciations":{"text":["pronunciation text"],"audio":["pronunciation audio"]},"definitions":[{"relatedWords":[{"relationshipType":"word relationship type","words":["list of related words"]}],"text":["list of definitions"],"partOfSpeech":"part of speech","examples":["list of examples"]}],"etymology":"etymology text",}]InstallationUsing piprunpip install wiktionaryparserFrom SourceClone the repo or download the zipcdto the folderrunpip install -r "requirements.txt"UsageImport the WiktionaryParser class.Initialize an object and use thefetch("word", "language")method.The default language is English, it can be changed using theset_default_language method.Include/exclude parts of speech to be parsed usinginclude_part_of_speech(part_of_speech)andexclude_part_of_speech(part_of_speech)Include/exclude relations to be parsed usinginclude_relation(relation)andexclude_relation(relation)Examples>>>fromwiktionaryparserimportWiktionaryParser>>>parser=WiktionaryParser()>>>word=parser.fetch('test')>>>another_word=parser.fetch('test','french')>>>parser.set_default_language('french')>>>parser.exclude_part_of_speech('noun')>>>parser.include_relation('alternative forms')Requirementsrequests==2.20.0beautifulsoup4==4.4.0ContributionsIf you want to add features/improvement or report issues, feel free to send a pull request!LicenseWiktionary Parser is licensed underMIT.