Saravanan666/pypi-org huggingface dataset:
Package: minlp-tokenizer
MiNLP-Tokenizer1. 工具介绍MiNLP-Tokenizer是小米AI实验室NLP团队自研的中文分词工具，基于深度学习序列标注模型实现，在公开测试集上取得了SOTA效果。其具备以下特点：分词效果好：基于深度学习模型在大规模语料上进行训练，粗、细粒度在SIGHAN 2005 PKU测试集上的F1分别达到95.7%和96.3%[1]轻量级模型：精简模型参数和结构，模型仅有20MB，在CPU（i7-6700 3.4GHz）环境下，分词速度可达到150KB/s词典可定制：灵活、方便的干预机制，根据用户词典对模型结果进行干预多粒度切分：提供粗、细粒度两种分词规范，满足各种场景需要调用更便捷：一键快速安装，API简单易用注1：我们结合公司应用场景，制定了粗、细粒度分词规范，并按照规范对PKU测试集重新进行了标注（由于测试集版权限制，未包含在本项目中）。2. 安装pip全自动安装：pip install minlp-tokenizer适用环境：Python 3.5~3.8，TensorFlow>=1.143. 使用API分词（逐句或者列表）：fromminlptokenizer.tokenizerimportMiNLPTokenizertokenizer=MiNLPTokenizer(granularity='fine')# fine：细粒度，coarse：粗粒度，默认为细粒度print(tokenizer.cut('今天天气怎么样？'))# 单句分词# ['今天','天气','怎么样']print(tokenizer.cut(['今天天气怎么样','小米的价值观是真诚与热爱']))# 列表分词# [['今天','天气','怎么样'],['小米','的','价值观','是','真诚','与','热爱']]多进程分词：
开启多个进程并行分词，加快分词速度：（1）由于开启进程需要额外的时间开销，适用于分词数量较大的情况，建议数量在10万+时启用多进程分词。（2）请根据自身硬件和负载情况，选择合适的进程数量，进程数默认为1，即不启用多进程。fromminlptokenizer.tokenizerimportMiNLPTokenizertexts=['小米的价值观是真诚与热爱']*2048tokenizer=MiNLPTokenizer(granularity='fine')# fine：细粒度，coarse：粗粒度，默认为细粒度result=tokenizer.cut(texts,n_jobs=4)# n_jobs：进程数，默认为1，即不启用多进程4. 自定义用户词典List添加/文件路径方式：fromminlptokenizer.tokenizerimportMiNLPTokenizertokenizer=MiNLPTokenizer(file_or_list=['word1','word2'],granularity='fine')# 用户自定义干预词典传入tokenizer=MiNLPTokenizer(file_or_list='/path/to/your/lexicon/file',granularity='coarse')# 构造函数的参数为用户词典路径5. 注意事项由于Windows和Linux对multi-processing的实现方法不同，Linux基于Fork实现多进程，Windows则是启动新进程。在Windows环境下使用多进程分词（n_jobs>1）时，请务必保证调用时在 if __name__=='__main__'之后（详情见：官方文档），例如：fromminlptokenizer.tokenizerimportMiNLPTokenizer# Windows 环境下使用多进程分词if__name__=='__main__':texts=['小米的价值观是真诚与热爱']*2048tokenizer=MiNLPTokenizer(granularity='fine')result=tokenizer.cut(texts,n_jobs=4)# n_jobs：进程数，默认为1，即不启用多进程6. 未来计划MiNLP是小米AI实验室NLP团队开发的小米自然语言处理平台，目前已经具备词法、句法、语义等数十个功能模块，在公司业务中得到了广泛应用。
第一阶段我们开源了MiNLP的中文分词功能，后续我们将陆续开源词性标注、命名实体识别、句法分析等功能，和开发者一起打造功能强大、效果领先的NLP工具集。7. 参与开发我们欢迎开发者向MiNLP-Tokenizer贡献代码，也欢迎提出各种Issue和反馈意见。
开发流程详见CONTRIBUTING.md。8. 开发者致谢感谢社区众多的开发者对MiNLP-Tokenizer提出的支持、意见、鼓励和建议。在此特别感谢以下开发者为MiNLP-Tokenizer分词工具贡献了PR：2020.12.4  aseaday 贡献了有关多进程分词的代码，提升了分词速度。9. 在学术成果中使用如果您在学术成果中使用了MiNLP中文分词工具，请按如下格式引用：中文：郭元凯, 史亮, 陈宇鹏, 孟二利, 王斌. MiNLP-Tokenizer：小米中文分词工具. 2020.英文：Yuankai Guo, Liang Shi, Yupeng Chen, Erli Meng, Bin Wang. MiNLP-Tokenzier: XiaoMi Chinese Word Segmenter. 2020.
Package: min-max-heap
min-max-heapA implementation of MinMaxHeap with Python language.Usagefrommin_max_heapimportMinMaxHeapheap=MinMaxHeap()foriinrange(100):heap.push(i)foriinrange(50):assertheap.pop_min()==iassertheap.pop_max()==99-iassertheap.is_empty()
Package: minmaxplus
# minmaxplus![“MinMax+”](./assets/minmaxplus.png)Small library that extends python’s built inminandmaxfunctions.## Installingpip install minmaxplus## UsageImport the module into your source code as needed.`python import minmaxplus from minmaxplus import minp, maxp, minmaxp `## Functionsminprequires indexed iterable sequence as arguementcalculates and returns minimum value and it’s indexmaxprequires indexed iterable sequence as arguementcalculates and returns maximum value and it’s indexminmaxrequires an indexed iterable sequence as arguementcalculates and returns minimum and maximum values and their indeces## LicenseGNU Lesser General Public License v3.0
Package: minmlst
minMLST is a machine-learning based methodology for identifying a minimal subset of genes that preserves high discrimination among bacterial strains. It combines well known machine-learning algorithms and approaches such as XGBoost, distance-based hierarchical clustering, and SHAP.
minMLST quantifies the importance level of each gene in an MLST scheme and allows the user to investigate the trade-off between minimizing the number of genes in the scheme vs preserving a high resolution among strains.See more information inGitHub.
Package: minmon
usage: minmon [-h] [-V] [-s SECONDS] [-f FORMAT] [-t]

MINimal MONitor - write and graph: date, time, memory, CPU, temperature, disk i/o and net i/o

MINMON  writes  on  standard  output  at  fixed time intervals a line built
according to the characters in -f --format argument:

    • 'y': Date as 'YYYY-mm-dd'
    • 'h': Time as 'HH:MM:SS'
    • 'm':  Memory  and  Swap  %  usage as two 2-characters decimal numbers
      ('**' = 100)
    • 'M':  Memory  and  Swap  % usage as a 21-characters '0-50-100' linear
      graph ('M' = Memory, 'S' = Swap, 'X' = both)
    • 'c':   CPU  %  usage  and  Temperature  °C  (Celsius  degrees)as  two
      2-characters decimal numbers ('**' = 100)
    • 'C':  CPU  %  usage  and Temperature °C as a 21-characters '0-50-100'
      linear graph ('C' = CPU, 'T' = temperature, 'X' = both)
    • 'r': disk Read and Write B/s (bytes per second) as two human-readable
      5-characters  numbers  ('K' = 2 ** 10 = 1024, 'M' = 2 ** 20 = 1024 **
      2, 'G' = 2 ** 30 = 1024 ** 3, 'T' = 2 ** 40 = 1024 ** 4)
    • 'R':  disk  Read  and Write B/s (bytes per second) as a 19-characters
      '1-K-M-G' logarithmic graph ('R' = Read, 'W' = write, 'X' = both)
    • 'd':  network  Download  and  Upload in B/s (bytes per second) as two
      human-readable 5-characters numbers
    • 'D':  network  Download  and  Upload  in  B/s (bytes per second) as a
      19-characters  '1-K-M-G'  logarithmic  graph  ('D'  = Download, 'U' =
      Upload, 'X' = both)

MINMON is minimal as it has a minimal RAM (6 MB) and CPU footprint.

To stop the program press Ctrl-C.

options:
  -h, --help            show this help message and exit
  -V, --version         show program's version number and exit
  -s SECONDS, --seconds SECONDS
                        interval in seconds as an integer greater than 0
                        (default: '1')
  -f FORMAT, --format FORMAT
                        output format (default: 'yhmMcCrRdD')
  -t, --tera-byte       extended 25-characters '1-K-M-G-T' logarithmic scale
                        (default: 19-characters '1-K-M-G')
Package: minnetonka
Minnetonka is a Python package forbusiness modeling and simulation.MotivationOver the last 25 years, I built many business simulation models, initially iniThink, then inPowersim, and since 2006 inForio SimLang.Forio SimLang is greatfor business modeling, powerful and expressive, with great support for arrays.
But lately I have encountered several occasions in
which SimLang is a good solution for modeling part of the problem, and an
existing Python package is a good solution for modeling another part of the
problem.For example, in 2016 I built a model in SimLang that included some simplegraph logic.
There are no graph primitives in SimLang, so I created the graphs using the
primitives available: arrays
and enums and floats. There are no built-in analytics to find the shortest
path in a weighted graph, so I wrote one, using theFloyd-Warshall algorithm.That model would have been far simpler had I used the Python packageNetworkXfor the graph logic, and used SimLang
for the other 80% of the model. What I needed was the expressivity of SimLang,
within a Python package, so I could easily integrate with NetworkX.Minnetonka is that combination: the power of Forio SimLang for business
modeling, delivered as a Python package. Minnetonka is an appropriate solution
when you want to model a business (or other social organization) in Python.FeaturesA Minnetonka model is a collection of variables. Each variable takes a value,
a value that can be of any Python data type: an integer, a float, a tuple, an
array, a dict, etc.A Minnetonka model is simulated over time. The variables in a model take
a succession of values during the simulation.Minnetonka variables are defined in terms of other Minnetonka variables via
Python functions, allowing arbitary Python code
to be executed at every simulation time step, for every variable.Minnetonka supportsstocks and flows. Stocks
allow circular dependencies among variables, to model the circular causality
underlying many business situations.Minnetonka introducestreatments, a primitive for value modeling. A single
variable can take one value in one treatment and take a different value in
a different treatment. For example, business earnings might be $20 million
per year in the as-is treatment, and $25 million per year in a to-be treatment,
with a planned investment generating additional earnings.Getting StartedBuilding a model in MinnetonkaAPI referenceInstallationDependendenciesMinnetonka requires Python 3.6, and depends on NumPy and SciPy.ContactSend me an email.LicenseApache License, Version 2.NamingMinnetonka is named afterLake Minnetonka, the
ninth largest lake in the US state of Minnesota.
Package: minnow
Minnow PythonUtilities for theMinnow file processing framework.importminnowCreate a processorA processor can be created by subclassingminnow.Processorand overriding itsprocessmethod, which must take a metadata file path, a data file path, and an output path.  The built-inrunmethod will take care of finding files to process in the input directory.importsysfrompathlibimportPathimportminnowclassMyProcessor(minnow.Processor):defprocess(self,metadata_file_path,data_file_path,output_path):metadata_dict=minnow.load_properties(metadata_file_path)data_file=data_file_path.open('rb')# Use 'r' for text and 'rb' for binary# Do whatever work here# Write 0, 1, or many data/metadata pairs as outputoutput_path.joinpath('mydata').write_bytes(my_output_data)minnow.save_properties(my_output_metadata_dict,output_path.joinpath('mydata.properties'))defmain():input_path=Path(sys.argv[1])output_path=Path(sys.argv[2])my_processor=MyProcessor(input_path,output_path)# Create an instance of your processormy_processor.run()if__name__=="__main__":main()UtilitiesTheminnow.Processorclass is basically a wrapper for many of the utilities below.  If you need more manual control, these utilities can be used directly.Load a .properties fileThis function will return the properties from a file as a dictionary.frompathlibimportPathprops=load_properties(Path('path/to/file.properties'))Save to a .properties fileThis function will save a dictionary as a .properties file.props={'type':'blueprints','orientation':'above','size':2}save_properties(props,Path('path/to/file.properties'))Finding files to processThis function will return pairs of data/metadata files in a directory asDataMetaPairinstances.pairs_to_process=list_pairs_at_path(Path('path/to/input/directory'))forpairinpairs_to_process:data_path=pair.data_pathproperties_path=pair.metadata_path# read the properties if you need toproperties_dict=load_properties(properties_path)# do some processing on each pairBy default,list_pairs_at_path()looks for.propertiesfiles, but you can change theextensionparameter:pairs_to_process=list_pairs_at_path(Path('path/to/input/directory'),extension='.json')forpairinpairs_to_process:data_path=pair.data_pathproperties_path=pair.metadata_path# read the properties if you need toproperties_json=json.load(properties_path.read_text())# do some processing on each pair
Package: minos-apigateway
API GatewayMinos is a framework which helps you createreactivemicroservices in Python.
Internally, it leverages Event Sourcing, CQRS and a message driven architecture to fulfil the commitments of an
asynchronous environment.DocumentationThe official documentation as well as the API you can find it underhttps://clariteia.github.io/api_gateway/.
Please, submit any issue regarding documentation as well!Set up a development environmentMinos usespoetryas its default package manager. Please refer to thePoetry installation guidefor instructions on how to install it.Now you con install all the dependencies by runningmakeinstallIn order to make the pre-commits checks available to git, runpre-commitinstallMake yourself sure you are able to run the tests. Refer to the appropriate section in this guide.Run the testsIn order to run the tests, please make sure you have theDocker EngineandDocker Composeinstalled.Move intotests/directorycdtests/Run service dependencies:docker-composeup-dInstall library dependencies:makeinstallRun tests:maketestHow to contributeMinos being an open-source project, we are looking forward to having your contributions. No matter whether it is a pull
request with new features, or the creation of an issue related to a bug you have found.Please consider these guidelines before you submit any modification.Create an issueIf you happen to find a bug, please file a new issue filling the 'Bug report' template.Set the appropriate labels, so we can categorise it easily.Wait for any core developer's feedback on it.Submit a Pull RequestCreate an issue following the previous steps.Fork the project.Push your changes to a local branch.Run the tests!Submit a pull request from your fork's branch.CreditsThis package was created withand theproject template.
Package: minos-apigateway-common
API Gateway CommonMinos is a framework which helps you createreactivemicroservices in Python.
Internally, it leverages Event Sourcing, CQRS and a message driven architecture to fulfil the commitments of an
asynchronous environment.DocumentationThe official documentation as well as the API you can find it underhttps://clariteia.github.io/api_gateway_common/.
Please, submit any issue regarding documentation as well!Set up a development environmentMinos usespoetryas its default package manager. Please refer to thePoetry installation guidefor instructions on how to install it.Now you con install all the dependencies by runningmakeinstallIn order to make the pre-commits checks available to git, runpre-commitinstallMake yourself sure you are able to run the tests. Refer to the appropriate section in this guide.Run the testsIn order to run the tests, please make sure you have theDocker EngineandDocker Composeinstalled.Move intotests/directorycdtests/Run service dependencies:docker-composeup-dInstall library dependencies:makeinstallRun tests:maketestHow to contributeMinos being an open-source project, we are looking forward to having your contributions. No matter whether it is a pull
request with new features, or the creation of an issue related to a bug you have found.Please consider these guidelines before you submit any modification.Create an issueIf you happen to find a bug, please file a new issue filling the 'Bug report' template.Set the appropriate labels, so we can categorise it easily.Wait for any core developer's feedback on it.Submit a Pull RequestCreate an issue following the previous steps.Fork the project.Push your changes to a local branch.Run the tests!Submit a pull request from your fork's branch.CreditsThis package was created withand theproject template.
Package: minos-auth
Minos AuthMinos is a framework which helps you createreactivemicroservices in Python.
Internally, it leverages Event Sourcing, CQRS and a message driven architecture to fulfil the commitments of an
asynchronous environment.DocumentationThe official documentation as well as the API you can find it underhttps://clariteia.github.io/minos_auth/.
Please, submit any issue regarding documentation as well!Set up a development environmentMinos usespoetryas its default package manager. Please refer to thePoetry installation guidefor instructions on how to install it.Now you con install all the dependencies by runningmakeinstallIn order to make the pre-commits checks available to git, runpre-commitinstallMake yourself sure you are able to run the tests. Refer to the appropriate section in this guide.Run the testsIn order to run the tests, please make sure you have theDocker EngineandDocker Composeinstalled.Move intotests/directorycdtests/Run service dependencies:docker-composeup-dInstall library dependencies:makeinstallRun tests:maketestHow to contributeMinos being an open-source project, we are looking forward to having your contributions. No matter whether it is a pull
request with new features, or the creation of an issue related to a bug you have found.Please consider these guidelines before you submit any modification.Create an issueIf you happen to find a bug, please file a new issue filling the 'Bug report' template.Set the appropriate labels, so we can categorise it easily.Wait for any core developer's feedback on it.Submit a Pull RequestCreate an issue following the previous steps.Fork the project.Push your changes to a local branch.Run the tests!Submit a pull request from your fork's branch.CreditsThis package was created withCookiecutterand theMinos Packageproject template.
Package: minos-auth-credential
Minos Auth CredentialMinos is a framework which helps you createreactivemicroservices in Python.
Internally, it leverages Event Sourcing, CQRS and a message driven architecture to fulfil the commitments of an
asynchronous environment.DocumentationThe official documentation as well as the API you can find it underhttps://clariteia.github.io/minos_auth_credential/.
Please, submit any issue regarding documentation as well!Set up a development environmentMinos usespoetryas its default package manager. Please refer to thePoetry installation guidefor instructions on how to install it.Now you con install all the dependencies by runningmakeinstallIn order to make the pre-commits checks available to git, runpre-commitinstallMake yourself sure you are able to run the tests. Refer to the appropriate section in this guide.Run the testsIn order to run the tests, please make sure you have theDocker EngineandDocker Composeinstalled.Move intotests/directorycdtests/Run service dependencies:docker-composeup-dInstall library dependencies:makeinstallRun tests:maketestHow to contributeMinos being an open-source project, we are looking forward to having your contributions. No matter whether it is a pull
request with new features, or the creation of an issue related to a bug you have found.Please consider these guidelines before you submit any modification.Create an issueIf you happen to find a bug, please file a new issue filling the 'Bug report' template.Set the appropriate labels, so we can categorise it easily.Wait for any core developer's feedback on it.Submit a Pull RequestCreate an issue following the previous steps.Fork the project.Push your changes to a local branch.Run the tests!Submit a pull request from your fork's branch.CreditsThis package was created withCookiecutterand theMinos Packageproject template.
Package: minos-auth-token
Minos Auth TokenMinos is a framework which helps you createreactivemicroservices in Python.
Internally, it leverages Event Sourcing, CQRS and a message driven architecture to fulfil the commitments of an
asynchronous environment.DocumentationThe official documentation as well as the API you can find it underhttps://clariteia.github.io/minos_auth_token/.
Please, submit any issue regarding documentation as well!Set up a development environmentMinos usespoetryas its default package manager. Please refer to thePoetry installation guidefor instructions on how to install it.Now you con install all the dependencies by runningmakeinstallIn order to make the pre-commits checks available to git, runpre-commitinstallMake yourself sure you are able to run the tests. Refer to the appropriate section in this guide.Run the testsIn order to run the tests, please make sure you have theDocker EngineandDocker Composeinstalled.Move intotests/directorycdtests/Run service dependencies:docker-composeup-dInstall library dependencies:makeinstallRun tests:maketestHow to contributeMinos being an open-source project, we are looking forward to having your contributions. No matter whether it is a pull
request with new features, or the creation of an issue related to a bug you have found.Please consider these guidelines before you submit any modification.Create an issueIf you happen to find a bug, please file a new issue filling the 'Bug report' template.Set the appropriate labels, so we can categorise it easily.Wait for any core developer's feedback on it.Submit a Pull RequestCreate an issue following the previous steps.Fork the project.Push your changes to a local branch.Run the tests!Submit a pull request from your fork's branch.CreditsThis package was created withCookiecutterand theMinos Packageproject template.
Package: minos-broker-kafka
minos-broker-kafkaSummaryMinos is a framework which helps you createreactivemicroservices in Python. Internally, it leverages Event Sourcing, CQRS and a message driven architecture to fulfil the commitments of an asynchronous environment.InstallationInstall the dependency:pipinstallminos-broker-kafkaModifyconfig.ymlfile:...interfaces:broker:port:minos.networks.BrokerPortcommon:host:localhostport:9092queue:records:1000retry:2publisher:client:minos.plugins.kafka.KafkaBrokerPublisherqueue:minos.networks.PostgreSqlBrokerPublisherQueuesubscriber:client:minos.plugins.kafka.KafkaBrokerSubscriberqueue:minos.networks.PostgreSqlBrokerSubscriberQueue...DocumentationThe official API Reference is publicly available at theGitHub Pages.Source CodeThe source code of this project is hosted at theGitHub Repository.Getting HelpFor usage questions, the best place to go to isStackOverflow.Discussion and DevelopmentMost development discussions take place over theGitHub Issues. In addition, aGitter channelis available for development-related questions.LicenseThis project is distributed under theMITlicense.
Package: minos-broker-rabbitmq
minos-broker-rabbitmqSummaryMinos is a framework which helps you createreactivemicroservices in Python. Internally, it leverages Event Sourcing, CQRS and a message driven architecture to fulfil the commitments of an asynchronous environment.InstallationInstall the dependency:pipinstallminos-broker-rabbitmqModifyconfig.ymlfile:...interfaces:broker:port:minos.networks.BrokerPortcommon:host:localhostport:5672queue:records:1000retry:2publisher:client:minos.plugins.rabbitmq.RabbitMQBrokerPublisherqueue:minos.networks.PostgreSqlBrokerPublisherQueuesubscriber:client:minos.plugins.rabbitmq.RabbitMQBrokerSubscriberqueue:minos.networks.PostgreSqlBrokerSubscriberQueuevalidator:minos.networks.PostgreSqlBrokerSubscriberDuplicateValidator...DocumentationThe official API Reference is publicly available at theGitHub Pages.Source CodeThe source code of this project is hosted at theGitHub Repository.Getting HelpFor usage questions, the best place to go to isStackOverflow.Discussion and DevelopmentMost development discussions take place over theGitHub Issues. In addition, aGitter channelis available for development-related questions.LicenseThis project is distributed under theMITlicense.
Package: minos-cli
Minos CLI: Minos' microservices up and runningSummaryMinos CLI is a command line tool that helps you create and deploy Minos' microservices. Through its simple command
structure, you'll get your microservices up and running as fast as you've coded your business logic.QuickstartFirst, we need to create a project to host our microservicesminosnewprojecttestprojectcdtestproject/Our project has dependencies from services that we need to setminossetdatabasepostgres
minossetbrokerkafka
minossetdiscoveryminos
minossetapi-gatewayminosOnce we've the dependencies set, the project is ready to get a new microservice!minosnewmicroservicetestmicroserviceIt's time to deploy our systemdocker-composeup-dYou can test the default endpoints through theapi-gatewayusingcurllocalhost:5566/testmicroservices
curl-XPOSTlocalhost:5566/testmicroservicesTime to start coding! Yes, already!DocumentationComing soon...Source CodeThe source code of this project is hosted atGitHub Repository.Getting HelpFor usage questions, the best place to go to isStackOverflow.Discussion and DevelopmentMost development discussions take place over theGitHub Issues. In addition, aGitter channelis available for development-related
questions.How to contributeWe are looking forward to having your contributions. No matter whether it is a pull request with new features, or the
creation of an issue related to a bug you have found.Please consider these guidelines before you submit any modification.Create an issueIf you happen to find a bug, please file a new issue filling the 'Bug report' template.Set the appropriate labels, so we can categorise it easily.Wait for any core developer's feedback on it.Submit a Pull RequestCreate an issue following the previous steps.Fork the project.Push your changes to a local branch.Run the tests!Submit a pull request from your fork's branch.LicenseThis project is distributed under theMITlicense.