semvec/pypi-packages huggingface dataset:
detokenize 0.0.4
Package to detokenize the stream of tokens
Requires Python: >=3.7

# De-Tokenize

-----------------

![Package](https://img.shields.io/badge/Package-detokenize-brightgreen)
[![PyPI version](https://badge.fury.io/py/detokenize.svg)](https://badge.fury.io/py/detokenize)
![Author](https://img.shields.io/badge/author-littinrajan-blue)
![License](https://img.shields.io/github/license/littinrajan/bank_statement_renamer)
[![made-with-python](https://img.shields.io/badge/Made%20with-Python-1f425f.svg)](https://www.python.org/)
[![Python 3.7](https://img.shields.io/badge/python-3.7-blue.svg)](https://www.python.org/downloads/release/python-370/)
[![Downloads](https://static.pepy.tech/personalized-badge/detokenize?period=total&units=international_system&left_color=grey&right_color=brightgreen&left_text=PyPI%20Downloads)](https://pepy.tech/project/detokenize)

## What is it?
**De-Tokenize** is a Python  package which provides fast, accurate structuring of tokens back to original sentence form.

## Contributor
**Littin Rajan**

## Main Features
  - Light-weight package
  - No more dependencies
  - Powerful, flexible

## Where to get it?
The source code is currently hosted on GitHub at: https://github.com/littinrajan/detokenize

Binary installers for the latest released version are available at the [Python
Package Index (PyPI)](https://pypi.org/project/detokenize) and on [Conda](https://docs.conda.io/en/latest/).

```sh
# conda
conda install detokenize
```

```sh
# or PyPI
pip install detokenize
```

## Usage

```sh
from detokenize.detokenizer import detokenize

sample_tokens = ['These', 'are', 'some', 'tokens', '.']
sentence = detokenize(sample_tokens)
```

## License
[MIT](LICENSE)

## Contributing to De-Tokenize
All contributions, bug reports, bug fixes, documentation improvements, enhancements, and ideas are welcome.
ranged 0.0.1
A package aimed at creating a more feature rich range
Requires Python: >=3.7

# range

## tldr;

    -📦 ranged is a library for generating sequences of numbers
    -🚀 aims to be a more feature-rich version of the built-in range function
    -💪 performant and dependency-free
    -🧪 currently in beta (0.x)
    -🔍 full test coverage and thorough documentation coming in versions after 1.x
    -😊 easy to learn and use
    -💾 install with python3 -m pip install ranged
    -🙏 feedback and support appreciated!

## introduction

Welcome to ranged, a simple yet feature-rich library created with the goal of providing an alternative to the standard library's range function. Ranged is designed to be a more feature-rich version of range while still maintaining excellent performance. It is dependency-free and easy to learn, making it a great choice for any Python project.

Currently, ranged is in beta (0.x), but work is underway to ensure that every version after 1.x will have full test coverage and thorough documentation. Feedback and support are appreciated as this library continues to be improved and developed. Thank you for choosing ranged!

## install

`python3 -m pip install ranged`

or

`pip3 install ranged`

## example

```
for i in Range(10, 90, func=lambda a:a+1, filt=lambda a:a < 15):
	print(i)
```
zesl 0.1.0
Zayne's Extremely Simple Language
Requires Python: >=3.4,<4.0

<p align="center">
  <img src="https://user-images.githubusercontent.com/66521670/209605632-24e913e6-aa9b-4515-8b27-906b60b7695f.svg" />
</p>

# ***Zayne's Extremely Simple Language***
Inspired by **Tom's Obvious Minimal Language (TOML)** and **YAML**

This project isn't serious btw; This was just a side project 👀.
**ZESL** won't be getting regularly scheduled updates.

## **Grammar**
**ZESL** uses the **BNF** grammar format. It's grammar is as follows:
```bnf
<program> ::= <statement>

<statement> ::= <key>
| <comment>

<letter> ::= "A" | "B" | "C" | "D" | "E" | "F" | "G"
       | "H" | "I" | "J" | "K" | "L" | "M" | "N"
       | "O" | "P" | "Q" | "R" | "S" | "T" | "U"
       | "V" | "W" | "X" | "Y" | "Z" | "a" | "b"
       | "c" | "d" | "e" | "f" | "g" | "h" | "i"
       | "j" | "k" | "l" | "m" | "n" | "o" | "p"
       | "q" | "r" | "s" | "t" | "u" | "v" | "w"
       | "x" | "y" | "z" 

<digit> ::= "0" | "1" | "2" | "3" | "4" | "5"
	   | "6" | "7" | "8" | "9"

<symbol> ::=  "|" | " " | "!" | "#" | "$" | "%" | "&" | "(" | ")" | "*" | "+" | "," | "-" | "." | "/" | ":" | ";" | ">" | "=" | "<" | "?" | "@" | "[" | "\\" | "]" | "^" | "_" | "`" | "{" | "}" | "~"

<comment> ::= ">" " "* (<digit> | <letter> | " " | <symbol>)+
<value> ::= "\"" (<digit> | <letter> | " " | <symbol>)* "\"" | <digit>+ | "."* <digit>+ "."* <digit>*
<key> ::= <letter>+ "=" <value> " "* <comment>*
```

## **Syntax**
**ZESL** supports strings, integers, and floats. **ZESL** also support usage of comments.
```
> This is a comment.
city="Salt Lake City, Utah"
area=801
precipitation=50.0
```
There are multiple ways to type a value, however there're some *big* **no-no(s)**.

----

#### The correct way to enclose an string in **ZESL** would be in *double quotes*. Attempting to use single quotes will result in an error.
```
quote='Do not fear mistakes. There are none. (Miles Davis)' > Wrong way to write strings.
quote="Do not fear mistakes. There are none. (Miles Davis)" > Correct way to write strings. Note the double quotes.
```

# Goals

If I do decide to at least dedicate **SOME** of my time to this project, here's what I would do.
- Improve BNF grammar. Adding double-quotes and/or back-ticks for string would be nice. Make context a bit more loose.
- Add `[]` and `{}`, allows for defining dicts and/or lists.
- Syntax sugar!?