semvec/pypi-packages huggingface dataset:
thingsboard-common 0.1.1
ThingsBoard common package
Requires Python: >=3.9
Keywords: ThingsBoard common library IoT cloud connector core utils

# ThingsBoard Common

> Note: 
> 
> This is not an official project of the [
ThingsBoard](https://thingsboard.io/) authors! Please refer to [ThingsBoard - Open-source IoT Platform](https://github.com/thingsboard) for official ThingsBoard projects!

This project serves as a toolkit allowing other projects to use the same packages/modules as codebase.

These projects are using the [ThingsBoard](https://thingsboard.io/) platform and extend it with additional functionality.
bitty-tokenizer 0.1.5
A bitty BPE tokenizer library
Requires Python: >=3.10

![tokenizer.png](./assets/bitty-tokenizer.png)

Bitty, clean code for the (byte-level) Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. The BPE algorithm is "byte-level" because it runs on UTF-8 encoded strings.

This algorithm was popularized for LLMs by the GPT-2 paper and the associated GPT-2 code release from OpenAI. Sennrich et al. 2015 is cited as the original reference for the use of BPE in NLP applications. Today, all modern LLMs (e.g. GPT, Llama, Mistral) use this algorithm to train their tokenizers.

Tokenizers are the reason why Language models work so well, hallucinates other time, doesnt work well in finance industry, and can make or break a system 

Find medium link explaining tokenization here : https://medium.com/@mohitdulani/train-a-tokenizer-from-scratch-4a33450d42ee

To Download the data use these commands : 

``` sh
mkdir -p data
cd data

wget https://huggingface.co/datasets/roneneldan/TinyStories/resolve/main/TinyStoriesV2-GPT4-train.txt
wget https://huggingface.co/datasets/roneneldan/TinyStories/resolve/main/TinyStoriesV2-GPT4-valid.txt
```

or simply run the `download.sh` script (works on Linux, Mac, or Windows with WSL/Git Bash):

```sh
bash data_download.sh
```

### Lecture 
For more indepth video lecture refer to :

[Andrej Karpathy on Tokenizer](https://youtu.be/zduSFxRajkE)
eldar-math-duel 1.0.0
Two-player Math Duel terminal game
Requires Python: >=3.8

# Eldar Math Duel 🎯

Terminal üçün 2 oyunçulu riyaziyyat dueli oyunu.

## Qaydalar
- Təsadüfi riyazi suallar
- Düz cavab = 1 xal
- exit yazaraq oyunu dayandırmaq olar

## İstifadə

```python
from eldar_math_duel import MathDuel

MathDuel().play()
email2md 0.1.3
Pure Python EML and MSG converter
Requires Python: >=3.10

# email2md

Convert email files (`.eml`, `.msg`) to **Markdown** (default) or **HTML**.

## Install

```bash
pip install email2md
```

## CLI usage

Prefix with `uvx` to run as a portable tool "without installing".

```bash
# markdown (default)
email2md message.msg

# HTML
email2md message.eml --html

# read from stdin
cat message.msg | email2md > message.md

# save attachments, reference image instead of inlining as b64
email2md message.msg --save-attachments --reference-images -o ./output > message.md
```

For all flags:

```bash
email2md --help
```

## Python usage

```python
from email2md import ConvertOptions, to_markdown

md = to_markdown(
    "message.eml",
    ConvertOptions(include_headers=True, save_attachments=False, inline_images=True),
)
```