semvec/pypi-packages huggingface dataset:
tokenizerchanger 1.1.1
Library for manipulating the existing tokenizer.
Requires Python: >=3.9
Keywords: tokenizer deletion tokens

# Tokenizer-Changer

Python script for manipulating the existing tokenizer.

The solution was tested on Llama3-8B tokenizer.

# Installation

Installation from PyPI:

```bash
pip install tokenizerchanger
```

# Requirements

- Python 3.9+
- tokenizers>=0.21.0
- transformers>=4.47.0
- tqdm>=4.66.4

# Docs

[https://tokenizer-changer.readthedocs.io/en/latest/](https://tokenizer-changer.readthedocs.io/en/latest/)
pyscat 0.1.0
PyScat: a Python library for scatter-search metaheuristics.
Requires Python: >=3.11

[![ReadTheDocs status](https://app.readthedocs.org/projects/pyscat/badge/?version=latest)](https://pyscat.readthedocs.io/)
[![PyPI - Version](https://img.shields.io/pypi/v/pyscat)](https://pypi.org/project/pyscat/)
[![DOI](https://zenodo.org/badge/1103842718.svg)](https://doi.org/10.5281/zenodo.17787407)

# PyScat

*A Python library for scatter-search metaheuristics.*

> **Note**
> This package is still under development. Documentation is incomplete,
> and the API may change without notice.
> For now, please use the scatter search implementation in
> [pyPESTO](https://pypesto.readthedocs.io/en/latest/).

PyScat currently implements two scatter-search algorithms:

* **Enhanced Scatter Search (eSS)**
  based on the work by Egea et al. (2007)
  ([DOI:10.1021/ie801717t](https://doi.org/10.1021/ie801717t))
* **Self-Adaptive Cooperative enhanced Scatter Search (saCeSS)**
  based on the work by Penas et al. (2017)
  ([DOI:10.1186/s12859-016-1452-4](https://doi.org/10.1186/s12859-016-1452-4))

PyScat currently builds on top of the
[pyPESTO](https://pypesto.readthedocs.io/en/latest/) framework for parameter
estimation and leverages its problem definition and optimizer interfaces.

## 📖 Documentation

Documentation is available at
[pyscat.readthedocs.io](https://pyscat.readthedocs.io/).

## 📦 Installation

From [PyPI](https://pypi.org/project/pyscat/):

```bash
pip install pyscat
```

Latest development version from [GitHub](https://github.com/ICB-DCM/pyscat):

```bash
pip install git+https://github.com/ICB-DCM/pyscat@main
```