| # Models with reduced matrix size and overfitted for testing | |
| Base models and adapters for LLMs to be used to test converting to `gguf` and testing inference. | |
| These LLMs are in `safetensors` format with their architecture unchanged but for the size of their tensors. | |
| Folders structure: | |
| ``` | |
| <model architecture>/hidden_size=<reduced size>/<base|lora> | |
| ``` | |
| where: | |
| - `base`: overfitted to complete this [Sagan's Pale Blue Dot paragraph](https://github.com/ltoniazzi/reduce-llms-for-testing/blob/main/data/pale_blue_dot.txt) | |
| - `lora`: overfitted to complete this [Bohemian Rapshody paragraph](https://github.com/ltoniazzi/reduce-llms-for-testing/blob/main/data/bohemian_rapshody.txt) | |
| These models are generated with the repo [reduce-llms-for-testing](https://github.com/ltoniazzi/reduce-llms-for-testing). | |
| Please open an issue/PR there if you want to add more models. |