metadata
license: cc-by-nc-2.0
pipeline_tag: text-generation
inference: false
library_name: transformers
base_model: cognitivecomputations/laserxtral
tags:
- text-generation
This is just, SOTA 2 and 3-bit quants for laserxtral. Not much more to it. Meow.
The importance matrix, which is generated from 20k_random_data.txt, is included in this repo, as imatrix_laserxtral.dat.
System Prompt
Alpaca format
### Instruction:
...
### Input:
...
### Response:
If you use LM Studio, this repo has a model_config.json you can import which has that pre-configured.