Hugging Face's logo

RichardErkhov
/
Eric111_-_CatunaMayo3B-8bits

Safetensors
mistral
8-bit precision
bitsandbytes
Model card Files
xet
 Community

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Quantization made by Richard Erkhov.

Github

Discord

Request more models

CatunaMayo3B - bnb 8bits

Original model description:

license: apache-2.0 tags: - merge - mergekit - lazymergekit - Eric111/CatunaMayo - Eric111/CatunaLaserPi

CatunaMayo3B

CatunaMayo3B is a merge of the following models using mergekit:

馃З Configuration 

slices:
  - sources:
    - model: Eric111/CatunaMayo
      layer_range: [0, 1]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [2, 3]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [4, 5]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [6, 7]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [8, 9]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [10, 11]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [12, 13]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [14, 15]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [16, 17]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [18, 19]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [20, 21]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [22, 23]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [24, 25]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [26, 27]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [28, 29]
  - sources:
    - model: Eric111/CatunaLaserPi
      layer_range: [30, 32]
merge_method: passthrough
dtype: bfloat16
Downloads last month
16
Safetensors
Model size
4B params
Tensor type
F32
路
F16
路
I8
路
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support