Frankie-tiny
Frankie-tiny is a (franken)merge of the following models using mergekit:
🧩 Configuration
slices:
- sources:
- model: Locutusque/TinyMistral-248M-v2-Instruct
layer_range: [0, 12]
- sources:
- model: Locutusque/TinyMistral-248M-v2-Instruct
layer_range: [8, 12]
merge_method: passthrough
dtype: float16
- Downloads last month
- 22
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.