Quantizations of https://huggingface.co/jeiku/Foundation_3B

From original readme

This is a big step forward for 3B class models. Trained on smol PIPPA, alpaca-cleaned, and two custom datasets, and based on https://huggingface.co/jeiku/Rosa_v3_3B

This should serve as a decent fiction model, though it also excels at roleplaying, but is not an ideal model for logical queries or riddles.

Downloads last month: 145

GGUF

Model size

2.8B params

Architecture

stablelm

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

View +3 files

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.