leliuga
/

all-MiniLM-L6-v2-GGUF

Sentence Similarity

sentence-transformers

feature-extraction

text-embeddings-inference

Model card Files Files and versions Community

Edit model card

all-MiniLM-L6-v2 - GGUF

Model creator: Sentence Transformers
Original model: all-MiniLM-L6-v2

Description

This repo contains GGUF format model files for all-MiniLM-L6-v2.

Downloads last month: 578

GGUF

Model size

22.6M params

Architecture

bert

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

32-bit

Sentence Similarity

Inference API (serverless) has been turned off for this model.

Quantized from

Datasets used to train leliuga/all-MiniLM-L6-v2-GGUF

Collection including leliuga/all-MiniLM-L6-v2-GGUF

GGUF

5 items • Updated Mar 17 • 2