Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Suparious
's Collections
Best ChatML under 8B AWQ
Foundational under 8B AWQ
Tokenizers
2x 24GB VRAM
2x 24GB VRAM
updated
May 4
All the quants I wish I could have done.
Upvote
-
julep-ai/dolphin-2.9-llama3-70b-awq
Text Generation
•
Updated
May 22
•
10
•
4
casperhansen/llama-3-70b-instruct-awq
Text Generation
•
Updated
Apr 19
•
187k
•
66
PrunaAI/Meta-Llama-3-70b-instruct-AWQ-smashed
Text Generation
•
Updated
27 days ago
•
96
•
9
TechxGenus/Meta-Llama-3-70B-Instruct-AWQ
Text Generation
•
Updated
Apr 19
•
177
•
11
TechxGenus/Meta-Llama-3-70B-AWQ
Text Generation
•
Updated
Apr 19
•
172
•
5
MTSAIR/MultiVerse_70B_AWQ
Text Generation
•
Updated
May 6
•
76
•
2
TheBloke/Llama-2-70B-Chat-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
6.37k
•
23
TheBloke/Platypus2-70B-Instruct-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
17.5k
•
1
cdawg/llama-3-70b-instruct-awq
Text Generation
•
Updated
Apr 19
•
36
•
1
TheBloke/Nous-Hermes-Llama2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
35
•
2
TheBloke/OpenBuddy-Llama2-70b-v10.1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
62
•
4
dreamgen/opus-v1.2-70b-awq
Text Generation
•
Updated
Mar 13
•
23
•
1
TheBloke/ORCA_LLaMA_70B_QLoRA-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
31
•
1
TheBloke/Marcoroni-70B-v1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
29
•
2
TheBloke/Nous-Puffin-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
30
•
1
TheBloke/sheep-duck-llama-2-70B-v1.1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
33
•
4
TheBloke/TigerBot-70B-Chat-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
29
•
1
TheBloke/MAmmoTH-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
22
•
1
TheBloke/Llama-2-70B-LoRA-Assemble-v2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
29
•
1
TheBloke/Llama2-70B-OASST-SFT-v10-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
35
•
2
TheBloke/Lemur-70B-Chat-v1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
30
•
1
TheBloke/Uni-TianYan-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
28
•
1
TheBloke/MetaMath-70B-V1.0-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
32
•
1
TheBloke/LongAlpaca-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
31
•
3
TheBloke/vigogne-2-70B-chat-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
22
•
2
TheBloke/Tai-70B-AWQ
Text Generation
•
Updated
Nov 16, 2023
•
21
•
1
TheBloke/MoMo-70B-V1.1-AWQ
Text Generation
•
Updated
Nov 16, 2023
•
25
•
1
TheBloke/Kaori-70B-v1-AWQ
Text Generation
•
Updated
Nov 19, 2023
•
24
•
2
TheBloke/Lila-70B-L2-AWQ
Text Generation
•
Updated
Nov 27, 2023
•
22
•
1
TheBloke/Llama-2-70B-OASST-1-200-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
38
•
1
TheBloke/Platypus2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
27
•
1
TheBloke/Llama-2-70B-Orca-200k-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
34
•
2
TheBloke/Marcoroni-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
41
•
2
TheBloke/Llama-2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
3.84k
•
14
TheBloke/Upstage-Llama-2-70B-instruct-v2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
3.07k
•
3
TheBloke/Yarn-Llama-2-70B-32k-AWQ
Text Generation
•
Updated
Nov 21, 2023
•
27
•
2
TheBloke/CodeLlama-70B-Instruct-AWQ
Text Generation
•
Updated
Jan 30
•
5.48k
•
12
TheBloke/tulu-2-dpo-70B-AWQ
Text Generation
•
Updated
Nov 24, 2023
•
22
•
3
TheBloke/lzlv_70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
47
•
2
TheBloke/tigerbot-70B-chat-v2-AWQ
Text Generation
•
Updated
Nov 30, 2023
•
23
•
2
TheBloke/WizardLM-70B-V1.0-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
761
•
5
TheBloke/meditron-70B-AWQ
Text Generation
•
Updated
Nov 30, 2023
•
41
•
5
maywell/kiqu-70b-awq
Text Generation
•
Updated
Mar 5
•
35
•
1
TheBloke/agentlm-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
47
•
2
TheBloke/StableBeluga2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
38
•
2
TheBloke/em_german_70b_v01-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
41
•
1
MaziyarPanahi/WizardLM-70B-V1.0-AWQ
Text Generation
•
Updated
Feb 10
•
28
•
1
Dogge/Tia-70B-RP-awq
Text Generation
•
Updated
Apr 23
•
12
TETO101/airi-quartet-70b-awq
Text Generation
•
Updated
Mar 7
•
16
bigquant/Senku-70B-AWQ-4bit-GEMM
Text Generation
•
Updated
Feb 20
•
18
•
1
TheBloke/SynthIA-70B-v1.5-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
21
•
2
meetplace1/70b-eurfinetune-awq11
Text Generation
•
Updated
Mar 13
•
10
TheBloke/tulu-2-70B-AWQ
Text Generation
•
Updated
Nov 24, 2023
•
27
•
1
TheBloke/openbuddy-llama2-70B-v13.2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
31
•
2
TheBloke/Airoboros-L2-70B-3.1.2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
36
•
3
TheBloke/Xwin-LM-70B-V0.1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
25
•
14
masao1211/karakuri-lm-70b-chat-v0.1-AWQ
Text Generation
•
Updated
Mar 25
•
9
pvbhanuteja/llama-3-70b-instruct-awq
Text Generation
•
Updated
Apr 27
•
33
•
1
TheBloke/CodeLlama-70B-Python-AWQ
Text Generation
•
Updated
Jan 31
•
44
•
4
TheBloke/KafkaLM-70B-German-V0.1-AWQ
Text Generation
•
Updated
Jan 31
•
44
•
2
TitanML/Llama3-ChatQA-1.5-70B-AWQ-4bit
Text Generation
•
Updated
May 2
•
32
•
4
TheBloke/chronos007-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
35
TheBloke/leo-hessianai-70B-chat-AWQ
Text Generation
•
Updated
Dec 11, 2023
•
22
•
1
meetplace1/70b-eurfinetune-awq
Text Generation
•
Updated
Mar 9
•
13
TheBloke/med42-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
23
•
2
TheBloke/Genz-70b-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
26
•
5
TheBloke/airoboros-l2-70B-GPT4-2.0-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
32
•
1
nateraw/defog-sqlcoder-70b-alpha-awq
Text Generation
•
Updated
Feb 8
•
25
•
1
TheBloke/SauerkrautLM-70B-v1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
25
•
2
catid/cat-llama-3-70b-awq-q128-w4-gemm
Text Generation
•
Updated
Apr 19
•
14
study-hjt/Meta-Llama-3-70B-Instruct-AWQ
Text Generation
•
Updated
Apr 23
•
13
TitanML/Llama3-OpenBioLLM-70B-AWQ-4bit
Text Generation
•
Updated
May 1
•
352
TheBloke/llama2_70b_chat_uncensored-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
25
•
4
leptonai/Midnight-Rose-70B-v2.0.3-AWQ
Text Generation
•
Updated
Apr 5
•
11
TheBloke/Euryale-1.4-L2-70B-AWQ
Text Generation
•
Updated
Nov 18, 2023
•
1.15k
•
2
TheBloke/Swallow-70B-AWQ
Text Generation
•
Updated
Dec 19, 2023
•
21
TheBloke/CodeLlama-70B-hf-AWQ
Text Generation
•
Updated
Jan 30
•
19
•
4
TheBloke/WinterGoddess-1.4x-70B-L2-AWQ
Text Generation
•
Updated
Dec 15, 2023
•
22
•
1
TheBloke/Swallow-70B-instruct-AWQ
Text Generation
•
Updated
Dec 19, 2023
•
21
•
1
TheBloke/Euryale-1.3-L2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
32
•
5
jamesdborin/llama2-70b-chat-4bit-AWQ
Text Generation
•
Updated
Dec 11, 2023
•
16
•
1
anyisalin/Midnight-Rose-70B-v2.0.3-AWQ
Text Generation
•
Updated
Mar 29
•
14
ludis/tsukasa-llama-3-70b-qlora-awq
Text Generation
•
Updated
Apr 23
•
8
Epiculous/NeverSleep-Llama-3-Lumimaid-70B-v0.1-4-Bit-AWQ
Text Generation
•
Updated
May 3
•
7
TheBloke/Airoboros-L2-70b-2.2.1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
34
•
1
TheBloke/Synthia-70B-v1.2b-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
31
•
1
TheBloke/llama-2-70b-Guanaco-QLoRA-AWQ
Text Classification
•
Updated
Nov 9, 2023
•
13
tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ
Text Generation
•
Updated
Feb 18
•
27
•
1
TitanML/llama2-70b-chat-4bit-AWQ
Text Generation
•
Updated
Apr 24
•
18
poisson-fish/Marcoroni-70B-v1-AWQ
Text Generation
•
Updated
Sep 28, 2023
•
12
TheBloke/WizardMath-70B-V1.0-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
32
•
1
TheBloke/GodziLLa2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
25
•
4
TheBloke/airoboros-l2-70B-gpt4-1.4.1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
34
TheBloke/FashionGPT-70B-V1.1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
31
•
3
jin05102518/llama-2-ko-70b-awq
Text Generation
•
Updated
Sep 28, 2023
•
33
TheBloke/openbuddy-llama2-70B-v13-base-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
33
TheBloke/Dolphin-2.1-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
27
•
4
TheBloke/japanese-stablelm-base-beta-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
23
•
1
TheBloke/dolphin-2.2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
25
•
2
TheBloke/GOAT-70B-Storytelling-AWQ
Text Generation
•
Updated
Nov 20, 2023
•
28
•
2
TheBloke/leo-hessianai-70B-AWQ
Text Generation
•
Updated
Dec 11, 2023
•
24
catid/cat-llama-3-70b-awq-q256-w4-gemm
Text Generation
•
Updated
Apr 19
•
9
TheBloke/Euryale-L2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
35
•
1
rirv938/llama-70b-awq-4bit-g128
Text Generation
•
Updated
Aug 22, 2023
•
12
TheBloke/Euryale-Inverted-L2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
32
•
1
TheBloke/Airoboros-L2-70B-GPT4-m2.0-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
30
•
1
TheBloke/Chronos-70B-v2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
35
•
2
TheBloke/model_007-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
30
•
1
TheBloke/Synthia-70B-v1.1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
24
•
1
TheBloke/Synthia-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
29
•
1
TheBloke/ARIA-70B-V2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
32
•
3
TheBloke/FashionGPT-70B-v1.2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
33
•
1
TheBloke/Airoboros-L2-70B-3.1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
27
•
1
TheBloke/japanese-stablelm-instruct-beta-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
26
•
5
TheBloke/opus-v0-70B-AWQ
Text Generation
•
Updated
Nov 14, 2023
•
26
•
1
TheBloke/opus-v0.5-70B-AWQ
Text Generation
•
Updated
Nov 18, 2023
•
24
•
1
TheBloke/Aetheria-L2-70B-AWQ
Text Generation
•
Updated
Nov 28, 2023
•
26
•
1
vibhuagrawal/GodziLLa2-70B-AWQ-8k
Text Generation
•
Updated
Dec 12, 2023
•
20
TheBloke/Aurora-Nights-70B-v1.0-AWQ
Text Generation
•
Updated
Dec 28, 2023
•
24
•
3
Epiculous/NeverSleep-Llama-3-Lumimaid-70B-v0.1-alt-4-Bit-AWQ
Text Generation
•
Updated
May 3
•
12
TheBloke/Airoboros-L2-70b-2.2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
42
•
1
TheBloke/Airoboros-L2-70B-2.1-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
34
•
1
TheBloke/Airoboros-L2-70B-2.1-Creative-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
35
•
2
TheBloke/Samantha-1.11-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
34
TheBloke/orca_mini_v3_70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
29
TheBloke/Synthia-70B-v1.2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
55
TheBloke/fiction.live-Kimiko-V2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
26
TheBloke/Sheep-Duck-Llama-2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
32
youssefoud/Genz-70b-AWQ-split
Text Generation
•
Updated
Oct 4, 2023
•
14
TheBloke/tora-70B-v1.0-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
31
TheBloke/Dawn-v2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
21
•
1
dreamgen/opus-v0-70b-awq
Text Generation
•
Updated
Nov 18, 2023
•
24
TheBloke/tigerbot-70B-chat-v4-AWQ
Text Generation
•
Updated
Nov 19, 2023
•
24
TheBloke/Solus-70B-L2-AWQ
Text Generation
•
Updated
Nov 28, 2023
•
22
jamesdborin/llama2-70b-base-4bit-AWQ
Text Generation
•
Updated
Dec 11, 2023
•
16
TitanML/llama2-70b-base-4bit-AWQ
Text Generation
•
Updated
Apr 24
•
19
TheBloke/Samantha-1.1-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
33
TheBloke/Spicyboros-70B-2.2-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
31
Komposter43/saiga2_70b_lora-AWQ
Text Generation
•
Updated
Jan 30
•
29
Bomml/Llama-2-70B-chat-w4-g128-awq
Text Generation
•
Updated
Sep 16, 2023
Devops-hestabit/airoboros-l2-70b-awq-tensorrt
Updated
Nov 23, 2023
revealcti/cti-qwen1.5-70b-awq
Text Generation
•
Updated
May 7
•
6
catid/cat-llama-3-70b-awq-san66-q128-w4-gemm
Text Generation
•
Updated
Apr 23
•
8
Lobby-Technologies-Inc/llama-70b-4bit-gs128-awq-inflight-b16
Updated
Dec 4, 2023
•
2
casualjim/ibivibiv-strix-rufipes-70b_awq_q6_K
Updated
Feb 11
TheBloke/Camel-Platypus2-70B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
35
•
1
Kalei/Meta-Llama-3-70B-Instruct-AWQ
Updated
Apr 20
Upvote
-
Share collection
View history
Collection guide
Browse collections