Hugging Face's logo

lmstudio-community
/
Meta-Llama-3-120B-Instruct-GGUF

Text Generation
GGUF
Merge
mergekit
lazymergekit
Inference Endpoints
imatrix
conversational
Model card Files Community
Meta-Llama-3-120B-Instruct-GGUF
File size: 8,242 Bytes 
4187770
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
 

  0%|          | 0/1 [00:00<?, ?it/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:   0%|          | 0.00/19.7G [00:00<?, ?B/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:   0%|          | 19.7M/19.7G [00:20<5:39:49, 967kB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:   4%|▎         | 691M/19.7G [00:20<06:40, 47.6MB/s]  

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  10%|█         | 1.97G/19.7G [00:20<01:42, 173MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  12%|█▏        | 2.27G/19.7G [00:37<04:34, 63.6MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  12%|█▏        | 2.27G/19.7G [00:37<04:34, 63.6MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  12%|█▏        | 2.29G/19.7G [00:37<04:35, 63.4MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  15%|█▍        | 2.86G/19.7G [00:40<03:09, 89.2MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  18%|█▊        | 3.51G/19.7G [00:40<01:48, 150MB/s] 

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  23%|██▎       | 4.56G/19.7G [00:41<00:52, 287MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  24%|██▍       | 4.79G/19.7G [01:00<03:33, 70.0MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  24%|██▍       | 4.79G/19.7G [01:00<03:33, 70.0MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  24%|██▍       | 4.81G/19.7G [01:00<03:32, 70.2MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  27%|██▋       | 5.25G/19.7G [01:01<02:21, 102MB/s] 

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  28%|██▊       | 5.58G/19.7G [01:01<01:42, 138MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  34%|███▎      | 6.63G/19.7G [01:01<00:43, 298MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  36%|███▌      | 7.08G/19.7G [01:18<02:27, 85.6MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  36%|███▌      | 7.08G/19.7G [01:18<02:27, 85.6MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  36%|███▌      | 7.10G/19.7G [01:19<02:35, 81.3MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  38%|███▊      | 7.48G/19.7G [01:21<02:10, 93.6MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  39%|███▉      | 7.75G/19.7G [01:21<01:39, 121MB/s] 

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  41%|████      | 7.99G/19.7G [01:21<01:16, 153MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  43%|████▎     | 8.48G/19.7G [01:21<00:44, 250MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  47%|████▋     | 9.18G/19.7G [01:22<00:24, 438MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  49%|████▊     | 9.61G/19.7G [01:41<02:26, 69.3MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  49%|████▊     | 9.61G/19.7G [01:41<02:26, 69.3MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  49%|████▉     | 9.63G/19.7G [01:41<02:25, 69.5MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  50%|█████     | 9.94G/19.7G [01:42<01:42, 95.1MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  52%|█████▏    | 10.2G/19.7G [01:42<01:17, 123MB/s] 

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  53%|█████▎    | 10.4G/19.7G [01:42<00:57, 162MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  55%|█████▍    | 10.8G/19.7G [01:42<00:36, 244MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  57%|█████▋    | 11.3G/19.7G [01:42<00:19, 420MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  60%|█████▉    | 11.8G/19.7G [01:42<00:13, 608MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  60%|██████    | 11.9G/19.7G [01:58<02:11, 59.7MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  60%|██████    | 11.9G/19.7G [01:58<02:11, 59.7MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  60%|██████    | 11.9G/19.7G [01:59<02:09, 60.2MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  62%|██████▏   | 12.2G/19.7G [02:02<01:54, 65.8MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  63%|██████▎   | 12.4G/19.7G [02:02<01:24, 87.2MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  64%|██████▍   | 12.6G/19.7G [02:02<00:57, 124MB/s] 

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  65%|██████▌   | 12.8G/19.7G [02:02<00:41, 165MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  66%|██████▌   | 13.0G/19.7G [02:02<00:29, 227MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  68%|██████▊   | 13.3G/19.7G [02:03<00:19, 334MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  71%|███████   | 13.9G/19.7G [02:03<00:08, 664MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  72%|███████▏  | 14.3G/19.7G [02:03<00:06, 878MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  73%|███████▎  | 14.4G/19.7G [02:22<01:51, 47.7MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  73%|███████▎  | 14.4G/19.7G [02:22<01:51, 47.7MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  73%|███████▎  | 14.4G/19.7G [02:22<01:50, 48.0MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  74%|███████▍  | 14.7G/19.7G [02:23<01:13, 69.1MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  75%|███████▌  | 14.9G/19.7G [02:23<00:51, 94.6MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  76%|███████▋  | 15.1G/19.7G [02:23<00:35, 130MB/s] 

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  78%|███████▊  | 15.3G/19.7G [02:23<00:23, 189MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  79%|███████▊  | 15.5G/19.7G [02:23<00:16, 253MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  80%|████████  | 15.8G/19.7G [02:23<00:10, 384MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  83%|████████▎ | 16.4G/19.7G [02:23<00:04, 729MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  85%|████████▍ | 16.7G/19.7G [02:25<00:07, 405MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  85%|████████▍ | 16.7G/19.7G [02:37<00:55, 54.9MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  85%|████████▍ | 16.7G/19.7G [02:37<00:55, 54.9MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  85%|████████▍ | 16.7G/19.7G [02:40<01:05, 45.7MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  86%|████████▌ | 16.9G/19.7G [02:42<00:57, 49.3MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  86%|████████▌ | 17.0G/19.7G [02:43<00:44, 60.8MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  87%|████████▋ | 17.1G/19.7G [02:43<00:34, 75.6MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  87%|████████▋ | 17.2G/19.7G [02:43<00:24, 101MB/s] 

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  88%|████████▊ | 17.4G/19.7G [02:43<00:16, 141MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  90%|████████▉ | 17.7G/19.7G [02:43<00:07, 261MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  91%|█████████ | 17.9G/19.7G [02:43<00:05, 369MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  93%|█████████▎| 18.3G/19.7G [02:44<00:02, 651MB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  96%|█████████▋| 19.0G/19.7G [02:44<00:00, 1.29GB/s]

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf:  98%|█████████▊| 19.4G/19.7G [02:47<00:01, 308MB/s] 

(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf: 100%|█████████▉| 19.7G/19.7G [02:48<00:00, 292MB/s]
(…)120B-Instruct-Q5_K_S-00003-of-00003.gguf: 19.7GB [02:48, 117MB/s]                            

100%|██████████| 1/1 [02:49<00:00, 169.51s/it]
100%|██████████| 1/1 [02:49<00:00, 169.51s/it]