Hugging Face's logo

lmstudio-community
/
Meta-Llama-3-120B-Instruct-GGUF

Text Generation
GGUF
Merge
mergekit
lazymergekit
Inference Endpoints
imatrix
conversational
Model card Files Community
Meta-Llama-3-120B-Instruct-GGUF / nohup.out
bartowski's picture
bartowski
Upload folder using huggingface_hub
afb9a3d verified
raw
history blame
31.8 kB
0%| | 0/4 [00:00<?, ?it/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 0%| | 0.00/32.2G [00:00<?, ?B/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 0%| | 32.2M/32.2G [00:32<9:01:15, 990kB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 1%|▏ | 418M/32.2G [00:32<29:36, 17.9MB/s] 
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 4%|▎ | 1.13G/32.2G [00:32<08:23, 61.7MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 6%|▌ | 1.90G/32.2G [00:32<03:54, 129MB/s] 
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 8%|▊ | 2.64G/32.2G [00:32<02:15, 219MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 10%|█ | 3.28G/32.2G [00:33<01:28, 326MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 11%|█ | 3.57G/32.2G [01:01<09:44, 49.0MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 11%|█ | 3.57G/32.2G [01:01<09:44, 49.0MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 11%|█ | 3.60G/32.2G [01:03<10:15, 46.4MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 13%|█▎ | 4.02G/32.2G [01:05<07:11, 65.2MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 14%|█▍ | 4.51G/32.2G [01:05<04:34, 101MB/s] 
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 17%|█▋ | 5.31G/32.2G [01:05<02:24, 185MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 18%|█▊ | 5.92G/32.2G [01:05<01:35, 274MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 21%|██ | 6.63G/32.2G [01:05<01:01, 415MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 23%|██▎ | 7.37G/32.2G [01:05<00:40, 616MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 24%|██▍ | 7.69G/32.2G [01:37<07:47, 52.4MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 24%|██▍ | 7.69G/32.2G [01:37<07:47, 52.4MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 25%|██▍ | 7.98G/32.2G [01:38<06:17, 64.0MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 26%|██▋ | 8.50G/32.2G [01:38<04:13, 93.6MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 28%|██▊ | 9.11G/32.2G [01:38<02:41, 143MB/s] 
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 30%|███ | 9.69G/32.2G [01:38<01:47, 209MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 32%|███▏ | 10.3G/32.2G [01:38<01:13, 300MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 34%|███▍ | 11.1G/32.2G [01:38<00:44, 475MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 35%|███▌ | 11.3G/32.2G [02:04<06:04, 57.4MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 35%|███▌ | 11.3G/32.2G [02:04<06:04, 57.4MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 35%|███▌ | 11.3G/32.2G [02:05<05:59, 58.0MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 37%|███▋ | 11.7G/32.2G [02:10<05:27, 62.3MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 38%|███▊ | 12.2G/32.2G [02:11<03:40, 91.0MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 39%|███▉ | 12.6G/32.2G [02:11<02:29, 131MB/s] 
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 41%|████ | 13.1G/32.2G [02:11<01:32, 205MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 42%|████▏ | 13.6G/32.2G [02:11<01:04, 288MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 44%|████▍ | 14.3G/32.2G [02:11<00:37, 472MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 47%|████▋ | 15.1G/32.2G [02:11<00:23, 735MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 48%|████▊ | 15.4G/32.2G [02:38<04:32, 61.5MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 48%|████▊ | 15.4G/32.2G [02:38<04:32, 61.5MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 48%|████▊ | 15.4G/32.2G [02:38<04:28, 62.3MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 49%|████▉ | 15.8G/32.2G [02:44<04:25, 61.8MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 50%|█████ | 16.1G/32.2G [02:44<03:10, 84.2MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 52%|█████▏ | 16.6G/32.2G [02:44<01:58, 132MB/s] 
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 53%|█████▎ | 17.1G/32.2G [02:44<01:16, 198MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 55%|█████▍ | 17.6G/32.2G [02:44<00:50, 290MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 57%|█████▋ | 18.2G/32.2G [02:44<00:30, 458MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 59%|█████▉ | 18.9G/32.2G [02:44<00:18, 700MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 59%|█████▉ | 19.1G/32.2G [03:07<03:37, 60.2MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 59%|█████▉ | 19.1G/32.2G [03:07<03:37, 60.2MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 59%|█████▉ | 19.1G/32.2G [03:07<03:33, 61.1MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 61%|██████ | 19.5G/32.2G [03:17<04:13, 50.2MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 61%|██████▏ | 19.7G/32.2G [03:17<03:07, 66.5MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 62%|██████▏ | 20.1G/32.2G [03:17<02:07, 95.3MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 63%|██████▎ | 20.4G/32.2G [03:17<01:24, 140MB/s] 
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 65%|██████▍ | 20.8G/32.2G [03:17<00:56, 201MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 66%|██████▌ | 21.1G/32.2G [03:17<00:38, 285MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 67%|██████▋ | 21.6G/32.2G [03:18<00:23, 452MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 69%|██████▉ | 22.2G/32.2G [03:18<00:14, 703MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 71%|███████▏ | 23.0G/32.2G [03:18<00:08, 1.12GB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 72%|███████▏ | 23.2G/32.2G [03:41<02:23, 62.7MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 72%|███████▏ | 23.2G/32.2G [03:41<02:23, 62.7MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 72%|███████▏ | 23.2G/32.2G [03:41<02:20, 63.5MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 73%|███████▎ | 23.6G/32.2G [03:51<02:48, 51.0MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 74%|███████▍ | 23.9G/32.2G [03:51<01:51, 73.8MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 75%|███████▌ | 24.2G/32.2G [03:51<01:20, 99.3MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 77%|███████▋ | 24.7G/32.2G [03:51<00:49, 152MB/s] 
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 78%|███████▊ | 24.9G/32.2G [03:51<00:35, 202MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 79%|███████▉ | 25.6G/32.2G [03:51<00:18, 350MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 81%|████████ | 26.1G/32.2G [03:51<00:11, 527MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 83%|████████▎ | 26.8G/32.2G [03:51<00:06, 818MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 84%|████████▍ | 27.0G/32.2G [04:14<01:26, 59.6MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 84%|████████▍ | 27.0G/32.2G [04:14<01:26, 59.6MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 84%|████████▍ | 27.0G/32.2G [04:15<01:25, 60.4MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 85%|████████▌ | 27.4G/32.2G [04:24<01:33, 51.3MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 86%|████████▌ | 27.6G/32.2G [04:24<01:09, 65.0MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 87%|████████▋ | 28.1G/32.2G [04:25<00:38, 105MB/s] 
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 88%|████████▊ | 28.4G/32.2G [04:25<00:28, 136MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 89%|████████▉ | 28.7G/32.2G [04:25<00:17, 202MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 91%|█████████ | 29.2G/32.2G [04:25<00:09, 315MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 93%|█████████▎| 29.8G/32.2G [04:25<00:04, 512MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 96%|█████████▌| 30.8G/32.2G [04:25<00:01, 934MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 98%|█████████▊| 31.4G/32.2G [04:33<00:03, 217MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 99%|█████████▉| 31.9G/32.2G [04:33<00:00, 291MB/s] (…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 32.2GB [04:34, 117MB/s]
25%|██▌ | 1/4 [04:35<13:45, 275.04s/it]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 0%| | 0.00/32.1G [00:00<?, ?B/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 0%| | 32.1M/32.1G [00:33<9:12:39, 967kB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 1%| | 257M/32.1G [00:33<50:07, 10.6MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 3%|▎ | 1.03G/32.1G [00:33<09:01, 57.3MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 6%|▌ | 1.83G/32.1G [00:33<04:00, 126MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 8%|▊ | 2.47G/32.1G [00:33<02:26, 202MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 10%|▉ | 3.18G/32.1G [00:33<01:30, 319MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 12%|█▏ | 3.76G/32.1G [01:04<08:46, 53.8MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 12%|█▏ | 3.76G/32.1G [01:04<08:46, 53.8MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 12%|█▏ | 3.79G/32.1G [01:05<08:46, 53.7MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 13%|█▎ | 4.24G/32.1G [01:06<06:16, 74.0MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 15%|█▌ | 4.85G/32.1G [01:06<03:48, 119MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 17%|█▋ | 5.52G/32.1G [01:06<02:20, 189MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 19%|█▉ | 6.07G/32.1G [01:06<01:37, 268MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 21%|██ | 6.71G/32.1G [01:06<01:04, 396MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 23%|██▎ | 7.25G/32.1G [01:07<00:45, 542MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 24%|██▍ | 7.80G/32.1G [01:09<00:57, 422MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 25%|██▍ | 7.86G/32.1G [01:39<09:59, 40.4MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 25%|██▍ | 7.86G/32.1G [01:39<09:59, 40.4MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 25%|██▌ | 8.02G/32.1G [01:39<08:32, 47.0MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 26%|██▌ | 8.35G/32.1G [01:39<06:00, 65.9MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 28%|██▊ | 8.92G/32.1G [01:40<03:23, 114MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 30%|███ | 9.69G/32.1G [01:40<01:49, 204MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 32%|███▏ | 10.3G/32.1G [01:40<01:13, 297MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 34%|███▎ | 10.8G/32.1G [01:40<00:51, 410MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 35%|███▌ | 11.3G/32.1G [01:40<00:37, 559MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 36%|███▌ | 11.6G/32.1G [02:04<06:01, 56.8MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 36%|███▌ | 11.6G/32.1G [02:04<06:01, 56.8MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 36%|███▌ | 11.6G/32.1G [02:05<05:55, 57.7MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 37%|███▋ | 12.0G/32.1G [02:13<06:24, 52.3MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 38%|███▊ | 12.2G/32.1G [02:13<04:47, 69.0MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 39%|███▉ | 12.6G/32.1G [02:13<03:12, 102MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 41%|████ | 13.2G/32.1G [02:13<01:44, 181MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 44%|████▎ | 14.0G/32.1G [02:13<00:56, 321MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 45%|████▌ | 14.5G/32.1G [02:13<00:39, 444MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 47%|████▋ | 15.0G/32.1G [02:13<00:28, 610MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 48%|████▊ | 15.5G/32.1G [02:14<00:21, 786MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 49%|████▉ | 15.7G/32.1G [02:38<05:03, 54.0MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 49%|████▉ | 15.7G/32.1G [02:38<05:03, 54.0MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 49%|████▉ | 15.7G/32.1G [02:38<04:58, 54.9MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 50%|█████ | 16.0G/32.1G [02:47<05:29, 48.7MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 51%|█████ | 16.3G/32.1G [02:47<04:09, 63.3MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 52%|█████▏ | 16.7G/32.1G [02:47<02:35, 99.1MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 54%|█████▍ | 17.3G/32.1G [02:47<01:22, 179MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 56%|█████▌ | 17.8G/32.1G [02:47<00:51, 277MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 58%|█████▊ | 18.5G/32.1G [02:47<00:31, 435MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 59%|█████▉ | 18.9G/32.1G [02:47<00:22, 588MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 60%|██████ | 19.4G/32.1G [02:48<00:19, 662MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 61%|██████ | 19.5G/32.1G [03:12<04:12, 49.7MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 61%|██████ | 19.5G/32.1G [03:12<04:12, 49.7MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 61%|██████ | 19.6G/32.1G [03:12<04:07, 50.6MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 62%|██████▏ | 19.8G/32.1G [03:20<04:42, 43.3MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 62%|██████▏ | 20.0G/32.1G [03:21<03:36, 55.9MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 63%|██████▎ | 20.3G/32.1G [03:21<02:34, 76.6MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 64%|██████▍ | 20.6G/32.1G [03:21<01:37, 119MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 65%|██████▌ | 21.0G/32.1G [03:21<00:59, 189MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 67%|██████▋ | 21.5G/32.1G [03:21<00:32, 326MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 69%|██████▉ | 22.2G/32.1G [03:21<00:17, 556MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 71%|███████ | 22.7G/32.1G [03:21<00:12, 764MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 72%|███████▏ | 23.1G/32.1G [03:21<00:08, 1.00GB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 73%|███████▎ | 23.6G/32.1G [03:25<00:27, 316MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 74%|███████▎ | 23.7G/32.1G [03:46<02:54, 48.3MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 74%|███████▎ | 23.7G/32.1G [03:46<02:54, 48.3MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 74%|███████▍ | 23.7G/32.1G [03:46<02:51, 49.2MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 75%|███████▍ | 23.9G/32.1G [03:54<03:22, 40.5MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 75%|███████▌ | 24.1G/32.1G [03:54<02:36, 51.3MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 76%|███████▌ | 24.3G/32.1G [03:55<01:46, 73.0MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 76%|███████▋ | 24.5G/32.1G [03:55<01:13, 103MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 78%|███████▊ | 25.1G/32.1G [03:55<00:34, 207MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 80%|████████ | 25.7G/32.1G [03:55<00:17, 365MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 82%|████████▏ | 26.4G/32.1G [03:55<00:09, 608MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 84%|████████▍ | 26.9G/32.1G [03:55<00:06, 846MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 85%|████████▌ | 27.4G/32.1G [03:57<00:08, 589MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 86%|████████▌ | 27.5G/32.1G [04:20<01:30, 50.9MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 86%|████████▌ | 27.5G/32.1G [04:20<01:30, 50.9MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 86%|████████▌ | 27.5G/32.1G [04:20<01:28, 51.5MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 87%|████████▋ | 27.8G/32.1G [04:28<01:38, 43.8MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 87%|████████▋ | 28.0G/32.1G [04:28<01:12, 56.4MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 88%|████████▊ | 28.2G/32.1G [04:28<00:50, 77.4MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 89%|████████▊ | 28.4G/32.1G [04:29<00:34, 106MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 90%|█████████ | 28.9G/32.1G [04:29<00:16, 195MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 92%|█████████▏| 29.6G/32.1G [04:29<00:07, 359MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 95%|█████████▌| 30.6G/32.1G [04:29<00:02, 697MB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 98%|█████████▊| 31.4G/32.1G [04:29<00:00, 1.05GB/s]
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 100%|█████████▉| 31.9G/32.1G [04:33<00:00, 375MB/s]  (…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 32.1GB [04:33, 117MB/s]
50%|█████ | 2/4 [09:09<09:09, 274.60s/it]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 0%| | 0.00/32.2G [00:00<?, ?B/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 0%| | 32.2M/32.2G [00:32<8:54:41, 1.00MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 1%| | 161M/32.2G [00:32<1:19:42, 6.70MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 1%| | 386M/32.2G [00:32<25:28, 20.8MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 3%|▎ | 805M/32.2G [00:32<09:02, 57.8MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 5%|▌ | 1.64G/32.2G [00:32<03:08, 162MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 7%|▋ | 2.32G/32.2G [00:32<01:47, 278MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 9%|▉ | 2.93G/32.2G [00:32<01:09, 420MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 11%|█ | 3.51G/32.2G [01:01<08:30, 56.3MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 11%|█ | 3.51G/32.2G [01:01<08:30, 56.3MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 11%|█ | 3.54G/32.2G [01:02<08:38, 55.3MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 12%|█▏ | 3.93G/32.2G [01:04<06:41, 70.4MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 13%|█▎ | 4.22G/32.2G [01:04<05:03, 92.3MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 14%|█▍ | 4.61G/32.2G [01:04<03:26, 134MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 17%|█▋ | 5.35G/32.2G [01:04<01:49, 246MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 19%|█▊ | 5.99G/32.2G [01:05<01:09, 377MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 21%|██ | 6.70G/32.2G [01:05<00:44, 577MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 23%|██▎ | 7.25G/32.2G [01:05<00:32, 774MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 24%|██▎ | 7.63G/32.2G [01:36<07:57, 51.5MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 24%|██▎ | 7.63G/32.2G [01:36<07:57, 51.5MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 24%|██▍ | 7.70G/32.2G [01:37<07:34, 54.0MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 25%|██▌ | 8.08G/32.2G [01:37<05:15, 76.5MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 27%|██▋ | 8.73G/32.2G [01:37<02:59, 131MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 29%|██▉ | 9.28G/32.2G [01:37<01:57, 195MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 30%|███ | 9.73G/32.2G [01:37<01:24, 266MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 32%|███▏ | 10.4G/32.2G [01:37<00:53, 409MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 34%|███▍ | 11.0G/32.2G [01:37<00:36, 582MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 35%|███▍ | 11.2G/32.2G [02:06<07:14, 48.4MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 35%|███▍ | 11.2G/32.2G [02:06<07:14, 48.4MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 35%|███▍ | 11.2G/32.2G [02:07<07:00, 49.8MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 36%|███▌ | 11.6G/32.2G [02:09<05:31, 62.3MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 37%|███▋ | 11.9G/32.2G [02:09<04:09, 81.6MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 38%|███▊ | 12.2G/32.2G [02:09<02:47, 120MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 40%|███▉ | 12.8G/32.2G [02:10<01:33, 207MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 41%|████▏ | 13.3G/32.2G [02:10<01:00, 314MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 43%|████▎ | 13.8G/32.2G [02:10<00:42, 438MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 45%|████▍ | 14.4G/32.2G [02:10<00:26, 669MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 47%|████▋ | 15.0G/32.2G [02:10<00:17, 965MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 48%|████▊ | 15.3G/32.2G [02:42<05:58, 47.1MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 48%|████▊ | 15.3G/32.2G [02:42<05:58, 47.1MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 48%|████▊ | 15.4G/32.2G [02:42<05:39, 49.6MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 49%|████▉ | 15.7G/32.2G [02:42<03:47, 72.3MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 50%|█████ | 16.2G/32.2G [02:42<02:25, 110MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 53%|█████▎ | 16.9G/32.2G [02:42<01:18, 195MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 54%|█████▍ | 17.4G/32.2G [02:42<00:55, 265MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 56%|█████▌ | 18.0G/32.2G [02:43<00:35, 403MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 58%|█████▊ | 18.6G/32.2G [02:43<00:23, 576MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 59%|█████▊ | 18.8G/32.2G [03:09<04:06, 54.2MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 59%|█████▊ | 18.8G/32.2G [03:09<04:06, 54.2MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 59%|█████▊ | 18.9G/32.2G [03:10<04:15, 52.2MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 60%|█████▉ | 19.2G/32.2G [03:14<03:38, 59.5MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 61%|██████ | 19.5G/32.2G [03:15<02:44, 77.4MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 62%|██████▏ | 19.9G/32.2G [03:15<01:42, 120MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 64%|██████▎ | 20.5G/32.2G [03:15<00:56, 208MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 65%|██████▍ | 20.9G/32.2G [03:15<00:40, 282MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 66%|██████▋ | 21.4G/32.2G [03:15<00:26, 410MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 68%|██████▊ | 21.8G/32.2G [03:15<00:18, 555MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 70%|██████▉ | 22.4G/32.2G [03:15<00:11, 852MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 71%|███████ | 22.9G/32.2G [03:23<00:52, 176MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 71%|███████▏ | 23.0G/32.2G [03:47<03:54, 39.4MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 71%|███████▏ | 23.0G/32.2G [03:47<03:54, 39.4MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 72%|███████▏ | 23.0G/32.2G [03:47<03:37, 42.1MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 72%|███████▏ | 23.3G/32.2G [03:47<02:38, 56.6MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 73%|███████▎ | 23.4G/32.2G [03:47<01:58, 74.0MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 74%|███████▍ | 24.0G/32.2G [03:47<00:58, 141MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 76%|███████▌ | 24.4G/32.2G [03:47<00:36, 216MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 77%|███████▋ | 24.8G/32.2G [03:48<00:24, 309MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 78%|███████▊ | 25.2G/32.2G [03:48<00:15, 445MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 80%|███████▉ | 25.6G/32.2G [03:48<00:10, 636MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 81%|████████ | 26.2G/32.2G [03:48<00:06, 923MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 82%|████████▏ | 26.5G/32.2G [04:12<01:45, 54.1MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 82%|████████▏ | 26.5G/32.2G [04:12<01:45, 54.1MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 82%|████████▏ | 26.5G/32.2G [04:15<01:59, 47.3MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 83%|████████▎ | 26.8G/32.2G [04:19<01:40, 53.5MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 84%|████████▍ | 27.1G/32.2G [04:20<01:17, 66.4MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 85%|████████▍ | 27.2G/32.2G [04:20<01:01, 81.3MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 86%|████████▌ | 27.6G/32.2G [04:20<00:35, 131MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 87%|████████▋ | 28.1G/32.2G [04:20<00:17, 237MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 89%|████████▊ | 28.5G/32.2G [04:20<00:10, 337MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 90%|█████████ | 29.0G/32.2G [04:21<00:06, 506MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 91%|█████████▏| 29.4G/32.2G [04:21<00:03, 708MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 94%|█████████▍| 30.2G/32.2G [04:21<00:01, 1.16GB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 95%|█████████▌| 30.6G/32.2G [04:33<00:12, 123MB/s] 
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 95%|█████████▌| 30.6G/32.2G [04:33<00:12, 123MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 95%|█████████▌| 30.7G/32.2G [04:33<00:11, 131MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 96%|█████████▋| 31.0G/32.2G [04:34<00:06, 171MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 98%|█████████▊| 31.7G/32.2G [04:34<00:01, 290MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 100%|█████████▉| 32.0G/32.2G [04:34<00:00, 330MB/s] (…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 32.2GB [04:35, 117MB/s]
75%|███████▌ | 3/4 [13:44<04:34, 274.98s/it]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 0%| | 0.00/3.52G [00:00<?, ?B/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 0%| | 16.0M/3.52G [00:13<47:34, 1.23MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 1%| | 32.0M/3.52G [00:15<25:19, 2.29MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 2%|▏ | 64.0M/3.52G [00:15<09:28, 6.07MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 8%|▊ | 272M/3.52G [00:15<01:19, 40.7MB/s] 
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 16%|█▌ | 560M/3.52G [00:16<00:27, 107MB/s] 
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 24%|██▎ | 832M/3.52G [00:16<00:14, 191MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 30%|███ | 1.06G/3.52G [00:16<00:08, 277MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 36%|███▋ | 1.28G/3.52G [00:16<00:05, 391MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 42%|████▏ | 1.49G/3.52G [00:16<00:03, 520MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 49%|████▊ | 1.71G/3.52G [00:16<00:02, 683MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 50%|████▉ | 1.74G/3.52G [00:27<00:39, 45.3MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 50%|████▉ | 1.74G/3.52G [00:27<00:39, 45.3MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 50%|█████ | 1.76G/3.52G [00:28<00:40, 43.1MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 54%|█████▍ | 1.90G/3.52G [00:29<00:30, 52.7MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 60%|█████▉ | 2.10G/3.52G [00:29<00:16, 86.3MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 73%|███████▎ | 2.58G/3.52G [00:30<00:04, 204MB/s] 
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 89%|████████▊ | 3.12G/3.52G [00:30<00:01, 385MB/s]
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 3.52GB [00:30, 551MB/s]  (…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 3.52GB [00:30, 116MB/s]
100%|██████████| 4/4 [14:15<00:00, 178.47s/it] 100%|██████████| 4/4 [14:15<00:00, 213.82s/it]