Hugging Face's logo

lmstudio-community
/
Meta-Llama-3-120B-Instruct-GGUF

Text Generation
GGUF
Merge
mergekit
lazymergekit
Model card Files Community
Meta-Llama-3-120B-Instruct-GGUF / nohup.out
bartowski's picture
bartowski
Upload folder using huggingface_hub
cef120f verified
raw history blame contribute delete
No virus
43.7 kB
0%| | 0/5 [00:00<?, ?it/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 0%| | 0.00/32.1G [00:00<?, ?B/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 0%| | 32.1M/32.1G [00:32<8:54:07, 1.00MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 0%| | 64.2M/32.1G [00:32<3:41:07, 2.41MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 1%| | 257M/32.1G [00:32<36:36, 14.5MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 1%| | 385M/32.1G [00:32<20:30, 25.8MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 2%|▏ | 642M/32.1G [00:32<09:07, 57.4MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 4%|▎ | 1.12G/32.1G [00:32<03:40, 141MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 5%|▍ | 1.51G/32.1G [00:32<02:12, 231MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 6%|▌ | 1.83G/32.1G [00:32<01:32, 328MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 7%|▋ | 2.21G/32.1G [00:33<01:01, 486MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 9%|▊ | 2.73G/32.1G [00:33<00:38, 766MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 10%|▉ | 3.18G/32.1G [00:33<00:27, 1.04GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 11%|█ | 3.56G/32.1G [00:33<00:24, 1.18GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 11%|█ | 3.59G/32.1G [00:44<06:00, 79.0MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 11%|█ | 3.59G/32.1G [00:44<06:00, 79.0MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 11%|█▏ | 3.63G/32.1G [01:01<17:03, 27.8MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 11%|█▏ | 3.63G/32.1G [01:01<17:03, 27.8MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 11%|█▏ | 3.66G/32.1G [01:02<16:30, 28.7MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 12%|█▏ | 3.88G/32.1G [01:05<12:30, 37.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 13%|█▎ | 4.04G/32.1G [01:05<09:03, 51.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 14%|█▎ | 4.36G/32.1G [01:05<05:03, 91.5MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 14%|█▍ | 4.62G/32.1G [01:05<03:23, 135MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 16%|█▌ | 5.00G/32.1G [01:05<01:59, 227MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 17%|█▋ | 5.58G/32.1G [01:05<01:03, 415MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 19%|█▊ | 5.94G/32.1G [01:05<00:47, 552MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 20%|█▉ | 6.35G/32.1G [01:05<00:33, 768MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 21%|██▏ | 6.83G/32.1G [01:05<00:23, 1.09GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 23%|██▎ | 7.22G/32.1G [01:06<00:18, 1.34GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 24%|██▎ | 7.60G/32.1G [01:10<01:29, 273MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 24%|██▍ | 7.73G/32.1G [01:37<11:53, 34.1MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 24%|██▍ | 7.73G/32.1G [01:37<11:53, 34.1MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 24%|██▍ | 7.83G/32.1G [01:37<10:31, 38.4MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 25%|██▌ | 8.05G/32.1G [01:38<07:37, 52.5MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 26%|██▌ | 8.31G/32.1G [01:38<05:15, 75.5MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 27%|██▋ | 8.76G/32.1G [01:38<02:56, 132MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 28%|██▊ | 9.02G/32.1G [01:38<02:10, 176MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 29%|██▉ | 9.43G/32.1G [01:38<01:21, 277MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 31%|███ | 9.85G/32.1G [01:38<00:54, 410MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 32%|███▏ | 10.3G/32.1G [01:38<00:36, 599MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 33%|███▎ | 10.7G/32.1G [01:38<00:27, 790MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 35%|███▍ | 11.1G/32.1G [01:38<00:19, 1.09GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 35%|███▌ | 11.3G/32.1G [01:50<03:53, 89.1MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 35%|███▌ | 11.3G/32.1G [01:50<03:53, 89.1MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 35%|███▌ | 11.3G/32.1G [02:08<11:19, 30.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 35%|███▌ | 11.3G/32.1G [02:08<11:19, 30.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 35%|███▌ | 11.4G/32.1G [02:08<11:09, 31.0MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 36%|███▌ | 11.6G/32.1G [02:10<07:40, 44.5MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 37%|███▋ | 11.8G/32.1G [02:10<05:29, 61.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 37%|███▋ | 12.0G/32.1G [02:10<04:06, 81.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 38%|███▊ | 12.3G/32.1G [02:10<02:29, 133MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 39%|███▉ | 12.6G/32.1G [02:11<01:28, 219MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 40%|████ | 13.0G/32.1G [02:11<00:57, 334MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 42%|████▏ | 13.3G/32.1G [02:11<00:37, 500MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 43%|████▎ | 13.7G/32.1G [02:11<00:25, 713MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 44%|████▍ | 14.1G/32.1G [02:11<00:18, 982MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 45%|████▌ | 14.5G/32.1G [02:11<00:13, 1.27GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 46%|████▋ | 14.9G/32.1G [02:11<00:11, 1.54GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 48%|████▊ | 15.2G/32.1G [02:11<00:10, 1.57GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 48%|████▊ | 15.4G/32.1G [02:23<03:16, 84.9MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 48%|████▊ | 15.4G/32.1G [02:23<03:16, 84.9MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 48%|████▊ | 15.4G/32.1G [02:43<10:47, 25.7MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 48%|████▊ | 15.4G/32.1G [02:43<10:47, 25.7MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 48%|████▊ | 15.5G/32.1G [02:43<09:37, 28.7MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 49%|████▉ | 15.7G/32.1G [02:43<06:11, 44.0MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 50%|████▉ | 15.9G/32.1G [02:43<04:18, 62.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 50%|█████ | 16.1G/32.1G [02:43<02:51, 93.0MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 51%|█████▏ | 16.5G/32.1G [02:44<01:37, 160MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 53%|█████▎ | 16.9G/32.1G [02:44<00:54, 277MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 54%|█████▍ | 17.3G/32.1G [02:44<00:38, 385MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 55%|█████▍ | 17.6G/32.1G [02:44<00:26, 541MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 56%|█████▌ | 18.0G/32.1G [02:44<00:19, 736MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 57%|█████▋ | 18.3G/32.1G [02:44<00:14, 974MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 59%|█████▊ | 18.8G/32.1G [02:44<00:09, 1.39GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 59%|█████▉ | 19.1G/32.1G [02:56<02:16, 95.2MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 59%|█████▉ | 19.1G/32.1G [02:56<02:16, 95.2MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 60%|█████▉ | 19.1G/32.1G [03:12<06:24, 33.8MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 60%|█████▉ | 19.1G/32.1G [03:12<06:24, 33.8MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 60%|█████▉ | 19.1G/32.1G [03:13<06:33, 33.0MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 60%|██████ | 19.4G/32.1G [03:16<04:54, 43.2MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 61%|██████ | 19.6G/32.1G [03:16<03:30, 59.3MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 62%|██████▏ | 19.9G/32.1G [03:16<02:03, 98.4MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 63%|██████▎ | 20.2G/32.1G [03:17<01:21, 147MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 64%|██████▍ | 20.5G/32.1G [03:17<00:52, 221MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 65%|██████▍ | 20.8G/32.1G [03:17<00:38, 295MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 66%|██████▌ | 21.2G/32.1G [03:17<00:21, 498MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 68%|██████▊ | 21.7G/32.1G [03:17<00:14, 720MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 69%|██████▊ | 22.0G/32.1G [03:17<00:10, 954MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 70%|███████ | 22.5G/32.1G [03:17<00:07, 1.28GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 71%|███████ | 22.8G/32.1G [03:17<00:05, 1.59GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 72%|███████▏ | 23.2G/32.1G [03:49<03:50, 38.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 72%|███████▏ | 23.2G/32.1G [03:49<03:50, 38.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 72%|███████▏ | 23.2G/32.1G [03:49<03:42, 39.8MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 73%|███████▎ | 23.5G/32.1G [03:50<02:31, 56.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 74%|███████▍ | 23.8G/32.1G [03:50<01:38, 83.9MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 75%|███████▌ | 24.2G/32.1G [03:50<01:05, 122MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 76%|███████▋ | 24.5G/32.1G [03:50<00:43, 175MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 77%|███████▋ | 24.8G/32.1G [03:50<00:29, 247MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 79%|███████▊ | 25.2G/32.1G [03:50<00:18, 365MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 80%|███████▉ | 25.5G/32.1G [03:50<00:13, 486MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 81%|████████ | 25.9G/32.1G [03:50<00:09, 665MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 82%|████████▏ | 26.3G/32.1G [03:50<00:06, 934MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 83%|████████▎ | 26.7G/32.1G [03:51<00:04, 1.25GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 84%|████████▎ | 26.8G/32.1G [04:02<01:02, 83.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 84%|████████▎ | 26.8G/32.1G [04:02<01:02, 83.6MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 84%|████████▎ | 26.9G/32.1G [04:11<02:02, 42.8MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 85%|████████▍ | 27.1G/32.1G [04:23<02:34, 32.2MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 85%|████████▍ | 27.1G/32.1G [04:23<02:26, 33.8MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 85%|████████▌ | 27.3G/32.1G [04:23<01:36, 49.2MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 86%|████████▌ | 27.5G/32.1G [04:23<01:08, 67.3MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 87%|████████▋ | 27.8G/32.1G [04:23<00:37, 114MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 88%|████████▊ | 28.1G/32.1G [04:23<00:22, 177MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 89%|████████▊ | 28.5G/32.1G [04:23<00:12, 293MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 90%|█████████ | 28.9G/32.1G [04:24<00:06, 475MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 91%|█████████ | 29.3G/32.1G [04:24<00:04, 649MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 92%|█████████▏| 29.6G/32.1G [04:24<00:02, 865MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 95%|█████████▍| 30.3G/32.1G [04:24<00:01, 1.45GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 96%|█████████▌| 30.7G/32.1G [04:24<00:00, 1.63GB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 97%|█████████▋| 31.1G/32.1G [04:33<00:06, 144MB/s] 
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 98%|█████████▊| 31.4G/32.1G [04:33<00:03, 178MB/s]
(…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 100%|█████████▉| 32.0G/32.1G [04:34<00:00, 299MB/s] (…)3-120B-Instruct-Q8_0-00001-of-00005.gguf: 32.1GB [04:34, 117MB/s]
20%|██ | 1/5 [04:34<18:18, 274.60s/it]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 0%| | 0.00/32.1G [00:00<?, ?B/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 0%| | 32.1M/32.1G [00:33<9:15:59, 961kB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 1%| | 225M/32.1G [00:33<58:00, 9.15MB/s] 
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 3%|▎ | 930M/32.1G [00:33<10:01, 51.8MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 5%|▍ | 1.57G/32.1G [00:33<04:47, 106MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 7%|▋ | 2.12G/32.1G [00:33<02:55, 171MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 8%|▊ | 2.69G/32.1G [00:33<01:50, 266MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 10%|█ | 3.27G/32.1G [00:34<01:13, 392MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 12%|█▏ | 3.79G/32.1G [00:34<00:52, 534MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 12%|█▏ | 3.82G/32.1G [01:04<12:48, 36.8MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 12%|█▏ | 3.82G/32.1G [01:04<12:48, 36.8MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 12%|█▏ | 3.85G/32.1G [01:06<13:09, 35.8MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 13%|█▎ | 4.17G/32.1G [01:07<08:49, 52.7MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 15%|█▍ | 4.72G/32.1G [01:07<04:46, 95.5MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 16%|█▌ | 5.16G/32.1G [01:07<03:05, 145MB/s] 
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 19%|█▊ | 5.97G/32.1G [01:07<01:37, 269MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 20%|██ | 6.54G/32.1G [01:07<01:05, 390MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 22%|██▏ | 7.06G/32.1G [01:07<00:46, 535MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 24%|██▎ | 7.60G/32.1G [01:07<00:33, 737MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 25%|██▍ | 7.92G/32.1G [01:40<08:54, 45.2MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 25%|██▍ | 7.92G/32.1G [01:40<08:54, 45.2MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 25%|██▌ | 8.05G/32.1G [01:40<07:58, 50.3MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 27%|██▋ | 8.60G/32.1G [01:40<04:47, 81.7MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 28%|██▊ | 9.11G/32.1G [01:40<03:05, 123MB/s] 
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 30%|███ | 9.69G/32.1G [01:41<01:58, 189MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 32%|███▏ | 10.2G/32.1G [01:41<01:20, 270MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 34%|███▎ | 10.7G/32.1G [01:41<00:54, 389MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 35%|███▌ | 11.3G/32.1G [01:41<00:37, 549MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 37%|███▋ | 11.7G/32.1G [02:09<06:17, 53.9MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 37%|███▋ | 11.7G/32.1G [02:09<06:17, 53.9MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 37%|███▋ | 11.7G/32.1G [02:10<06:24, 52.9MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 38%|███▊ | 12.1G/32.1G [02:14<05:23, 61.7MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 39%|███▉ | 12.6G/32.1G [02:14<03:17, 98.3MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 41%|████▏ | 13.3G/32.1G [02:14<01:55, 163MB/s] 
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 43%|████▎ | 13.8G/32.1G [02:14<01:19, 229MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 44%|████▍ | 14.2G/32.1G [02:14<00:56, 315MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 47%|████▋ | 15.0G/32.1G [02:14<00:32, 521MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 48%|████▊ | 15.5G/32.1G [02:15<00:23, 706MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 49%|████▉ | 15.8G/32.1G [02:47<05:55, 45.7MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 49%|████▉ | 15.8G/32.1G [02:47<05:55, 45.7MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 50%|████▉ | 15.9G/32.1G [02:48<05:26, 49.5MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 51%|█████ | 16.3G/32.1G [02:48<03:34, 73.4MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 52%|█████▏ | 16.7G/32.1G [02:48<02:27, 104MB/s] 
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 54%|█████▍ | 17.3G/32.1G [02:48<01:24, 174MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 55%|█████▌ | 17.8G/32.1G [02:48<00:58, 244MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 57%|█████▋ | 18.3G/32.1G [02:48<00:37, 370MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 59%|█████▊ | 18.8G/32.1G [02:48<00:26, 509MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 60%|██████ | 19.3G/32.1G [02:48<00:18, 692MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 61%|██████ | 19.6G/32.1G [03:16<00:18, 692MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 61%|██████ | 19.6G/32.1G [03:16<04:17, 48.4MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 61%|██████ | 19.6G/32.1G [03:17<04:19, 48.0MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 62%|██████▏ | 20.0G/32.1G [03:21<03:39, 55.2MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 64%|██████▎ | 20.4G/32.1G [03:21<02:21, 82.9MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 65%|██████▌ | 20.9G/32.1G [03:21<01:25, 132MB/s] 
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 66%|██████▌ | 21.2G/32.1G [03:22<00:58, 185MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 68%|██████▊ | 21.8G/32.1G [03:22<00:34, 299MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 70%|██████▉ | 22.4G/32.1G [03:22<00:21, 453MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 71%|███████▏ | 22.9G/32.1G [03:22<00:14, 620MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 73%|███████▎ | 23.4G/32.1G [03:22<00:10, 831MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 74%|███████▍ | 23.7G/32.1G [03:55<03:13, 43.3MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 74%|███████▍ | 23.7G/32.1G [03:55<03:13, 43.3MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 74%|███████▍ | 23.9G/32.1G [03:55<02:44, 49.8MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 76%|███████▌ | 24.3G/32.1G [03:55<01:48, 72.2MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 77%|███████▋ | 24.7G/32.1G [03:55<01:07, 109MB/s] 
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 78%|███████▊ | 25.1G/32.1G [03:55<00:45, 153MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 80%|████████ | 25.7G/32.1G [03:55<00:26, 246MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 81%|████████▏ | 26.1G/32.1G [03:55<00:17, 344MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 83%|████████▎ | 26.6G/32.1G [03:56<00:11, 475MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 85%|████████▍ | 27.2G/32.1G [03:56<00:06, 733MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 86%|████████▌ | 27.5G/32.1G [04:22<01:27, 52.6MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 86%|████████▌ | 27.5G/32.1G [04:22<01:27, 52.6MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 86%|████████▌ | 27.5G/32.1G [04:23<01:30, 50.3MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 87%|████████▋ | 27.9G/32.1G [04:28<01:15, 55.4MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 88%|████████▊ | 28.1G/32.1G [04:29<00:53, 73.4MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 89%|████████▉ | 28.6G/32.1G [04:29<00:30, 115MB/s] 
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 91%|█████████ | 29.0G/32.1G [04:29<00:16, 182MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 92%|█████████▏| 29.6G/32.1G [04:29<00:08, 287MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 95%|█████████▍| 30.4G/32.1G [04:29<00:03, 501MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 97%|█████████▋| 31.2G/32.1G [04:29<00:01, 810MB/s]
(…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 99%|█████████▉| 31.9G/32.1G [04:33<00:00, 373MB/s] (…)3-120B-Instruct-Q8_0-00002-of-00005.gguf: 32.1GB [04:34, 117MB/s]
40%|████ | 2/5 [09:09<13:44, 274.89s/it]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 0%| | 0.00/32.1G [00:00<?, ?B/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 0%| | 32.1M/32.1G [00:33<9:16:40, 961kB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 1%| | 161M/32.1G [00:33<1:23:00, 6.42MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 1%| | 354M/32.1G [00:33<29:25, 18.0MB/s] 
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 2%|▏ | 611M/32.1G [00:33<13:11, 39.8MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 4%|▎ | 1.12G/32.1G [00:33<05:06, 101MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 6%|▌ | 1.93G/32.1G [00:33<02:08, 235MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 8%|▊ | 2.44G/32.1G [00:34<01:24, 350MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 9%|▉ | 2.92G/32.1G [00:34<00:59, 491MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 11%|█ | 3.44G/32.1G [00:34<00:41, 695MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 12%|█▏ | 3.76G/32.1G [01:04<10:35, 44.7MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 12%|█▏ | 3.76G/32.1G [01:04<10:35, 44.7MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 12%|█▏ | 3.79G/32.1G [01:05<10:25, 45.3MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 13%|█▎ | 4.11G/32.1G [01:06<07:58, 58.6MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 14%|█▎ | 4.34G/32.1G [01:07<06:05, 76.0MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 14%|█▍ | 4.63G/32.1G [01:07<04:15, 108MB/s] 
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 15%|█▌ | 4.89G/32.1G [01:07<03:06, 146MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 17%|█▋ | 5.53G/32.1G [01:07<01:33, 285MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 20%|██ | 6.43G/32.1G [01:07<00:46, 549MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 22%|██▏ | 6.94G/32.1G [01:07<00:34, 725MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 23%|██▎ | 7.42G/32.1G [01:07<00:26, 949MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 25%|██▍ | 7.87G/32.1G [01:40<08:11, 49.3MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 25%|██▍ | 7.87G/32.1G [01:40<08:11, 49.3MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 25%|██▍ | 7.91G/32.1G [01:40<08:00, 50.4MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 26%|██▌ | 8.26G/32.1G [01:40<05:37, 70.8MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 27%|██▋ | 8.55G/32.1G [01:40<04:10, 94.2MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 27%|██▋ | 8.81G/32.1G [01:40<03:09, 123MB/s] 
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 29%|██▉ | 9.32G/32.1G [01:40<01:50, 206MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 31%|███▏ | 10.1G/32.1G [01:40<00:59, 372MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 33%|███▎ | 10.7G/32.1G [01:41<00:38, 554MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 35%|███▍ | 11.2G/32.1G [01:41<00:28, 736MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 36%|███▌ | 11.6G/32.1G [02:11<06:35, 52.0MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 36%|███▌ | 11.6G/32.1G [02:11<06:35, 52.0MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 36%|███▌ | 11.6G/32.1G [02:11<06:39, 51.3MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 37%|███▋ | 12.0G/32.1G [02:13<05:13, 64.3MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 38%|███▊ | 12.2G/32.1G [02:13<03:57, 84.0MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 39%|███▉ | 12.5G/32.1G [02:13<02:50, 115MB/s] 
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 40%|███▉ | 12.8G/32.1G [02:14<02:06, 153MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 41%|████ | 13.0G/32.1G [02:14<01:32, 206MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 42%|████▏ | 13.5G/32.1G [02:14<00:52, 356MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 44%|████▍ | 14.2G/32.1G [02:14<00:28, 633MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 46%|████▋ | 14.9G/32.1G [02:14<00:18, 951MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 48%|████▊ | 15.4G/32.1G [02:14<00:13, 1.21GB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 49%|████▉ | 15.7G/32.1G [02:46<05:55, 46.2MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 49%|████▉ | 15.7G/32.1G [02:46<05:55, 46.2MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 49%|████▉ | 15.8G/32.1G [02:46<05:36, 48.6MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 50%|█████ | 16.1G/32.1G [02:47<03:58, 67.2MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 51%|█████ | 16.4G/32.1G [02:47<02:53, 91.0MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 52%|█████▏ | 16.6G/32.1G [02:47<02:09, 120MB/s] 
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 53%|█████▎ | 17.0G/32.1G [02:47<01:22, 182MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 54%|█████▍ | 17.4G/32.1G [02:47<00:58, 253MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 56%|█████▌ | 18.0G/32.1G [02:47<00:31, 450MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 59%|█████▊ | 18.8G/32.1G [02:47<00:17, 780MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 60%|██████ | 19.3G/32.1G [02:48<00:12, 1.00GB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 61%|██████ | 19.4G/32.1G [03:15<04:29, 47.2MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 61%|██████ | 19.4G/32.1G [03:15<04:29, 47.2MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 61%|██████ | 19.5G/32.1G [03:16<04:25, 47.8MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 62%|██████▏ | 19.8G/32.1G [03:20<03:48, 54.0MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 62%|██████▏ | 20.0G/32.1G [03:20<02:51, 70.6MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 63%|██████▎ | 20.2G/32.1G [03:20<02:07, 93.0MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 64%|██████▍ | 20.5G/32.1G [03:20<01:26, 134MB/s] 
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 65%|██████▌ | 20.9G/32.1G [03:20<00:54, 205MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 66%|██████▌ | 21.1G/32.1G [03:21<00:40, 271MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 67%|██████▋ | 21.6G/32.1G [03:21<00:23, 449MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 69%|██████▉ | 22.2G/32.1G [03:21<00:13, 730MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 71%|███████▏ | 22.9G/32.1G [03:21<00:07, 1.20GB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 73%|███████▎ | 23.5G/32.1G [03:21<00:06, 1.37GB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 73%|███████▎ | 23.6G/32.1G [03:53<03:38, 39.3MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 73%|███████▎ | 23.6G/32.1G [03:53<03:38, 39.3MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 74%|███████▎ | 23.6G/32.1G [03:53<03:23, 41.8MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 75%|███████▍ | 23.9G/32.1G [03:54<02:15, 60.6MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 75%|███████▌ | 24.2G/32.1G [03:54<01:37, 81.8MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 76%|███████▋ | 24.5G/32.1G [03:54<01:03, 120MB/s] 
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 77%|███████▋ | 24.8G/32.1G [03:54<00:45, 161MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 78%|███████▊ | 25.0G/32.1G [03:54<00:33, 214MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 79%|███████▉ | 25.4G/32.1G [03:54<00:21, 311MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 80%|████████ | 25.7G/32.1G [03:54<00:14, 452MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 83%|████████▎ | 26.6G/32.1G [03:54<00:05, 945MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 85%|████████▍ | 27.2G/32.1G [03:55<00:03, 1.34GB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 85%|████████▍ | 27.3G/32.1G [04:23<01:49, 44.4MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 85%|████████▍ | 27.3G/32.1G [04:23<01:49, 44.4MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 85%|████████▌ | 27.3G/32.1G [04:23<01:46, 45.2MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 86%|████████▌ | 27.7G/32.1G [04:27<01:21, 54.8MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 87%|████████▋ | 27.9G/32.1G [04:27<00:57, 73.7MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 88%|████████▊ | 28.2G/32.1G [04:27<00:41, 97.2MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 89%|████████▉ | 28.5G/32.1G [04:27<00:23, 154MB/s] 
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 90%|████████▉ | 28.8G/32.1G [04:27<00:16, 206MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 90%|█████████ | 29.1G/32.1G [04:28<00:11, 272MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 91%|█████████▏| 29.4G/32.1G [04:28<00:07, 388MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 94%|█████████▍| 30.3G/32.1G [04:28<00:02, 851MB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 97%|█████████▋| 31.1G/32.1G [04:28<00:00, 1.38GB/s]
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 99%|█████████▊| 31.7G/32.1G [04:34<00:01, 264MB/s] 
(…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 100%|█████████▉| 32.1G/32.1G [04:34<00:00, 347MB/s] (…)3-120B-Instruct-Q8_0-00003-of-00005.gguf: 32.1GB [04:34, 117MB/s]
60%|██████ | 3/5 [13:44<09:10, 275.07s/it]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 0%| | 0.00/32.2G [00:00<?, ?B/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 0%| | 32.2M/32.2G [00:33<9:16:51, 962kB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 2%|▏ | 547M/32.2G [00:33<23:04, 22.8MB/s] 
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 8%|▊ | 2.44G/32.2G [00:33<03:36, 137MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 12%|█▏ | 3.76G/32.2G [01:03<06:43, 70.4MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 12%|█▏ | 3.76G/32.2G [01:03<06:43, 70.4MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 12%|█▏ | 3.79G/32.2G [01:04<06:49, 69.2MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 14%|█▍ | 4.53G/32.2G [01:06<04:56, 93.2MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 16%|█▌ | 5.08G/32.2G [01:07<03:35, 126MB/s] 
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 19%|█▉ | 6.14G/32.2G [01:07<02:00, 215MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 22%|██▏ | 6.98G/32.2G [01:07<01:20, 313MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 24%|██▍ | 7.69G/32.2G [01:07<00:57, 423MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 25%|██▍ | 7.88G/32.2G [01:39<07:34, 53.4MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 25%|██▍ | 7.88G/32.2G [01:39<07:34, 53.4MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 25%|██▍ | 7.98G/32.2G [01:40<07:05, 56.9MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 26%|██▌ | 8.43G/32.2G [01:40<04:53, 80.8MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 27%|██▋ | 8.81G/32.2G [01:40<03:32, 110MB/s] 
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 29%|██▉ | 9.39G/32.2G [01:40<02:12, 172MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 32%|███▏ | 10.2G/32.2G [01:40<01:16, 287MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 34%|███▍ | 10.9G/32.2G [01:40<00:48, 439MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 36%|███▌ | 11.5G/32.2G [01:40<00:34, 593MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 36%|███▌ | 11.6G/32.2G [02:10<07:06, 48.2MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 36%|███▌ | 11.6G/32.2G [02:10<07:06, 48.2MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 36%|███▌ | 11.6G/32.2G [02:10<07:02, 48.6MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 37%|███▋ | 12.0G/32.2G [02:13<05:22, 62.5MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 39%|███▊ | 12.4G/32.2G [02:13<03:42, 88.9MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 40%|███▉ | 12.7G/32.2G [02:13<02:39, 122MB/s] 
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 41%|████ | 13.1G/32.2G [02:13<01:43, 184MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 43%|████▎ | 13.8G/32.2G [02:13<00:58, 316MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 45%|████▍ | 14.3G/32.2G [02:14<00:37, 475MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 46%|████▋ | 14.9G/32.2G [02:14<00:25, 688MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 48%|████▊ | 15.5G/32.2G [02:14<00:17, 946MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 49%|████▉ | 15.7G/32.2G [02:46<06:13, 44.0MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 49%|████▉ | 15.7G/32.2G [02:46<06:13, 44.0MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 49%|████▉ | 15.8G/32.2G [02:46<05:41, 47.8MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 50%|█████ | 16.2G/32.2G [02:46<03:47, 70.1MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 51%|█████▏ | 16.5G/32.2G [02:47<02:42, 96.4MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 52%|█████▏ | 16.9G/32.2G [02:47<01:54, 133MB/s] 
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 54%|█████▍ | 17.4G/32.2G [02:47<01:08, 216MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 56%|█████▌ | 17.9G/32.2G [02:47<00:41, 345MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 58%|█████▊ | 18.5G/32.2G [02:47<00:26, 520MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 59%|█████▉ | 19.0G/32.2G [02:47<00:18, 704MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 61%|██████ | 19.5G/32.2G [03:15<03:58, 53.3MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 61%|██████ | 19.5G/32.2G [03:15<03:58, 53.3MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 61%|██████ | 19.5G/32.2G [03:16<03:59, 53.0MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 62%|██████▏ | 19.8G/32.2G [03:20<03:26, 59.7MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 62%|██████▏ | 20.0G/32.2G [03:20<02:40, 75.7MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 63%|██████▎ | 20.3G/32.2G [03:20<01:56, 102MB/s] 
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 64%|██████▍ | 20.6G/32.2G [03:20<01:23, 139MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 66%|██████▌ | 21.1G/32.2G [03:20<00:44, 250MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 67%|██████▋ | 21.5G/32.2G [03:20<00:29, 363MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 69%|██████▊ | 22.1G/32.2G [03:20<00:17, 564MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 70%|███████ | 22.6G/32.2G [03:20<00:11, 803MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 72%|███████▏ | 23.1G/32.2G [03:21<00:07, 1.13GB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 73%|███████▎ | 23.6G/32.2G [03:53<03:01, 47.2MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 73%|███████▎ | 23.6G/32.2G [03:53<03:01, 47.2MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 74%|███████▎ | 23.6G/32.2G [03:53<02:51, 49.7MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 75%|███████▍ | 24.0G/32.2G [03:53<01:56, 70.3MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 76%|███████▌ | 24.3G/32.2G [03:53<01:23, 93.8MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 77%|███████▋ | 24.6G/32.2G [03:54<00:55, 135MB/s] 
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 78%|███████▊ | 25.1G/32.2G [03:54<00:32, 219MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 80%|███████▉ | 25.7G/32.2G [03:54<00:18, 340MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 81%|████████ | 26.1G/32.2G [03:54<00:13, 463MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 83%|████████▎ | 26.8G/32.2G [03:54<00:07, 752MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 85%|████████▍ | 27.3G/32.2G [04:23<01:27, 55.6MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 85%|████████▍ | 27.3G/32.2G [04:23<01:27, 55.6MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 85%|████████▌ | 27.3G/32.2G [04:23<01:25, 56.7MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 86%|████████▌ | 27.7G/32.2G [04:26<01:09, 64.6MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 87%|████████▋ | 27.9G/32.2G [04:27<00:50, 83.1MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 88%|████████▊ | 28.2G/32.2G [04:27<00:36, 110MB/s] 
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 88%|████████▊ | 28.4G/32.2G [04:27<00:26, 142MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 90%|████████▉ | 28.8G/32.2G [04:27<00:15, 220MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 91%|█████████▏| 29.4G/32.2G [04:27<00:07, 381MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 93%|█████████▎| 30.0G/32.2G [04:27<00:03, 597MB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 96%|█████████▋| 31.0G/32.2G [04:27<00:01, 1.10GB/s]
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 98%|█████████▊| 31.6G/32.2G [04:33<00:01, 297MB/s] 
(…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 100%|█████████▉| 32.0G/32.2G [04:34<00:00, 321MB/s] (…)3-120B-Instruct-Q8_0-00004-of-00005.gguf: 32.2GB [04:35, 117MB/s]
80%|████████ | 4/5 [18:20<04:35, 275.35s/it]
(…)3-120B-Instruct-Q8_0-00005-of-00005.gguf: 0%| | 0.00/1.06G [00:00<?, ?B/s]
(…)3-120B-Instruct-Q8_0-00005-of-00005.gguf: 2%|▏ | 16.0M/1.06G [00:02<03:03, 5.71MB/s]
(…)3-120B-Instruct-Q8_0-00005-of-00005.gguf: 3%|▎ | 32.0M/1.06G [00:08<04:50, 3.54MB/s]
(…)3-120B-Instruct-Q8_0-00005-of-00005.gguf: 47%|████▋ | 496M/1.06G [00:08<00:06, 88.2MB/s] 
(…)3-120B-Instruct-Q8_0-00005-of-00005.gguf: 91%|█████████ | 960M/1.06G [00:09<00:00, 167MB/s]  (…)3-120B-Instruct-Q8_0-00005-of-00005.gguf: 1.07GB [00:09, 110MB/s]
100%|██████████| 5/5 [18:30<00:00, 179.63s/it] 100%|██████████| 5/5 [18:30<00:00, 222.13s/it]