| Chunking for generation: 0%| | 0/13 [00:00<?, ?it/s]INFO:root:vllm: loading model: /media/hangyu5/Home/Documents/Hugging-Face/LLaMA_Factory/phi-2-sft-alpaca_gpt4_en-ep1, tp=1, trust_remote_code=1 | |
| INFO 12-20 04:43:59 llm_engine.py:73] Initializing an LLM engine with config: model='/media/hangyu5/Home/Documents/Hugging-Face/LLaMA_Factory/phi-2-sft-alpaca_gpt4_en-ep1', tokenizer='/media/hangyu5/Home/Documents/Hugging-Face/LLaMA_Factory/phi-2-sft-alpaca_gpt4_en-ep1', tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.float16, max_seq_len=2048, download_dir=None, load_format=auto, tensor_parallel_size=1, quantization=None, enforce_eager=False, seed=0) | |
| Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. | |
| INFO 12-20 04:44:03 llm_engine.py:223] # GPU blocks: 2853, # CPU blocks: 819 | |
| INFO 12-20 04:44:04 model_runner.py:394] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI. | |
| INFO 12-20 04:44:09 model_runner.py:437] Graph capturing finished in 4 secs. | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.64it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.64it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.72s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.72s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.48s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.48s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.85s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.85s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.44it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.44it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.73s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.73s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.29it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.29it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.64s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.64s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.81s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.21s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.21s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.32s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.32s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.80it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.80it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.00s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.00s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.25s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.25s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.28it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.28it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.33it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.33it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.08s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.08s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.93s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.93s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.60s/it][A Processed prompts: 100%|██████████| 1/1 [00:08<00:00, 8.60s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.37s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.19s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.19s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.77it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.76it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.78s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.78s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.42s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.42s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.82s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.82s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.46s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.46s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.32s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.77s/it][A Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.77s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.89s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.42it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.41it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.38it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.38it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.69s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.69s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.04s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.04s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.08s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.08s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.86s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.86s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.13it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.13it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.18s/it][A Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.18s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.13it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.13it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.94s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.94s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.88s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.88s/it] | |
| Chunking for generation: 8%|▊ | 1/13 [02:37<31:26, 157.23s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 64. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.12s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.12s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.37s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.37s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.65s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.65s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.69s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.69s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.98it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.97it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.01it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.01it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.88s/it][A Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.88s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.47s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.47s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.03s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.03s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.06it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.06it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.28s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.80s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.80s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.75s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.75s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.41it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.41it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.69s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.69s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.71s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.71s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.73s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.73s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.77it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.77it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.08s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.08s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.97s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.97s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it][A Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.14it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.14it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.17it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.17it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.42s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.42s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.75s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.75s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.87s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.87s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.17s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.17s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.14it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.14it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.22s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.22s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.31s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.31s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.37s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.49it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.48it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.74it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.74it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.18s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.18s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.44s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.44s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.36s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.36s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.89s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.89s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.40it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.39it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.45it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.45it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.68s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.68s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.78s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.43it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.43it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.20s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.20s/it] | |
| Chunking for generation: 15%|█▌ | 2/13 [05:05<27:51, 151.97s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 128. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.09it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.09it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.18it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.18it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.51s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.52s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.52s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.32it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.32it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.16it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.15it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.91s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.91s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.42s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.42s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.81s/it][A Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.81s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.58s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.58s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.48s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.48s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.98s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.98s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.29it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.29it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 10.41it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.71s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.71s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.27s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.27s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.33it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.33it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.09it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.09it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.03s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.03s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.28s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.28s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.57s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.57s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.26it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.26it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.04s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.22it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.22it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.98it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.98it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.46it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.46it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 15.87it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.07it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.07it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.77s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.77s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 12.55it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.89s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.89s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.48s/it][A Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.48s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.73it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.73it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.07it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.07it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.65it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.65it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.08s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.08s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.74s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.74s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.06s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.02s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.02s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.92s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.61s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.61s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.92s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.92s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.79s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.79s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.46s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.46s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.40s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.40s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.71s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.71s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.12s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.12s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.36s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.36s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 21.47it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.56s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.56s/it] | |
| Chunking for generation: 23%|██▎ | 3/13 [07:30<24:46, 148.64s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 192. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.02it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.02it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.21s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.21s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 12.66it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.59s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.59s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.95it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.95it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.46it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.46it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 12.74it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.95s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.95s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.84s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.84s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it][A Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.12s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.68s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.68s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.18s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.18s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.91s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.91s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.76it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.76it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.16s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.16s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.27it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.27it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 16.09it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.20s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.20s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.18it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.18it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.71s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.71s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.14s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.14s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.28it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.28it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.51s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.51s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.44it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.44it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.53s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.53s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.70it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.70it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.10it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.10it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.17s/it][A Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.17s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.64s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.64s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.32it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.32it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.19s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.19s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 16.00it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.12s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.12s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.20s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.20s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.02s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.02s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.35s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.35s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.28s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.28s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.03it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.03it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.75s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.75s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.52s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.52s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.42it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.41it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.88s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.88s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.07s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.07s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.48s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.48s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.96it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.96it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.07s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.07s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.52s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.52s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.41s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.41s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.41it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.41it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.23s/it][A Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.23s/it] | |
| Chunking for generation: 31%|███ | 4/13 [09:51<21:51, 145.72s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 256. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.68s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.68s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.43s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.43s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.06it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.06it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.66s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.41s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.41s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.16s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.16s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.86it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.85it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.76it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.75it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.10it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.10it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.31it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.31it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.41it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.41it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.90s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.90s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.86s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.86s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.43s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.43s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.60s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.60s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.35s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.35s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.95s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.95s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.95s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it][A Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.97s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.37it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.37it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.91it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.91it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.66s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.66s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.39s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.39s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.57s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.57s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.01s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.01s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.76it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.76it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.69it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.69it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.44it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.44it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.82s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.82s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.87s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.87s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.77s/it][A Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.77s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.85s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.85s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.19s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.19s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.10it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.10it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.47s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.47s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.98s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.62s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.62s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.25it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.25it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 2.00s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 2.00s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.18it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.18it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.46s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.46s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.15it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.14it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.99it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.99it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.50s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.50s/it] | |
| Chunking for generation: 38%|███▊ | 5/13 [12:16<19:22, 145.33s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 320. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.08s/it][A Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.08s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.50s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.93s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.93s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.25s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.25s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.67s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.67s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.18s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.43s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.43s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.94s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.94s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.68it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.68it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.64it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.64it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.04s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.04s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.35s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.35s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.76it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.76it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.44s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.08it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.08it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.57it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.57it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.66it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.66it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.18s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.18s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.99s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.99s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.29s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.29s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.40s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.40s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.15it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.15it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.71it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.71it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.93it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.93it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.84it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.84it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.12s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.12s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.33s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.33s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.35s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.35s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.08it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.08it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.01s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.01s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.87it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.87it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.96s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.15s/it][A Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.15s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.89it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.89it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.31s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.31s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.06s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.65it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.64it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.63s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.63s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.56s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.56s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.52it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.52it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 14.16it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.89it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.89it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.35s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.35s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.48s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.48s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.13it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.13it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.65s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.35it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.35it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.03it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.03it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.26it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.26it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.19s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.19s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it] | |
| Chunking for generation: 46%|████▌ | 6/13 [14:45<17:06, 146.58s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 384. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.00s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.00s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.50it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.50it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.17s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.17s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.04it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.04it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 9.03it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 9.03it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.03it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.03it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.91s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.91s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.75s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.75s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.24s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.24s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.34it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.34it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.22s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.22s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.58it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.58it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.01s/it][A Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.01s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.54s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.54s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.53it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.53it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.80it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.80it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.58s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.60s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.60s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.14s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.14s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.38it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.38it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.22s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.22s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.25it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.25it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.01it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.01it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.42s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.42s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.95s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.95s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.81s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.81s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.60s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.42s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.42s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.55s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.55s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.40it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.40it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.43it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.43it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.12it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.12it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.54s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.54s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.87it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.86it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.90it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.89it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.57s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.57s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.59s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.59s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.02it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.02it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.58s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.58s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.99s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.99s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.69s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.69s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.22it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.22it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.26it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.26it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.37s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.37s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.17s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.17s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.52it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.51it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.06s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.06s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.47it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.47it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.61s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.61s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.07s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.07s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.10it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.10it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.43s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.02it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.02it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.08it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.08it/s] | |
| Chunking for generation: 54%|█████▍ | 7/13 [16:39<13:35, 135.90s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 448. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.25it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.24it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.21s/it][A Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.21s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.81s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.81s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.48s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.48s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.20s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.20s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.48s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.31s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.31s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.95it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.95it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.69it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.69it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.37s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.37s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.60it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.60it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.09it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.08it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.15s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.15s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.20s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.20s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.04s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.04s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.14s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.14s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.74s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.74s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.76it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.76it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.69s/it][A Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.69s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.11it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.80it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.80it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.93s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.93s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.97it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.96it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 18.15it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.40s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.40s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.48it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.48it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.85it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.84it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.11s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.01s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.01s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.24s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.93s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.93s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.08s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.08s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.48it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.48it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.31it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.31it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.82s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.82s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.22s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.22s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.87it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.87it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 11.25it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.74it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.74it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 18.13it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.29s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.29s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.64s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.64s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.24it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.33s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.33s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.15it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.15it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.77it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.77it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.06it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.06it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.66s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.66s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.13it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.13it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.69s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.69s/it] | |
| Chunking for generation: 62%|██████▏ | 8/13 [18:22<10:27, 125.45s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 512. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.88s/it][A Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.88s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.98it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.97it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.01s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.01s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.39s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.39s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.23s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.73s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.73s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.73s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.73s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.47s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.84s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.84s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.80s/it][A Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.80s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.28it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.28it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.81s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.81s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.52s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.52it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.52it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.73it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.73it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.49it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.49it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.08s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.08s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.41s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.41s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.31s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.31s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.51it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.51it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.55it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.55it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.59it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.59it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.96it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.96it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.94it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.94it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.75s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.75s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.15it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.14it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 13.83it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 15.26it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.86s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.69s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.70s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 10.39it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.21it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.21it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.75s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.75s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.81s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.81s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 18.12it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.03s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.03s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.45s/it][A Processed prompts: 100%|██████████| 1/1 [00:09<00:00, 9.45s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.19it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.18it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.21s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.21s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.28s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.28s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.01it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.01it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.59s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.50s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.50s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.79s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.46s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.46s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.28s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.28s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.34it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.34it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.34s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.12s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.12s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.03s/it][A Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.03s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.29s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.29s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.28s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.28s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.69it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.69it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.55it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.55it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.57it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.57it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.98s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.98s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.99s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.99s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.12it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.12it/s] | |
| Chunking for generation: 69%|██████▉ | 9/13 [20:36<08:32, 128.18s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 576. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.34s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.34s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.02s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.02s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.23s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.23s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.21s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.21s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.13s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.01s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.01s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.72s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.72s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.67s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.67s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.28it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.27it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.13s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.08s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.08s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.24s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.24s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.08it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.08it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.49s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.55s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.63it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.63it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.28it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.28it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.31it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.31it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.65s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.65s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.12it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.14s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.14s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.15s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.15s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 12.75it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.27s/it][A Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.27s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.37it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.36it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.03it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.03it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.02it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.02it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.27s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 11.51it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.48s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.48s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.54s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.54s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.80it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.80it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.52it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.52it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.38s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.38s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.60s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.60s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 15.82it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.95it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.94it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.24it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.24it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.80it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.80it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.17it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.17it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.25it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.25it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.88it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.87it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.18it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.17it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.76it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.76it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.87it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.86it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 46.24it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.73it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.73it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.14it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.14it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.80it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.80it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.14it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.14it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.93it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.93it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.84it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.84it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 15.84it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 25.92it/s] | |
| Chunking for generation: 77%|███████▋ | 10/13 [22:25<06:07, 122.47s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 640. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 9.52it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 9.51it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.88s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.88s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.02it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.02it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.29s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.29s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.96it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 6.95it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.83it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.83it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.06it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.06it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.23it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.92s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.92s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.84it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.83it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.83it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.83it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.32it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.32it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 16.08it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.95it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.95it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 11.45it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.35it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.34it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.09s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.38it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.38it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 14.10it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.41it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.40it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.89it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.88it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.98s/it][A Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.98s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.08s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.08s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 11.35it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 12.36it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 15.66it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.26it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.25it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.65it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.65it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.52it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.52it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.66it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.66it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.75it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.75it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 15.31it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.27it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.27it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.42it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.42it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.25it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.25it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.96s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.76it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.76it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.12it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.12it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.21it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.20it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.98s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.98s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.40s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.40s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.36s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.36s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.93it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.93it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.75s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.75s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.25s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.16s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.16s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.71s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.71s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.75it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.74it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.22s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.22s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.99it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.98it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.76s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.70s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.70s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.87it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.87it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.89it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.89it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.64it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.64it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.36it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.16it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 2.16it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.42it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.42it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.12s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.12s/it] | |
| Chunking for generation: 85%|████████▍ | 11/13 [23:42<03:36, 108.44s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 704. Only generating 64 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.36it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.35it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 21.62it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.92s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.92s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.23it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.23it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.40it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 5.40it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.90s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 25.26it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.54s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.54s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 10.51it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.42it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.41it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.01s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.01s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.35it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 8.34it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.40it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 7.39it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.27it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.27it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.69it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.69it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.75it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 4.75it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.21s/it][A Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.21s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.50it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.50it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.02it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 3.02it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.17it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.17it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.20s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.20s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.11s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.11s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.56s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.11s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.11s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.67s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.67s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.64s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.64s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 3.00s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 3.00s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.04s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.04s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.85s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.85s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.50s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.22s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.29s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.29s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.99s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.99s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.30s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.31s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.85s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.85s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.95s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.95s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.17s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.17s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.06s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.06s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.74s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.17it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.17it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.06it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.06it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.13it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.13it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.77s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.77s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.46s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.64s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.64s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.42it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.42it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.57s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.12s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.12s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.13s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.10s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.62s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.62s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.59s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.87s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.63s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.14s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.14s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.67s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.66s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.66s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.03s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.22it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.22it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.39s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.39s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.28s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.28s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.92s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.92s/it] | |
| Chunking for generation: 92%|█████████▏| 12/13 [26:09<02:00, 120.09s/it]INFO:root:Loading outputs from output/chatgpt_fn_--phi-2-alpaca-gpt4/model_outputs.json | |
| INFO:root:Found 768. Only generating 37 . | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.41s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.41s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.78s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.78s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.34s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.34s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.44s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.44s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.50s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.50s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.17s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.17s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.91s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.17s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.17s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.16s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.16s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.05s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.04it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.04it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.41s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.41s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.79s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.02s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.03s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.03s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.47s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.47s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.97s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.77s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.60s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.60s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.76s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.40s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.40s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.03s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.03s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.60it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.60it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.19it/s][A Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 1.19it/s] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.37s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.37s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.45s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.45s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.82s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.51s/it][A Processed prompts: 100%|██████████| 1/1 [00:04<00:00, 4.51s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it][A Processed prompts: 100%|██████████| 1/1 [00:02<00:00, 2.49s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.45s/it][A Processed prompts: 100%|██████████| 1/1 [00:01<00:00, 1.45s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.35s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.35s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:07<00:00, 7.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.66s/it][A Processed prompts: 100%|██████████| 1/1 [00:03<00:00, 3.66s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.26s/it][A Processed prompts: 100%|██████████| 1/1 [00:06<00:00, 6.26s/it] | |
| Processed prompts: 0%| | 0/1 [00:00<?, ?it/s][A | |
| Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.04s/it][A Processed prompts: 100%|██████████| 1/1 [00:05<00:00, 5.04s/it] | |
| Chunking for generation: 100%|██████████| 13/13 [27:52<00:00, 114.96s/it] Chunking for generation: 100%|██████████| 13/13 [27:52<00:00, 128.65s/it] | |
| INFO:root:Skipping evaluation of phi-2 as it is already in the precomputed leaderboard. | |
| INFO:root:Saving all results to output/chatgpt_fn_--phi-2-alpaca-gpt4 | |
| INFO:root:Saving result to the precomputed leaderboard at /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv | |
| win_rate standard_error n_total avg_length | |
| gpt4 73.79 1.54 805 1365 | |
| claude 70.37 1.60 805 1082 | |
| chatgpt 66.09 1.66 805 811 | |
| wizardlm-13b 65.16 1.67 805 985 | |
| vicuna-13b 64.10 1.69 805 1037 | |
| guanaco-65b 62.36 1.71 805 1249 | |
| oasst-rlhf-llama-33b 62.05 1.71 805 1079 | |
| alpaca-farm-ppo-human 60.25 1.72 805 803 | |
| falcon-40b-instruct 56.52 1.74 805 662 | |
| text_davinci_003 50.00 0.00 805 307 | |
| alpaca-7b 45.22 1.74 805 396 | |
| phi-2 43.79 1.74 805 924 | |
| text_davinci_001 28.07 1.56 805 296 | |