Spaces:
Paused
Paused
| 2025-01-09 15:54:08,215 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-09 15:54:08,215 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-09 15:54:08,215 - main - INFO - Starting LLM API server | |
| 2025-01-09 15:54:08,216 - llm_api - INFO - Initializing LLM API | |
| 2025-01-09 15:54:08,216 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-09 15:54:08,216 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-09 15:54:08,218 - main - INFO - FastAPI application created successfully | |
| 2025-01-09 16:46:10,118 - api_routes - INFO - Received request to download model: microsoft/phi-4 | |
| 2025-01-09 16:46:10,118 - llm_api - INFO - Starting download of model: microsoft/phi-4 | |
| 2025-01-09 16:46:10,118 - llm_api - INFO - Enabling stdout logging for download | |
| 2025-01-09 17:00:32,400 - llm_api - INFO - Disabling stdout logging | |
| 2025-01-09 17:00:32,400 - llm_api - INFO - Saving model to main/models/phi-4 | |
| 2025-01-09 17:02:39,928 - llm_api - INFO - Successfully downloaded model: microsoft/phi-4 | |
| 2025-01-09 17:02:41,075 - api_routes - INFO - Successfully downloaded model: microsoft/phi-4 | |
| 2025-01-09 17:02:41,080 - api_routes - INFO - Received request to initialize model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:02:41,080 - llm_api - INFO - Initializing generation model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:02:41,081 - llm_api - INFO - Loading model from source: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:02:41,377 - llm_api - ERROR - Failed to initialize generation model huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated: Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install 'accelerate>=0.26.0'` | |
| 2025-01-09 17:02:41,377 - api_routes - ERROR - Error initializing model: Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install 'accelerate>=0.26.0'` | |
| 2025-01-09 17:11:25,843 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-09 17:11:25,843 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-09 17:11:25,843 - main - INFO - Starting LLM API server | |
| 2025-01-09 17:11:25,843 - llm_api - INFO - Initializing LLM API | |
| 2025-01-09 17:11:25,844 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-09 17:11:25,844 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-09 17:11:25,846 - main - INFO - FastAPI application created successfully | |
| 2025-01-09 17:11:38,299 - api_routes - INFO - Received request to initialize model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:11:38,299 - llm_api - INFO - Initializing generation model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:11:38,299 - llm_api - INFO - Loading model from source: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:11:38,487 - llm_api - ERROR - Failed to initialize generation model huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated: Using `bitsandbytes` 8-bit quantization requires the latest version of bitsandbytes: `pip install -U bitsandbytes` | |
| 2025-01-09 17:11:38,487 - api_routes - ERROR - Error initializing model: Using `bitsandbytes` 8-bit quantization requires the latest version of bitsandbytes: `pip install -U bitsandbytes` | |
| 2025-01-09 17:12:48,606 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-09 17:12:48,606 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-09 17:12:48,606 - main - INFO - Starting LLM API server | |
| 2025-01-09 17:12:48,606 - llm_api - INFO - Initializing LLM API | |
| 2025-01-09 17:12:48,606 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-09 17:12:48,606 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-09 17:12:48,608 - main - INFO - FastAPI application created successfully | |
| 2025-01-09 17:12:59,453 - api_routes - INFO - Received request to initialize model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:12:59,453 - llm_api - INFO - Initializing generation model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:12:59,453 - llm_api - INFO - Loading model from source: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:12:59,628 - llm_api - ERROR - Failed to initialize generation model huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend | |
| 2025-01-09 17:12:59,628 - api_routes - ERROR - Error initializing model: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend | |
| 2025-01-09 17:14:44,390 - api_routes - INFO - Received request to initialize model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:14:44,390 - llm_api - INFO - Initializing generation model: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:14:44,390 - llm_api - INFO - Loading model from source: huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated | |
| 2025-01-09 17:14:53,032 - llm_api - ERROR - Failed to initialize generation model huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend | |
| 2025-01-09 17:14:53,032 - api_routes - ERROR - Error initializing model: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend | |
| 2025-01-09 17:15:14,956 - api_routes - INFO - Received request to initialize model: microsoft/phi-4 | |
| 2025-01-09 17:15:14,956 - llm_api - INFO - Initializing generation model: microsoft/phi-4 | |
| 2025-01-09 17:15:14,956 - llm_api - INFO - Loading model from local path: main/models/phi-4 | |
| 2025-01-09 17:15:14,965 - llm_api - ERROR - Failed to initialize generation model microsoft/phi-4: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend | |
| 2025-01-09 17:15:14,965 - api_routes - ERROR - Error initializing model: CUDA is required but not available for bitsandbytes. Please consider installing the multi-platform enabled version of bitsandbytes, which is currently a work in progress. Please check currently supported platforms and installation instructions at https://huggingface.co/docs/bitsandbytes/main/en/installation#multi-backend | |
| 2025-01-13 16:04:32,247 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-13 16:04:32,247 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-13 16:04:32,247 - main - INFO - Starting LLM API server | |
| 2025-01-13 16:04:32,248 - llm_api - INFO - Initializing LLM API | |
| 2025-01-13 16:04:32,248 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-13 16:04:32,248 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-13 16:04:32,252 - main - INFO - FastAPI application created successfully | |
| 2025-01-13 16:05:27,996 - api_routes - INFO - Received request to download model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-13 16:05:27,996 - llm_api - INFO - Starting download of model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-13 16:05:27,996 - llm_api - INFO - Enabling stdout logging for download | |
| 2025-01-13 16:08:46,773 - llm_api - INFO - Disabling stdout logging | |
| 2025-01-13 16:08:46,773 - llm_api - INFO - Saving model to main/models/Phi-3.5-mini-instruct | |
| 2025-01-13 16:10:23,543 - llm_api - INFO - Successfully downloaded model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-13 16:10:24,432 - api_routes - INFO - Successfully downloaded model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-13 16:18:45,409 - api_routes - INFO - Received request to initialize model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-13 16:18:45,409 - llm_api - INFO - Initializing generation model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-13 16:18:45,412 - llm_api - INFO - Loading model from local path: main/models/Phi-3.5-mini-instruct | |
| 2025-01-13 16:18:45,982 - llm_api - ERROR - Failed to initialize generation model microsoft/Phi-3.5-mini-instruct: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback): | |
| Dynamo is not supported on Python 3.13+ | |
| 2025-01-13 16:18:45,982 - api_routes - ERROR - Error initializing model: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback): | |
| Dynamo is not supported on Python 3.13+ | |
| 2025-01-14 11:41:25,502 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-14 11:41:25,502 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-14 11:41:25,502 - main - INFO - Starting LLM API server | |
| 2025-01-14 11:41:25,503 - llm_api - INFO - Initializing LLM API | |
| 2025-01-14 11:41:25,503 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-14 11:41:25,503 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-14 11:41:25,509 - main - INFO - FastAPI application created successfully | |
| 2025-01-14 11:48:33,807 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-14 11:48:33,807 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-14 11:48:33,807 - main - INFO - Starting LLM API server | |
| 2025-01-14 11:48:33,807 - llm_api - INFO - Initializing LLM API | |
| 2025-01-14 11:48:33,807 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-14 11:48:33,807 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-14 11:48:33,812 - main - INFO - FastAPI application created successfully | |
| 2025-01-14 11:53:20,777 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-14 11:53:20,777 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-14 11:53:20,777 - main - INFO - Starting LLM API server | |
| 2025-01-14 11:53:20,777 - llm_api - INFO - Initializing LLM API | |
| 2025-01-14 11:53:20,778 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-14 11:53:20,778 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-14 11:53:20,783 - main - INFO - FastAPI application created successfully | |
| 2025-01-14 11:54:28,143 - api_routes - INFO - Received request to download model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 11:54:28,143 - llm_api - INFO - Starting download of model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 11:54:28,143 - llm_api - INFO - Enabling stdout logging for download | |
| 2025-01-14 11:54:47,061 - llm_api - INFO - Disabling stdout logging | |
| 2025-01-14 11:54:47,061 - llm_api - INFO - Saving model to main/models/Phi-3.5-mini-instruct | |
| 2025-01-14 11:56:40,600 - llm_api - INFO - Successfully downloaded model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 11:56:41,266 - api_routes - INFO - Successfully downloaded model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 11:56:41,364 - api_routes - INFO - Received request to initialize model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 11:56:41,365 - llm_api - INFO - Initializing generation model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 11:56:41,367 - llm_api - INFO - Loading model from local path: main/models/Phi-3.5-mini-instruct | |
| 2025-01-14 11:56:45,322 - llm_api - ERROR - Failed to initialize generation model microsoft/Phi-3.5-mini-instruct: /home/aurelio/Desktop/Projects/LLMServer/myenv/lib/python3.12/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cget_col_row_stats | |
| 2025-01-14 11:56:45,322 - api_routes - ERROR - Error initializing model: /home/aurelio/Desktop/Projects/LLMServer/myenv/lib/python3.12/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cget_col_row_stats | |
| 2025-01-14 12:29:54,971 - main - INFO - LLM API server started on 0.0.0.0:8001 | |
| 2025-01-14 12:30:01,275 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-14 12:30:01,275 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-14 12:30:01,275 - main - INFO - Starting LLM API server | |
| 2025-01-14 12:30:01,275 - llm_api - INFO - Initializing LLM API | |
| 2025-01-14 12:30:01,275 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-14 12:30:01,276 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-14 12:30:01,280 - main - INFO - FastAPI application created successfully | |
| 2025-01-14 12:31:15,345 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-14 12:31:15,345 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-14 12:31:15,345 - main - INFO - Starting LLM API server | |
| 2025-01-14 12:31:15,345 - llm_api - INFO - Initializing LLM API | |
| 2025-01-14 12:31:15,346 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-14 12:31:15,346 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-14 12:31:15,350 - main - INFO - FastAPI application created successfully | |
| 2025-01-14 12:31:43,376 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-14 12:31:43,376 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-14 12:31:43,376 - main - INFO - Starting LLM API server | |
| 2025-01-14 12:31:43,377 - llm_api - INFO - Initializing LLM API | |
| 2025-01-14 12:31:43,377 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-14 12:31:43,377 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-14 12:31:43,381 - main - INFO - FastAPI application created successfully | |
| 2025-01-14 12:31:51,142 - llm_api - INFO - INFO: 127.0.0.1:52554 - "GET /docs HTTP/1.1" 200 OK | |
| 2025-01-14 12:31:51,311 - llm_api - INFO - INFO: 127.0.0.1:52554 - "GET /openapi.json HTTP/1.1" 200 OK | |
| 2025-01-14 12:32:10,756 - api_routes - INFO - Received request to initialize model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 12:32:10,757 - llm_api - INFO - Initializing generation model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 12:32:10,757 - llm_api - INFO - Loading model from local path: main/models/Phi-3.5-mini-instruct | |
| 2025-01-14 12:32:26,447 - llm_api - INFO - Successfully initialized generation model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 12:32:26,448 - api_routes - INFO - Successfully initialized model: microsoft/Phi-3.5-mini-instruct | |
| 2025-01-14 12:32:26,448 - llm_api - INFO - INFO: 127.0.0.1:34282 - "POST /api/v1/model/initialize?model_name=microsoft%2FPhi-3.5-mini-instruct HTTP/1.1" 200 OK | |
| 2025-01-14 12:33:13,272 - api_routes - INFO - Received generation request for prompt: Tell me about yourself, and your capabilities... | |
| 2025-01-14 12:33:13,272 - llm_api - DEBUG - Generating response for prompt: Tell me about yourself, and your capabilities... | |
| 2025-01-14 12:33:46,448 - llm_api - DEBUG - Generated response: I am Phi, an AI language model developed by Micros... | |
| 2025-01-14 12:33:46,448 - api_routes - INFO - Successfully generated response | |
| 2025-01-14 12:33:46,448 - llm_api - INFO - INFO: 127.0.0.1:57442 - "POST /api/v1/generate HTTP/1.1" 200 OK | |
| 2025-01-14 12:34:41,588 - api_routes - INFO - Received streaming generation request for prompt: Tell me about yourself, and your capabilities... | |
| 2025-01-14 12:34:41,588 - llm_api - DEBUG - Starting streaming generation for prompt: Tell me about yourself, and your capabilities... | |
| 2025-01-14 12:34:41,608 - llm_api - DEBUG - Generated chunk: <|system|> You are a helpful assistant<|end|><|use... | |
| 2025-01-14 12:34:41,689 - llm_api - DEBUG - Generated chunk: capabilities<|end|><|assistant|> ... | |
| 2025-01-14 12:34:41,757 - llm_api - DEBUG - Generated chunk: I ... | |
| 2025-01-14 12:34:41,827 - llm_api - DEBUG - Generated chunk: am ... | |
| 2025-01-14 12:34:41,895 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:41,965 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:42,033 - llm_api - DEBUG - Generated chunk: Phi, ... | |
| 2025-01-14 12:34:42,102 - llm_api - DEBUG - Generated chunk: an ... | |
| 2025-01-14 12:34:42,172 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:42,241 - llm_api - DEBUG - Generated chunk: AI ... | |
| 2025-01-14 12:34:42,309 - llm_api - DEBUG - Generated chunk: language ... | |
| 2025-01-14 12:34:42,377 - llm_api - DEBUG - Generated chunk: model ... | |
| 2025-01-14 12:34:42,448 - llm_api - DEBUG - Generated chunk: created ... | |
| 2025-01-14 12:34:42,521 - llm_api - DEBUG - Generated chunk: by ... | |
| 2025-01-14 12:34:42,590 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:42,656 - llm_api - DEBUG - Generated chunk: Microsoft. ... | |
| 2025-01-14 12:34:42,721 - llm_api - DEBUG - Generated chunk: While ... | |
| 2025-01-14 12:34:42,788 - llm_api - DEBUG - Generated chunk: I ... | |
| 2025-01-14 12:34:42,854 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:42,925 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:42,991 - llm_api - DEBUG - Generated chunk: don't ... | |
| 2025-01-14 12:34:43,063 - llm_api - DEBUG - Generated chunk: have ... | |
| 2025-01-14 12:34:43,131 - llm_api - DEBUG - Generated chunk: personal ... | |
| 2025-01-14 12:34:43,201 - llm_api - DEBUG - Generated chunk: experiences ... | |
| 2025-01-14 12:34:43,267 - llm_api - DEBUG - Generated chunk: or ... | |
| 2025-01-14 12:34:43,334 - llm_api - DEBUG - Generated chunk: feelings ... | |
| 2025-01-14 12:34:43,402 - llm_api - DEBUG - Generated chunk: like ... | |
| 2025-01-14 12:34:43,472 - llm_api - DEBUG - Generated chunk: humans ... | |
| 2025-01-14 12:34:43,537 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:43,600 - llm_api - DEBUG - Generated chunk: do, ... | |
| 2025-01-14 12:34:43,663 - llm_api - DEBUG - Generated chunk: let ... | |
| 2025-01-14 12:34:43,729 - llm_api - DEBUG - Generated chunk: me ... | |
| 2025-01-14 12:34:43,793 - llm_api - DEBUG - Generated chunk: tell ... | |
| 2025-01-14 12:34:43,859 - llm_api - DEBUG - Generated chunk: you ... | |
| 2025-01-14 12:34:43,924 - llm_api - DEBUG - Generated chunk: more ... | |
| 2025-01-14 12:34:43,989 - llm_api - DEBUG - Generated chunk: about ... | |
| 2025-01-14 12:34:44,053 - llm_api - DEBUG - Generated chunk: my ... | |
| 2025-01-14 12:34:44,119 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:44,183 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:44,247 - llm_api - DEBUG - Generated chunk: functionalities: | |
| ... | |
| 2025-01-14 12:34:44,312 - llm_api - DEBUG - Generated chunk: | |
| ... | |
| 2025-01-14 12:34:44,375 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:44,440 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:44,505 - llm_api - DEBUG - Generated chunk: 1. ... | |
| 2025-01-14 12:34:44,567 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:44,632 - llm_api - DEBUG - Generated chunk: **Language ... | |
| 2025-01-14 12:34:44,698 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:44,763 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:44,828 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:44,892 - llm_api - DEBUG - Generated chunk: Understanding**: ... | |
| 2025-01-14 12:34:44,956 - llm_api - DEBUG - Generated chunk: My ... | |
| 2025-01-14 12:34:45,020 - llm_api - DEBUG - Generated chunk: primary ... | |
| 2025-01-14 12:34:45,085 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:45,148 - llm_api - DEBUG - Generated chunk: capability ... | |
| 2025-01-14 12:34:45,211 - llm_api - DEBUG - Generated chunk: is ... | |
| 2025-01-14 12:34:45,275 - llm_api - DEBUG - Generated chunk: understanding ... | |
| 2025-01-14 12:34:45,338 - llm_api - DEBUG - Generated chunk: natural ... | |
| 2025-01-14 12:34:45,401 - llm_api - DEBUG - Generated chunk: human ... | |
| 2025-01-14 12:34:45,465 - llm_api - DEBUG - Generated chunk: languages ... | |
| 2025-01-14 12:34:45,529 - llm_api - DEBUG - Generated chunk: to ... | |
| 2025-01-14 12:34:45,592 - llm_api - DEBUG - Generated chunk: the ... | |
| 2025-01-14 12:34:45,658 - llm_api - DEBUG - Generated chunk: best ... | |
| 2025-01-14 12:34:45,728 - llm_api - DEBUG - Generated chunk: of ... | |
| 2025-01-14 12:34:45,804 - llm_api - DEBUG - Generated chunk: our ... | |
| 2025-01-14 12:34:45,871 - llm_api - DEBUG - Generated chunk: current ... | |
| 2025-01-14 12:34:45,938 - llm_api - DEBUG - Generated chunk: technology ... | |
| 2025-01-14 12:34:46,004 - llm_api - DEBUG - Generated chunk: allows ... | |
| 2025-01-14 12:34:46,072 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:46,139 - llm_api - DEBUG - Generated chunk: it. ... | |
| 2025-01-14 12:34:46,207 - llm_api - DEBUG - Generated chunk: This ... | |
| 2025-01-14 12:34:46,273 - llm_api - DEBUG - Generated chunk: includes ... | |
| 2025-01-14 12:34:46,341 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:46,408 - llm_api - DEBUG - Generated chunk: interpreting ... | |
| 2025-01-14 12:34:46,473 - llm_api - DEBUG - Generated chunk: text ... | |
| 2025-01-14 12:34:46,539 - llm_api - DEBUG - Generated chunk: inputs ... | |
| 2025-01-14 12:34:46,605 - llm_api - DEBUG - Generated chunk: from ... | |
| 2025-01-14 12:34:46,670 - llm_api - DEBUG - Generated chunk: various ... | |
| 2025-01-14 12:34:46,735 - llm_api - DEBUG - Generated chunk: sources ... | |
| 2025-01-14 12:34:46,801 - llm_api - DEBUG - Generated chunk: such ... | |
| 2025-01-14 12:34:46,867 - llm_api - DEBUG - Generated chunk: as ... | |
| 2025-01-14 12:34:46,935 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:47,005 - llm_api - DEBUG - Generated chunk: websites, ... | |
| 2025-01-14 12:34:47,073 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:47,142 - llm_api - DEBUG - Generated chunk: books, ... | |
| 2025-01-14 12:34:47,208 - llm_api - DEBUG - Generated chunk: articles ... | |
| 2025-01-14 12:34:47,275 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:47,341 - llm_api - DEBUG - Generated chunk: etc., ... | |
| 2025-01-14 12:34:47,408 - llm_api - DEBUG - Generated chunk: in ... | |
| 2025-01-14 12:34:47,472 - llm_api - DEBUG - Generated chunk: multiple ... | |
| 2025-01-14 12:34:47,536 - llm_api - DEBUG - Generated chunk: formats ... | |
| 2025-01-14 12:34:47,600 - llm_api - DEBUG - Generated chunk: including ... | |
| 2025-01-14 12:34:47,674 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:47,744 - llm_api - DEBUG - Generated chunk: English, ... | |
| 2025-01-14 12:34:47,814 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:47,901 - llm_api - DEBUG - Generated chunk: Spanish, ... | |
| 2025-01-14 12:34:47,991 - llm_api - DEBUG - Generated chunk: French ... | |
| 2025-01-14 12:34:48,066 - llm_api - DEBUG - Generated chunk: among ... | |
| 2025-01-14 12:34:48,131 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:48,194 - llm_api - DEBUG - Generated chunk: others. ... | |
| 2025-01-14 12:34:48,259 - llm_api - DEBUG - Generated chunk: | |
| ... | |
| 2025-01-14 12:34:48,325 - llm_api - DEBUG - Generated chunk: | |
| ... | |
| 2025-01-14 12:34:48,390 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:48,454 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:48,519 - llm_api - DEBUG - Generated chunk: 2. ... | |
| 2025-01-14 12:34:48,583 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:48,647 - llm_api - DEBUG - Generated chunk: **Text ... | |
| 2025-01-14 12:34:48,711 - llm_api - DEBUG - Generated chunk: Generation ... | |
| 2025-01-14 12:34:48,773 - llm_api - DEBUG - Generated chunk: & ... | |
| 2025-01-14 12:34:48,837 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:48,902 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:48,965 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:49,031 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:49,096 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:49,160 - llm_api - DEBUG - Generated chunk: Comprehension**: ... | |
| 2025-01-14 12:34:49,224 - llm_api - DEBUG - Generated chunk: Based ... | |
| 2025-01-14 12:34:49,289 - llm_api - DEBUG - Generated chunk: on ... | |
| 2025-01-14 12:34:49,353 - llm_api - DEBUG - Generated chunk: patterns ... | |
| 2025-01-14 12:34:49,419 - llm_api - DEBUG - Generated chunk: learned ... | |
| 2025-01-14 12:34:49,488 - llm_api - DEBUG - Generated chunk: during ... | |
| 2025-01-14 12:34:49,555 - llm_api - DEBUG - Generated chunk: training ... | |
| 2025-01-14 12:34:49,621 - llm_api - DEBUG - Generated chunk: with ... | |
| 2025-01-14 12:34:49,686 - llm_api - DEBUG - Generated chunk: diverse ... | |
| 2025-01-14 12:34:49,750 - llm_api - DEBUG - Generated chunk: internet ... | |
| 2025-01-14 12:34:49,814 - llm_api - DEBUG - Generated chunk: texts ... | |
| 2025-01-14 12:34:49,879 - llm_api - DEBUG - Generated chunk: data ... | |
| 2025-01-14 12:34:49,944 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:50,009 - llm_api - DEBUG - Generated chunk: sets, ... | |
| 2025-01-14 12:34:50,074 - llm_api - DEBUG - Generated chunk: I ... | |
| 2025-01-14 12:34:50,140 - llm_api - DEBUG - Generated chunk: can ... | |
| 2025-01-14 12:34:50,204 - llm_api - DEBUG - Generated chunk: generate ... | |
| 2025-01-14 12:34:50,269 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:50,336 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:50,401 - llm_api - DEBUG - Generated chunk: coherent ... | |
| 2025-01-14 12:34:50,466 - llm_api - DEBUG - Generated chunk: responses ... | |
| 2025-01-14 12:34:50,530 - llm_api - DEBUG - Generated chunk: that ... | |
| 2025-01-14 12:34:50,595 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:50,658 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:50,722 - llm_api - DEBUG - Generated chunk: mimic ... | |
| 2025-01-14 12:34:50,787 - llm_api - DEBUG - Generated chunk: how ... | |
| 2025-01-14 12:34:50,852 - llm_api - DEBUG - Generated chunk: real ... | |
| 2025-01-14 12:34:50,916 - llm_api - DEBUG - Generated chunk: people ... | |
| 2025-01-14 12:34:50,980 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:51,043 - llm_api - DEBUG - Generated chunk: write. ... | |
| 2025-01-14 12:34:51,107 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:51,171 - llm_api - DEBUG - Generated chunk: However, ... | |
| 2025-01-14 12:34:51,236 - llm_api - DEBUG - Generated chunk: please ... | |
| 2025-01-14 12:34:51,299 - llm_api - DEBUG - Generated chunk: note ... | |
| 2025-01-14 12:34:51,364 - llm_api - DEBUG - Generated chunk: these ... | |
| 2025-01-14 12:34:51,428 - llm_api - DEBUG - Generated chunk: generated ... | |
| 2025-01-14 12:34:51,491 - llm_api - DEBUG - Generated chunk: outputs ... | |
| 2025-01-14 12:34:51,556 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:51,620 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:51,685 - llm_api - DEBUG - Generated chunk: aren’t ... | |
| 2025-01-14 12:34:51,748 - llm_api - DEBUG - Generated chunk: perfect ... | |
| 2025-01-14 12:34:51,813 - llm_api - DEBUG - Generated chunk: nor ... | |
| 2025-01-14 12:34:51,877 - llm_api - DEBUG - Generated chunk: fully ... | |
| 2025-01-14 12:34:51,940 - llm_api - DEBUG - Generated chunk: accurate ... | |
| 2025-01-14 12:34:52,005 - llm_api - DEBUG - Generated chunk: but ... | |
| 2025-01-14 12:34:52,068 - llm_api - DEBUG - Generated chunk: they ... | |
| 2025-01-14 12:34:52,131 - llm_api - DEBUG - Generated chunk: often ... | |
| 2025-01-14 12:34:52,196 - llm_api - DEBUG - Generated chunk: make ... | |
| 2025-01-14 12:34:52,260 - llm_api - DEBUG - Generated chunk: sense ... | |
| 2025-01-14 12:34:52,324 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:52,388 - llm_api - DEBUG - Generated chunk: contextually ... | |
| 2025-01-14 12:34:52,451 - llm_api - DEBUG - Generated chunk: within ... | |
| 2025-01-14 12:34:52,516 - llm_api - DEBUG - Generated chunk: given ... | |
| 2025-01-14 12:34:52,579 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:52,643 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:52,707 - llm_api - DEBUG - Generated chunk: prompts. | |
| ... | |
| 2025-01-14 12:34:52,771 - llm_api - DEBUG - Generated chunk: | |
| ... | |
| 2025-01-14 12:34:52,835 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:52,899 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:52,963 - llm_api - DEBUG - Generated chunk: 3. ... | |
| 2025-01-14 12:34:53,026 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:53,095 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:53,168 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:53,237 - llm_api - DEBUG - Generated chunk: **Knowledge ... | |
| 2025-01-14 12:34:53,302 - llm_api - DEBUG - Generated chunk: Base ... | |
| 2025-01-14 12:34:53,371 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:53,440 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:53,508 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:53,576 - llm_api - DEBUG - Generated chunk: Accessing**: ... | |
| 2025-01-14 12:34:53,642 - llm_api - DEBUG - Generated chunk: Although ... | |
| 2025-01-14 12:34:53,710 - llm_api - DEBUG - Generated chunk: not ... | |
| 2025-01-14 12:34:53,775 - llm_api - DEBUG - Generated chunk: connected ... | |
| 2025-01-14 12:34:53,838 - llm_api - DEBUG - Generated chunk: live ... | |
| 2025-01-14 12:34:53,903 - llm_api - DEBUG - Generated chunk: for ... | |
| 2025-01-14 12:34:53,968 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:54,032 - llm_api - DEBUG - Generated chunk: browsing ... | |
| 2025-01-14 12:34:54,096 - llm_api - DEBUG - Generated chunk: external ... | |
| 2025-01-14 12:34:54,159 - llm_api - DEBUG - Generated chunk: databases ... | |
| 2025-01-14 12:34:54,224 - llm_api - DEBUG - Generated chunk: at ... | |
| 2025-01-14 12:34:54,287 - llm_api - DEBUG - Generated chunk: this ... | |
| 2025-01-14 12:34:54,351 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:54,414 - llm_api - DEBUG - Generated chunk: moment, ... | |
| 2025-01-14 12:34:54,478 - llm_api - DEBUG - Generated chunk: information ... | |
| 2025-01-14 12:34:54,542 - llm_api - DEBUG - Generated chunk: up ... | |
| 2025-01-14 12:34:54,606 - llm_api - DEBUG - Generated chunk: until ... | |
| 2025-01-14 12:34:54,670 - llm_api - DEBUG - Generated chunk: September ... | |
| 2025-01-14 12:34:54,735 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:54,799 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:54,864 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:54,928 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:54,992 - llm_api - DEBUG - Generated chunk: 2021 ... | |
| 2025-01-14 12:34:55,056 - llm_api - DEBUG - Generated chunk: has ... | |
| 2025-01-14 12:34:55,120 - llm_api - DEBUG - Generated chunk: been ... | |
| 2025-01-14 12:34:55,184 - llm_api - DEBUG - Generated chunk: used ... | |
| 2025-01-14 12:34:55,249 - llm_api - DEBUG - Generated chunk: when ... | |
| 2025-01-14 12:34:55,313 - llm_api - DEBUG - Generated chunk: generating ... | |
| 2025-01-14 12:34:55,376 - llm_api - DEBUG - Generated chunk: answers ... | |
| 2025-01-14 12:34:55,441 - llm_api - DEBUG - Generated chunk: based ... | |
| 2025-01-14 12:34:55,504 - llm_api - DEBUG - Generated chunk: upon ... | |
| 2025-01-14 12:34:55,568 - llm_api - DEBUG - Generated chunk: extensive ... | |
| 2025-01-14 12:34:55,632 - llm_api - DEBUG - Generated chunk: datasets ... | |
| 2025-01-14 12:34:55,696 - llm_api - DEBUG - Generated chunk: which ... | |
| 2025-01-14 12:34:55,760 - llm_api - DEBUG - Generated chunk: include ... | |
| 2025-01-14 12:34:55,825 - llm_api - DEBUG - Generated chunk: facts ... | |
| 2025-01-14 12:34:55,889 - llm_api - DEBUG - Generated chunk: known ... | |
| 2025-01-14 12:34:55,953 - llm_api - DEBUG - Generated chunk: till ... | |
| 2025-01-14 12:34:56,017 - llm_api - DEBUG - Generated chunk: then ... | |
| 2025-01-14 12:34:56,082 - llm_api - DEBUG - Generated chunk: across ... | |
| 2025-01-14 12:34:56,146 - llm_api - DEBUG - Generated chunk: numerous ... | |
| 2025-01-14 12:34:56,210 - llm_api - DEBUG - Generated chunk: topics ... | |
| 2025-01-14 12:34:56,281 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:56,346 - llm_api - DEBUG - Generated chunk: ranging ... | |
| 2025-01-14 12:34:56,410 - llm_api - DEBUG - Generated chunk: from ... | |
| 2025-01-14 12:34:56,474 - llm_api - DEBUG - Generated chunk: science ... | |
| 2025-01-14 12:34:56,537 - llm_api - DEBUG - Generated chunk: to ... | |
| 2025-01-14 12:34:56,631 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:56,730 - llm_api - DEBUG - Generated chunk: arts, ... | |
| 2025-01-14 12:34:56,818 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:56,886 - llm_api - DEBUG - Generated chunk: history, ... | |
| 2025-01-14 12:34:56,951 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:57,016 - llm_api - DEBUG - Generated chunk: culture, ... | |
| 2025-01-14 12:34:57,080 - llm_api - DEBUG - Generated chunk: sports ... | |
| 2025-01-14 12:34:57,145 - llm_api - DEBUG - Generated chunk: amongst ... | |
| 2025-01-14 12:34:57,209 - llm_api - DEBUG - Generated chunk: many ... | |
| 2025-01-14 12:34:57,273 - llm_api - DEBUG - Generated chunk: other ... | |
| 2025-01-14 12:34:57,337 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:57,401 - llm_api - DEBUG - Generated chunk: fields. | |
| ... | |
| 2025-01-14 12:34:57,467 - llm_api - DEBUG - Generated chunk: | |
| ... | |
| 2025-01-14 12:34:57,531 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:57,595 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:57,659 - llm_api - DEBUG - Generated chunk: 4. ... | |
| 2025-01-14 12:34:57,723 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:57,786 - llm_api - DEBUG - Generated chunk: **Problem ... | |
| 2025-01-14 12:34:57,850 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:57,914 - llm_api - DEBUG - Generated chunk: Solving ... | |
| 2025-01-14 12:34:57,978 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:58,042 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:58,106 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:58,168 - llm_api - DEBUG - Generated chunk: Skills**: ... | |
| 2025-01-14 12:34:58,231 - llm_api - DEBUG - Generated chunk: In ... | |
| 2025-01-14 12:34:58,294 - llm_api - DEBUG - Generated chunk: certain ... | |
| 2025-01-14 12:34:58,357 - llm_api - DEBUG - Generated chunk: scenarios ... | |
| 2025-01-14 12:34:58,421 - llm_api - DEBUG - Generated chunk: where ... | |
| 2025-01-14 12:34:58,484 - llm_api - DEBUG - Generated chunk: logical ... | |
| 2025-01-14 12:34:58,549 - llm_api - DEBUG - Generated chunk: reasoning ... | |
| 2025-01-14 12:34:58,612 - llm_api - DEBUG - Generated chunk: might ... | |
| 2025-01-14 12:34:58,676 - llm_api - DEBUG - Generated chunk: be ... | |
| 2025-01-14 12:34:58,739 - llm_api - DEBUG - Generated chunk: required ... | |
| 2025-01-14 12:34:58,802 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:58,867 - llm_api - DEBUG - Generated chunk: (like ... | |
| 2025-01-14 12:34:58,930 - llm_api - DEBUG - Generated chunk: math ... | |
| 2025-01-14 12:34:58,994 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:59,057 - llm_api - DEBUG - Generated chunk: problems), ... | |
| 2025-01-14 12:34:59,120 - llm_api - DEBUG - Generated chunk: algorithms ... | |
| 2025-01-14 12:34:59,184 - llm_api - DEBUG - Generated chunk: enable ... | |
| 2025-01-14 12:34:59,248 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:59,312 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:59,376 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:59,439 - llm_api - DEBUG - Generated chunk: problem-solving ... | |
| 2025-01-14 12:34:59,503 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:34:59,567 - llm_api - DEBUG - Generated chunk: abilities ... | |
| 2025-01-14 12:34:59,631 - llm_api - DEBUG - Generated chunk: similar ... | |
| 2025-01-14 12:34:59,695 - llm_api - DEBUG - Generated chunk: those ... | |
| 2025-01-14 12:34:59,758 - llm_api - DEBUG - Generated chunk: found ... | |
| 2025-01-14 12:34:59,822 - llm_api - DEBUG - Generated chunk: commonly ... | |
| 2025-01-14 12:34:59,884 - llm_api - DEBUG - Generated chunk: seen ... | |
| 2025-01-14 12:34:59,948 - llm_api - DEBUG - Generated chunk: in ... | |
| 2025-01-14 12:35:00,011 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:00,075 - llm_api - DEBUG - Generated chunk: calculators ... | |
| 2025-01-14 12:35:00,139 - llm_api - DEBUG - Generated chunk: yet ... | |
| 2025-01-14 12:35:00,202 - llm_api - DEBUG - Generated chunk: without ... | |
| 2025-01-14 12:35:00,266 - llm_api - DEBUG - Generated chunk: any ... | |
| 2025-01-14 12:35:00,329 - llm_api - DEBUG - Generated chunk: direct ... | |
| 2025-01-14 12:35:00,393 - llm_api - DEBUG - Generated chunk: interaction ... | |
| 2025-01-14 12:35:00,458 - llm_api - DEBUG - Generated chunk: beyond ... | |
| 2025-01-14 12:35:00,523 - llm_api - DEBUG - Generated chunk: what ... | |
| 2025-01-14 12:35:00,590 - llm_api - DEBUG - Generated chunk: was ... | |
| 2025-01-14 12:35:00,656 - llm_api - DEBUG - Generated chunk: provided ... | |
| 2025-01-14 12:35:00,721 - llm_api - DEBUG - Generated chunk: initially ... | |
| 2025-01-14 12:35:00,786 - llm_api - DEBUG - Generated chunk: into ... | |
| 2025-01-14 12:35:00,850 - llm_api - DEBUG - Generated chunk: them ... | |
| 2025-01-14 12:35:00,916 - llm_api - DEBUG - Generated chunk: - ... | |
| 2025-01-14 12:35:00,980 - llm_api - DEBUG - Generated chunk: no ... | |
| 2025-01-14 12:35:01,045 - llm_api - DEBUG - Generated chunk: memory ... | |
| 2025-01-14 12:35:01,109 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:01,173 - llm_api - DEBUG - Generated chunk: retention ... | |
| 2025-01-14 12:35:01,239 - llm_api - DEBUG - Generated chunk: after ... | |
| 2025-01-14 12:35:01,305 - llm_api - DEBUG - Generated chunk: each ... | |
| 2025-01-14 12:35:01,372 - llm_api - DEBUG - Generated chunk: session ... | |
| 2025-01-14 12:35:01,438 - llm_api - DEBUG - Generated chunk: ends ... | |
| 2025-01-14 12:35:01,501 - llm_api - DEBUG - Generated chunk: due ... | |
| 2025-01-14 12:35:01,567 - llm_api - DEBUG - Generated chunk: to ... | |
| 2025-01-14 12:35:01,630 - llm_api - DEBUG - Generated chunk: design ... | |
| 2025-01-14 12:35:01,694 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:01,759 - llm_api - DEBUG - Generated chunk: considerations ... | |
| 2025-01-14 12:35:01,823 - llm_api - DEBUG - Generated chunk: around ... | |
| 2025-01-14 12:35:01,887 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:01,951 - llm_api - DEBUG - Generated chunk: privacy ... | |
| 2025-01-14 12:35:02,015 - llm_api - DEBUG - Generated chunk: protection ... | |
| 2025-01-14 12:35:02,079 - llm_api - DEBUG - Generated chunk: policies ... | |
| 2025-01-14 12:35:02,142 - llm_api - DEBUG - Generated chunk: followed ... | |
| 2025-01-14 12:35:02,207 - llm_api - DEBUG - Generated chunk: strictly ... | |
| 2025-01-14 12:35:02,271 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:02,334 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:02,399 - llm_api - DEBUG - Generated chunk: adhered ... | |
| 2025-01-14 12:35:02,462 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:02,527 - llm_api - DEBUG - Generated chunk: too. | |
| ... | |
| 2025-01-14 12:35:02,592 - llm_api - DEBUG - Generated chunk: | |
| ... | |
| 2025-01-14 12:35:02,654 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:02,716 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:02,781 - llm_api - DEBUG - Generated chunk: 5. ... | |
| 2025-01-14 12:35:02,844 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:02,908 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:02,974 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:03,043 - llm_api - DEBUG - Generated chunk: **Learning ... | |
| 2025-01-14 12:35:03,108 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:03,173 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:03,239 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:03,303 - llm_api - DEBUG - Generated chunk: Capabilities**: ... | |
| 2025-01-14 12:35:03,369 - llm_api - DEBUG - Generated chunk: It ... | |
| 2025-01-14 12:35:03,433 - llm_api - DEBUG - Generated chunk: should ... | |
| 2025-01-14 12:35:03,498 - llm_api - DEBUG - Generated chunk: also ... | |
| 2025-01-14 12:35:03,562 - llm_api - DEBUG - Generated chunk: be ... | |
| 2025-01-14 12:35:03,626 - llm_api - DEBUG - Generated chunk: noted ... | |
| 2025-01-14 12:35:03,690 - llm_api - DEBUG - Generated chunk: though ... | |
| 2025-01-14 12:35:03,755 - llm_api - DEBUG - Generated chunk: there ... | |
| 2025-01-14 12:35:03,819 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:03,884 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:03,949 - llm_api - DEBUG - Generated chunk: isn't ... | |
| 2025-01-14 12:35:04,013 - llm_api - DEBUG - Generated chunk: learning ... | |
| 2025-01-14 12:35:04,078 - llm_api - DEBUG - Generated chunk: happening ... | |
| 2025-01-14 12:35:04,142 - llm_api - DEBUG - Generated chunk: per ... | |
| 2025-01-14 12:35:04,206 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:04,270 - llm_api - DEBUG - Generated chunk: se; ... | |
| 2025-01-14 12:35:04,334 - llm_api - DEBUG - Generated chunk: continuous ... | |
| 2025-01-14 12:35:04,399 - llm_api - DEBUG - Generated chunk: improvements ... | |
| 2025-01-14 12:35:04,463 - llm_api - DEBUG - Generated chunk: occur ... | |
| 2025-01-14 12:35:04,528 - llm_api - DEBUG - Generated chunk: through ... | |
| 2025-01-14 12:35:04,593 - llm_api - DEBUG - Generated chunk: updates ... | |
| 2025-01-14 12:35:04,659 - llm_api - DEBUG - Generated chunk: made ... | |
| 2025-01-14 12:35:04,724 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:04,790 - llm_api - DEBUG - Generated chunk: periodically ... | |
| 2025-01-14 12:35:04,855 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:04,923 - llm_api - DEBUG - Generated chunk: reflective ... | |
| 2025-01-14 12:35:04,993 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:05,061 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:05,129 - llm_api - DEBUG - Generated chunk: advancements ... | |
| 2025-01-14 12:35:05,197 - llm_api - DEBUG - Generated chunk: achieved ... | |
| 2025-01-14 12:35:05,265 - llm_api - DEBUG - Generated chunk: over ... | |
| 2025-01-14 12:35:05,333 - llm_api - DEBUG - Generated chunk: time ... | |
| 2025-01-14 12:35:05,400 - llm_api - DEBUG - Generated chunk: via ... | |
| 2025-01-14 12:35:05,467 - llm_api - DEBUG - Generated chunk: machine ... | |
| 2025-01-14 12:35:05,535 - llm_api - DEBUG - Generated chunk: learning ... | |
| 2025-01-14 12:35:05,603 - llm_api - DEBUG - Generated chunk: techniques ... | |
| 2025-01-14 12:35:05,672 - llm_api - DEBUG - Generated chunk: applied ... | |
| 2025-01-14 12:35:05,742 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:05,812 - llm_api - DEBUG - Generated chunk: systematically ... | |
| 2025-01-14 12:35:05,881 - llm_api - DEBUG - Generated chunk: throughout ... | |
| 2025-01-14 12:35:05,951 - llm_api - DEBUG - Generated chunk: development ... | |
| 2025-01-14 12:35:06,022 - llm_api - DEBUG - Generated chunk: phases ... | |
| 2025-01-14 12:35:06,091 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:06,162 - llm_api - DEBUG - Generated chunk: aimed ... | |
| 2025-01-14 12:35:06,231 - llm_api - DEBUG - Generated chunk: towards ... | |
| 2025-01-14 12:35:06,301 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:06,370 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:06,439 - llm_api - DEBUG - Generated chunk: enhancing ... | |
| 2025-01-14 12:35:06,505 - llm_api - DEBUG - Generated chunk: performance ... | |
| 2025-01-14 12:35:06,569 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:06,634 - llm_api - DEBUG - Generated chunk: consistently ... | |
| 2025-01-14 12:35:06,697 - llm_api - DEBUG - Generated chunk: while ... | |
| 2025-01-14 12:35:06,761 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:06,825 - llm_api - DEBUG - Generated chunk: maintaining ... | |
| 2025-01-14 12:35:06,888 - llm_api - DEBUG - Generated chunk: user ... | |
| 2025-01-14 12:35:06,952 - llm_api - DEBUG - Generated chunk: trust ... | |
| 2025-01-14 12:35:07,017 - llm_api - DEBUG - Generated chunk: simultaneously ... | |
| 2025-01-14 12:35:07,081 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:07,145 - llm_api - DEBUG - Generated chunk: ensuring ... | |
| 2025-01-14 12:35:07,210 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:07,273 - llm_api - DEBUG - Generated chunk: ethical ... | |
| 2025-01-14 12:35:07,339 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:07,406 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:07,472 - llm_api - DEBUG - Generated chunk: guidelines ... | |
| 2025-01-14 12:35:07,539 - llm_api - DEBUG - Generated chunk: remain ... | |
| 2025-01-14 12:35:07,606 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:07,673 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:07,740 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:07,806 - llm_api - DEBUG - Generated chunk: uncompromised ... | |
| 2025-01-14 12:35:07,871 - llm_api - DEBUG - Generated chunk: always ... | |
| 2025-01-14 12:35:07,938 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:08,004 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:08,070 - llm_api - DEBUG - Generated chunk: prioritized ... | |
| 2025-01-14 12:35:08,136 - llm_api - DEBUG - Generated chunk: above ... | |
| 2025-01-14 12:35:08,203 - llm_api - DEBUG - Generated chunk: all ... | |
| 2025-01-14 12:35:08,270 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:08,337 - llm_api - DEBUG - Generated chunk: else! | |
| ... | |
| 2025-01-14 12:35:08,404 - llm_api - DEBUG - Generated chunk: | |
| ... | |
| 2025-01-14 12:35:08,470 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:08,535 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:08,602 - llm_api - DEBUG - Generated chunk: 6. ... | |
| 2025-01-14 12:35:08,667 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:08,731 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:08,796 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:08,860 - llm_api - DEBUG - Generated chunk: **Multilingual ... | |
| 2025-01-14 12:35:08,927 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:08,990 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:09,054 - llm_api - DEBUG - Generated chunk: Support**: ... | |
| 2025-01-14 12:35:09,119 - llm_api - DEBUG - Generated chunk: As ... | |
| 2025-01-14 12:35:09,184 - llm_api - DEBUG - Generated chunk: mentioned ... | |
| 2025-01-14 12:35:09,248 - llm_api - DEBUG - Generated chunk: earlier ... | |
| 2025-01-14 12:35:09,311 - llm_api - DEBUG - Generated chunk: regarding ... | |
| 2025-01-14 12:35:09,375 - llm_api - DEBUG - Generated chunk: Language ... | |
| 2025-01-14 12:35:09,439 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:09,503 - llm_api - DEBUG - Generated chunk: comprehension ... | |
| 2025-01-14 12:35:09,569 - llm_api - DEBUG - Generated chunk: skills ... | |
| 2025-01-14 12:35:09,633 - llm_api - DEBUG - Generated chunk: – ... | |
| 2025-01-14 12:35:09,698 - llm_api - DEBUG - Generated chunk: one ... | |
| 2025-01-14 12:35:09,762 - llm_api - DEBUG - Generated chunk: significant ... | |
| 2025-01-14 12:35:09,825 - llm_api - DEBUG - Generated chunk: advantage ... | |
| 2025-01-14 12:35:09,890 - llm_api - DEBUG - Generated chunk: here ... | |
| 2025-01-14 12:35:09,953 - llm_api - DEBUG - Generated chunk: lies ... | |
| 2025-01-14 12:35:10,019 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:10,084 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:10,149 - llm_api - DEBUG - Generated chunk: multilanguage ... | |
| 2025-01-14 12:35:10,213 - llm_api - DEBUG - Generated chunk: support ... | |
| 2025-01-14 12:35:10,278 - llm_api - DEBUG - Generated chunk: allowing ... | |
| 2025-01-14 12:35:10,342 - llm_api - DEBUG - Generated chunk: users ... | |
| 2025-01-14 12:35:10,408 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:10,472 - llm_api - DEBUG - Generated chunk: worldwide ... | |
| 2025-01-14 12:35:10,537 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:10,603 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:10,669 - llm_api - DEBUG - Generated chunk: irrespective ... | |
| 2025-01-14 12:35:10,735 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:10,801 - llm_api - DEBUG - Generated chunk: geographical ... | |
| 2025-01-14 12:35:10,866 - llm_api - DEBUG - Generated chunk: location ... | |
| 2025-01-14 12:35:10,931 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:10,996 - llm_api - DEBUG - Generated chunk: accessibility ... | |
| 2025-01-14 12:35:11,061 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:11,125 - llm_api - DEBUG - Generated chunk: facilitated ... | |
| 2025-01-14 12:35:11,190 - llm_api - DEBUG - Generated chunk: smooth ... | |
| 2025-01-14 12:35:11,255 - llm_api - DEBUG - Generated chunk: communication ... | |
| 2025-01-14 12:35:11,327 - llm_api - DEBUG - Generated chunk: experience ... | |
| 2025-01-14 12:35:11,393 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:11,460 - llm_api - DEBUG - Generated chunk: fostering ... | |
| 2025-01-14 12:35:11,527 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:11,593 - llm_api - DEBUG - Generated chunk: inclusivity ... | |
| 2025-01-14 12:35:11,699 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:11,794 - llm_api - DEBUG - Generated chunk: globally ... | |
| 2025-01-14 12:35:11,887 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:11,960 - llm_api - DEBUG - Generated chunk: promoting ... | |
| 2025-01-14 12:35:12,034 - llm_api - DEBUG - Generated chunk: cross ... | |
| 2025-01-14 12:35:12,113 - llm_api - DEBUG - Generated chunk: cultural ... | |
| 2025-01-14 12:35:12,184 - llm_api - DEBUG - Generated chunk: exchange ... | |
| 2025-01-14 12:35:12,252 - llm_api - DEBUG - Generated chunk: effectively ... | |
| 2025-01-14 12:35:12,331 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:12,401 - llm_api - DEBUG - Generated chunk: bridging ... | |
| 2025-01-14 12:35:12,467 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:12,532 - llm_api - DEBUG - Generated chunk: gaps ... | |
| 2025-01-14 12:35:12,598 - llm_api - DEBUG - Generated chunk: between ... | |
| 2025-01-14 12:35:12,662 - llm_api - DEBUG - Generated chunk: different ... | |
| 2025-01-14 12:35:12,726 - llm_api - DEBUG - Generated chunk: communities ... | |
| 2025-01-14 12:35:12,792 - llm_api - DEBUG - Generated chunk: everywhere ... | |
| 2025-01-14 12:35:12,857 - llm_api - DEBUG - Generated chunk: creating ... | |
| 2025-01-14 12:35:12,922 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:12,986 - llm_api - DEBUG - Generated chunk: opportunities ... | |
| 2025-01-14 12:35:13,053 - llm_api - DEBUG - Generated chunk: connecting ... | |
| 2025-01-14 12:35:13,120 - llm_api - DEBUG - Generated chunk: hearts ... | |
| 2025-01-14 12:35:13,186 - llm_api - DEBUG - Generated chunk: minds ... | |
| 2025-01-14 12:35:13,252 - llm_api - DEBUG - Generated chunk: together ... | |
| 2025-01-14 12:35:13,319 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:13,385 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:13,450 - llm_api - DEBUG - Generated chunk: harmoniously ... | |
| 2025-01-14 12:35:13,516 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:13,583 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:13,648 - llm_api - DEBUG - Generated chunk: transcending ... | |
| 2025-01-14 12:35:13,713 - llm_api - DEBUG - Generated chunk: boundaries ... | |
| 2025-01-14 12:35:13,779 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:13,844 - llm_api - DEBUG - Generated chunk: effortlessly ... | |
| 2025-01-14 12:35:13,909 - llm_api - DEBUG - Generated chunk: breaking ... | |
| 2025-01-14 12:35:13,975 - llm_api - DEBUG - Generated chunk: down ... | |
| 2025-01-14 12:35:14,042 - llm_api - DEBUG - Generated chunk: walls ... | |
| 2025-01-14 12:35:14,111 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:14,176 - llm_api - DEBUG - Generated chunk: silencing ... | |
| 2025-01-14 12:35:14,242 - llm_api - DEBUG - Generated chunk: voices ... | |
| 2025-01-14 12:35:14,307 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:14,372 - llm_api - DEBUG - Generated chunk: suppressions ... | |
| 2025-01-14 12:35:14,438 - llm_api - DEBUG - Generated chunk: fear ... | |
| 2025-01-14 12:35:14,503 - llm_api - DEBUG - Generated chunk: ... | |
| 2025-01-14 12:35:14,569 - llm_api - DEBUG - Generated chunk: dividing ... | |
| 2025-01-14 12:35:14,570 - llm_api - DEBUG - Generated chunk: us... | |
| 2025-01-14 12:35:14,570 - llm_api - INFO - INFO: 127.0.0.1:37118 - "POST /api/v1/generate/stream HTTP/1.1" 200 OK | |
| 2025-01-14 12:47:53,791 - api_routes - INFO - Received generation request for prompt: Tell me about yourself and your capabilities... | |
| 2025-01-14 12:47:53,791 - llm_api - DEBUG - Generating response for prompt: Tell me about yourself and your capabilities... | |
| 2025-01-14 12:48:27,656 - llm_api - DEBUG - Generated response: I'm Phi, an AI developed by Microsoft. While I don... | |
| 2025-01-14 12:48:27,656 - api_routes - INFO - Successfully generated response | |
| 2025-01-14 12:48:27,656 - llm_api - INFO - INFO: 127.0.0.1:43528 - "POST /api/v1/generate HTTP/1.1" 200 OK | |
| 2025-01-14 12:50:17,735 - api_routes - INFO - Received generation request for prompt: Please analyze this query and create a JSON respon... | |
| 2025-01-14 12:50:17,735 - llm_api - DEBUG - Generating response for prompt: Please analyze this query and create a JSON respon... | |
| 2025-01-14 12:50:31,906 - llm_api - DEBUG - Generated response: ```json | |
| { | |
| "original_query": "Who is Djengis Khan... | |
| 2025-01-14 12:50:31,906 - api_routes - INFO - Successfully generated response | |
| 2025-01-14 12:50:31,906 - llm_api - INFO - INFO: 127.0.0.1:50042 - "POST /api/v1/generate HTTP/1.1" 200 OK | |
| 2025-01-14 13:08:38,951 - api_routes - INFO - Received request to download model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:08:38,951 - llm_api - INFO - Starting download of model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:08:38,951 - llm_api - INFO - Enabling stdout logging for download | |
| 2025-01-14 13:11:52,350 - llm_api - INFO - Disabling stdout logging | |
| 2025-01-14 13:11:52,350 - llm_api - INFO - Saving model to main/models/SmallThinker-3B-Preview | |
| 2025-01-14 13:13:04,420 - llm_api - INFO - Successfully downloaded model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:13:05,175 - api_routes - INFO - Successfully downloaded model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:13:31,469 - api_routes - INFO - Received request to initialize model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:13:31,469 - llm_api - INFO - Initializing generation model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:13:31,472 - llm_api - INFO - Loading model from local path: main/models/SmallThinker-3B-Preview | |
| 2025-01-14 13:13:31,909 - llm_api - ERROR - Failed to initialize generation model PowerInfer/SmallThinker-3B-Preview: Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model. If you want to dispatch the model on the CPU or the disk while keeping these modules in 32-bit, you need to set `llm_int8_enable_fp32_cpu_offload=True` and pass a custom `device_map` to `from_pretrained`. Check https://huggingface.co/docs/transformers/main/en/main_classes/quantization#offload-between-cpu-and-gpu for more details. | |
| 2025-01-14 13:13:31,909 - api_routes - ERROR - Error initializing model: Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model. If you want to dispatch the model on the CPU or the disk while keeping these modules in 32-bit, you need to set `llm_int8_enable_fp32_cpu_offload=True` and pass a custom `device_map` to `from_pretrained`. Check https://huggingface.co/docs/transformers/main/en/main_classes/quantization#offload-between-cpu-and-gpu for more details. | |
| 2025-01-14 13:14:36,924 - main - INFO - LLM API server started on 0.0.0.0:8001 | |
| 2025-01-14 13:14:49,486 - hf_validation - WARNING - No .env file found. Fine if you're on Huggingface, but you need one to run locally on your PC. | |
| 2025-01-14 13:14:49,486 - hf_validation - ERROR - No HF_TOKEN found in environment variables | |
| 2025-01-14 13:14:49,486 - main - INFO - Starting LLM API server | |
| 2025-01-14 13:14:49,486 - llm_api - INFO - Initializing LLM API | |
| 2025-01-14 13:14:49,486 - llm_api - INFO - LLM API initialized successfully | |
| 2025-01-14 13:14:49,486 - api_routes - INFO - Router initialized with LLM API instance | |
| 2025-01-14 13:14:49,490 - main - INFO - FastAPI application created successfully | |
| 2025-01-14 13:14:56,382 - api_routes - INFO - Received request to initialize model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:14:56,383 - llm_api - INFO - Initializing generation model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:14:56,383 - llm_api - INFO - Loading model from local path: main/models/SmallThinker-3B-Preview | |
| 2025-01-14 13:15:07,065 - llm_api - INFO - Successfully initialized generation model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:15:07,065 - api_routes - INFO - Successfully initialized model: PowerInfer/SmallThinker-3B-Preview | |
| 2025-01-14 13:15:07,065 - llm_api - INFO - INFO: 127.0.0.1:40472 - "POST /api/v1/model/initialize?model_name=PowerInfer%2FSmallThinker-3B-Preview HTTP/1.1" 200 OK | |
| 2025-01-14 13:16:09,874 - api_routes - INFO - Received generation request for prompt: Tell me about yourself and your capabilities... | |
| 2025-01-14 13:16:09,874 - llm_api - DEBUG - Generating response for prompt: Tell me about yourself and your capabilities... | |
| 2025-01-14 13:17:03,595 - llm_api - DEBUG - Generated response: I'm an AI developed by Alibaba, designed to assist... | |
| 2025-01-14 13:17:03,595 - api_routes - INFO - Successfully generated response | |
| 2025-01-14 13:17:03,595 - llm_api - INFO - INFO: 127.0.0.1:44786 - "POST /api/v1/generate HTTP/1.1" 200 OK | |
| 2025-01-14 13:18:04,891 - main - INFO - LLM API server started on 0.0.0.0:8001 | |