| 2023-11-18 09:03:25 | INFO | controller | args: Namespace(host='0.0.0.0', port=10000, dispatch_method='shortest_queue') | |
| 2023-11-18 09:03:25 | INFO | controller | Init controller | |
| 2023-11-18 09:03:25 | ERROR | stderr | INFO: Started server process [6312] | |
| 2023-11-18 09:03:25 | ERROR | stderr | INFO: Waiting for application startup. | |
| 2023-11-18 09:03:25 | ERROR | stderr | INFO: Application startup complete. | |
| 2023-11-18 09:03:25 | ERROR | stderr | INFO: Uvicorn running on http://0.0.0.0:10000 (Press CTRL+C to quit) | |
| 2023-11-18 09:06:26 | INFO | controller | Register a new worker: http://localhost:40000 | |
| 2023-11-18 09:06:26 | INFO | controller | Register done: http://localhost:40000, {'model_names': ['llava-v1.5-7b-5GB'], 'speed': 1, 'queue_length': 0} | |
| 2023-11-18 09:06:26 | INFO | stdout | INFO: 127.0.0.1:55496 - "POST /register_worker HTTP/1.1" 200 OK | |
| 2023-11-18 09:06:41 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:06:41 | INFO | stdout | INFO: 127.0.0.1:47384 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:06:56 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:06:56 | INFO | stdout | INFO: 127.0.0.1:51760 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:07:11 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:07:11 | INFO | stdout | INFO: 127.0.0.1:60042 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:07:26 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:07:26 | INFO | stdout | INFO: 127.0.0.1:52662 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:07:41 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:07:41 | INFO | stdout | INFO: 127.0.0.1:46100 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:07:56 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:07:56 | INFO | stdout | INFO: 127.0.0.1:34094 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:08:11 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:08:11 | INFO | stdout | INFO: 127.0.0.1:50558 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:08:26 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:08:26 | INFO | stdout | INFO: 127.0.0.1:34502 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:08:41 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:08:41 | INFO | stdout | INFO: 127.0.0.1:32922 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:08:56 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:08:56 | INFO | stdout | INFO: 127.0.0.1:37724 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:09:11 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:09:11 | INFO | stdout | INFO: 127.0.0.1:53322 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:09:26 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:09:26 | INFO | stdout | INFO: 127.0.0.1:33208 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:09:41 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:09:41 | INFO | stdout | INFO: 127.0.0.1:53010 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:09:56 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:09:56 | INFO | stdout | INFO: 127.0.0.1:34478 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:10:11 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:10:11 | INFO | stdout | INFO: 127.0.0.1:52736 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:10:26 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:10:26 | INFO | stdout | INFO: 127.0.0.1:47056 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:10:41 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:10:41 | INFO | stdout | INFO: 127.0.0.1:38568 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:10:56 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:10:56 | INFO | stdout | INFO: 127.0.0.1:37650 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:11:11 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:11:11 | INFO | stdout | INFO: 127.0.0.1:33520 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:11:26 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:11:26 | INFO | stdout | INFO: 127.0.0.1:54452 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:11:34 | INFO | controller | Register a new worker: http://localhost:40000 | |
| 2023-11-18 09:11:34 | INFO | controller | Register done: http://localhost:40000, {'model_names': ['llava-v1.5-7b-5GB'], 'speed': 1, 'queue_length': 0} | |
| 2023-11-18 09:11:34 | INFO | stdout | INFO: 127.0.0.1:37052 - "POST /refresh_all_workers HTTP/1.1" 200 OK | |
| 2023-11-18 09:11:34 | INFO | stdout | INFO: 127.0.0.1:37054 - "POST /list_models HTTP/1.1" 200 OK | |
| 2023-11-18 09:11:41 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:11:41 | INFO | stdout | INFO: 127.0.0.1:46636 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:11:56 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:11:56 | INFO | stdout | INFO: 127.0.0.1:41816 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:12:11 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:12:11 | INFO | stdout | INFO: 127.0.0.1:35034 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:12:26 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:12:26 | INFO | stdout | INFO: 127.0.0.1:43630 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:12:41 | INFO | controller | Receive heart beat. http://localhost:40000 | |
| 2023-11-18 09:12:41 | INFO | stdout | INFO: 127.0.0.1:40032 - "POST /receive_heart_beat HTTP/1.1" 200 OK | |
| 2023-11-18 09:12:43 | ERROR | stderr | INFO: Shutting down | |
| 2023-11-18 09:12:43 | ERROR | stderr | INFO: Waiting for application shutdown. | |
| 2023-11-18 09:12:43 | ERROR | stderr | INFO: Application shutdown complete. | |
| 2023-11-18 09:12:43 | ERROR | stderr | INFO: Finished server process [6312] | |