Repository: pytorch/serve

Issue #1110: code:405, type:"MethodNotAllowedException", message:"Requested method is not allowed, please refer to API document."
Created: 2021-06-06T19:03:21Z
I am trying to deploy Scaled YOLOV4 object detection model. Below are the steps I followed:


Converted .pt model to .torchscript.pt model


Created new environment and installed all dependencies.


Converted torchscript model to mar model using the following code,
torch-model-archiver --model-name scaled_yolov4_tablecell --version 1.0 --extra-files 'path to .torchscript file' --handler object_detector


Created model-store folder and pasted the mar file in it.


Stared torchserve using following command,
torchserve --start --ncs --model-store /home/billion/47Billion/table_cell_detection/borderless_tablecell/model-server/model-store/ --models scaled_yolov4_tablecell.mar


Checked whether the model is registered or not and the status of the server
curl -X GET http://127.0.0.1:8081/models


{
"models": [
{
"modelName": "scaled_yolov4_tablecell",
"modelUrl": "scaled_yolov4_tablecell.mar"
}
]
}
curl http://localhost:8080/ping
{
"status": "Healthy"
}
I got the following log...
main org.pytorch.serve.servingsdk.impl.PluginsManager - Initializing plugins manager...
2021-06-07 00:02:18,418 [INFO ] main org.pytorch.serve.ModelServer -
Torchserve version: 0.4.0
TS Home: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve/serving/lib/python3.8/site-packages
Current directory: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve
Temp directory: /tmp
Number of GPUs: 0
Number of CPUs: 4
Max heap size: 3986 M
Python executable: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve/serving/bin/python3
Config file: N/A
Inference address: http://127.0.0.1:8080
Management address: http://127.0.0.1:8081
Metrics address: http://127.0.0.1:8082
Model Store: /home/billion/47Billion/table_cell_detection/borderless_tablecell/model-server/model-store
Initial Models: N/A
Log dir: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve/logs
Metrics dir: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve/logs
Netty threads: 0
Netty client threads: 0
Default workers per model: 4
Blacklist Regex: N/A
Maximum Response Size: 6553500
Maximum Request Size: 6553500
Prefer direct buffer: false
Allowed Urls: [file://.|http(s)?://.]
Custom python dependency for model allowed: false
Metrics report format: prometheus
Enable metrics API: true
Workflow Store: /home/billion/47Billion/table_cell_detection/borderless_tablecell/model-server/model-store
2021-06-07 00:02:18,436 [INFO ] main org.pytorch.serve.servingsdk.impl.PluginsManager -  Loading snapshot serializer plugin...
2021-06-07 00:02:18,488 [INFO ] main org.pytorch.serve.ModelServer - Initialize Inference server with: EpollServerSocketChannel.
2021-06-07 00:02:18,630 [INFO ] main org.pytorch.serve.ModelServer - Inference API bind to: http://127.0.0.1:8080
2021-06-07 00:02:18,630 [INFO ] main org.pytorch.serve.ModelServer - Initialize Management server with: EpollServerSocketChannel.
2021-06-07 00:02:18,632 [INFO ] main org.pytorch.serve.ModelServer - Management API bind to: http://127.0.0.1:8081
2021-06-07 00:02:18,632 [INFO ] main org.pytorch.serve.ModelServer - Initialize Metrics server with: EpollServerSocketChannel.
2021-06-07 00:02:18,635 [INFO ] main org.pytorch.serve.ModelServer - Metrics API bind to: http://127.0.0.1:8082
Model server started.
2021-06-07 00:02:19,073 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339
2021-06-07 00:02:19,075 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:202.5420799255371|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339
2021-06-07 00:02:19,075 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:231.13413619995117|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339
2021-06-07 00:02:19,075 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339
2021-06-07 00:02:19,076 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:12359.21484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339
2021-06-07 00:02:19,076 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:2626.8359375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339
2021-06-07 00:02:19,076 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:22.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339
2021-06-07 00:03:19,075 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399
2021-06-07 00:03:19,076 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:202.03667831420898|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399
2021-06-07 00:03:19,076 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:231.63954162597656|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399
2021-06-07 00:03:19,077 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399
2021-06-07 00:03:19,077 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:12335.22265625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399
2021-06-07 00:03:19,077 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:2666.046875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399
2021-06-07 00:03:19,078 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:22.6|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399
2021-06-07 00:03:33,334 [DEBUG] epollEventLoopGroup-3-1 org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1 for model scaled_yolov4_tablecell
2021-06-07 00:03:33,335 [DEBUG] epollEventLoopGroup-3-1 org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1 for model scaled_yolov4_tablecell
2021-06-07 00:03:33,335 [INFO ] epollEventLoopGroup-3-1 org.pytorch.serve.wlm.ModelManager - Model scaled_yolov4_tablecell loaded.
2021-06-07 00:03:33,336 [DEBUG] epollEventLoopGroup-3-1 org.pytorch.serve.wlm.ModelManager - updateModel: scaled_yolov4_tablecell, count: 1
2021-06-07 00:03:34,083 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Listening on port: /tmp/.ts.sock.9000
2021-06-07 00:03:34,242 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - [PID]11523
2021-06-07 00:03:34,243 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Torch worker started.
2021-06-07 00:03:34,243 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Python runtime: 3.8.5
2021-06-07 00:03:34,243 [DEBUG] W-9000-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9000-scaled_yolov4_tablecell_1 State change null -> WORKER_STARTED
2021-06-07 00:03:34,248 [INFO ] W-9000-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Connecting to: /tmp/.ts.sock.9000
2021-06-07 00:03:34,263 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Connection accepted: /tmp/.ts.sock.9000.
2021-06-07 00:03:36,586 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Missing the index_to_name.json file. Inference output will not include class name.
2021-06-07 00:03:36,587 [INFO ] W-9000-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Backend response time: 2292
2021-06-07 00:03:36,588 [DEBUG] W-9000-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9000-scaled_yolov4_tablecell_1 State change WORKER_STARTED -> WORKER_MODEL_LOADED
2021-06-07 00:03:36,588 [INFO ] W-9000-scaled_yolov4_tablecell_1 TS_METRICS - W-9000-scaled_yolov4_tablecell_1.ms:3247|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004416
2021-06-07 00:03:36,589 [INFO ] W-9000-scaled_yolov4_tablecell_1 TS_METRICS - WorkerThreadTime.ms:30|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:03:36,620 [INFO ] epollEventLoopGroup-3-1 ACCESS_LOG - /127.0.0.1:53270 "POST /models?initial_workers=1&synchronous=true&url=scaled_yolov4_tablecell.mar HTTP/1.1" 200 30063
2021-06-07 00:03:36,620 [INFO ] epollEventLoopGroup-3-1 TS_METRICS - Requests2XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:04:09,195 [INFO ] epollEventLoopGroup-3-2 ACCESS_LOG - /127.0.0.1:53278 "PUT /models/foodnet?min_worker=3 HTTP/1.1" 404 2
2021-06-07 00:04:09,196 [INFO ] epollEventLoopGroup-3-2 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:04:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459
2021-06-07 00:04:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47347259521484|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459
2021-06-07 00:04:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20274353027344|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459
2021-06-07 00:04:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459
2021-06-07 00:04:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:11085.8125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459
2021-06-07 00:04:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:3906.17578125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459
2021-06-07 00:04:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:30.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459
2021-06-07 00:05:19,065 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519
2021-06-07 00:05:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47345733642578|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519
2021-06-07 00:05:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.2027587890625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519
2021-06-07 00:05:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519
2021-06-07 00:05:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:11087.11328125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519
2021-06-07 00:05:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:3905.21875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519
2021-06-07 00:05:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:30.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519
2021-06-07 00:06:19,064 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579
2021-06-07 00:06:19,064 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.4734649658203|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579
2021-06-07 00:06:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20275115966797|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579
2021-06-07 00:06:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579
2021-06-07 00:06:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:11092.88671875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579
2021-06-07 00:06:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:3898.94921875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579
2021-06-07 00:06:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:30.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579
2021-06-07 00:06:42,299 [INFO ] epollEventLoopGroup-3-3 ACCESS_LOG - /127.0.0.1:53282 "PUT /models/scaled_yolov4_tabelcell?min_worker=3 HTTP/1.1" 404 0
2021-06-07 00:06:42,299 [INFO ] epollEventLoopGroup-3-3 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:07:19,064 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639
2021-06-07 00:07:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47344207763672|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639
2021-06-07 00:07:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20277404785156|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639
2021-06-07 00:07:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639
2021-06-07 00:07:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:11083.26171875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639
2021-06-07 00:07:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:3908.7578125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639
2021-06-07 00:07:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:30.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639
2021-06-07 00:08:19,063 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:100.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699
2021-06-07 00:08:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47357177734375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699
2021-06-07 00:08:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20264434814453|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699
2021-06-07 00:08:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699
2021-06-07 00:08:19,064 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:11079.484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699
2021-06-07 00:08:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:3907.734375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699
2021-06-07 00:08:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:30.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699
2021-06-07 00:08:42,730 [INFO ] epollEventLoopGroup-3-4 ACCESS_LOG - /127.0.0.1:34728 "GET / HTTP/1.1" 405 1
2021-06-07 00:08:42,730 [INFO ] epollEventLoopGroup-3-4 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:09:19,062 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759
2021-06-07 00:09:19,063 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47352981567383|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759
2021-06-07 00:09:19,063 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20268630981445|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759
2021-06-07 00:09:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759
2021-06-07 00:09:19,064 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:11052.05078125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759
2021-06-07 00:09:19,064 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:3945.51171875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759
2021-06-07 00:09:19,064 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:30.7|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759
2021-06-07 00:10:19,065 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819
2021-06-07 00:10:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47339630126953|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819
2021-06-07 00:10:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20281982421875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819
2021-06-07 00:10:19,067 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819
2021-06-07 00:10:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:11029.1875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819
2021-06-07 00:10:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:3967.6328125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819
2021-06-07 00:10:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:30.8|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819
2021-06-07 00:11:19,071 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879
2021-06-07 00:11:19,071 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47330856323242|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879
2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20290756225586|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879
2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879
2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:11012.90625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879
2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:3978.9375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879
2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:30.9|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879
2021-06-07 00:11:38,808 [INFO ] epollEventLoopGroup-3-5 ACCESS_LOG - /127.0.0.1:34754 "GET / HTTP/1.1" 405 0
2021-06-07 00:11:38,809 [INFO ] epollEventLoopGroup-3-5 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:12:19,067 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:100.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939
2021-06-07 00:12:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4732780456543|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939
2021-06-07 00:12:19,068 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20293807983398|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939
2021-06-07 00:12:19,068 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939
2021-06-07 00:12:19,068 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:10991.5234375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939
2021-06-07 00:12:19,069 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:4005.8203125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939
2021-06-07 00:12:19,069 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:31.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939
2021-06-07 00:13:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999
2021-06-07 00:13:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47271728515625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999
2021-06-07 00:13:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20349884033203|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999
2021-06-07 00:13:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999
2021-06-07 00:13:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:10965.4765625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999
2021-06-07 00:13:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:4026.4375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999
2021-06-07 00:13:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:31.2|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999
2021-06-07 00:13:30,128 [INFO ] epollEventLoopGroup-3-6 ACCESS_LOG - /127.0.0.1:53346 "GET /models HTTP/1.1" 200 26
2021-06-07 00:13:30,128 [INFO ] epollEventLoopGroup-3-6 TS_METRICS - Requests2XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:14:19,064 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059
2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47271728515625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059
2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20349884033203|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059
2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059
2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:10990.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059
2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:4009.8203125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059
2021-06-07 00:14:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:31.1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059
2021-06-07 00:14:27,983 [DEBUG] epollEventLoopGroup-3-7 org.pytorch.serve.wlm.ModelManager - updateModel: scaled_yolov4_tablecell, count: 3
2021-06-07 00:14:27,988 [INFO ] epollEventLoopGroup-3-7 ACCESS_LOG - /127.0.0.1:53350 "PUT /models/scaled_yolov4_tablecell?min_worker=3 HTTP/1.1" 202 5
2021-06-07 00:14:27,988 [INFO ] epollEventLoopGroup-3-7 TS_METRICS - Requests2XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:14:28,881 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Listening on port: /tmp/.ts.sock.9001
2021-06-07 00:14:28,882 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - [PID]11794
2021-06-07 00:14:28,882 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Torch worker started.
2021-06-07 00:14:28,882 [DEBUG] W-9001-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9001-scaled_yolov4_tablecell_1 State change null -> WORKER_STARTED
2021-06-07 00:14:28,883 [INFO ] W-9001-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Connecting to: /tmp/.ts.sock.9001
2021-06-07 00:14:28,884 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Python runtime: 3.8.5
2021-06-07 00:14:28,885 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Connection accepted: /tmp/.ts.sock.9001.
2021-06-07 00:14:28,902 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Listening on port: /tmp/.ts.sock.9002
2021-06-07 00:14:28,902 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - [PID]11797
2021-06-07 00:14:28,903 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Torch worker started.
2021-06-07 00:14:28,903 [DEBUG] W-9002-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9002-scaled_yolov4_tablecell_1 State change null -> WORKER_STARTED
2021-06-07 00:14:28,903 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Python runtime: 3.8.5
2021-06-07 00:14:28,903 [INFO ] W-9002-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Connecting to: /tmp/.ts.sock.9002
2021-06-07 00:14:28,905 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Connection accepted: /tmp/.ts.sock.9002.
2021-06-07 00:14:31,637 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Missing the index_to_name.json file. Inference output will not include class name.
2021-06-07 00:14:31,637 [INFO ] W-9001-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Backend response time: 2738
2021-06-07 00:14:31,638 [DEBUG] W-9001-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9001-scaled_yolov4_tablecell_1 State change WORKER_STARTED -> WORKER_MODEL_LOADED
2021-06-07 00:14:31,638 [INFO ] W-9001-scaled_yolov4_tablecell_1 TS_METRICS - W-9001-scaled_yolov4_tablecell_1.ms:3654|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005071
2021-06-07 00:14:31,638 [INFO ] W-9001-scaled_yolov4_tablecell_1 TS_METRICS - WorkerThreadTime.ms:15|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:14:31,639 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Missing the index_to_name.json file. Inference output will not include class name.
2021-06-07 00:14:31,639 [INFO ] W-9002-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Backend response time: 2733
2021-06-07 00:14:31,640 [DEBUG] W-9002-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9002-scaled_yolov4_tablecell_1 State change WORKER_STARTED -> WORKER_MODEL_LOADED
2021-06-07 00:14:31,640 [INFO ] W-9002-scaled_yolov4_tablecell_1 TS_METRICS - W-9002-scaled_yolov4_tablecell_1.ms:3656|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005071
2021-06-07 00:14:31,640 [INFO ] W-9002-scaled_yolov4_tablecell_1 TS_METRICS - WorkerThreadTime.ms:2|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:15:19,064 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119
2021-06-07 00:15:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47269821166992|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119
2021-06-07 00:15:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20351791381836|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119
2021-06-07 00:15:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119
2021-06-07 00:15:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8553.57421875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119
2021-06-07 00:15:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6447.1015625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119
2021-06-07 00:15:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119
2021-06-07 00:16:15,828 [INFO ] epollEventLoopGroup-3-8 ACCESS_LOG - /127.0.0.1:34790 "GET / HTTP/1.1" 405 0
2021-06-07 00:16:15,828 [INFO ] epollEventLoopGroup-3-8 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:16:19,065 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179
2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.4727020263672|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179
2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.2035140991211|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179
2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179
2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8553.015625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179
2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6456.35546875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179
2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179
2021-06-07 00:16:28,039 [INFO ] epollEventLoopGroup-3-1 ACCESS_LOG - /127.0.0.1:34796 "GET / HTTP/1.1" 405 0
2021-06-07 00:16:28,040 [INFO ] epollEventLoopGroup-3-1 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:16:32,773 [INFO ] epollEventLoopGroup-3-2 ACCESS_LOG - /127.0.0.1:53368 "GET / HTTP/1.1" 405 0
2021-06-07 00:16:32,773 [INFO ] epollEventLoopGroup-3-2 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:16:34,892 [INFO ] epollEventLoopGroup-4-1 ACCESS_LOG - /127.0.0.1:45800 "GET / HTTP/1.1" 405 0
2021-06-07 00:16:34,892 [INFO ] epollEventLoopGroup-4-1 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null
2021-06-07 00:17:19,076 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239
2021-06-07 00:17:19,076 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47254180908203|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239
2021-06-07 00:17:19,076 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20367431640625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239
2021-06-07 00:17:19,076 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239
2021-06-07 00:17:19,077 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8561.828125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239
2021-06-07 00:17:19,078 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6428.21484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239
2021-06-07 00:17:19,083 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239
2021-06-07 00:18:19,070 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299
2021-06-07 00:18:19,070 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4723892211914|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299
2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20382690429688|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299
2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299
2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8543.109375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299
2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6452.421875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299
2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299
2021-06-07 00:19:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359
2021-06-07 00:19:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4723243713379|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359
2021-06-07 00:19:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.2038917541504|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359
2021-06-07 00:19:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359
2021-06-07 00:19:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8549.8671875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359
2021-06-07 00:19:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6450.7578125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359
2021-06-07 00:19:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359
2021-06-07 00:20:19,069 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419
2021-06-07 00:20:19,069 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47233200073242|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419
2021-06-07 00:20:19,070 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20388412475586|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419
2021-06-07 00:20:19,070 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419
2021-06-07 00:20:19,071 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8555.1484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419
2021-06-07 00:20:19,071 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6450.03515625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419
2021-06-07 00:20:19,071 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419
2021-06-07 00:21:19,078 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479
2021-06-07 00:21:19,078 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4723014831543|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479
2021-06-07 00:21:19,078 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20391464233398|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479
2021-06-07 00:21:19,079 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479
2021-06-07 00:21:19,079 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8538.91796875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479
2021-06-07 00:21:19,079 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6459.62890625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479
2021-06-07 00:21:19,079 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479
2021-06-07 00:22:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539
2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47230911254883|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539
2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20390701293945|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539
2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539
2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8539.63671875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539
2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6465.8515625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539
2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timest(serving) billion@billion-Lenovo-B50-70:/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve$ 2021-06-07 00:23:19,079 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599
2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47228622436523|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599
2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20392990112305|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599
2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599
2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8546.51171875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599
2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6465.12890625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599
2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599
2021-06-07 00:24:19,065 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659
2021-06-07 00:24:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47229766845703|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659
2021-06-07 00:24:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20391845703125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659
2021-06-07 00:24:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659
2021-06-07 00:24:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8539.8671875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659
2021-06-07 00:24:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6456.89453125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659
2021-06-07 00:24:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659
2021-06-07 00:25:19,064 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719
2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47222518920898|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719
2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.2039909362793|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719
2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719
2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8552.15234375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719
2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6462.359375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719
2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719
2021-06-07 00:26:19,064 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779
2021-06-07 00:26:19,064 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47223663330078|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779
2021-06-07 00:26:19,064 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.2039794921875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779
2021-06-07 00:26:19,064 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779
2021-06-07 00:26:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8549.703125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779
2021-06-07 00:26:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6465.21875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779
2021-06-07 00:26:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timest(serving) billion@billion-Lenovo-B50-70:/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve$ torchserve --start --ncs --model-store /home/billion/47Billion/table_cell_detection/borderless_tablecell/model-server/model-store/ --models scaled_yolov4_tablecell.mar2021-06-07 00:27:19,065 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839
2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4721908569336|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839
2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.2040252685547|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839
2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839
2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8535.28125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839
2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6461.9140625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839
2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839
2021-06-07 00:28:19,068 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899
2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47219467163086|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899
2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20402145385742|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899
2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899
2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8524.05078125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899
2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6472.828125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899
2021-06-07 00:28:19,070 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899
2021-06-07 00:29:19,064 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959
2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47217178344727|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959
2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20404434204102|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959
2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959
2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8532.93359375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959
2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6473.6953125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959
2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959
2021-06-07 00:30:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019
2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47218322753906|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019
2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20403289794922|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019
2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019
2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8525.44140625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019
2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6472.1484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019
2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019
And the when I opened the locahost in my browser, it showed:
{
"code": 405,
"type": "MethodNotAllowedException",
"message": "Requested method is not allowed, please refer to API document."
}
Is there something I am missing or something I am doing wrong???

Duplicate issue #2018: example is out of date, running end to end results in model not found: alexnet
Created: 2022-12-01T21:33:35Z
📚 The doc issue
https://github.com/pytorch/serve/tree/master/examples/image_classifier/alexnet is out of date or there is a bug in torchserve
when I follow the instructions to

clone the repo
run commands from ./serve
run these commands referenced at the link

wget https://download.pytorch.org/models/alexnet-owt-7be5be79.pth
torch-model-archiver --model-name alexnet --version 1.0 --model-file ./serve/examples/image_classifier/alexnet/model.py --serialized-file alexnet-owt-7be5be79.pth --handler image_classifier --extra-files ./serve/examples/image_classifier/index_to_name.json
mkdir model_store
mv alexnet.mar model_store/
torchserve --start --model-store model_store --models alexnet=alexnet.mar
curl http://127.0.0.1:8080/predictions/alexnet -T ./serve/examples/image_classifier/kitten.jpg
I get this error
# root at rave in ~/serve on git:master ✖︎ [13:26:56]
→ curl http://127.0.0.1:8080/predictions/alexnet -T ./examples/image_classifier/kitten.jpg
2022-12-01T13:27:16,651 [INFO ] epollEventLoopGroup-3-1 ACCESS_LOG - /127.0.0.1:40832 "PUT /predictions/alexnet HTTP/1.1" 404 10
2022-12-01T13:27:16,651 [INFO ] epollEventLoopGroup-3-1 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:rave,timestamp:1669930036
{
  "code": 404,
  "type": "ModelNotFoundException",
  "message": "Model not found: alexnet"
}
# root at rave in ~/serve on git:master ✖︎ [13:31:53]
→ torchserve --version
TorchServe Version is 0.6.1

torch model archiver version is  0.6.1
Suggest a potential alternative/fix
fix this and other examples so the examples run end to end with recent versions of torchserve and torch model archiver.

Closing comment (2022-12-06T16:39:56Z): Yeah, it's still not working for me either. These are the steps I tried:
git clone https://github.com/pytorch/serve.git  # commit 8d877b0f75f4c9cd899ed02669b9278f019013a1
mamba create --name torchserve -c pytorch python=3.9 torchserve=0.6.1 torch-model-archiver=0.6.1 torch-workflow-archiver=0.2.5
mamba activate torchserve

wget https://download.pytorch.org/models/alexnet-owt-7be5be79.pth
torch-model-archiver --model-name alexnet --version 1.0 --model-file ./serve/examples/image_classifier/alexnet/model.py --serialized-file alexnet-owt-7be5be79.pth --handler image_classifier --extra-files ./serve/examples/image_classifier/index_to_name.json
mkdir model_store
mv alexnet.mar model_store/
torchserve --start --model-store model_store --models alexnet=alexnet.mar
curl http://127.0.0.1:8080/predictions/alexnet -T ./serve/examples/image_classifier/kitten.jpg
Visiting https://127.0.0.1:8080 shows this output. @rbavery's got a 404, but I got a 405 🤷 The error seems similar to #1110.
{
  "code": 405,
  "type": "MethodNotAllowedException",
  "message": "Requested method is not allowed, please refer to API document."
}