[ENTRYPOINT] Validating Runtime configuration... [CONFIG] validation PASS streams=0 active_learning=False [GPU] Selected GPU ID: 0 [ENTRYPOINT] Starting Triton Inference Server... [ENTRYPOINT] Triton PID: 73 [ENTRYPOINT] Waiting for Triton to be ready... I0911 11:42:09.053668 73 pinned_memory_manager.cc:277] "Pinned memory pool is created at '0x7492e8000000' with size 268435456" I0911 11:42:09.053835 73 cuda_memory_manager.cc:107] "CUDA memory pool is created on device 0 with size 67108864" I0911 11:42:09.056886 73 model_lifecycle.cc:473] "loading: RFDETRMedium:2" I0911 11:42:09.230044 73 tensorrt.cc:65] "TRITONBACKEND_Initialize: tensorrt" I0911 11:42:09.230172 73 tensorrt.cc:75] "Triton TRITONBACKEND API version: 1.19" I0911 11:42:09.230202 73 tensorrt.cc:81] "'tensorrt' TRITONBACKEND API version: 1.19" I0911 11:42:09.230220 73 tensorrt.cc:105] "backend configuration:\n{\"cmdline\":{\"auto-complete-config\":\"true\",\"backend-directory\":\"/opt/tritonserver/backends\",\"min-compute-capability\":\"6.000000\",\"default-max-batch-size\":\"4\"}}" I0911 11:42:09.231470 73 tensorrt.cc:231] "TRITONBACKEND_ModelInitialize: RFDETRMedium (version 2)" I0911 11:42:09.355177 73 logging.cc:46] "Loaded engine size: 62 MiB" I0911 11:42:09.470843 73 tensorrt.cc:297] "TRITONBACKEND_ModelInstanceInitialize: RFDETRMedium_0 (GPU device 0)" I0911 11:42:09.570883 73 logging.cc:46] "Loaded engine size: 62 MiB" I0911 11:42:09.621960 73 logging.cc:46] "[MS] Running engine with multi stream info" I0911 11:42:09.622034 73 logging.cc:46] "[MS] Number of aux streams is 1" I0911 11:42:09.622042 73 logging.cc:46] "[MS] Number of total worker streams is 2" I0911 11:42:09.622051 73 logging.cc:46] "[MS] The main stream provided by execute/enqueue calls is the first worker stream" I0911 11:42:09.882017 73 logging.cc:46] "[MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +18, now: CPU 0, GPU 75 (MiB)" I0911 11:42:09.882792 73 instance_state.cc:186] "Created instance RFDETRMedium_0 on GPU 0 with stream priority 0 and optimization profile default[0];" I0911 11:42:09.883279 73 model_lifecycle.cc:849] "successfully loaded 'RFDETRMedium'" I0911 11:42:09.883414 73 server.cc:620] +------------------+------+ | Repository Agent | Path | +------------------+------+ +------------------+------+ I0911 11:42:09.883489 73 server.cc:647] +----------+-----------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Backend | Path | Config | +----------+-----------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------+ | tensorrt | /opt/tritonserver/backends/tensorrt/libtriton_tensorrt.so | {"cmdline":{"auto-complete-config":"true","backend-directory":"/opt/tritonserver/backends","min-compute-capability":"6.000000","default-max-batch-size":"4"}} | +----------+-----------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------+ I0911 11:42:09.883552 73 server.cc:690] +--------------+---------+--------+ | Model | Version | Status | +--------------+---------+--------+ | RFDETRMedium | 2 | READY | +--------------+---------+--------+ I0911 11:42:09.945386 73 metrics.cc:889] "Collecting metrics for GPU 0: NVIDIA RTX A6000" I0911 11:42:09.952125 73 metrics.cc:782] "Collecting CPU metrics" I0911 11:42:09.952392 73 tritonserver.cc:2598] +----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Option | Value | +----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | server_id | triton | | server_version | 2.67.0 | | server_extensions | classification sequence model_repository model_repository(unload_dependents) schedule_policy model_configuration system_shared_memory cuda_shared_memory binary_tensor_data parameters statistics trace logging | | model_repository_path[0] | /opt/contextra/models/triton | | model_control_mode | MODE_NONE | | strict_model_config | 0 | | model_config_name | | | rate_limit | OFF | | pinned_memory_pool_byte_size | 268435456 | | cuda_memory_pool_byte_size{0} | 67108864 | | min_supported_compute_capability | 6.0 | | strict_readiness | 0 | | exit_timeout | 30 | | cache_enabled | 0 | +----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ I0911 11:42:09.958755 73 grpc_server.cc:2562] "Started GRPCInferenceService at 0.0.0.0:8001" I0911 11:42:09.959172 73 http_server.cc:4823] "Started HTTPService at 0.0.0.0:8000" I0911 11:42:10.002173 73 http_server.cc:358] "Started Metrics Service at 0.0.0.0:8002" [ENTRYPOINT] Triton not ready... retry (1/30) [ENTRYPOINT] Triton is ready at localhost:8001 [ENTRYPOINT] Starting FastAPI application... [ENTRYPOINT] Supervisor loop (watchdog every 10s): triton=73 fastapi=197 [RedisPublisher] Connected [FastAPI] Starting uvicorn on port 5000 ... INFO: Started server process [197] INFO: Waiting for application startup. (python3:197): GStreamer-WARNING **: 11:42:14.414: External plugin loader failed. This most likely means that the plugin loader helper binary was not found or could not be run. You might need to set the GST_PLUGIN_SCANNER environment variable if your setup is unusual. This should normally not be required though. (python3:197): GStreamer-WARNING **: 11:42:14.687: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.1: cannot open shared object file: No such file or directory (python3:197): GStreamer-WARNING **: 11:42:14.712: Failed to load plugin '/opt/nvidia/deepstream/deepstream/lib/gst-plugins/libnvdsgst_udp.so': librivermax.so.1: cannot open shared object file: No such file or directory (python3:197): GStreamer-WARNING **: 11:42:16.087: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.1: cannot open shared object file: No such file or directory [STREAM-MGR] loaded 1 streams (base=/etc/contextra/streams.yaml, overlay=/var/lib/contextra/runtime/streams_runtime.yaml) INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:5000 (Press CTRL+C to quit) INFO: 127.0.0.1:34568 - "GET /ready HTTP/1.1" 200 OK INFO: 172.20.0.1:44278 - "GET /live HTTP/1.1" 200 OK INFO: 172.20.0.1:44284 - "GET /ready HTTP/1.1" 200 OK INFO: 172.20.0.1:44286 - "GET /health HTTP/1.1" 200 OK INFO: 172.20.0.1:44290 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:44296 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:44306 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:44310 - "GET /api/v1/streams/CCV-01577/settings HTTP/1.1" 200 OK INFO: 172.20.0.1:44324 - "PATCH /api/v1/streams/CCV-01577/settings HTTP/1.1" 200 OK INFO: 172.20.0.1:44330 - "POST /api/v1/streams/CCV-01577/start HTTP/1.1" 202 Accepted INFO: 172.20.0.1:44332 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:44338 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:44348 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:44350 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK Initializing GStreamer Backend...! [STREAM-MGR] CCV-01577: STARTING type=rtsp generation=1 Add Element ... batch_capture-mux-1 Add Element ... rtsp-det-g1-b65d332aacf4eeb7 LINKING: Source: rtsp-det-g1-b65d332aacf4eeb7 Target: batch_capture-mux-1 Add Element ... preprocess-preprocess-0 Add Element ... preprocess-queue-1 LINKING: Source: batch_capture-mux-1 Target: preprocess-preprocess-0 LINKING: Source: preprocess-preprocess-0 Target: preprocess-queue-1 Add Element ... infer-infer-0 LINKING: Source: preprocess-queue-1 Target: infer-infer-0 Add Element ... retrieve-converter-0 Add Element ... retrieve-appsink-2 Add Element ... retrieve-capsfilter-1 LINKING: Source: retrieve-converter-0 Target: retrieve-capsfilter-1 LINKING: Source: retrieve-capsfilter-1 Target: retrieve-appsink-2 LINKING: Source: infer-infer-0 Target: retrieve-converter-0 Protocol set: 0x4 INFO: TritonGrpcBackend id:1430340086 initialized for model: RFDETRMedium INFO: 172.20.0.1:44364 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:44366 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK WARNING: unsupported tensor order for dims to image-info, retry as kLinear [rfdetr-adapter] processor loaded Event Thread Enabled... Main Loop Running... End of file reached on stdin. INFO: 172.20.0.1:44380 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:44390 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:44398 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:44400 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56060 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56066 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56078 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56092 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56106 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56116 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56120 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56136 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56146 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56158 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56170 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56184 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56192 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56204 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56214 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56216 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56224 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56232 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56246 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56254 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56268 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56272 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56286 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56292 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56304 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56308 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56318 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56328 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56330 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56338 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56346 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56356 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:56360 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:56374 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54372 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54378 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54380 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54384 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54388 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54392 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54400 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54402 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54412 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54414 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54430 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54436 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54440 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54452 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54456 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54460 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54476 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54490 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54492 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54496 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54504 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54508 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54522 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54532 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54546 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54560 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54572 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54574 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54582 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54592 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54608 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54610 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:54612 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:54622 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:47686 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47702 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:47712 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47728 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:47732 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47746 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:47750 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47752 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:47756 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47760 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK *** Inside cb_newpad name=video/x-raw Opening in BLOCKING MODE INFO: 172.20.0.1:47764 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47770 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:47778 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47788 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK [rfdetr-adapter] stage=native_enter count=1 [rfdetr-adapter] stage=native_complete count=1 /opt/contextra/app/byte_tracking.py:47: FutureWarning: The `ByteTrack` was deprecated since v0.28.0. It will be removed in v0.31.0. self._trackers[class_id] = self.sv.ByteTrack( INFO: 172.20.0.1:47792 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47798 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:47808 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47814 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 127.0.0.1:49054 - "GET /ready HTTP/1.1" 200 OK INFO: 172.20.0.1:47818 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47834 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:47846 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47850 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:47856 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:47870 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:59764 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:59776 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:59788 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:59796 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK [NATIVE_BRIDGE_SAMPLE] {"source": [1920, 1080], "surface": [1920, 1080], "detections": [{"class_id": 4, "score": 0.5322427749633789, "bbox_xyxy": [0.16357421875, 0.1744384765625, 0.99853515625, 0.5716552734375]}]} INFO: 172.20.0.1:59810 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:59818 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:59832 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:59848 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK Posted EOS to stop pipeline INFO: 172.20.0.1:59862 - "POST /api/v1/streams/CCV-01577/stop HTTP/1.1" 202 Accepted INFO: 172.20.0.1:59872 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:59876 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK nvstreammux: Successfully handled EOS for source_id=0 INFO: 172.20.0.1:59892 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:59898 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:59910 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:59924 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK INFO: 172.20.0.1:59930 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:59934 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK End of stream Main Loop Exited... sys:1: Warning: Source ID 3 was not found when attempting to remove it Pipeline det stopped INFO: 172.20.0.1:59944 - "GET /api/v1/streams/CCV-01577 HTTP/1.1" 200 OK INFO: 172.20.0.1:59952 - "GET /api/v1/metadata/status HTTP/1.1" 200 OK [ENTRYPOINT] Shutdown signal — stopping FastAPI + Triton Signal (15) received. INFO: Shutting down I0911 11:42:59.608476 73 grpc_server.cc:2640] "Timeout 30: Found 3 gRPC service connections and inference handlers" INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [197] I0911 11:43:00.608632 73 server.cc:312] "Waiting for in-flight requests to complete." I0911 11:43:00.608698 73 server.cc:328] "Timeout 29: Found 0 model versions that have in-flight inferences" I0911 11:43:00.608928 73 server.cc:343] "All models are stopped, unloading models" I0911 11:43:00.608954 73 server.cc:352] "Timeout 29: Found 1 live models and 0 in-flight non-inference requests" I0911 11:43:00.609345 73 tensorrt.cc:353] "TRITONBACKEND_ModelInstanceFinalize: delete instance state" I0911 11:43:00.666296 73 tensorrt.cc:274] "TRITONBACKEND_ModelFinalize: delete model state" I0911 11:43:00.667952 73 model_lifecycle.cc:636] "successfully unloaded 'RFDETRMedium' version 2" I0911 11:43:01.609072 73 server.cc:352] "Timeout 28: Found 0 live models and 0 in-flight non-inference requests"