base on NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 application for YOLO-Pose models # DeepStream-Yolo-Pose NVIDIA DeepStream SDK application for YOLO-Pose models -------------------------------------------------------------------------------------------------- ### YOLO objetct detection models and other infos: https://github.com/marcoslucianops/DeepStream-Yolo -------------------------------------------------------------------------------------------------- ### Important: I've changed the output logic to prevent the TensorRT to use the wrong output order. Please export the ONNX model with the new export file, generate the TensorRT engine again with the updated files, and use the new config_infer_primary file according to your model -------------------------------------------------------------------------------------------------- ### Getting started * [Supported models](#supported-models) * [Instructions](#basic-usage) * [YOLOv7-Pose usage](docs/YOLOv7_Pose.md) * [YOLOv8-Pose usage](docs/YOLOv8_Pose.md) * [YOLO-NAS-Pose usage](docs/YOLONAS_Pose.md) * [NMS configuration](#nms-configuration) * [Detection threshold configuration](#detection-threshold-configuration) ## ### Supported models * [YOLO-NAS-Pose](https://github.com/Deci-AI/super-gradients/blob/master/YOLONAS-POSE.md) * [YOLOv8-Pose](https://github.com/ultralytics/ultralytics) * [YOLOv7-Pose](https://github.com/WongKinYiu/yolov7) ## ### Instructions #### 1. Download the DeepStream-Yolo-Pose repo ``` git clone https://github.com/marcoslucianops/DeepStream-Yolo-Pose.git cd DeepStream-Yolo-Pose ``` #### 2. Compile the libs Export the CUDA_VER env according to your DeepStream version and platform: * DeepStream 6.3 on x86 platform ``` export CUDA_VER=12.1 ``` * DeepStream 6.2 on x86 platform ``` export CUDA_VER=11.8 ``` * DeepStream 6.1.1 on x86 platform ``` export CUDA_VER=11.7 ``` * DeepStream 6.1 on x86 platform ``` export CUDA_VER=11.6 ``` * DeepStream 6.0.1 / 6.0 on x86 platform ``` export CUDA_VER=11.4 ``` * DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform ``` export CUDA_VER=11.4 ``` * DeepStream 6.0.1 / 6.0 on Jetson platform ``` export CUDA_VER=10.2 ``` Compile the libs ``` make -C nvdsinfer_custom_impl_Yolo_pose make ``` **NOTE**: To use the Python code, you need to install the DeepStream Python bindings. Reference: https://github.com/NVIDIA-AI-IOT/deepstream_python_apps * x86 platform: ``` wget https://github.com/NVIDIA-AI-IOT/deepstream_python_apps/releases/download/v1.1.8/pyds-1.1.8-py3-none-linux_x86_64.whl pip3 install pyds-1.1.8-py3-none-linux_x86_64.whl ``` * Jetson platform: ``` wget https://github.com/NVIDIA-AI-IOT/deepstream_python_apps/releases/download/v1.1.8/pyds-1.1.8-py3-none-linux_aarch64.whl pip3 install pyds-1.1.8-py3-none-linux_aarch64.whl ``` **NOTE**: It is recommended to use Python virtualenv. **NOTE**: The steps above only work on **DeepStream 6.3**. For previous versions, please check the files on the `NVIDIA-AI-IOT/deepstream_python_apps` repo. #### 3. Run * C code ``` ./deepstream -s file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_1080p_h264.mp4 -c config_infer_primary_yoloV8_pose.txt ``` * Python code ``` python3 deepstream.py -s file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_1080p_h264.mp4 -c config_infer_primary_yoloV8_pose.txt ``` **NOTE**: The TensorRT engine file may take a very long time to generate (sometimes more than 10 minutes). **NOTE**: To change the source ``` -s file:// or rtsp:// or http:// --source file:// or rtsp:// or http:// ``` **NOTE**: To change the config infer file (example for config_infer.txt file) ``` -c config_infer.txt --config-infer config_infer.txt ``` **NOTE**: To change the nvstreammux batch-size (example for 2; default: 1) ``` -b 2 --streammux-batch-size 2 ``` **NOTE**: To change the nvstreammux width (example for 1280; default: 1920) ``` -w 1280 --streammux-width 1280 ``` **NOTE**: To change the nvstreammux height (example for 720; default: 1080) ``` -e 720 --streammux-height 720 ``` **NOTE**: To change the GPU id (example for 1; default: 0) ``` -g 1 --gpu-id 1 ``` **NOTE**: To change the FPS measurement interval (example for 10; default: 5) ``` -f 10 --fps-interval 10 ``` ## ### NMS configuration For now, the `nms-iou-threshold` is fixed to `0.45`. **NOTE**: Make sure to set `cluster-mode=4` in the config_infer file. ## ### Detection threshold configuration ``` [class-attrs-all] pre-cluster-threshold=0.25 topk=300 ``` ## My projects: https://www.youtube.com/MarcosLucianoTV ", Assign "at most 3 tags" to the expected json: {"id":"1143","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"