vintage4681

Thanks Shockley

...

2. The Stride Math Fail: Next, it assumed they were YOLOv8 feature map distances (`l, t, r, b`) and tried multiplying them by strides (8, 16, 32). This literally just drew the entire feature grid across my screen.
3. The "Raw Box" Fail: Finally, it guessed that the BPU *already* did all the math and outputted perfect `[x1, y1, x2, y2]` coordinates and probabilities. We stripped out all the math, and it immediately drew 8,400 boxes over every single piece of empty background in the room.

I have no idea if these tensors are raw logits, stride-multiplied distances, or something proprietary to the BPU compiler.

How exactly am I supposed to parse and decode `outputs[0]` and `outputs[1]` from this specific `.bin` file in Python? Any snippet or guidance would be a lifesaver.

Hii Shockely, I need some help. I'm trying to run a YOLO-World + MiDaS pipeline concurrently on the RDK X5 using `pyeasy_dnn` in a ROS 2 (TROS) node, and I am absolutely cooked. Time is running out for my project.

I was using Gemini to help write the tensor decoding logic for the YOLO-World output, and it completely failed me. We went through like five iterations of math, and my bounding boxes are still completely broken.

Here is the exact situation:

1. The Setup

Hardware: D-Robotics RDK X5 (Sunrise 5 BPU).
Framework:ROS 2 (Humble/TROS) using `hobot_dnn.pyeasy_dnn`.
Model:The official `yolo_world.bin` from `/opt/tros/humble/lib/hobot_yolo_world/config/`.

2. The Output Tensors

The BPU inference (`yolo_model[0].forward()`) is giving me two output buffers with these exact shapes:

* `outputs[0].buffer.shape`: **`(1, 8400, 31, 1)`** (Assuming Scores/Classes)
* `outputs[1].buffer.shape`: **`(1, 8400, 4, 1)`** (Assuming Boxes)

3. What Gemini Tried (And How It Failed)

Gemini completely hallucinated how to parse these specific Horizon BPU tensors:

1. The Anchor Grid Fail: It told me to apply a Sigmoid function to the scores and mathematically map the boxes to a generated 640x640 anchor grid. This just shoved 8,400 green boxes into a tiny cluster in the top-left corner.

Yay!!
It worked finally!!
midas worked!
 image.png   1,68 Mo   0 téléchargement(s)