24 réponses à ce sujet

[shockley6668]

Hi @brian_hacker , this looks like a great project! Once you've completed the TODO list, please remember to submit a pull request to our official GitHub repository.

[brian_hacker]

sure will do:yes:

[brian_hacker]

**VLM Police Patrol - Stage 3 (Launch) COMPLETE!**

Hey everyone! Just finished Stage 3 of the Robotics Dream Keeper Challenge. My autonomous patrol robot on the **RDK X5** is fully built, demoed, and packaged.

**What it does**
An autonomous patrol robot that detects people on-board with **YOLO11n (BPU)**, triages each one against an operator's reference photo using an on-device **Vision-Language Model (InternVL2.5-1B)**, and drops confirmed matches onto a live **SLAM map** - all driven from a Flask web dashboard with holonomic mecanum teleop.
> Surface-feature triage only (clothing colour/type + hairstyle) - not face recognition.

**Highlights**
Two BPU-accelerated models on-device - YOLO11n detector + InternVL2.5-1B ViT
Two concurrent AI workloads: continuous detection gates the slower VLM match
Off-board `slam_gmapping` mapping + on-board **AMCL** localization
RP2040 micro-ROS mecanum base - PID, `cmd_vel` watchdog + hardware **RF E-stop**
EKF sensor fusion (wheel odom + MPU-9250 IMU)
Full stack + VLM: ~70 °C / ~90 % CPU, and teleop *still* smooth (motion runs on the Pico, not the X5)
One-shot `master.sh` brings up all 9 nodes

**Links**
Demo video:
Repo: https://github.com/z...M-Police-Patrol
Showcase PR: [Showcase] Brian - VLM Police Patrol (Stage 3)

Happy to answer any questions about the build!

[brian_hacker]

@Shockley you may review my PR

[brian_hacker]

 Screenshot_20260719_144205_Chrome.jpg   45,57 Ko   0 téléchargement(s)