Arm bay
Gesture-Controlled Robotic Arms
Two 6-DoF arms that follow your hands, about 10 ms end to end.
- When
- May 2026 to now
- Built with
- Python
- MediaPipe
- C++
- xArm 1S
- hand landmarks tracked
- 21
- hand landmarks tracked
- vision pipeline
- 30 fps
- vision pipeline
- axes driven
- 12
- axes driven
- end-to-end latency
- ~10 ms
- end-to-end latency
What I did
- Real-time MediaPipe pipeline tracking 21 hand landmarks at 30 fps, checked under different lighting and fast motion.
- Drives a pair of HiWonder xArm 1S arms, 6 degrees of freedom each, from hand gestures.
- Tried several hand-to-servo mappings and tuned for roughly 10 ms end to end, about where control stops feeling laggy.