Software Architecture & Setup
Deploy the XLeRobot-Pro stack. One repository, full control.
1. System Architecture
Core computing (IK, Vision, VLA Policy inference) runs either on your Host Laptop or the onboard NVIDIA Jetson Orin Nano.
┌──────────────┐ ┌────────────────────────┐
│ Bus 1 & 2 │ USB-C │ Compute Node │
│ (Follower │◄────────────────►│ │
│ Arms) │ │ - Jetson Orin Nano │
└──────────────┘ │ OR │
│ - Laptop / PC │
┌──────────────┐ USB-C │ │
│ Bus 3 │◄────────────────►│ Running: │
│ (Neck/Wheels)│ │ - LeRobot Stack │
└──────────────┘ │ - Pink (Pinocchio) IK│
│ - YOLO / VLA │
┌──────────────┐ USB └───────────┬────────────┘
│ Cameras (3x) │◄─────────────────────────────┘
└──────────────┘
2. Framework Installation
We recommend Ubuntu 22.04 and Python 3.10.
Clone & Install
Terminal
# Clone the unified pro repository
$ git clone https://github.com/Minko82/xlerobot-pro
$ cd xlerobot-pro
# Install dependencies in editable mode
$ pip install -e .
$ git clone https://github.com/Minko82/xlerobot-pro
$ cd xlerobot-pro
# Install dependencies in editable mode
$ pip install -e .
JETSON USERS: Ensure JetPack 5.1.x or 6.0 is installed. Enable "Max Power Mode" via
sudo nvpmodel -m 0 for policy inference.
3. Environment & Port Configuration
A. USB Serial Permissions
Grant Permissions
$ sudo chmod 666 /dev/ttyACM*
# Verify your connected ports:
$ lerobot-find-port
# Verify your connected ports:
$ lerobot-find-port
B. Camera Verification
V4L2 Check
$ v4l2-ctl --list-devices
4. Control & Teleoperation
Test hardware integration using the tested scripts in the examples/ directory (run them from there with python3). More — YOLO tracking, Joy-Con, and full keyboard/VR teleop — live in examples/provided_examples/ as reference-only examples.
| Mode | Script Name | Notes |
|---|---|---|
| Joint control | 0_so100_keyboard_joint_control.py | Single-arm joint movement validation |
| End-effector (IK) | 2_dual_so100_keyboard_ee_control.py | Dual-arm joint + end-effector control |
| Wrist cameras | 9_dual_wrist_camera.py | Dual wrist-camera verification |
| Xbox teleop | 5_xlerobot_teleop_xbox.py | Gamepad control of the full platform |
| VR teleop | teleop_hand_and_arm.py | VR hand + arm teleoperation |
Troubleshooting Quick Reference
Full Diagnostic Guide ➔
Permission Denied
Run sudo chmod 666 /dev/ttyACM* to unlock USB ports.
Import Error
Ensure you ran pip install -e . inside the xlerobot-pro folder.
Ready to train your robot?
Start the First Reach Tutorial ↗