Close the sim2real gap for the Furuta pendulum (swings up but can't
balance on hardware). Root causes were (a) no domain randomization, so
the policy overfit one deterministic sim instance, and (b) reward design
flaws that produced degenerate policies.
Domain randomization (runner-level, backend-agnostic):
- BaseRunner: domain_rand config; per-env action-delay buffer (latency),
Gaussian qpos/qvel sensor noise, per-env dynamics-scale sampling
(friction/damping/torque), resampled per episode. Sensor noise per step.
- privileged_obs/privileged_dim expose normalized DR factors (mu) for RMA.
- step() now uses clean state for reward/termination, noisy state for the
observation the policy sees.
- MuJoCoRunner: applies per-env friction/damping/torque scales.
- robot.py: compute_motor_force gains friction/damping scale args.
- Configs: DR blocks for mujoco (full) and mjx (delay+noise); clean
defaults for mujoco_single/serial; noise/delay anchored to recordings.
Reward fixes (rotary_cartpole):
- Shift upright reward to [0,1] (was [-1,1]) + alive_bonus, so surviving
always beats ending early (kills the "suicide into the limit" policy).
- Add balance_bonus * upright * stillness so reward requires upright AND
near-zero pendulum velocity (kills the "spin in full loops" policy).
Deploy:
- eval.py load_policy reconstructs the history/adaptation encoder
(auto-detects its dim from the checkpoint) so DR+embedding policies load.
Fixes:
- MuJoCoRunner._sim_reset referenced self._env (typo) -> self.env, which
was breaking every rotary-cartpole reset.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Unified the two separate sysid codepaths (motor-only and full-system)
into a single module that optimizes all 28 parameters jointly:
- 13 motor params (asymmetric gear, damping, friction, deadzone,
Stribeck boost, action bias, filter tau, armature, ctrl_limit)
- 15 pendulum/arm params (mass, CoM, inertia, joint dynamics)
Key changes:
- Added stribeck_friction_boost, stribeck_vel, action_bias to
ActuatorConfig (robot.py) and MJX runner
- Created shared src/sysid/preprocess.py (SG velocity recomputation)
- Rewrote src/sysid/rollout.py with unified MOTOR_PARAMS + PENDULUM_PARAMS
spec and PARAM_SETS dict for flexible subset optimization
- Updated optimize.py, export.py, visualize.py to use unified params
(removed all LOCKED_MOTOR_PARAMS references)
- Removed src/sysid/motor/ module and scripts/motor_sysid.py
Net: -1383 lines, zero code duplication between motor and full-system sysid.
