Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Environments – Mobile Robotics

Navigation and locomotion configuration and contracts target Isaac Sim 6.1.0 with Isaac Lab 3.0.0; hardware readiness is not claimed.

Aerial (_aerial)

Template environment for aerial mobile robots. Configure via env.robot=<aerial_robot>.

_aerial

Readiness: simulator-only. No learned-policy, real-data or hardware evidence for aerial platforms is recorded in the capability ledger (docs/data/capabilities.toml); every lane there is still at present.

Episode Length10.0s (250 steps)
Reward Terms1
Default RobotIngenuity

Compatible Robots

Crazyflie | Ingenuity

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–

Ground (_ground)

Template environment for ground mobile robots. Configure via env.robot=<ground_robot>.

_ground

Episode Length10.0s (250 steps)
Reward Terms1
Default RobotCadre

Compatible Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–

Orbital (_orbital)

Template environment for orbital mobile robots. Configure via env.robot=<orbital_robot>.

_orbital

Episode Length10.0s (250 steps)
Reward Terms2
Default RobotCubesat

Compatible Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-1–

Camera depth range. Orbital cameras use camera_clipping_range = (0.01, 100.0) m; rendezvous uses 50 m, orbital_evasion 150 m, and landing and moonfall 400 m. Geometry beyond the far plane is not rendered. Override with env.camera_clipping_range=[near,far].

Aerial Navigation (aerial_navigation)

Aerial navigation to a dynamic waypoint with terrain-clearance tracking

aerial_navigation

Readiness: simulator-only. No learned-policy, real-data or hardware evidence for aerial platforms is recorded in the capability ledger (docs/data/capabilities.toml); every lane there is still at present.

Episode Length60.0s (1500 steps)
Reward Terms7
Default RobotIngenuity

Compatible Robots

Crazyflie | Ingenuity

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_altitude_trackingHyperbolicTracking41
reward_waypoint_approachHyperbolic162
penalty_tilt_angleOffsetLinear-2–
reward_terrain_clearanceHyperbolicBarrier80.5
penalty_energyLinear-0.5–
reward_waypoint_reachedThreshold32–

Success signal: return only. Evaluation reports the return, not a success rate.

Beam Transport (beam_transport)

Two-robot collaborative transport of a rigid beam payload to a target point

beam_transport

Readiness: simulator-only. Earlier baseline results are stale, and training readiness is not established.

Two Spot quadrupeds carry one beam to a target on MoonSurface terrain, driven by one centralized policy. The beam is kinematically mounted to the pair; set env.beam_kinematic_mount_enabled=false for a free beam.

Episode Length30.0s (750 steps)
Reward Terms15
Default RobotSpot

Compatible Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_beam_positionGaussian161.5
reward_beam_midpoint_alignmentGaussian100.25
reward_robot_support_slotsGaussian120.2
reward_beam_progressScaled8–
reward_attachment_balanceGaussian40.15
reward_successLinear24–
penalty_beam_tiltLinear-4–
penalty_beam_dropLinear-16–
penalty_beam_speedLinear-2–
penalty_joint_torqueLinear-0.000025–
penalty_joint_accelerationLinear-0.00000025–
penalty_undesired_lin_vel_zLinear-0.5–
penalty_undesired_ang_vel_xyLinear-0.1–
penalty_gravity_rotation_alignmentLinear-2–

Success. The beam stays within 0.20 m of the target, aligned with both robots and moving slowly, for 8 consecutive control steps.

Success signal: episode info. Evaluation reports a success rate and the return.

Flight (flight)

Generic powered aerial flight profile with takeoff, transfer, and final landing

flight

A rotorcraft takes off on Mars, flies to a landing pad and lands within 90 s. Set env.landing_only=true to start in the final descent.

Episode Length90.0s (2250 steps)
Reward Terms8
Default RobotIngenuity

Compatible Robots

Crazyflie | Ingenuity

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_waypoint_approachHyperbolic124
reward_altitude_trackingHyperbolicTracking61
reward_waypoint_reachedThreshold20–
penalty_tilt_angleOffsetLinear-2–
reward_terrain_clearanceHyperbolicBarrier60.8
penalty_energyLinear-0.6–
reward_mission_progressLinear60–

Only a crash (low terrain clearance or excessive tilt) terminates. Reaching the pad sets success; the episode then runs to the time limit.

Formation Following (formation_following)

Multi-robot formation tracking behind a moving formation center

formation_following

Readiness: simulator-only. Earlier baseline results are stale, and training readiness is not established.

Three Cadre rovers hold triangular formation slots around a drifting centre, driven by one centralized policy. With a ROS node, the centre follows the formation_center TF frame.

Episode Length60.0s (1500 steps)
Reward Terms9
Default RobotCadre

Compatible Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_formation_trackingLinear-1–
reward_formation_progressScaled4–
reward_formation_velocityLinear2–
reward_point_towards_targetLinear0.5–
reward_formation_precisionLinear4–
reward_in_zoneLinear0–
reward_formation_orientationLinear4–
reward_action_rate_in_formationLinear32–

Success. All rovers stay within 0.20 m and 20° of their slots for 8 consecutive control steps.

Success signal: episode info. Evaluation reports a success rate and the return.

Formation Following Decentralized (formation_following_decentralized)

Single-rover policy view for decentralized formation following

formation_following_decentralized

Episode Length60.0s (1500 steps)
Reward Terms9
Default RobotCadre

Compatible Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_formation_trackingLinear-1–
reward_formation_progressScaled4–
reward_formation_velocityLinear2–
reward_point_towards_targetLinear0.5–
reward_formation_precisionLinear4–
reward_in_zoneLinear0–
reward_formation_orientationLinear4–
reward_action_rate_in_formationLinear32–

Formation Following Orbital (formation_following_orbital)

Orbital formation tracking in microgravity

formation_following_orbital

Episode Length60.0s (600 steps)
Reward Terms7
Default RobotCubesat

Compatible Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-8–
penalty_fuel_consumptionLinear0–
penalty_action_magnitudeLinear-8–
penalty_formation_trackingLinear-2–
reward_formation_precisionLinear16–
reward_formation_orientationLinear48–
reward_action_rate_in_formationLinear48–

Slot assignment. With randomize_formation_assignment = false, environment i always takes formation slot i % N (N formation positions), including after partial resets; with it enabled, each reset draws a slot at random.

Landing (landing)

Landing of spacecraft on planetary surfaces with varying terrain and obstacles

Episode Length40.0s (1000 steps)
Reward Terms11
Default RobotPeregrine Lander

Compatible Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-1–
penalty_angular_velocityLinear-0.25–
penalty_gravity_rotation_alignmentLinear-1–
penalty_horizontal_linear_velocityLinear-0.1–
reward_vertical_linear_velocityHyperbolic81
reward_landing_angleLinear8–
reward_landing_velocityLinear16–
reward_landing_fuelLinear4–
penalty_crashLinear-32–
penalty_below_targetLinear-16–

Success signal: return only. Evaluation reports the return, not a success rate.

Event camera (opt-in; disabled by default). Set env.enable_event_camera_onboard=true to add the onboard event camera.

Locomotion Velocity Tracking (locomotion_velocity_tracking)

Locomotion with legged robots and humanoids while tracking desired velocity commands

Readiness: simulator-only. No learned-policy, real-data or hardware evidence for legged or humanoid platforms is recorded in the capability ledger (docs/data/capabilities.toml); every lane there is still at present.

Episode Length20.0s (500 steps)
Reward Terms12
Default RobotSpot

Compatible Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cassie | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped | Humanoid21 | Humanoid28 | Unitree H1 | Unitree G1

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_cmd_lin_vel_xyLinear4–
reward_cmd_ang_vel_zLinear2–
penalty_undesired_lin_vel_zLinear-0.5–
penalty_undesired_ang_vel_xyLinear-0.1–
penalty_joint_torqueLinear-0.000025–
penalty_joint_accelerationLinear-0.00000025–
penalty_undesired_robot_contactsThreshold-2–
penalty_gravity_rotation_alignmentLinear-2–
reward_feet_air_timeLinear0.75–
reward_quadruped_trotLinear1–
penalty_foot_slipLinear-0.5–

Success signal: return only. Evaluation reports the return, not a success rate.

Locomotion Waypoint Navigation (locomotion_waypoint_navigation)

Navigation to a dynamic waypoint with legged robots and humanoids

Readiness: simulator-only. No learned-policy, real-data or hardware evidence for legged or humanoid platforms is recorded in the capability ledger (docs/data/capabilities.toml); every lane there is still at present.

Episode Length60.0s (1500 steps)
Reward Terms13
Default RobotSpot

Compatible Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cassie | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped | Humanoid21 | Humanoid28 | Unitree H1 | Unitree G1

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_position_trackingLinear-1–
reward_point_towards_targetLinear1–
reward_position_tracking_precisionLinear4–
reward_orientation_trackingLinear8–
reward_action_rate_at_targetLinear16–
penalty_joint_torqueLinear-0.000025–
penalty_joint_accelerationLinear-0.00000025–
penalty_undesired_robot_contactsThreshold-2–
penalty_undesired_lin_vel_zLinear-0.5–
penalty_undesired_ang_vel_xyLinear-0.1–
penalty_gravity_rotation_alignmentLinear-2–
reward_feet_air_timeLinear0.5–

Non-foot contact or a fall terminates; the time limit is a truncation.

Success signal: return only. Evaluation reports the return, not a success rate.

Moonfall (moonfall)

Heavy-weight lunar descent with deployment stage and multi-stage landing phases

moonfall

Episode Length70.0s (1750 steps)
Reward Terms12
Default RobotPeregrine Lander

Compatible Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-1–
penalty_angular_velocityLinear-0.25–
penalty_gravity_rotation_alignmentLinear-1–
penalty_horizontal_linear_velocityLinear-0.1–
reward_waypoint_progressHyperbolic44
reward_vertical_linear_velocityHyperbolic81
reward_landing_angleLinear8–
reward_landing_velocityLinear16–
reward_landing_fuelLinear4–
penalty_crashLinear-32–
penalty_below_targetLinear-16–

Event camera (opt-in; disabled by default). Set env.enable_event_camera_onboard=true to add the onboard event camera.

Orbital Evasion (orbital_evasion)

Navigation of spacecraft in microgravity while avoiding obstacles

Episode Length30.0s (750 steps)
Reward Terms7
Default RobotCubesat

Compatible Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-1–
penalty_angular_velocityLinear-0.25–
reward_obstacle_clearanceHyperbolicBarrier42
penalty_distance_robot_to_targetLinear-0.32–
penalty_out_of_boundsLinear-16–
reward_target_approachHyperbolic85

Termination semantics. max_target_distance drives the penalty_out_of_bounds reward and does not set terminated. Entering an asteroid’s keep-out sphere terminates; the time limit is reported as truncated.

Success signal: return only. Evaluation reports the return, not a success rate.

Orbital Waypoint Navigation (orbital_waypoint_navigation)

Navigation to a dynamic waypoint in orbital microgravity

orbital_waypoint_navigation

Episode Length30.0s (300 steps)
Reward Terms9
Default RobotSatellite Mockup

Compatible Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLogCosh-4–
penalty_fuel_consumptionLinear0–
penalty_action_magnitudeLogCosh-1–
penalty_angular_velocityLogCosh-2–
penalty_position_distanceLinear-1–
penalty_velocity_at_targetLogCosh-4–
reward_position_approachHyperbolic42
reward_position_precisionScaled8–
reward_smooth_station_keepingScaled8–

Success signal: return only. Evaluation reports the return, not a success rate.

Rendezvous (rendezvous)

Maneuvering of spacecraft in microgravity to rendezvous with an uncooperative target

Episode Length25.0s (625 steps)
Reward Terms7
Default RobotCubesat

Compatible Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-8–
penalty_angular_velocityLinear-0.05–
penalty_distance_robot_to_targetLinear-16–
penalty_too_farLinear-16–
reward_precision_positionGaussian1280.025
reward_precision_orientationLinear128–

Termination semantics. max_target_distance drives the penalty_too_far reward. Exceeding it leaves terminated false so the agent can recover; only the time limit sets truncated.

Success signal: return only. Evaluation reports the return, not a success rate.

Terrain Landscaping (terrain_landscaping)

Terrain landscaping with a ground mobile robot reshaping a particle bed

terrain_landscaping

Readiness: blocked. No learned policy exists, Dreamer with num_envs > 1 and TD-MPC2 are rejected fail-closed, and the raph-hardware lane of the capability ledger has no evidence.

A RaphRover with a RaphShovel reshapes a regolith particle bed toward a per-episode target heightmap. The action is [rover_linear_velocity, rover_angular_velocity, shovel_linear_velocity].

srb agent teleop -e terrain_landscaping env.num_envs=1
Episode Length60.0s (600 steps)
Reward Terms0
Default RobotRaph Rover

Compatible Robots

Raph Rover

The policy observes current and target heightmaps, the rover pose and velocity, but not the shovel extension, so TD-MPC2 is disabled. The reward is 1 / (1 + mae / 0.02); episodes end only at the time limit. See Terrain Landscaping Training Readiness.

Terrain Landscaping Crater (terrain_landscaping_crater)

Separate deterministic baseline: fill one shallow crater from a nearby regolith pile

terrain_landscaping_crater

Readiness: blocked. No learned policy exists, Dreamer with num_envs > 1 and TD-MPC2 are rejected fail-closed, and the raph-hardware lane of the capability ledger has no evidence.

A separate task, not a curriculum stage of terrain_landscaping: level a bed with one crater and one regolith pile from a fixed rover pose. Actions and observations match terrain_landscaping.

srb agent teleop -e terrain_landscaping_crater env.num_envs=1
srb agent train --headless --algo skrl_ppo -e terrain_landscaping_crater
Episode Length30.0s (300 steps)
Reward Terms0
Default RobotRaph Rover

Compatible Robots

Raph Rover

Crater and pile geometry are overridable under env.*. Dreamer runs only with env.num_envs=1, TD-MPC2 is disabled, and particle physics needs an NVIDIA GPU. See Terrain Landscaping Training Readiness.

Terrain Landscaping Mound (terrain_landscaping_mound)

Separate deterministic baseline: level one regolith mound on a flat bed, graded by excess volume

terrain_landscaping_mound

Readiness: blocked. No learned policy exists, Dreamer with num_envs > 1 and TD-MPC2 are rejected fail-closed, and the raph-hardware lane of the capability ledger has no evidence.

Episode Length30.0s (300 steps)
Reward Terms0
Default RobotRaph Rover

Compatible Robots

Raph Rover

Traversal (traversal)

Straight-line path following at a target velocity

traversal

Episode Length120.0s (3000 steps)
Reward Terms5
Default RobotNifty

Compatible Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.05–
penalty_lateral_pos_deviationLinear-1–
reward_vel_progressLinear8–
reward_action_rate_at_targetLinear32–
penalty_rolloverLinear-16–

Termination semantics. max_tilt_rad drives the penalty_rollover reward. Exceeding the tilt threshold leaves terminated false so the rover can recover; the time limit is reported as truncated.

Success signal: return only. Evaluation reports the return, not a success rate.

Velocity Tracking (velocity_tracking)

Basic tracking of desired velocity commands

Episode Length20.0s (500 steps)
Reward Terms5
Default RobotCadre

Compatible Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_cmd_lin_vel_xyLinear4–
reward_cmd_ang_vel_zLinear2–
penalty_undesired_lin_vel_zLinear-0.5–
penalty_undesired_ang_vel_xyLinear-0.1–

Success signal: return only. Evaluation reports the return, not a success rate.

Event camera (opt-in; disabled by default). Set env.enable_event_camera_front=true to add the front event camera.

Waypoint Navigation (waypoint_navigation)

Navigation to a dynamic waypoint

Episode Length60.0s (1500 steps)
Reward Terms6
Default RobotCadre

Compatible Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Reward Breakdown
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_position_trackingLinear-1–
reward_point_towards_targetLinear1–
reward_position_tracking_precisionLinear4–
reward_orientation_trackingLinear8–
reward_action_rate_at_targetLinear16–

Success signal: return only. Evaluation reports the return, not a success rate.

Event camera (opt-in; disabled by default). Set env.enable_event_camera_front=true to add the front event camera.