Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Environments – Mobile Robotics

Mobile robot navigation and locomotion tasks for Isaac Sim 6.1.0 with Isaac Lab 3.0.0.

Aerial (_aerial)

Template environment for aerial mobile robots. Configure via env.robot=<aerial_robot>.

_aerial

Simulation only; no trained policy ships.

Episode Length10.0s (250 steps)
Reward Terms1
Default RobotIngenuity

Robots

Crazyflie | Ingenuity

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–

Ground (_ground)

Template environment for ground mobile robots. Configure via env.robot=<ground_robot>.

_ground

Episode Length10.0s (250 steps)
Reward Terms1
Default RobotCadre

Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–

Orbital (_orbital)

Template environment for orbital mobile robots. Configure via env.robot=<orbital_robot>.

_orbital

Episode Length10.0s (250 steps)
Reward Terms2
Default RobotCubesat

Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-1–

Camera clipping. Set env.camera_clipping_range=[near,far] to override the render far plane and uint8 depth quantization; depth beyond far saturates and geometry is omitted from RGB.

EnvironmentFar planeReason or limit
Orbital default100 m ((0.01, 100.0) m)Orbital robots define no clipping range.
rendezvous50 mmax_target_distance; about 20 cm per uint8 depth step, versus 39 cm at 100 m.
orbital_evasion150 m100 m bounds radius plus obstacle field.
landing, moonfall400 mNadir camera reaches 200–220 m above terrain, tilted up to 30°.

Aerial Navigation (aerial_navigation)

Aerial navigation to a dynamic waypoint with terrain-clearance tracking

aerial_navigation

Simulation only; no trained policy ships.

Episode Length60.0s (1500 steps)
Reward Terms7
Default RobotIngenuity

Robots

Crazyflie | Ingenuity

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_altitude_trackingHyperbolicTracking41
reward_waypoint_approachHyperbolic162
penalty_tilt_angleOffsetLinear-2–
reward_terrain_clearanceHyperbolicBarrier80.5
penalty_energyLinear-0.5–
reward_waypoint_reachedThreshold32–

Bounded evaluation. Aerial Navigation and linked tasks omit success; bounded evaluation reports return only.

Beam Transport (beam_transport)

Two-robot collaborative transport of a rigid beam payload to a target point

beam_transport

Two Spot quadrupeds carry a rigid beam to a target on procedural MoonSurface. One shared policy observes robots in fixed order and splits one joint action across them, as in formation following.

beam_kinematic_mount_enabledBehavior
true (default)Mount beam at pair midpoint and heading, level at fixed height. Reward shapes support-slot alignment and gentle transport; no grasp/contact dynamics, tilt/drop penalties, or tilt success gate.
falseFree-beam ablation; restores tilt/drop penalties and tilt success gate.

No trained policy ships. Train and evaluate with:

srb agent train --algo dreamer --env beam_transport
srb agent eval --algo dreamer --env beam_transport --model <path/to/checkpoint>

Rollouts report min_beam_distance_to_target (m), success-hold streak, and success_rate. At zero success, minimum distance shows partial progress.

Episode Length30.0s (750 steps)
Reward Terms15
Default RobotSpot

Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_beam_positionGaussian161.5
reward_beam_midpoint_alignmentGaussian100.25
reward_robot_support_slotsGaussian120.2
reward_beam_progressScaled8–
reward_attachment_balanceGaussian40.15
reward_successLinear24–
penalty_beam_tiltLinear-4–
penalty_beam_dropLinear-16–
penalty_beam_speedLinear-2–
penalty_joint_torqueLinear-0.000025–
penalty_joint_accelerationLinear-0.00000025–
penalty_undesired_lin_vel_zLinear-0.5–
penalty_undesired_ang_vel_xyLinear-0.1–
penalty_gravity_rotation_alignmentLinear-2–

Success limits. Hold target pose for success_hold_steps=8 steps (0.32 s); target distance ≤ target_zone_radius_xy=0.20 m; beam-to-midpoint and support-slot alignment ≤ beam_attachment_radius_xy=0.30 m; planar speed ≤ target_speed_threshold_xy=0.35 m/s. Free-beam mode also requires 1 - |cos θ| ≤ beam_tilt_tolerance=0.20 (θ ≲ 37° from vertical). Holding success terminates the episode; otherwise it truncates at 30 s. Resets preserve robot spacing with a shared planar offset within ±1.5 m and shared yaw over the full circle; the mounted beam follows the transformed pair.

Policy spaces. Observations: per-robot planar position, velocity, and beam offset; beam position and 6D rotation; beam-target offset and distance; assignment-invariant support-slot error; beam planar/angular velocity; pair midpoint. Positions are environment-relative; inter-body offsets are unchanged. Actions drive both Spot quadrupeds. The reward table includes per-robot penalties for joint torque/acceleration, vertical velocity, roll/pitch rate, and projected-gravity alignment.

Episode-end info publishes success; bounded evaluation reports success rate and return.

Flight (flight)

Generic powered aerial flight profile with takeoff, transfer, and final landing

flight

Flight: 90 s Martian mission—ascend to cruise altitude, transfer to landing pad, guarded touchdown approach. Mars is default because rotorcraft need atmosphere; see Modelling envelope. Aerial configuration’s domain-selected scenery owns default Mars spawn and clearance.

Set env.landing_only=true to start in final descent phase 2, skipping ascent and transfer. This is the aerial Flight variant; orbital landing is separate.

Episode Length90.0s (2250 steps)
Reward Terms8
Default RobotIngenuity

Robots

Crazyflie | Ingenuity

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_waypoint_approachHyperbolic124
reward_altitude_trackingHyperbolicTracking61
reward_waypoint_reachedThreshold20–
penalty_tilt_angleOffsetLinear-2–
reward_terrain_clearanceHyperbolicBarrier60.8
penalty_energyLinear-0.6–
reward_mission_progressLinear60–

Termination/success. Crash terminates below termination_min_clearance or above termination_max_tilt. Pad arrival latches success in episode_outcome_info (crashed, on_pad, mission_phase), but episode runs to the limit. Success requires reaching the pad without crashing on the final step. At default weights, reward_mission_progress pays 60 per completed phase each step, more than other terms combined per step.

Formation Following (formation_following)

Multi-robot formation tracking behind a moving formation center

formation_following

Three Cadre-class rovers follow a drifting center in triangular slots (1.5, 0), (-0.75, 1.3), (-0.75, -1.3) m. Center follows a smooth random walk or ROS formation_center TF.

One shared policy: concatenate observations in fixed rover order, split one joint action across rovers, return one team reward per environment. Observation/action sizes scale linearly with team size. Small teams avoid decentralized communication and role assignment while keeping checkpoints reproducible. Companion centralized surface task: beam transport.

No trained policy ships.

srb agent train --algo dreamer --env formation_following
srb agent eval --algo dreamer --env formation_following --model <path/to/checkpoint>

Rollouts report mean per-rover slot-distance error (formation_distance_error, m), mean heading error (formation_orientation_error, rad), success-hold streak, and success_rate. At zero success, errors show partial progress.

Episode Length60.0s (1500 steps)
Reward Terms9
Default RobotCadre

Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_formation_trackingLinear-1–
reward_formation_progressScaled4–
reward_formation_velocityLinear2–
reward_point_towards_targetLinear0.5–
reward_formation_precisionLinear4–
reward_in_zoneLinear0–
reward_formation_orientationLinear4–
reward_action_rate_in_formationLinear32–

Success limits. All rovers stay within formation_success_position_tolerance_xy=0.20 m of their slots and formation_success_yaw_tolerance≈0.349 rad (20°) in heading for success_hold_steps=8 (0.32 s). Holding success terminates the episode (terminate_on_success=true; formation_following_decentralized keeps running); otherwise it truncates at 60 s. Infinite-horizon (is_finite_horizon=false).

Policy spaces. Each rover observes planar slot offset and heading-to-slot (sin, cos); policy observes center and rover planar velocities. Fixed episodic reset noise: 1 cm position, 2.5° heading. Actions: planar linear/angular velocity.

ROS center. ROS replaces random walk with formation_center TF. First post-reset pose re-anchors center; reset jump is not velocity. Not hardware-validated.

Episode-end info publishes success; bounded evaluation reports success rate and return.

Formation Following Decentralized (formation_following_decentralized)

Single-rover policy view for decentralized formation following

formation_following_decentralized

Episode Length60.0s (1500 steps)
Reward Terms9
Default RobotCadre

Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_formation_trackingLinear-1–
reward_formation_progressScaled4–
reward_formation_velocityLinear2–
reward_point_towards_targetLinear0.5–
reward_formation_precisionLinear4–
reward_in_zoneLinear0–
reward_formation_orientationLinear4–
reward_action_rate_in_formationLinear32–

Formation Following Orbital (formation_following_orbital)

Orbital formation tracking in microgravity

formation_following_orbital

Episode Length60.0s (600 steps)
Reward Terms7
Default RobotCubesat

Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-8–
penalty_fuel_consumptionLinear0–
penalty_action_magnitudeLinear-8–
penalty_formation_trackingLinear-2–
reward_formation_precisionLinear16–
reward_formation_orientationLinear48–
reward_action_rate_in_formationLinear48–

Slot assignment. randomize_formation_assignment=false assigns environment i to slot i % N (N formation positions), including partial resets. When true (default), each reset draws a random slot.

Landing (landing)

Landing of spacecraft on planetary surfaces with varying terrain and obstacles

Episode Length40.0s (1000 steps)
Reward Terms11
Default RobotPeregrine Lander

Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-1–
penalty_angular_velocityLinear-0.25–
penalty_gravity_rotation_alignmentLinear-1–
penalty_horizontal_linear_velocityLinear-0.1–
reward_vertical_linear_velocityHyperbolic81
reward_landing_angleLinear8–
reward_landing_velocityLinear16–
reward_landing_fuelLinear4–
penalty_crashLinear-32–
penalty_below_targetLinear-16–

See evaluation note.

Event cameras. Add events to env.active_sensors for the onboard (landing, moonfall) or front (velocity_tracking, waypoint_navigation) event camera.

Locomotion Velocity Tracking (locomotion_velocity_tracking)

Locomotion with legged robots and humanoids while tracking desired velocity commands

Simulation only; no trained policy ships.

Episode Length20.0s (500 steps)
Reward Terms12
Default RobotSpot

Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cassie | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped | Humanoid21 | Humanoid28 | Unitree H1 | Unitree G1

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_cmd_lin_vel_xyLinear4–
reward_cmd_ang_vel_zLinear2–
penalty_undesired_lin_vel_zLinear-0.5–
penalty_undesired_ang_vel_xyLinear-0.1–
penalty_joint_torqueLinear-0.000025–
penalty_joint_accelerationLinear-0.00000025–
penalty_undesired_robot_contactsThreshold-2–
penalty_gravity_rotation_alignmentLinear-2–
reward_feet_air_timeLinear0.75–
reward_quadruped_trotLinear1–
penalty_foot_slipLinear-0.5–

Termination matches Locomotion Waypoint Navigation: undesired non-foot contact, fall (planar projected gravity above 0.85), or non-finite state. Time limits truncate.

See evaluation note.

Locomotion Waypoint Navigation (locomotion_waypoint_navigation)

Navigation to a dynamic waypoint with legged robots and humanoids

Simulation only; no trained policy ships.

Episode Length60.0s (1500 steps)
Reward Terms13
Default RobotSpot

Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cassie | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped | Humanoid21 | Humanoid28 | Unitree H1 | Unitree G1

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_position_trackingLinear-1–
reward_point_towards_targetLinear1–
reward_position_tracking_precisionLinear4–
reward_orientation_trackingLinear8–
reward_action_rate_at_targetLinear16–
penalty_joint_torqueLinear-0.000025–
penalty_joint_accelerationLinear-0.00000025–
penalty_undesired_robot_contactsThreshold-2–
penalty_undesired_lin_vel_zLinear-0.5–
penalty_undesired_ang_vel_xyLinear-0.1–
penalty_gravity_rotation_alignmentLinear-2–
reward_feet_air_timeLinear0.5–

Episodes terminate if non-foot contact exceeds its configured undesired-contact threshold, projected gravity’s planar norm exceeds 0.85 (fall), or contact/gravity state is non-finite (fail-closed). Time limits truncate, not terminate.

See evaluation note.

Moonfall (moonfall)

Heavy-weight lunar descent with deployment stage and multi-stage landing phases

moonfall

Episode Length70.0s (1750 steps)
Reward Terms12
Default RobotPeregrine Lander

Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-1–
penalty_angular_velocityLinear-0.25–
penalty_gravity_rotation_alignmentLinear-1–
penalty_horizontal_linear_velocityLinear-0.1–
reward_waypoint_progressHyperbolic44
reward_vertical_linear_velocityHyperbolic81
reward_landing_angleLinear8–
reward_landing_velocityLinear16–
reward_landing_fuelLinear4–
penalty_crashLinear-32–
penalty_below_targetLinear-16–

See event camera options.

See evaluation note.

Orbital Evasion (orbital_evasion)

Navigation of spacecraft in microgravity while avoiding obstacles

Episode Length30.0s (750 steps)
Reward Terms7
Default RobotCubesat

Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-1–
penalty_angular_velocityLinear-0.25–
reward_obstacle_clearanceHyperbolicBarrier42
penalty_distance_robot_to_targetLinear-0.32–
penalty_out_of_boundsLinear-16–
reward_target_approachHyperbolic85

Termination. max_target_distance affects penalty_out_of_bounds, not terminated. Collision terminates when robot center of mass enters an obstacle keep-out sphere (0.5 * obstacle_scale * 1.4; 3.5 m for default 5 m asteroids), i.e. clearance falls below termination_min_obstacle_distance (0 m). Robot is a point: large robots may touch obstacles without termination, and about 7% of asteroids extend beyond the sphere on one axis. Obstacle centers spawn at z ∈ [-43, -7] m, at least 7 m from robot spawn and target. Time limits set truncated.

See evaluation note.

Orbital Waypoint Navigation (orbital_waypoint_navigation)

Navigation to a dynamic waypoint in orbital microgravity

orbital_waypoint_navigation

Episode Length30.0s (300 steps)
Reward Terms9
Default RobotSatellite Mockup

Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLogCosh-4–
penalty_fuel_consumptionLinear0–
penalty_action_magnitudeLogCosh-1–
penalty_angular_velocityLogCosh-2–
penalty_position_distanceLinear-1–
penalty_velocity_at_targetLogCosh-4–
reward_position_approachHyperbolic42
reward_position_precisionScaled8–
reward_smooth_station_keepingScaled8–

See evaluation note.

Rendezvous (rendezvous)

Maneuvering of spacecraft in microgravity to rendezvous with an uncooperative target

Episode Length25.0s (625 steps)
Reward Terms7
Default RobotCubesat

Robots

Floating Platform | Int Ball1 | Int Ball2 | Apollo Lander | Peregrine Lander | Vikram Lander | Resilience Lander | Random Lander | Iss | Gateway | Cubesat | Satellite Mockup | Venus Express | Starship | Super Heavy

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_fuel_consumptionLinear-8–
penalty_angular_velocityLinear-0.05–
penalty_distance_robot_to_targetLinear-16–
penalty_too_farLinear-16–
reward_precision_positionGaussian1280.025
reward_precision_orientationLinear128–

Termination. Exceeding max_target_distance incurs penalty_too_far but leaves terminated false so the agent can recover. Only the time limit sets truncated.

See evaluation note.

Terrain Landscaping (terrain_landscaping)

Terrain landscaping with a ground mobile robot reshaping a particle bed

terrain_landscaping

No trained policy ships. Dreamer requires env.num_envs=1; TD-MPC2 is unsupported; Raph hardware validation is incomplete. See Terrain Landscaping Training.

Setup: RaphRover + articulated RaphShovel (env.robot=raph_rover+raph_shovel). Filtered actions, in order: rover linear, rover angular, shovel extension velocity (terms robot/cmd_vel = linear, angular; payload/joint_vel = prismatic). Shovel resets raised at its 0.2 m joint limit; zero velocity holds position via actuator damping, keeping blade above settled particles until policy lowers it.

Reset: rover within ±1.1 m of bed center, random yaw. Blade reaches about 0.53 m from rover origin and starts clear of ±2.0 m walls. Rear-axle Ackermann steering limits yaw rate; full C/V turn gives about half the command.

Teleoperate (one environment):

srb agent teleop -e terrain_landscaping env.num_envs=1
InputAction
W/S, C/VForward/reverse; turn.
Q/ERaise/lower shovel. Release sends zero velocity; damping resists drift, no auto-retract.
SpaceMouse forward/back, verticalSame channels; rover ignores lateral translation.

Each episode deforms the flat reset bed with a hashed, mass-balanced mission: cut/fill balance within 1e-4 m³; cuts stay above available material, fills below containment ceiling, significant deformation in reachable zone. Seed (env.general_mission_seed, env_id, episode_index) reproduces missions across processes. Manifest records generator version, seed, frame, geometry, physical bounds, target-map, reset-layout, and manifest hashes. Infeasible missions redraw; exhausted attempts raise. Configure env.general_mission_profile.*.

This task shares only reward implementation and observation contract with terrain_landscaping_crater; targets, manifests, and curriculum stages are separate.

Episode Length60.0s (600 steps)
Default RobotRaph Rover

Robots

Raph Rover

Observation contract. Actor uses external heightmaps, not depth; PhysX particles cannot be raycast. Each policy step publishes one accepted-or-held 10 Hz live-regolith frame. Seven ordered leaves: global current/target (16×16), rover-frame local current/target (24×16), mission pose (x,y,yaw), body velocity (vx,vy,wz), frame age; flattened to 1287 float32. Elevations use mission-frame +z, matching deployment adapters. No validity mask: all 146×146 source cells finite; incomplete/out-of-envelope frames rejected whole. Unobserved: shovel extension, previous action, particle positions, simulator world pose, privileged current-minus-target maps. env.external_heightmap.profile: ideal, randomized, failure_stale.

Reward/episode. Sole reward 1 / (1 + mae / 0.02) on fixed mission grading cells, shared with crater. MDP continues (is_finite_horizon=false); time limit truncates. Success is evaluation-only, never termination or bonus.

Canonical tasks require RaphRover and RaphShovel; other robots or payloads fail before scene binding. Actor observations and canonical deployment profile omit shovel state.

Frame validity. Map, pose, and velocity share a timestamp; local crop uses that pose. Simulation resets capture one synchronous frame; deployment resets wait up to 2.0 s. A missing frame raises (no zero substitute). Frames older than 0.5 s stale-abort outside MDP. Dropped updates repeat the last complete map and increase frame age.

TD-MPC2 is unsupported because shovel extension is unobserved; it fails with an actionable error before creating logs, config, replay, or model. See Terrain Landscaping Training.

Terrain Landscaping Crater (terrain_landscaping_crater)

Separate deterministic baseline: fill one shallow crater from a nearby regolith pile

terrain_landscaping_crater

No trained policy ships; Dreamer supports only env.num_envs=1; TD-MPC2 is unsupported; the task is not validated on Raph hardware. See Terrain Landscaping Training.

Separate deterministic task from terrain_landscaping: no curriculum, scheduler, or automatic switching. Layered bed: one shallow bowl crater and one loose pile; crater particles reused, preserving particle count/mass. RaphRover starts fixed with both forward. Visible 4 m slab below physical ground, dark neutral terrain, and light regolith keep the bed readable against lunar skydome in viewport/headless captures.

Static analytic flat-bed target: crater_target_manifest.json; config fails if crater, pile, or spawner settings cannot reproduce hashed reset layout. Reward: 1 / (1 + mae / 0.02) on fixed manifest grading cells using oracle particle truth. Success: 90% of cells within tolerance for 20 consecutive newly accepted mapper frames; report at time-limit truncation, never termination/bonus. Continuing MDP (is_finite_horizon=false): the time limit truncates; leaving the rover pose/velocity envelope terminates. Physics perturbations/lighting randomization disabled. Action/observation schemas match terrain_landscaping.

Inspect by teleoperation:

srb agent teleop -e terrain_landscaping_crater env.num_envs=1
Episode Length30.0s (300 steps)
Default RobotRaph Rover

Robots

Raph Rover

FeatureDefaults
CraterCenter (0.45 m, 0.20 m), radius 0.36 m, depth 0.11 m.
PileCenter (-0.25 m, -0.20 m), radius 0.32 m, height 0.28 m.

Override under env.*. Out-of-bed, overlapping, or under-capacity layouts fail before particle spawn.

Observation contract. Same heightmap and frame contract as terrain_landscaping; schema flattens to 1287 float32.

TD-MPC2 has the same unsupported setup and fails before logs, config, replay, or model. PhysX PBD particles require a CUDA-capable NVIDIA GPU; particle state uses CPU readback (sim.device = "cpu") for heightmap, reward, and rendering. See Terrain Landscaping Training.

Terrain Landscaping Mound (terrain_landscaping_mound)

Separate deterministic baseline: level one regolith mound on a flat bed, graded by excess volume

terrain_landscaping_mound

No trained policy ships, Dreamer runs with env.num_envs=1 only, TD-MPC2 is not supported, and the task is not validated on Raph hardware. See Terrain Landscaping Training.

Episode Length30.0s (300 steps)
Default RobotRaph Rover

Robots

Raph Rover

Traversal (traversal)

Straight-line path following at a target velocity

traversal

Episode Length120.0s (3000 steps)
Reward Terms5
Default RobotNifty

Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.05–
penalty_lateral_pos_deviationLinear-1–
reward_vel_progressLinear8–
reward_action_rate_at_targetLinear32–
penalty_rolloverLinear-16–

Termination. Exceeding max_tilt_rad incurs penalty_rollover but leaves terminated false so the rover can recover. The time limit sets truncated.

See evaluation note.

Velocity Tracking (velocity_tracking)

Basic tracking of desired velocity commands

Episode Length20.0s (500 steps)
Reward Terms5
Default RobotCadre

Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
reward_cmd_lin_vel_xyLinear4–
reward_cmd_ang_vel_zLinear2–
penalty_undesired_lin_vel_zLinear-0.5–
penalty_undesired_ang_vel_xyLinear-0.1–

Commands (vx, vy, wz) are sampled uniformly in ±1 m/s and rad/s. Wheeled drives use their own limits instead and get no lateral command.

See evaluation note.

See event camera options.

Waypoint Navigation (waypoint_navigation)

Navigation to a dynamic waypoint

Episode Length60.0s (1500 steps)
Reward Terms6
Default RobotCadre

Robots

Anymal C | Anymal D | Random Anymal Quadruped | Cadre | Cassie | Husky | Leo Rover | Mars Rover | Nifty | Open Source Rover | Perseverance | Pragyan | Raph Rover | Spot | Unitree A1 | Unitree Go1 | Unitree Go2 | Random Unitree Quadruped

Rewards
TermTypeWeightScaleNotes
penalty_action_rateLinear-0.1–
penalty_position_trackingLinear-1–
reward_point_towards_targetLinear1–
reward_position_tracking_precisionLinear4–
reward_orientation_trackingLinear8–
reward_action_rate_at_targetLinear16–

See evaluation note.

See event camera options.