Skip to main content

MAX_EVAL_EPISODES

Constant MAX_EVAL_EPISODES 

pub const MAX_EVAL_EPISODES: usize = 10_000;
Expand description

The most greedy evaluation episodes one metric request may ask for.

oniro eval runs the episodes in a single process whose wall clock grows linearly with the count, while the standard error of the mean return it reports only falls as 1/sqrt(n): past a few hundred episodes extra ones buy nothing measurable and cost proportionally. Ten thousand is a thousand times the ten-episode default and far past any honest evaluation budget, so a request above it is a mis-parsed number or a typo, not a workload — and without the cap it is an unbounded subprocess on a path where the timeout is optional.

Enforced by the command adapter, which is the layer that owns process limits; the OniroRuntime seam itself is unchanged and a test double may script whatever it likes.