Module belief
Expand description
What a run has learned about the function, as the page draws it (D95).
Three views, each computed from public atune state only:
Belieffits atune’s Gaussian process ([atune::gp::Gp], the model behind GP-EI, with its closed-form median-heuristic hyperparameters) to the run’s completed trials, collected exactly as GP-EI collects them. For a GP-EI run it is the model GP-EI fits for its next proposal; for any other sampler it is the same model applied to that run’s results, not the sampler’s own. The page maps its posterior mean, standard deviation, or expected improvement.tpe_goodis the set of trials TPE’s densityl(x)is fitted to: themin(⌈0.1·n⌉, 25)lowest values, by TPE’s own (linear) split rule.ellipsetraces CMA-ES’s search distribution from the sampler’s own mean, step size and covariance (Controller::cmaes_distribution).
Structs§
- Belief
- A Gaussian process fitted to a run’s completed trials.
Enums§
- Model
Map - What the model map shows.
Constants§
- GP_
WARMUP - GP-EI’s warmup: below this many completed trials it draws space-filling points instead of consulting its model (the earlier search’s floor for two parameters, which the page builds GP-EI with).
- MIN_
POINTS - The fewest completed trials the page fits a model to.
- TPE_
SPLIT_ CAP - The cap on TPE’s linear split.
- TPE_
SPLIT_ DIVISOR - TPE’s linear split:
n_good = min(⌈n / TPE_SPLIT_DIVISOR⌉, TPE_SPLIT_CAP)(Tpe::new’s default, Optuna’sdefault_gamma). - TPE_
STARTUP - TPE’s uniform startup trials before its model takes over
(
Tpe::new’s default).
Functions§
- ellipse
- The ellipse of points
sigmasstandard deviations from the mean of CMA-ES’s search distribution, assegmentsunit-square points. - tpe_
good - The trial numbers in TPE’s “good” set for its next proposal, lowest value
first, or
Nonewhen the run is not an unscheduled TPE run past its startup. - training_
data - GP-EI’s training pairs for the controller’s study (see
Belief::new).