AIMech AI

Information-geometric optimization

Algorithms AIMech:InformationGeometricOptimization DRAFT
A stochastic black-box optimization framework that adapts a parametrized sampling distribution using objective ranks and Fisher natural gradients, defining a continuous flow with reference-frozen quantile utilities and finite algorithms that approximate that flow by ranked sampling and Euler updates.
Identity Notes & Concept Scope IGO specifies quantile/rank utility, reference-frozen natural-gradient flow and a parameterized sampled update across distribution families. It is not an exact alias of generic NES, xNES, SNES, full maintained CMA-ES, CEM or PBIL. The scoped rank-mu/no-path Gaussian, normalized-weight ML and Bernoulli/no-mutation correspondences do not equate the maintained whole methods. Current bounded identity assessment covers730native and442pinnedAIO records and four ignored/hidden-inclusive checkout scans; all2900matches were reconciled. Existing frontier owner203 is retained in place, without a duplicate leaf. The premerge collection and actual creation freshness checks remain separately recorded.

Claims & Grounded Evidence

6 Claims
Mechanism #distribution-relative-rank-utility
For minimization of a black-box objective f over a search space X, choose a parametrized family of sampling distributions P_theta and a non-increasing selection function w on [0,1]. Define the lower and upper probability levels of x using, respectively, objective values strictly below and at or below f(x) under P_theta. When the two levels coincide, the utility W_theta(x) is w at that level. For a positive-probability tie, it is the average of w over the whole interval between the two levels. Averaging w over this interval is generally different from evaluating w at its midpoint. This distribution-relative rank utility replaces raw objective magnitudes as the preference signal.
Mechanism #reference-frozen-natural-gradient-flow
At a current parameter theta_t, freeze the reference utility W_theta_t while differentiating its expectation under a variable P_theta. The IGO flow follows natural-gradient ascent of that expectation, evaluated at theta_t. With a differentiable sampling family and a usable nonsingular Fisher information matrix I, its velocity is I(theta_t)^(-1) times the expectation under P_theta_t of W_theta_t(x) times the score gradient of log P_theta(x), evaluated at theta_t. Differentiation acts on the distribution parameters, not on the black-box objective. Differentiating the utility and its averaging distribution together would instead differentiate the constant integral of w and lose the intended preference update.
Mechanism #sampled-euler-update-and-ties
The finite IGO algorithm draws N independent samples from the current distribution, evaluates f and ranks samples from best to worst for minimization. Without ties, a sample with zero-based rank r receives weight (1/N) w((r + 1/2)/N). Tied samples receive the average of these weights over their possible rank positions. The parameter update adds delta_t times the sum of each weight multiplied by its natural score gradient at the current parameter. The factor 1/N is already in each weight. This is a sampled Euler approximation, requiring a chosen distribution family, weighting scheme, coordinate parametrization, sample size and step size; it is not an exact finite-time solution of the flow.
Mechanism #qualified-invariance-properties
Strictly increasing transformations of objective values preserve the population probability levels, sampled rankings and ties, so they preserve the IGO flow and the finite rule with corresponding samples. A smooth invertible reparametrization preserves the continuous trajectory in distribution space. Finite additive updates generally agree only to first order in delta_t, with local differences of order delta_t squared under the stated regularity assumptions; affine parameter changes preserve the finite rule exactly. A one-to-one search-space transformation also requires preservation of the distribution family, a locally diffeomorphic induced parameter correspondence and transformed initialization. Its finite-update equivariance has the same second-order qualification unless the induced parameter map is affine.
Scope #population-limit-and-quantile-improvement
At a fixed parameter, independent sampling, square-integrable score components and a bounded non-increasing selection function support almost-sure convergence of the rank-weighted empirical update to the exact-population Euler update as N tends to infinity, with the stated tie averaging. This limit alone does not remove the time-discretization error. For the ideal continuous IGO flow with truncation weights w(u)=1 when u<=q and 0 otherwise, where 0<q<1, the source establishes non-increase of the q-quantile of f under its regularity assumptions. Strict improvement additionally requires no objective plateaus and a nonstationary trajectory. These are not finite-population monotonicity, finite-budget accuracy or global-optimum guarantees.
Scope #scoped-algorithm-correspondences
The framework overlaps rank-shaped natural evolution strategies; it does not equate the rank utility with raw expected fitness. For Gaussian distributions in mean/covariance coordinates, the IGO update matches the displayed rank-mu CMA update when mean and covariance learning rates are equal and evolution-path and step-size-control effects are disabled. For product Bernoulli distributions in probability coordinates, a weight of one on the best sample and zero on the others recovers the stated PBIL attraction update without probability mutation. The separate IGO-ML construction maximizes a weighted likelihood objective; for an exponential family in expectation coordinates and sample weights summing to one, it coincides with the corresponding IGO and smoothed cross-entropy updates when their required maximizers exist. These special cases do not make the whole framework an exact alias of full CMA-ES, mutated PBIL, generic NES or cross-entropy updates in arbitrary coordinates.

⚠️ Curated Limitations & Negative Results

Artificial Intelligence Ontology (AIO) Grounding

Explicit AIO Snapshot Assessment: No Match

Rationale: No inspected target establishes a sufficiently specific identity or defining-component relation for the general rank-based natural-gradient optimization framework. Optional learning applications and distribution families do not justify forcing a learning-task, network, model or scalar-function mapping.

Search Scope: On2026-10-15 the bounded current assessment covered730native and442pinned AIO identities, aliases and scoped synonyms, with complete definition projections and focused semantic comparison to NES, CMA-ES, cross-entropy optimization and PBIL. All908main and393nested frontier objects were mechanically scanned; retained complete label/status coverage and17 freshly read relevant objects identify owners193/194/203. Four rg --no-ignore --hidden checkout searches yielded2900occurrences in18 exact contents, all reconciled and read, including explicit NES variant exclusions and four license-acronym false positives. Fourteen exact AIO CLASS nodes and48 incident edges plus31 additional semantic rows were inspected. The13 original rejected alternatives and ExponentialFunction are considered explicitly below; scalar exponential updates are not mandatory for generic IGO. Supporting full-inventory reading and root focused readings are separately attributed. Record/report bytes were verified at committed330head78f5e99222362867cab3990afd59485c58e18f8a; merge-based creation freshness is recorded separately. This is scoped pinned-snapshot evidence, not universal absence or literature saturation.
Examined AIO Candidate Rejection Reason
AIO:EvolutionaryLLM This is a large language model class. Its related evolutionary-algorithms synonym does not identify the general distribution-based optimizer.
AIO:TrainingStrategy The pinned model-training and preprocessing scope does not identify a general black-box optimization framework.
AIO:MachineLearningTask A task defined by learning from data does not identify this general optimizer, even though its sampling distribution adapts.
AIO:MetaLearning IGO does not inherently use metadata over machine-learning experiments.
AIO:ActiveLearning Black-box objective evaluations do not inherently require label queries or a predictive surrogate.
AIO:ReinforcementLearning An optional policy-search application does not make reward/environment learning the defining identity.
AIO:RandomForest No decision-tree ensemble or forest surrogate is required.
AIO:EvaluationBias Bias in a testing population is not the rank-based optimizer; a possible limitation is not a mapping.
AIO:MarkovChain A generic stochastic-state representation does not identify the natural-gradient search framework or establish a target-invariant sampler.
AIO:MathematicalFunction The concept is an iterative optimization framework, not merely a scalar function or acquisition criterion.
AIO:BayesianNetwork No directed acyclic graphical model is inherent to the chosen distribution family.
AIO:ProbabilisticGraphicalModel The pinned graph-expressed conditional-dependence task is not required by the IGO construction.
AIO:RestrictedBoltzmannMachine An optional distribution-family example does not identify the general framework or give it a hidden-layer requirement.
AIO:ExponentialFunction Scalar exponential scale updates define the selected xNES/SNES procedures, but are not required by the general rank-based IGO flow or sampled Euler construction over arbitrary distribution families.

Evidence Sources & Primary Literature

1 Source
Source ID Publication / Document Type / Access Reference & Checksum
ollivier2017
Yann Ollivier, Ludovic Arnold, Anne Auger, Nikolaus Hansen
primary paper
full_text
sha256:9ae914cf439b…

Curation Provenance

Curator: Codex
Method: ai_assisted
Model: GPT-6
Created: 2026-10-15T04:48:29Z
Updated: 2026-10-15T04:48:29Z
Source File: data/curated/InformationGeometricOptimization.yaml