DIRECT global optimization
Algorithms AIMech:DIRECTGlobalOptimization DRAFT
A deterministic derivative-free global optimization algorithm that adaptively partitions a bounded real search box, samples rectangle centers and trisects the longest sides of every rectangle that is potentially optimal for some positive rate-of-change weight and a specified score-improvement threshold.
Identity Notes & Concept Scope
DIRECT denotes the original deterministic box-partition method: normalized-domain center sampling, potentially optimal rectangles under an unspecified positive slope, and longest-side trisection. It does not require a surrogate or an information acquisition. This differs from random or grid search, population-based differential evolution/CMA-ES, and GP-guided optimization. Direct Preference Optimization is a policy objective and is unrelated.
Claims & Grounded Evidence
6 Claims
Mechanism
#normalized-center-sampled-partition
For minimization of a finite-valued deterministic scalar objective on a finite-dimensional box with strictly positive side lengths, normalize each coordinate to [0,1]. Start with the unit hypercube and evaluate its center. Maintain a partition into axis-aligned hyperrectangles, each with an evaluated center, and retain the smallest objective value observed. The defining search uses function values rather than objective derivatives or a fitted probabilistic surrogate. The geometry is measured in normalized coordinates, so the original coordinate bounds affect its metric.
Mechanism
#potentially-optimal-rectangle-rule
Let c_i be each rectangle center and d_i its Euclidean distance to a vertex, equal to one half of its diagonal length in normalized coordinates. For a fixed epsilon > 0 and current best value f_min, rectangle j is potentially optimal when some finite K_tilde > 0 satisfies both f(c_j) - K_tilde d_j <= f(c_i) - K_tilde d_i for every current rectangle i, and f(c_j) - K_tilde d_j <= f_min - epsilon |f_min|. All such rectangles are eligible, including distinct rectangles tied at the same distance and value. The rate-of-change weight is varied rather than supplied as a known Lipschitz bound; its score is not automatically a certified lower bound on the objective inside the rectangle.
Mechanism
#longest-side-trisection
For each selected rectangle, collect all dimensions whose side length equals its maximum side length L. Evaluate the objective at c plus and minus (L/3)e_i for every such dimension i. Order these dimensions by the smaller of their two sampled values. Trisect the rectangle containing the original center along the best dimension, then continue splitting only the remaining central rectangle along each subsequent dimension. With m tied longest dimensions, this creates 2m + 1 child rectangles from 2m new center samples while reusing the original center value. A stated deterministic rule is needed to order dimensions with equal pair scores; different valid tie orders can produce different labeled partitions.
Mechanism
#complete-selected-set-iterations
Determine the full potentially optimal set at the start of an iteration. Subdivide every member of that fixed set, updating the partition and the observed best value, before computing a new potentially optimal set. The original procedure processes all selected rectangles and does not replace this step by repeatedly selecting only the current best rectangle. Complete-iteration results do not depend on the order of processing disjoint selected rectangles when within-rectangle tie conventions are fixed and evaluations are deterministic. An iteration can contain multiple new evaluations. The source uses a specified iteration limit and also permits an evaluation budget; an early budget stop may interrupt the complete-iteration convention.
Mechanism
#epsilon-and-objective-origin
Epsilon imposes a required improvement on the weighted selection score relative to |f_min|; it is not a verified error bound or stopping tolerance. At f_min = 0 the epsilon term vanishes, although the remaining selection inequalities still apply. Multiplying all objective values by a positive constant preserves the exact selection test after rescaling K_tilde. Adding a constant generally does not, because |f_min| changes. For example, with epsilon = 1/100, a best small interval of radius 1/18 and value 0 competes with larger intervals of radius 1/6 and value 1 for 0 < K_tilde <= 9. Adding 100 to every value requires K_tilde >= 18 for the small interval, so it ceases to be potentially optimal despite unchanged objective rankings.
Mechanism
#asymptotic-coverage-with-scoped-convergence
For the ideal original algorithm continued indefinitely with exact selection, complete iterations and finite objective values, at least one rectangle with maximal center-to-vertex distance is selected each iteration. Repeated longest-side trisection makes the maximum rectangle radius tend to zero, so sampled centers become dense in the box. If a finite global minimum is attained and the objective is continuous in a neighborhood of a global minimizer, the best sampled values converge to that minimum. This is an asymptotic value statement, not a finite-budget error certificate, a rate guarantee, exact finite attainment of a boundary minimizer or a guarantee for arbitrary discontinuous objectives and modified selection rules.
⚠️ Curated Limitations & Negative Results
- This record describes the original 1993 DIRECT construction. Later locally biased, tie-reduced, restart, noisy-objective, constrained or parallel variants are not silently imported or declared exact aliases. A direct-search optimizer is not the maintained DirectPreferenceOptimization algorithm.
- The source uses finite-valued deterministic objective evaluations on a finite box. General constraints, failed evaluations, noise handling, categorical parameters, zero-width coordinates and floating-point degeneracy need additional implementation rules. Normalization and tie conventions can affect the search trajectory; no rotation invariance or coordinate-independent behavior is asserted.
- The lower-right convex-hull interpretation concerns existence of a positive weight satisfying both inequalities. A point touching only at weight zero is excluded by the stated definition, and the epsilon filter can exclude a hull candidate. Equal-distance candidates require direct value comparison rather than division by a zero distance difference.
- In the introductory Shubert comparison, PDF p.4 / printed p.160 Eq 5 omits the factor one half on K(b-a) for the claimed bottom-of-V value. With equal endpoint values 0, interval [0,2] and K=1, the intersecting lines have minimum -1, while the printed expression gives -2. That expression is a weaker lower bound in this example, not the stated intersection value. DIRECT’s center-based Eq 8 and potentially optimal definitions are separate.
- The convergence proof’s Eq 11, PDF p.17 / printed p.173, writes an unrestricted maximum of ratios with denominator d_j-d_i, including equal-distance cases and i=j. The argument requires taking those ratios only over strictly smaller distances, while handling equal-distance centers by selecting a minimum-value one. This is an explicit curator reading of the definition-level proof, not an asserted author-issued correction.
- Dense sampling alone does not guarantee convergence of values for arbitrary discontinuities: a function equal to -1 only at sqrt(2)/2 and 0 elsewhere on [0,1] has an isolated minimum that the exact rational center sequence never samples. Even for a continuous objective, a finite set of sampled values can miss a narrow negative tent between samples. Without additional certified function bounds, a budget stop cannot certify global accuracy.
- The source’s benchmark comparisons use different convergence definitions for competing methods and discuss parameter-tuning and stochastic-run comparability problems. No benchmark was reproduced and no universal speed, dimension-independent storage, parameter-insensitivity or superiority claim is made. The central sample avoids enumerating all box vertices, but subdivision, retained rectangles and coordinate bookkeeping still require resources.
- The original bounded calculator in research/discovery/direct-boundaries.py uses rational radius clouds for selection, exact multivariate partition geometry and finite one-dimensional examples. It does not implement general multivariate square-root radius selection or establish asymptotic results by testing. Its trace evaluation counts denote distinct sampled locations, not runtime function-call costs; center values may be recomputed for geometric checks. It is supporting evidence within the author workflow, not independent scientific approval or external author-code execution.
Artificial Intelligence Ontology (AIO) Grounding
Explicit AIO Snapshot Assessment: No Match
Rationale: No inspected pinned AIO target provides a sufficiently specific mapping for the general DIRECT optimizer. Its machine-learning uses do not make it a learning task, training preprocessing, network or model. This is an explicit bounded no-match assessment, not a claim that no suitable concept exists in another ontology.
Search Scope: Freshly assessed all 721 native and 442 pinned AIO records (1,163 total): IDs, names, aliases, scoped synonyms and complete definitions. Four whole-checkout searches used rg --no-ignore --hidden with exact IDs/full names and meaningful compounds; all 4,196 occurrences were reconciled and all 88 decoded matching contexts read. Bare DIRECT was not treated as an exhaustive identity probe; ordinary direct-algorithm phrases were false positives. All 902 main and 393 nested frontier labels/statuses, all matching fields and 29 relevant full objects were read. Nine exact examined AIO CLASS nodes (ActiveLearning, MachineLearningTask, TrainingStrategy, ReinforcementLearning, EvolutionaryLLM, MathematicalFunction, Model, Network and MarkovChain), including metadata/synonyms and every incident edge, support no suitable mapping for this deterministic rectangle-partition optimizer. TransferLearning was also inspected for the cohort. This is a scoped pinned-snapshot no-match assessment, not absence from all ontologies.
| Examined AIO Candidate | Rejection Reason |
|---|---|
AIO:ActiveLearning
|
The general deterministic optimizer does not require labeling examples or selecting queries by learned predictive uncertainty; objective evaluation alone does not establish this learning-task mapping. |
AIO:MachineLearningTask
|
The algorithm can optimize an arbitrary box-constrained objective without building a method that learns from data; an AI application does not identify its full scope with this task. |
AIO:TrainingStrategy
|
The pinned definition concerns preprocessing and model training. DIRECT is a reusable optimizer; its use inside hyperparameter selection is an application rather than a necessary training mechanism. |
AIO:ReinforcementLearning
|
Balancing local and global exploration does not make the general search procedure a policy/environment learning task. |
AIO:EvolutionaryLLM
|
This target is a large language model and its broad related synonyms do not denote the deterministic rectangle algorithm. |
AIO:MathematicalFunction
|
The objective and selection score are mathematical functions, but the proposed concept is the iterative partitioning algorithm, not a function node. |
AIO:Model
|
A partition and stored evaluations do not make this search algorithm identical to the pinned abstract model class. |
AIO:Network
|
The optional search-tree representation is bookkeeping, not a defining network architecture. |
AIO:MarkovChain
|
A generic state representation would be too broad; DIRECT does not define a stochastic transition process or target-invariant sampler. |
Evidence Sources & Primary Literature
1 Source| Source ID | Publication / Document | Type / Access | Reference & Checksum |
|---|---|---|---|
jones1993-direct
|
D. R. Jones, C. D. Perttunen, B. E. Stuckman
|
primary paper
full_text
|
ID: doi:10.1007/BF00941892
sha256:7c5944920fe5…
|
Curation Provenance
Curator: Codex
Method: ai_assisted
Model: GPT-6
Created: 2026-10-15T04:14:51Z
Updated: 2026-10-15T04:14:51Z
Source File:
data/curated/DIRECTGlobalOptimization.yaml