CTAugment
Algorithms AIMech:CTAugment DRAFT
An online augmentation-policy adaptation procedure that samples image operations and adjusts their parameter-selection weights using classifier feedback on labeled probe images during training.
Identity Notes & Concept Scope
CTAugment is the augmentation-policy component introduced with ReMixMatch, not the complete ReMixMatch classifier-training objective. It adapts parameter sampling from prediction feedback during training rather than performing AutoAugment’s separate child-model search or using RandAugment’s fixed uniform operation sampling with one shared magnitude. The record preserves a versioned implementation profile and does not silently identify its numerical update with the printed paper formula. No normalized identity match was found across all 442 pinned AIO labels/scoped synonyms and 238 preceding native IDs/names/aliases. Full-checkout fixed-string searches included ignored and hidden files in both worktree and main checkout, returning 34 lines in each from prior discovery, saved reviews and related native records. Ten exact AIO CLASS nodes, their scoped synonyms and outgoing edges, plus five neighboring native mechanisms were inspected. This absence assessment is bounded to the pinned snapshot and inspected semantic neighborhood.
Claims & Grounded Evidence
2 Claims
Mechanism
#method
Maintain weights for parameter ranges of each operation, initially one, and sample a short sequence of operation types uniformly. Generate exploratory augmentations of labeled images and compare classifier probabilities with their known labels; use that feedback to update the chosen parameter weights by an exponential moving average. Use the adapted weights to select training-image augmentation parameters. This shared description is supported by the paper and released code, but their numerical conventions differ. In the pinned ReMixMatch implementation, training defaults use depth two, decay 0.99 and threshold 0.80. Probe parameters are sampled uniformly from [0,1); operation choices can repeat. The feedback score is 1−0.5*sum(abs(q−one_hot(y))), equal to the true-class probability for a valid probability vector. For training sampling, add 1−decay to the stored weights, divide by their maximum, then zero values below the threshold. Sample an adjacent parameter interval with weight equal to the sum of its two retained endpoint weights, then uniformly within that interval. Update the bin indexed by int(parameter*number_of_bins*0.999) with the observed feedback. In the ReMixMatch wrapper, the probe classifier is the returned EMA evaluation classifier. The worker generates separate probe and learned-policy training views for labeled examples, preserves the first weak view of unlabeled multiview inputs, and augments the other views with learned policies. Most parameter arrays have 17 entries, posterize has 8 and the rescale method has 6. The training wrapper overrides the bare policy class’s threshold default 0.85 with 0.80; these are implementation defaults, not universal constants.
Limitation
#feedback-conventions
The printed class-divided feedback score and the released-code score are different. For a valid L-class probability vector, the former is 1−(1−q_y)/L while the latter is q_y. Thus the paper expression is at least 1−1/L; interpreting its 0.8 threshold as an absolute raw-weight cutoff has different behavior from the code’s relative threshold. These are algebraic consequences of the cited formulas, not an assertion of an author-issued correction.
⚠️ Curated Limitations & Negative Results
- The paper’s printed feedback score is 1−sum(abs(q−one_hot(y)))/(2L), with L classes, whereas the inspected implementation omits the class-count divisor. The paper also describes direct weighted-bin sampling and a raw threshold, unlike the implementation’s relative threshold and interval sampling.
- Parameter counts also differ: the paper describes 17 bins except six rescale methods, while the inspected code uses eight posterize entries. These source differences are documented, not declared author-issued errata.
- Predictive feedback can reward easy transformations rather than prove preservation of useful class information. A learned policy remains data- and model-dependent.
- The ReMixMatch wrapper’s probe classifier uses evaluation EMA parameters, and worker queues can delay application of updated rates; no immediate next-step or fixed operation-order guarantee is asserted.
- The original paper’s exact revision is not stamped in the author-hosted PDF. Code provenance is an exact commit; no byte equivalence with an OpenReview release, author-code execution or performance reproduction is claimed.
Artificial Intelligence Ontology (AIO) Grounding
Mapped AIO Classes
| AIO Target Class | Mapping Relation | Mapping Rationale |
|---|---|---|
AIO:DataAugmentation
Data Augmentation
|
related_match | This algorithm selects or learns transformations used for augmented training examples. The AIO target denotes data augmentation in the preprocessing branch, while the local identity includes a selection or training procedure; no equivalence or subclass membership is asserted. |
Evidence Sources & Primary Literature
6 Sources| Source ID | Publication / Document | Type / Access | Reference & Checksum |
|---|---|---|---|
method-source
|
David Berthelot, Nicholas Carlini, Ekin D. Cubuk, Alex Kurakin, Han Zhang, Colin Raffel, Kihyuk Sohn
|
primary paper
full_text
|
sha256:6b6326a1adfa…
|
policy-code
|
Google Research
|
official documentation
documentation
|
sha256:2b11d60ddc86…
|
training-code
|
Google Research
|
official documentation
documentation
|
sha256:56b35c81884e…
|
worker-code
|
Google Research
|
official documentation
documentation
|
sha256:c169e09eb3a5…
|
classifier-code
|
Google Research
|
official documentation
documentation
|
sha256:ec4f04fa71ad…
|
entrypoint-code
|
Google Research
|
official documentation
documentation
|
sha256:98e8d8309e1f…
|
Curation Provenance
Curator: Codex
Method: ai_assisted
Model: GPT-6
Created: 2026-10-11T10:34:59Z
Updated: 2026-10-11T10:34:59Z
Source File:
data/curated/CTAugment.yaml