ReMixMatch
Algorithms AIMech:ReMixMatch DRAFT
A semi-supervised classifier-training procedure that adjusts weak-view guessed labels toward an estimated class prior, sharpens and anchors those soft targets across strong augmentations, and trains with interpolated pairs plus unmixed consistency and rotation-prediction losses.
Identity Notes & Concept Scope
This record follows the paper’s distribution-aligned, augmentation-anchored procedure and explicitly qualifies author-code conventions. It retains the first unmixed strong view for both auxiliary losses and includes the weak view in the mixing pool. It is not an alias for MixMatch, generic distribution matching, hard pseudo-label FixMatch, or the separate CTAugment policy-learning component. No normalized identity match was found across all 442 pinned AIO labels/scoped synonyms and 234 preceding native IDs/names/aliases. Full-checkout fixed-string searches included ignored and hidden files in both worktree and main checkout, returning 21 lines in each from prior discovery and the related MixMatch record. Twelve exact AIO CLASS nodes, their scoped synonyms and outgoing edges, plus six neighboring native mechanisms were inspected. This absence assessment is bounded to the pinned snapshot and inspected semantic neighborhood.
Claims & Grounded Evidence
1 Claim
Mechanism
#method
For each unlabeled input, compute one weakly augmented current-model probability vector q. Adjust it to Normalize(q*p_prior/p_running), componentwise, using an estimated class prior and a running average of predictions on unlabeled inputs; then sharpen by a positive inverse temperature and normalize again. Hold guessed targets fixed during student differentiation. Construct one strong labeled view and K strong plus one weak view per unlabeled input, assigning its guessed target to all those views. Shuffle the combined labeled/unlabeled pair pool and use the MixMatch-style MixUp routine: a symmetric-Beta coefficient is replaced by max(lambda,1−lambda), and the same coefficient mixes input and target. Train mixed labeled and mixed unlabeled branches with cross-entropy. Also train against the guessed target on the first unmixed strong unlabeled view and apply a four-class rotation-prediction loss on that view, with the paper sampling 0,90,180,270-degree rotations uniformly. Equations3–4 write four weighted sums; the inspected author implementation instead averages each branch before applying its weights, so numerical coefficients must be interpreted with that normalization. The implementation detaches guesses, stabilizes the prior ratio with 1e-6, and uses a rolling prediction buffer. Its CTA entrypoint selects the first weak view as anchor; the standalone no-CTA entrypoint’s default swapped-view configuration is a different option. Parameter EMA is used for evaluation, not as the guessed-label teacher.
⚠️ Curated Limitations & Negative Results
- The ideal ratio requires defined denominators and a nonzero normalization total; the inspected code adds epsilon. A poorly estimated or mismatched class prior can distort pseudo-targets.
- Per-example distribution rescaling encourages class-prior alignment but does not impose an exact equality of aggregate predictions and the prior. This follows from the normalization formula and is checked by a finite curator example.
- The source calls the input-output information objective fair in a class-balance sense; this is not a social-fairness guarantee. Sharpening may reinforce wrong guesses and does not resolve tied maxima into a unique class.
- The paper and implementation differ in sum-versus-mean loss normalization and rotation sampling: code assigns rotations by batch quarters. No bitwise-equivalent training trajectory or universal hyperparameter values are claimed.
- CTAugment is an external strong-augmentation component here. Its complete policy-update algorithm, source score convention and variants remain a separate discovery item; no benchmark or source implementation was executed.
Artificial Intelligence Ontology (AIO) Grounding
Mapped AIO Classes
| AIO Target Class | Mapping Relation | Mapping Rationale |
|---|---|---|
AIO:Classification
Classification
|
related_match | This algorithm learns class predictions from labeled and unlabeled examples. The pinned target is a classification task under SupervisedLearning; the association is not an equivalence or an is-a assertion. |
AIO:MachineLearningTask
Machine Learning Task
|
related_match | This training algorithm realizes learning from data; the AIO target is a general learning task at a different abstraction level, so the relation is associative. |
Evidence Sources & Primary Literature
4 Sources| Source ID | Publication / Document | Type / Access | Reference & Checksum |
|---|---|---|---|
method-source
|
David Berthelot, Nicholas Carlini, Ekin D. Cubuk, Alex Kurakin, Han Zhang, Colin Raffel, Kihyuk Sohn
|
primary paper
full_text
|
sha256:6b6326a1adfa…
|
implementation
|
Google Research
|
official documentation
documentation
|
sha256:ec4f04fa71ad…
|
interpolation
|
Google Research
|
official documentation
documentation
|
sha256:7618af6b6870…
|
cta-entrypoint
|
Google Research
|
official documentation
documentation
|
sha256:98e8d8309e1f…
|
Curation Provenance
Curator: Codex
Method: ai_assisted
Model: GPT-6
Created: 2026-10-11T10:22:43Z
Updated: 2026-10-11T10:22:43Z
Source File:
data/curated/ReMixMatch.yaml